2023-12-12T08:57:33.629 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T08:57:33.630 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --archive /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184 --owner mchangir --name mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi -- /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/orig.config.yaml 2023-12-12T08:57:33.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T08:57:33.772 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184 branch: wip-mchangir-testing-20231205.064351 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: mchangir@redhat.com first_in_suite: false job_id: '7488184' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20231205.064351 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20231205.064351 sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 owner: mchangir priority: 1000 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5473 sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 sleep_before_teardown: 0 subset: 600/1024 suite: fs suite_branch: wip-mchangir-testing-20231205.064351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAqNLpf4IbFXbiM18QnkWOef8PT2IowuupE1hWdbapuXdOjF7PZrwyAYfLpYFUaSic7P/nqdQ87LHwyut5lLwnk= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBONAwCdHqF9AWgE5HTVT/FvFhV6fiaVq5ALNYzBlibIW1xnpUuwLbM+Ck0NdCbwA2nxbnyN/wgTiPCSfeREef3w= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-12_08:46:52 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-12T08:57:33.772 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa; will attempt to use it 2023-12-12T08:57:33.773 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks 2023-12-12T08:57:33.773 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-12T08:57:33.774 INFO:teuthology.task.internal:Checking packages... 2023-12-12T08:57:33.799 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9' 2023-12-12T08:57:33.800 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T08:57:33.800 INFO:teuthology.packaging:ref: None 2023-12-12T08:57:33.800 INFO:teuthology.packaging:tag: None 2023-12-12T08:57:33.800 INFO:teuthology.packaging:branch: wip-mchangir-testing-20231205.064351 2023-12-12T08:57:33.800 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T08:57:33.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20231205.064351 2023-12-12T08:57:34.058 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-96.gf1fbf3c5 2023-12-12T08:57:34.060 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-12T08:57:34.065 INFO:teuthology.task.internal:no buildpackages task found 2023-12-12T08:57:34.066 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-12T08:57:34.073 INFO:teuthology.task.internal:Saving configuration 2023-12-12T08:57:34.089 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-12T08:57:34.096 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T08:57:34.122 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 08:47:45.354792', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAqNLpf4IbFXbiM18QnkWOef8PT2IowuupE1hWdbapuXdOjF7PZrwyAYfLpYFUaSic7P/nqdQ87LHwyut5lLwnk='} 2023-12-12T08:57:34.146 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 08:47:45.353119', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBONAwCdHqF9AWgE5HTVT/FvFhV6fiaVq5ALNYzBlibIW1xnpUuwLbM+Ck0NdCbwA2nxbnyN/wgTiPCSfeREef3w='} 2023-12-12T08:57:34.146 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-12T08:57:34.153 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-12T08:57:34.154 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-12T08:57:34.154 INFO:teuthology.run_tasks:Running task console_log... 2023-12-12T08:57:34.245 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee3eba9e50>, signals=[15]) 2023-12-12T08:57:34.245 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-12T08:57:34.251 INFO:teuthology.task.internal:Opening connections... 2023-12-12T08:57:34.252 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T08:57:34.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T08:57:34.338 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T08:57:34.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T08:57:34.424 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-12T08:57:34.434 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-12-12T08:57:34.452 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-12-12T08:57:34.452 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-12-12T08:57:34.509 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T08:57:34.510 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T08:57:34.510 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T08:57:34.510 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-12-12T08:57:34.532 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-12-12T08:57:34.550 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-12-12T08:57:34.550 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-12-12T08:57:34.607 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-12-12T08:57:34.607 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2023-12-12T08:57:34.607 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-12-12T08:57:34.607 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-12-12T08:57:34.607 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T08:57:34.608 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T08:57:34.608 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-12-12T08:57:34.631 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-12T08:57:34.642 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-12T08:57:34.655 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-12T08:57:34.655 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2023-12-12T08:57:34.657 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2023-12-12T08:57:34.673 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-12T08:57:34.684 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-12T08:57:34.685 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2023-12-12T08:57:34.714 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2023-12-12T08:57:34.746 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-12T08:57:34.827 INFO:teuthology.run_tasks:Running task kernel... 2023-12-12T08:57:34.847 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-12T08:57:34.847 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-12T08:57:34.847 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T08:57:34.848 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T08:57:34.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T08:57:34.865 DEBUG:teuthology.task.kernel:sha1 for mon.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T08:57:34.865 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-12T08:57:34.865 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2023-12-12T08:57:34.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T08:57:34.867 DEBUG:teuthology.task.kernel:sha1 for mon.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T08:57:34.867 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-12T08:57:34.867 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-12-12T08:57:34.921 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-361.el9.x86_64 2023-12-12T08:57:34.921 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T08:57:34.922 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-12T08:57:34.922 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T08:57:34.927 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-361.el9.x86_64 2023-12-12T08:57:34.927 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T08:57:34.927 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-12T08:57:34.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T08:57:35.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum upgrade -y linux-firmware 2023-12-12T08:57:35.251 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum upgrade -y linux-firmware 2023-12-12T08:57:37.065 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-12T08:57:37.317 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-12T08:57:38.659 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-12-12T08:57:38.665 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2023-12-12T08:57:39.514 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-12-12T08:57:39.766 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-12-12T08:57:41.332 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 25 MB/s | 18 MB 00:00 2023-12-12T08:57:43.642 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 18 MB 00:02 2023-12-12T08:57:46.423 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 5.8 MB 00:01 2023-12-12T08:57:47.708 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 15 kB 00:00 2023-12-12T08:57:48.276 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 5.8 MB 00:01 2023-12-12T08:57:49.902 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 15 kB 00:00 2023-12-12T08:57:51.244 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2023-12-12T08:57:55.986 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-12-12T08:57:58.241 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-12T08:57:58.248 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-12T08:57:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-12T08:57:58.248 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 1 Package 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 328 M 2023-12-12T08:57:58.249 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-12T08:58:01.903 INFO:teuthology.orchestra.run.smithi099.stdout:linux-firmware-20231030-141.el9.noarch.rpm 90 MB/s | 328 MB 00:03 2023-12-12T08:58:01.904 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-12T08:58:01.905 INFO:teuthology.orchestra.run.smithi099.stdout:Total 90 MB/s | 328 MB 00:03 2023-12-12T08:58:01.905 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-12T08:58:02.002 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-12T08:58:02.002 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-12T08:58:04.116 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-12T08:58:04.117 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-12T08:58:09.924 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 912 kB/s | 20 MB 00:22 2023-12-12T08:58:09.932 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-12T08:58:10.361 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-12T08:58:10.467 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T08:58:11.608 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T08:58:11.608 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-12T08:58:11.994 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T08:58:11.994 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T08:58:11.994 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2023-12-12T08:58:11.994 INFO:teuthology.orchestra.run.smithi099.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-12T08:58:11.994 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T08:58:11.994 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-12T08:58:12.289 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-12T08:58:12.289 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T08:58:12.431 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-12T08:58:12.432 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-12T08:58:12.434 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi099.front.sepia.ceph.com to complete... 2023-12-12T08:58:14.704 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-12-12T08:58:16.932 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-12-12T08:58:16.942 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-12-12T08:58:16.942 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2023-12-12T08:58:16.942 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-12-12T08:58:16.942 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-12-12T08:58:16.942 INFO:teuthology.orchestra.run.smithi084.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-12T08:58:16.942 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T08:58:16.942 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-12-12T08:58:16.943 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2023-12-12T08:58:16.943 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 1 Package 2023-12-12T08:58:16.943 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T08:58:16.943 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 328 M 2023-12-12T08:58:16.943 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-12-12T08:58:21.396 INFO:teuthology.orchestra.run.smithi084.stdout:linux-firmware-20231030-141.el9.noarch.rpm 74 MB/s | 328 MB 00:04 2023-12-12T08:58:21.397 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-12-12T08:58:21.398 INFO:teuthology.orchestra.run.smithi084.stdout:Total 74 MB/s | 328 MB 00:04 2023-12-12T08:58:21.398 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-12-12T08:58:21.493 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-12-12T08:58:21.493 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-12-12T08:58:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-12-12T08:58:23.628 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-12-12T08:58:29.486 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-12-12T08:58:29.879 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-12T08:58:29.959 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T08:58:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T08:58:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-12T08:58:31.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-12T08:58:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T08:58:31.147 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-12-12T08:58:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-12T08:58:31.147 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T08:58:31.147 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-12-12T08:58:31.459 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-12T08:58:31.460 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T08:58:31.599 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-12T08:58:31.600 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-12T08:58:31.602 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi084.front.sepia.ceph.com to complete... 2023-12-12T09:00:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12 09:00:20 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-12T09:00:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:FINISHED --2023-12-12 09:00:20-- 2023-12-12T09:00:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:Total wall clock time: 2m 8s 2023-12-12T09:00:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:Downloaded: 1 files, 306M in 2m 8s (2.40 MB/s) 2023-12-12T09:00:20.477 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-12T09:00:20.478 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-12T09:00:22.334 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying... ######################################## 2023-12-12T09:00:22.399 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing... ######################################## 2023-12-12T09:00:22.478 INFO:teuthology.orchestra.run.smithi099.stdout:Updating / installing... 2023-12-12T09:00:29.571 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-12T09:00:43.020 INFO:teuthology.orchestra.run.smithi099.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-12T09:00:51.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12 09:00:51 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-12T09:00:51.516 INFO:teuthology.orchestra.run.smithi084.stderr:FINISHED --2023-12-12 09:00:51-- 2023-12-12T09:00:51.517 INFO:teuthology.orchestra.run.smithi084.stderr:Total wall clock time: 2m 20s 2023-12-12T09:00:51.517 INFO:teuthology.orchestra.run.smithi084.stderr:Downloaded: 1 files, 306M in 2m 19s (2.20 MB/s) 2023-12-12T09:00:51.519 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-12T09:00:51.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-12T09:00:53.368 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying... ######################################## 2023-12-12T09:00:53.480 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing... ######################################## 2023-12-12T09:00:53.559 INFO:teuthology.orchestra.run.smithi084.stdout:Updating / installing... 2023-12-12T09:01:00.635 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-12T09:01:04.113 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-12T09:01:04.113 DEBUG:teuthology.orchestra.run.smithi099:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-12T09:01:04.205 INFO:teuthology.orchestra.run.smithi099.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.205 INFO:teuthology.orchestra.run.smithi099.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-12T09:01:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-12T09:01:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-12T09:01:04.208 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-12T09:01:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-12T09:01:04.210 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-12T09:01:04.210 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-12T09:01:04.210 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-12T09:01:04.210 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-12T09:01:04.210 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-12T09:01:04.212 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-12T09:01:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-12T09:01:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-12T09:01:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-12T09:01:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-12T09:01:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-12T09:01:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-12T09:01:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-12T09:01:04.213 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-12T09:01:04.214 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-12T09:01:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-12T09:01:04.216 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-12T09:01:04.217 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-12T09:01:04.218 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-12T09:01:04.219 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-12T09:01:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-12T09:01:04.221 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-12T09:01:04.222 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-12T09:01:04.223 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-12T09:01:04.224 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-12T09:01:04.225 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-12T09:01:04.226 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-12T09:01:04.226 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-12T09:01:04.227 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-12T09:01:04.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-12T09:01:04.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-12T09:01:04.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-12T09:01:04.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-12T09:01:04.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-12T09:01:04.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-12T09:01:04.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-12T09:01:04.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-12T09:01:04.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-12T09:01:04.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-12T09:01:04.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-12T09:01:04.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-12T09:01:04.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-12T09:01:04.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-12T09:01:04.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-12T09:01:04.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-12T09:01:04.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-12T09:01:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-12T09:01:04.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-12T09:01:04.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-12T09:01:04.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-12T09:01:04.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-12T09:01:04.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-12T09:01:04.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-12T09:01:04.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-12T09:01:04.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-12T09:01:04.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-12T09:01:04.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-12T09:01:04.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-12T09:01:04.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-12T09:01:04.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-12T09:01:04.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-12T09:01:04.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-12T09:01:04.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-12T09:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-12T09:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-12T09:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-12T09:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-12T09:01:04.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-12T09:01:04.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-12T09:01:04.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-12T09:01:04.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-12T09:01:04.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-12T09:01:04.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-12T09:01:04.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-12T09:01:04.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-12T09:01:04.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-12T09:01:04.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-12T09:01:04.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-12T09:01:04.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-12T09:01:04.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-12T09:01:04.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-12T09:01:04.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-12T09:01:04.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-12T09:01:04.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-12T09:01:04.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-12T09:01:04.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-12T09:01:04.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-12T09:01:04.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-12T09:01:04.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-12T09:01:04.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-12T09:01:04.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-12T09:01:04.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-12T09:01:04.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-12T09:01:04.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-12T09:01:04.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-12T09:01:04.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-12T09:01:04.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-12T09:01:04.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-12T09:01:04.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-12T09:01:04.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-12T09:01:04.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-12T09:01:04.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-12T09:01:04.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-12T09:01:04.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-12T09:01:04.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-12T09:01:04.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-12T09:01:04.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-12T09:01:04.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-12T09:01:04.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-12T09:01:04.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-12T09:01:04.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-12T09:01:04.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-12T09:01:04.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-12T09:01:04.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-12T09:01:04.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-12T09:01:04.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-12T09:01:04.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-12T09:01:04.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-12T09:01:04.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-12T09:01:04.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-12T09:01:04.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-12T09:01:04.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-12T09:01:04.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-12T09:01:04.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-12T09:01:04.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-12T09:01:04.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-12T09:01:04.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-12T09:01:04.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-12T09:01:04.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-12T09:01:04.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-12T09:01:04.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-12T09:01:04.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-12T09:01:04.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-12T09:01:04.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-12T09:01:04.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-12T09:01:04.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-12T09:01:04.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-12T09:01:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-12T09:01:04.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-12T09:01:04.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-12T09:01:04.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-12T09:01:04.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-12T09:01:04.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-12T09:01:04.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-12T09:01:04.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-12T09:01:04.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-12T09:01:04.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-12T09:01:04.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-12T09:01:04.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-12T09:01:04.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-12T09:01:04.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-12T09:01:04.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-12T09:01:04.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-12T09:01:04.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-12T09:01:04.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-12T09:01:04.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-12T09:01:04.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-12T09:01:04.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-12T09:01:04.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-12T09:01:04.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-12T09:01:04.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-12T09:01:04.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-12T09:01:04.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-12T09:01:04.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-12T09:01:04.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-12T09:01:04.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-12T09:01:04.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-12T09:01:04.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-12T09:01:04.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-12T09:01:04.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-12T09:01:04.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-12T09:01:04.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-12T09:01:04.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-12T09:01:04.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-12T09:01:04.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-12T09:01:04.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-12T09:01:04.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-12T09:01:04.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-12T09:01:04.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-12T09:01:04.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-12T09:01:04.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-12T09:01:04.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-12T09:01:04.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-12T09:01:04.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-12T09:01:04.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-12T09:01:04.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-12T09:01:04.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-12T09:01:04.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-12T09:01:04.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-12T09:01:04.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-12T09:01:04.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-12T09:01:04.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-12T09:01:04.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-12T09:01:04.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-12T09:01:04.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-12T09:01:04.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-12T09:01:04.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-12T09:01:04.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-12T09:01:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-12T09:01:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-12T09:01:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-12T09:01:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-12T09:01:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-12T09:01:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-12T09:01:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-12T09:01:04.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-12T09:01:04.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-12T09:01:04.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-12T09:01:04.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-12T09:01:04.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-12T09:01:04.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-12T09:01:04.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-12T09:01:04.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-12T09:01:04.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-12T09:01:04.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-12T09:01:04.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-12T09:01:04.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-12T09:01:04.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-12T09:01:04.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-12T09:01:04.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-12T09:01:04.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-12T09:01:04.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-12T09:01:04.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-12T09:01:04.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-12T09:01:04.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-12T09:01:04.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-12T09:01:04.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-12T09:01:04.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-12T09:01:04.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-12T09:01:04.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-12T09:01:04.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-12T09:01:04.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-12T09:01:04.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-12T09:01:04.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-12T09:01:04.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-12T09:01:04.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-12T09:01:04.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-12T09:01:04.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-12T09:01:04.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-12T09:01:04.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-12T09:01:04.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-12T09:01:04.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-12T09:01:04.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-12T09:01:04.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-12T09:01:04.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-12T09:01:04.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-12T09:01:04.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-12T09:01:04.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-12T09:01:04.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-12T09:01:04.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-12T09:01:04.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-12T09:01:04.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-12T09:01:04.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-12T09:01:04.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-12T09:01:04.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-12T09:01:04.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-12T09:01:04.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-12T09:01:04.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-12T09:01:04.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-12T09:01:04.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-12T09:01:04.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-12T09:01:04.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-12T09:01:04.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-12T09:01:04.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-12T09:01:04.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-12T09:01:04.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-12T09:01:04.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-12T09:01:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-12T09:01:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-12T09:01:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-12T09:01:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-12T09:01:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-12T09:01:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-12T09:01:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-12T09:01:04.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-12T09:01:04.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-12T09:01:04.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-12T09:01:04.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-12T09:01:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-12T09:01:04.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-12T09:01:04.375 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-12T09:01:04.375 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-12T09:01:04.375 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-12T09:01:04.375 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-12T09:01:04.375 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-12T09:01:04.375 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-12T09:01:04.375 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-12T09:01:04.376 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-12T09:01:04.377 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-12T09:01:04.386 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-12T09:01:04.386 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-12T09:01:04.386 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-12T09:01:04.386 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-12T09:01:04.386 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-12T09:01:04.386 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-12T09:01:04.386 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-12T09:01:04.387 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-12T09:01:04.388 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-12T09:01:04.389 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-12T09:01:04.390 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-12T09:01:04.391 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-12T09:01:04.391 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-12T09:01:04.391 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-12T09:01:04.391 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-12T09:01:04.391 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-12T09:01:04.391 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-12T09:01:04.392 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-12T09:01:04.393 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-12T09:01:04.393 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.393 DEBUG:teuthology.orchestra.run.smithi099:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:postinstall scriptlet (using /bin/sh): 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-12T09:01:04.417 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-12T09:01:04.418 INFO:teuthology.orchestra.run.smithi099.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-12T09:01:04.418 INFO:teuthology.orchestra.run.smithi099.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-12T09:01:04.418 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.418 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2023-12-12T09:01:04.418 INFO:teuthology.orchestra.run.smithi099.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-12T09:01:04.418 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-12T09:01:04.418 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.418 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2023-12-12T09:01:04.418 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2023-12-12T09:01:04.491 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 68.el9 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8264254 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-12T09:01:04.492 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2023-12-12T09:01:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:01:04.494 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2023-12-12T09:01:04.495 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-12T09:01:04.495 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 6.6.0-gcd68252d7b4d 2023-12-12T09:01:04.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-12T09:01:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2023-12-12T09:01:06.584 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-12T09:01:06.631 INFO:teuthology.orchestra.run.smithi099.stderr:done 2023-12-12T09:01:06.631 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-12-12T09:01:06.686 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.EZAXLu85xg 2023-12-12T09:01:06.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EZAXLu85xg 2023-12-12T09:01:06.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.EZAXLu85xg 2023-12-12T09:01:06.897 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.EZAXLu85xg is 6KB 2023-12-12T09:01:06.947 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.EZAXLu85xg 2023-12-12T09:01:06.961 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2023-12-12T09:01:07.026 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-12T09:01:07.026 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-12T09:01:07.026 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-12T09:01:07.026 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-12T09:01:07.027 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-12T09:01:07.202 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2023-12-12T09:01:14.224 INFO:teuthology.orchestra.run.smithi084.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-12T09:01:35.344 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-12T09:01:35.344 DEBUG:teuthology.orchestra.run.smithi084:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-12T09:01:35.470 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.470 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.470 INFO:teuthology.orchestra.run.smithi084.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.470 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.470 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-12T09:01:35.471 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-12T09:01:35.472 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-12T09:01:35.472 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-12T09:01:35.472 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-12T09:01:35.472 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-12T09:01:35.472 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-12T09:01:35.472 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-12T09:01:35.472 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-12T09:01:35.473 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-12T09:01:35.473 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-12T09:01:35.474 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-12T09:01:35.474 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-12T09:01:35.475 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-12T09:01:35.476 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-12T09:01:35.477 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-12T09:01:35.478 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-12T09:01:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-12T09:01:35.480 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-12T09:01:35.481 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-12T09:01:35.482 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-12T09:01:35.483 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-12T09:01:35.484 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-12T09:01:35.484 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-12T09:01:35.485 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-12T09:01:35.485 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-12T09:01:35.485 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-12T09:01:35.485 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-12T09:01:35.485 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-12T09:01:35.485 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-12T09:01:35.485 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-12T09:01:35.486 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-12T09:01:35.487 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-12T09:01:35.487 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-12T09:01:35.487 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-12T09:01:35.487 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-12T09:01:35.487 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-12T09:01:35.488 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-12T09:01:35.489 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-12T09:01:35.490 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-12T09:01:35.491 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-12T09:01:35.492 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-12T09:01:35.493 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-12T09:01:35.494 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-12T09:01:35.495 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-12T09:01:35.496 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-12T09:01:35.497 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-12T09:01:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-12T09:01:35.499 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-12T09:01:35.500 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-12T09:01:35.501 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-12T09:01:35.502 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-12T09:01:35.503 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-12T09:01:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-12T09:01:35.505 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-12T09:01:35.506 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-12T09:01:35.507 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-12T09:01:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-12T09:01:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-12T09:01:35.510 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-12T09:01:35.511 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-12T09:01:35.512 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-12T09:01:35.513 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-12T09:01:35.514 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-12T09:01:35.514 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-12T09:01:35.514 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-12T09:01:35.515 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-12T09:01:35.515 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-12T09:01:35.515 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-12T09:01:35.515 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-12T09:01:35.515 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-12T09:01:35.515 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-12T09:01:35.515 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-12T09:01:35.515 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-12T09:01:35.516 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-12T09:01:35.517 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-12T09:01:35.518 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-12T09:01:35.519 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-12T09:01:35.521 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-12T09:01:35.521 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-12T09:01:35.521 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-12T09:01:35.521 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-12T09:01:35.522 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-12T09:01:35.522 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-12T09:01:35.522 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-12T09:01:35.522 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-12T09:01:35.523 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-12T09:01:35.524 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-12T09:01:35.525 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-12T09:01:35.526 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-12T09:01:35.527 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-12T09:01:35.528 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-12T09:01:35.529 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-12T09:01:35.530 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-12T09:01:35.531 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-12T09:01:35.531 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-12T09:01:35.542 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-12T09:01:35.542 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-12T09:01:35.542 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-12T09:01:35.543 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-12T09:01:35.544 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-12T09:01:35.545 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-12T09:01:35.546 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-12T09:01:35.548 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-12T09:01:35.548 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-12T09:01:35.548 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-12T09:01:35.548 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-12T09:01:35.549 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-12T09:01:35.550 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-12T09:01:35.551 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-12T09:01:35.552 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-12T09:01:35.553 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-12T09:01:35.554 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-12T09:01:35.554 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-12T09:01:35.555 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-12T09:01:35.556 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-12T09:01:35.557 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-12T09:01:35.558 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-12T09:01:35.558 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-12T09:01:35.558 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-12T09:01:35.559 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-12T09:01:35.559 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-12T09:01:35.559 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-12T09:01:35.559 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-12T09:01:35.560 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-12T09:01:35.561 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-12T09:01:35.562 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-12T09:01:35.563 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-12T09:01:35.564 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-12T09:01:35.565 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-12T09:01:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-12T09:01:35.567 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-12T09:01:35.568 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-12T09:01:35.570 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-12T09:01:35.571 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-12T09:01:35.572 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-12T09:01:35.572 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-12T09:01:35.572 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-12T09:01:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-12T09:01:35.574 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-12T09:01:35.575 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-12T09:01:35.576 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-12T09:01:35.576 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-12T09:01:35.576 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-12T09:01:35.576 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-12T09:01:35.576 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-12T09:01:35.576 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-12T09:01:35.576 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-12T09:01:35.577 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-12T09:01:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-12T09:01:35.579 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-12T09:01:35.579 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-12T09:01:35.580 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-12T09:01:35.580 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-12T09:01:35.581 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-12T09:01:35.582 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-12T09:01:35.583 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-12T09:01:35.584 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-12T09:01:35.585 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-12T09:01:35.586 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-12T09:01:35.587 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-12T09:01:35.588 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-12T09:01:35.589 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-12T09:01:35.590 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-12T09:01:35.591 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-12T09:01:35.592 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-12T09:01:35.593 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-12T09:01:35.594 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-12T09:01:35.595 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-12T09:01:35.596 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-12T09:01:35.597 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-12T09:01:35.598 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-12T09:01:35.599 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-12T09:01:35.600 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-12T09:01:35.601 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-12T09:01:35.601 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-12T09:01:35.601 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-12T09:01:35.601 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-12T09:01:35.602 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-12T09:01:35.602 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-12T09:01:35.602 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-12T09:01:35.602 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-12T09:01:35.602 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-12T09:01:35.602 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-12T09:01:35.602 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-12T09:01:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-12T09:01:35.604 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-12T09:01:35.605 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-12T09:01:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-12T09:01:35.607 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-12T09:01:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-12T09:01:35.609 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-12T09:01:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-12T09:01:35.611 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-12T09:01:35.612 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-12T09:01:35.613 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-12T09:01:35.614 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-12T09:01:35.615 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-12T09:01:35.616 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-12T09:01:35.617 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-12T09:01:35.618 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-12T09:01:35.619 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-12T09:01:35.620 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-12T09:01:35.621 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-12T09:01:35.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-12T09:01:35.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-12T09:01:35.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-12T09:01:35.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-12T09:01:35.622 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-12T09:01:35.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-12T09:01:35.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-12T09:01:35.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-12T09:01:35.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-12T09:01:35.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-12T09:01:35.623 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-12T09:01:35.624 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-12T09:01:35.625 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-12T09:01:35.626 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-12T09:01:35.627 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-12T09:01:35.628 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-12T09:01:35.629 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-12T09:01:35.630 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-12T09:01:35.631 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-12T09:01:35.632 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-12T09:01:35.633 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-12T09:01:35.634 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-12T09:01:35.635 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-12T09:01:35.636 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-12T09:01:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-12T09:01:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-12T09:01:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-12T09:01:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-12T09:01:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-12T09:01:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-12T09:01:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-12T09:01:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-12T09:01:35.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-12T09:01:35.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-12T09:01:35.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-12T09:01:35.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-12T09:01:35.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-12T09:01:35.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-12T09:01:35.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-12T09:01:35.638 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-12T09:01:35.639 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-12T09:01:35.640 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-12T09:01:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-12T09:01:35.642 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-12T09:01:35.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-12T09:01:35.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-12T09:01:35.643 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-12T09:01:35.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-12T09:01:35.645 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-12T09:01:35.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-12T09:01:35.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-12T09:01:35.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-12T09:01:35.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-12T09:01:35.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-12T09:01:35.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-12T09:01:35.646 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-12T09:01:35.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-12T09:01:35.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-12T09:01:35.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-12T09:01:35.647 INFO:teuthology.orchestra.run.smithi084.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-12T09:01:35.647 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.648 DEBUG:teuthology.orchestra.run.smithi084:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-12T09:01:35.670 INFO:teuthology.orchestra.run.smithi084.stdout:postinstall scriptlet (using /bin/sh): 2023-12-12T09:01:35.670 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-12T09:01:35.670 INFO:teuthology.orchestra.run.smithi084.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:01:35.670 INFO:teuthology.orchestra.run.smithi084.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:01:35.670 INFO:teuthology.orchestra.run.smithi084.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.670 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:01:35.670 INFO:teuthology.orchestra.run.smithi084.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-12T09:01:35.670 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2023-12-12T09:01:35.671 INFO:teuthology.orchestra.run.smithi084.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-12T09:01:35.671 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-12T09:01:35.671 INFO:teuthology.orchestra.run.smithi084.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-12T09:01:35.671 INFO:teuthology.orchestra.run.smithi084.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-12T09:01:35.671 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.671 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2023-12-12T09:01:35.671 INFO:teuthology.orchestra.run.smithi084.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-12T09:01:35.672 INFO:teuthology.orchestra.run.smithi084.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-12T09:01:35.672 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.672 INFO:teuthology.orchestra.run.smithi084.stdout:fi 2023-12-12T09:01:35.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.06 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 68.el9 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Group : Unspecified 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 8264254 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-12T09:01:35.748 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : builder@centos.org 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:01:35.749 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2023-12-12T09:01:35.750 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-12T09:01:35.750 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 6.6.0-gcd68252d7b4d 2023-12-12T09:01:35.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-12T09:01:36.357 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2023-12-12T09:01:37.205 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-12T09:01:37.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-12T09:01:37.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:01:37.885 INFO:teuthology.orchestra.run.smithi084.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-12T09:01:37.905 INFO:teuthology.orchestra.run.smithi084.stderr:done 2023-12-12T09:01:37.907 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-12-12T09:01:37.964 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.bn7hxKrAdA 2023-12-12T09:01:37.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bn7hxKrAdA 2023-12-12T09:01:38.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.bn7hxKrAdA 2023-12-12T09:01:38.182 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.bn7hxKrAdA is 6KB 2023-12-12T09:01:38.233 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.bn7hxKrAdA 2023-12-12T09:01:38.247 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2023-12-12T09:01:38.312 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-12T09:01:38.313 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-12T09:01:38.313 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-12T09:01:38.313 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-12T09:01:38.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-12T09:01:38.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2023-12-12T09:01:55.682 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-12T09:02:04.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-12T09:02:04.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:02:07.746 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-12T09:02:08.457 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-12T09:02:08.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-12T09:02:08.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:02:19.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-12T09:02:19.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:02:26.915 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-12T09:02:35.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-12T09:02:35.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:02:38.978 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-12T09:02:50.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-12T09:02:50.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:02:51.703 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-12-12T09:02:52.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-12T09:02:52.348 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-gcd68252d7b4d"... 2023-12-12T09:02:52.348 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2023-12-12T09:02:52.389 INFO:teuthology.orchestra.run.smithi099.stdout:6.6.0-gcd68252d7b4d 2023-12-12T09:02:52.390 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-12T09:02:52.390 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T09:02:52.390 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-12T09:02:53.391 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-12T09:02:53.391 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-12T09:02:53.524 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2023-12-12T09:02:53.566 DEBUG:teuthology.parallel:result is None 2023-12-12T09:03:09.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-12T09:03:24.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-12T09:03:24.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:03:24.827 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-12-12T09:03:25.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-12T09:03:25.552 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-gcd68252d7b4d"... 2023-12-12T09:03:25.552 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-12-12T09:03:25.605 INFO:teuthology.orchestra.run.smithi084.stdout:6.6.0-gcd68252d7b4d 2023-12-12T09:03:25.606 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-12T09:03:25.606 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T09:03:25.606 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-12T09:03:26.607 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-12T09:03:26.610 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-12T09:03:26.770 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2023-12-12T09:03:26.831 DEBUG:teuthology.parallel:result is None 2023-12-12T09:03:26.831 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-12T09:03:26.872 INFO:teuthology.task.internal:Creating test directory... 2023-12-12T09:03:26.872 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T09:03:26.885 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T09:03:26.948 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-12T09:03:26.955 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-12T09:03:26.972 INFO:teuthology.task.internal:Creating archive directory... 2023-12-12T09:03:26.973 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T09:03:26.980 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T09:03:27.058 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-12T09:03:27.078 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-12T09:03:27.080 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T09:03:27.094 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T09:03:27.180 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:03:27.215 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:03:27.231 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:03:27.274 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:03:27.278 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-12T09:03:27.292 INFO:teuthology.task.internal:Configuring sudo... 2023-12-12T09:03:27.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T09:03:27.301 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T09:03:27.407 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-12T09:03:27.422 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-12T09:03:27.423 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T09:03:27.434 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T09:03:27.495 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:03:27.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:03:27.683 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:03:27.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:03:27.848 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:03:27.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T09:03:27.921 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:03:28.010 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:03:28.120 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:03:28.203 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:03:28.300 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:03:28.300 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T09:03:28.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2023-12-12T09:03:28.400 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2023-12-12T09:03:28.555 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T09:03:28.574 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T09:03:29.071 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-12T09:03:29.084 INFO:teuthology.task.internal:Starting timer... 2023-12-12T09:03:29.085 INFO:teuthology.run_tasks:Running task pcp... 2023-12-12T09:03:29.104 INFO:teuthology.run_tasks:Running task selinux... 2023-12-12T09:03:29.121 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2023-12-12T09:03:29.231 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2023-12-12T09:03:29.232 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2023-12-12T09:03:29.369 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2023-12-12T09:03:29.373 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-12T09:03:29.373 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2023-12-12T09:03:29.423 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2023-12-12T09:03:29.423 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2023-12-12T09:03:29.487 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2023-12-12T09:03:29.491 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive'} 2023-12-12T09:03:29.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T09:03:29.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:03:29.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T09:03:29.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:03:29.670 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-12T09:03:29.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2023-12-12T09:03:29.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2023-12-12T09:03:29.856 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-12T09:03:29.866 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-12T09:03:29.866 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-12T09:03:29.946 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-12T09:03:29.947 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi099.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-12T09:16:11.406 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com')] 2023-12-12T09:16:11.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-12T09:16:11.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:16:11.554 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-12-12T09:16:11.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-12T09:16:11.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-12T09:16:11.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:16:11.831 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-12-12T09:16:11.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-12T09:16:11.994 INFO:teuthology.run_tasks:Running task clock... 2023-12-12T09:16:12.005 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-12T09:16:12.005 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T09:16:12.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T09:16:12.015 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T09:16:12.015 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T09:16:12.114 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-12T09:16:12.120 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-12T09:16:12.164 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-12T09:16:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-12T09:16:12.261 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2023-12-12T09:16:12.267 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2023-12-12T09:16:12.303 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2023-12-12T09:16:12.307 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2023-12-12T09:16:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-12T09:16:12.356 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-12T09:16:12.406 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-12T09:16:12.406 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-12T09:16:12.528 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2023-12-12T09:16:12.537 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T09:16:12.537 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-12-12T09:16:12.537 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:16:12.537 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:16:12.537 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:16:12.537 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:16:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2023-12-12T09:16:12.546 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T09:16:12.546 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2023-12-12T09:16:12.546 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:16:12.546 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:16:12.546 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:16:12.546 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:16:12.547 INFO:teuthology.run_tasks:Running task install... 2023-12-12T09:16:12.556 DEBUG:teuthology.task.install:project ceph 2023-12-12T09:16:12.557 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}} 2023-12-12T09:16:12.557 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'} 2023-12-12T09:16:12.557 INFO:teuthology.task.install:Using flavor: default 2023-12-12T09:16:12.563 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-12T09:16:12.563 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-12T09:16:12.564 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'tag': None, 'wait_for_package': False} 2023-12-12T09:16:12.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:16:12.566 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'tag': None, 'wait_for_package': False} 2023-12-12T09:16:12.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:16:12.780 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/ 2023-12-12T09:16:12.780 INFO:teuthology.task.install.rpm:Package version is 19.0.0-96.gf1fbf3c5 2023-12-12T09:16:12.787 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/ 2023-12-12T09:16:12.787 INFO:teuthology.task.install.rpm:Package version is 19.0.0-96.gf1fbf3c5 2023-12-12T09:16:12.891 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-12T09:16:12.891 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:16:12.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-12T09:16:12.950 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-12T09:16:12.951 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:16:12.951 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-12T09:16:12.995 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-12T09:16:12.995 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-12T09:16:13.042 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-12T09:16:13.043 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-12T09:16:13.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-12T09:16:13.185 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-12T09:16:13.273 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-12T09:16:13.318 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-12T09:16:13.366 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2023-12-12T09:16:13.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2023-12-12T09:16:13.407 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2023-12-12T09:16:13.411 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2023-12-12T09:16:13.759 INFO:teuthology.orchestra.run.smithi084.stdout:73 files removed 2023-12-12T09:16:13.771 INFO:teuthology.orchestra.run.smithi099.stdout:73 files removed 2023-12-12T09:16:13.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-12T09:16:13.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-12T09:16:14.721 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 191 kB/s | 78 kB 00:00 2023-12-12T09:16:14.790 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 166 kB/s | 78 kB 00:00 2023-12-12T09:16:15.222 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-12-12T09:16:15.301 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-12-12T09:16:15.714 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2023-12-12T09:16:15.786 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2023-12-12T09:16:16.190 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-12T09:16:16.355 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-12T09:16:17.763 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2023-12-12T09:16:17.931 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2023-12-12T09:16:21.517 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 7.9 MB 00:03 2023-12-12T09:16:25.185 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 18 MB 00:02 2023-12-12T09:16:30.977 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 5.8 MB 00:02 2023-12-12T09:16:31.533 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 613 kB/s | 7.9 MB 00:13 2023-12-12T09:16:32.561 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2023-12-12T09:16:33.634 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 20 MB/s | 18 MB 00:00 2023-12-12T09:16:33.914 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2023-12-12T09:16:38.790 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 5.8 MB 00:01 2023-12-12T09:16:39.487 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2023-12-12T09:16:40.601 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2023-12-12T09:16:42.126 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T09:16:42.127 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T09:16:42.146 INFO:teuthology.orchestra.run.smithi099.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-12T09:16:42.147 INFO:teuthology.orchestra.run.smithi099.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-12T09:16:42.148 INFO:teuthology.orchestra.run.smithi099.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-12T09:16:42.150 INFO:teuthology.orchestra.run.smithi099.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-12T09:16:42.152 INFO:teuthology.orchestra.run.smithi099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-12T09:16:42.156 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-12T09:16:42.157 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-12T09:16:42.237 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout:========================================================================================== 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout:========================================================================================== 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 6.5 k 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 5.2 M 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 860 k 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 141 k 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 1.5 M 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 133 k 2023-12-12T09:16:42.259 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 1.8 M 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 7.4 M 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 50 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 8.6 M 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 41 M 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 262 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 803 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 217 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 18 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 31 k 2023-12-12T09:16:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 718 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 126 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 161 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 320 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 297 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 99 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 85 k 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.0 M 2023-12-12T09:16:42.261 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 170 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-12T09:16:42.262 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.3 M 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.0 M 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 19 M 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 28 k 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 2.1 M 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 243 k 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 4.4 M 2023-12-12T09:16:42.263 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 18 M 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 15 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 24 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 163 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-12T09:16:42.264 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 476 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 4.8 M 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-12T09:16:42.265 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 45 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 129 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-12T09:16:42.266 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-12T09:16:42.267 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-12T09:16:42.268 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-12T09:16:42.269 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout:========================================================================================== 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout:Install 134 Packages 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 15 Packages 2023-12-12T09:16:42.270 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:16:42.271 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 204 M 2023-12-12T09:16:42.271 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-12T09:16:42.536 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-12T09:16:42.930 INFO:teuthology.orchestra.run.smithi099.stdout:(1/149): ceph-19.0.0-96.gf1fbf3c5.el9.x86_64.rp 26 kB/s | 6.5 kB 00:00 2023-12-12T09:16:43.122 INFO:teuthology.orchestra.run.smithi099.stdout:(2/149): ceph-fuse-19.0.0-96.gf1fbf3c5.el9.x86_ 4.4 MB/s | 860 kB 00:00 2023-12-12T09:16:43.189 INFO:teuthology.orchestra.run.smithi099.stdout:(3/149): ceph-immutable-object-cache-19.0.0-96. 2.1 MB/s | 141 kB 00:00 2023-12-12T09:16:43.481 INFO:teuthology.orchestra.run.smithi099.stdout:(4/149): ceph-mds-19.0.0-96.gf1fbf3c5.el9.x86_6 7.2 MB/s | 2.1 MB 00:00 2023-12-12T09:16:43.706 INFO:teuthology.orchestra.run.smithi099.stdout:(5/149): ceph-mgr-19.0.0-96.gf1fbf3c5.el9.x86_6 6.5 MB/s | 1.5 MB 00:00 2023-12-12T09:16:43.831 INFO:teuthology.orchestra.run.smithi099.stdout:(6/149): ceph-base-19.0.0-96.gf1fbf3c5.el9.x86_ 4.5 MB/s | 5.2 MB 00:01 2023-12-12T09:16:44.282 INFO:teuthology.orchestra.run.smithi099.stdout:(7/149): ceph-mon-19.0.0-96.gf1fbf3c5.el9.x86_6 7.6 MB/s | 4.4 MB 00:00 2023-12-12T09:16:44.607 INFO:teuthology.orchestra.run.smithi099.stdout:(8/149): ceph-common-19.0.0-96.gf1fbf3c5.el9.x8 9.9 MB/s | 19 MB 00:01 2023-12-12T09:16:44.674 INFO:teuthology.orchestra.run.smithi099.stdout:(9/149): ceph-selinux-19.0.0-96.gf1fbf3c5.el9.x 367 kB/s | 24 kB 00:00 2023-12-12T09:16:45.292 INFO:teuthology.orchestra.run.smithi099.stdout:(10/149): ceph-radosgw-19.0.0-96.gf1fbf3c5.el9. 8.5 MB/s | 8.6 MB 00:01 2023-12-12T09:16:45.414 INFO:teuthology.orchestra.run.smithi099.stdout:(11/149): cephfs-mirror-19.0.0-96.gf1fbf3c5.el9 2.3 MB/s | 217 kB 00:00 2023-12-12T09:16:45.449 INFO:teuthology.orchestra.run.smithi099.stdout:(12/149): libcephfs-devel-19.0.0-96.gf1fbf3c5.e 473 kB/s | 31 kB 00:00 2023-12-12T09:16:45.600 INFO:teuthology.orchestra.run.smithi099.stdout:(13/149): libcephfs2-19.0.0-96.gf1fbf3c5.el9.x8 4.7 MB/s | 718 kB 00:00 2023-12-12T09:16:45.675 INFO:teuthology.orchestra.run.smithi099.stdout:(14/149): libcephsqlite-19.0.0-96.gf1fbf3c5.el9 2.2 MB/s | 163 kB 00:00 2023-12-12T09:16:45.748 INFO:teuthology.orchestra.run.smithi099.stdout:(15/149): librados-devel-19.0.0-96.gf1fbf3c5.el 1.7 MB/s | 126 kB 00:00 2023-12-12T09:16:45.840 INFO:teuthology.orchestra.run.smithi099.stdout:(16/149): libradosstriper1-19.0.0-96.gf1fbf3c5. 5.1 MB/s | 476 kB 00:00 2023-12-12T09:16:46.232 INFO:teuthology.orchestra.run.smithi099.stdout:(17/149): ceph-osd-19.0.0-96.gf1fbf3c5.el9.x86_ 7.4 MB/s | 18 MB 00:02 2023-12-12T09:16:46.299 INFO:teuthology.orchestra.run.smithi099.stdout:(18/149): python3-ceph-argparse-19.0.0-96.gf1fb 689 kB/s | 45 kB 00:00 2023-12-12T09:16:46.432 INFO:teuthology.orchestra.run.smithi099.stdout:(19/149): librgw2-19.0.0-96.gf1fbf3c5.el9.x86_6 8.1 MB/s | 4.8 MB 00:00 2023-12-12T09:16:46.466 INFO:teuthology.orchestra.run.smithi099.stdout:(20/149): python3-ceph-common-19.0.0-96.gf1fbf3 776 kB/s | 129 kB 00:00 2023-12-12T09:16:46.499 INFO:teuthology.orchestra.run.smithi099.stdout:(21/149): python3-cephfs-19.0.0-96.gf1fbf3c5.el 2.4 MB/s | 161 kB 00:00 2023-12-12T09:16:46.558 INFO:teuthology.orchestra.run.smithi099.stdout:(22/149): python3-rbd-19.0.0-96.gf1fbf3c5.el9.x 5.0 MB/s | 297 kB 00:00 2023-12-12T09:16:46.608 INFO:teuthology.orchestra.run.smithi099.stdout:(23/149): python3-rados-19.0.0-96.gf1fbf3c5.el9 2.2 MB/s | 320 kB 00:00 2023-12-12T09:16:46.650 INFO:teuthology.orchestra.run.smithi099.stdout:(24/149): python3-rgw-19.0.0-96.gf1fbf3c5.el9.x 1.1 MB/s | 99 kB 00:00 2023-12-12T09:16:46.684 INFO:teuthology.orchestra.run.smithi099.stdout:(25/149): rbd-fuse-19.0.0-96.gf1fbf3c5.el9.x86_ 1.1 MB/s | 85 kB 00:00 2023-12-12T09:16:46.776 INFO:teuthology.orchestra.run.smithi099.stdout:(26/149): rbd-nbd-19.0.0-96.gf1fbf3c5.el9.x86_6 1.8 MB/s | 170 kB 00:00 2023-12-12T09:16:46.868 INFO:teuthology.orchestra.run.smithi099.stdout:(27/149): ceph-grafana-dashboards-19.0.0-96.gf1 309 kB/s | 28 kB 00:00 2023-12-12T09:16:46.993 INFO:teuthology.orchestra.run.smithi099.stdout:(28/149): rbd-mirror-19.0.0-96.gf1fbf3c5.el9.x8 8.8 MB/s | 3.0 MB 00:00 2023-12-12T09:16:47.026 INFO:teuthology.orchestra.run.smithi099.stdout:(29/149): ceph-mgr-cephadm-19.0.0-96.gf1fbf3c5. 843 kB/s | 133 kB 00:00 2023-12-12T09:16:47.235 INFO:teuthology.orchestra.run.smithi099.stdout:(30/149): ceph-mgr-dashboard-19.0.0-96.gf1fbf3c 7.3 MB/s | 1.8 MB 00:00 2023-12-12T09:16:47.319 INFO:teuthology.orchestra.run.smithi099.stdout:(31/149): ceph-mgr-modules-core-19.0.0-96.gf1fb 2.9 MB/s | 243 kB 00:00 2023-12-12T09:16:47.777 INFO:teuthology.orchestra.run.smithi099.stdout:(32/149): ceph-test-19.0.0-96.gf1fbf3c5.el9.x86 13 MB/s | 41 MB 00:03 2023-12-12T09:16:47.794 INFO:teuthology.orchestra.run.smithi099.stdout:(33/149): ceph-mgr-rook-19.0.0-96.gf1fbf3c5.el9 106 kB/s | 50 kB 00:00 2023-12-12T09:16:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:(34/149): ceph-prometheus-alerts-19.0.0-96.gf1f 369 kB/s | 15 kB 00:00 2023-12-12T09:16:47.853 INFO:teuthology.orchestra.run.smithi099.stdout:(35/149): ceph-volume-19.0.0-96.gf1fbf3c5.el9.n 4.4 MB/s | 262 kB 00:00 2023-12-12T09:16:47.895 INFO:teuthology.orchestra.run.smithi099.stdout:(36/149): cephfs-top-19.0.0-96.gf1fbf3c5.el9.no 442 kB/s | 18 kB 00:00 2023-12-12T09:16:47.937 INFO:teuthology.orchestra.run.smithi099.stdout:(37/149): cephadm-19.0.0-96.gf1fbf3c5.el9.noarc 6.7 MB/s | 803 kB 00:00 2023-12-12T09:16:48.018 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2023-12-12T09:16:48.196 INFO:teuthology.orchestra.run.smithi099.stdout:(38/149): ceph-mgr-diskprediction-local-19.0.0- 6.3 MB/s | 7.4 MB 00:01 2023-12-12T09:16:48.254 INFO:teuthology.orchestra.run.smithi099.stdout:(39/149): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2023-12-12T09:16:48.305 INFO:teuthology.orchestra.run.smithi099.stdout:(40/149): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 920 kB 00:00 2023-12-12T09:16:48.330 INFO:teuthology.orchestra.run.smithi099.stdout:(41/149): boost-program-options-1.75.0-8.el9.x8 839 kB/s | 106 kB 00:00 2023-12-12T09:16:48.355 INFO:teuthology.orchestra.run.smithi099.stdout:(42/149): elfutils-libelf-devel-0.190-1.el9.x86 223 kB/s | 21 kB 00:00 2023-12-12T09:16:48.388 INFO:teuthology.orchestra.run.smithi099.stdout:(43/149): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2023-12-12T09:16:48.425 INFO:teuthology.orchestra.run.smithi099.stdout:(44/149): flexiblas-3.0.4-8.el9.x86_64.rpm 347 kB/s | 32 kB 00:00 2023-12-12T09:16:48.556 INFO:teuthology.orchestra.run.smithi099.stdout:(45/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2023-12-12T09:16:48.581 INFO:teuthology.orchestra.run.smithi099.stdout:(46/149): flexiblas-openblas-openmp-3.0.4-8.el9 91 kB/s | 17 kB 00:00 2023-12-12T09:16:48.615 INFO:teuthology.orchestra.run.smithi099.stdout:(47/149): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 186 kB 00:00 2023-12-12T09:16:48.640 INFO:teuthology.orchestra.run.smithi099.stdout:(48/149): libaio-devel-0.3.111-13.el9.x86_64.rp 180 kB/s | 10 kB 00:00 2023-12-12T09:16:48.674 INFO:teuthology.orchestra.run.smithi099.stdout:(49/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 159 kB 00:00 2023-12-12T09:16:48.741 INFO:teuthology.orchestra.run.smithi099.stdout:(50/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 358 kB/s | 44 kB 00:00 2023-12-12T09:16:48.791 INFO:teuthology.orchestra.run.smithi099.stdout:(51/149): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 578 kB 00:00 2023-12-12T09:16:48.833 INFO:teuthology.orchestra.run.smithi099.stdout:(52/149): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 661 kB 00:00 2023-12-12T09:16:48.858 INFO:teuthology.orchestra.run.smithi099.stdout:(53/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 213 kB/s | 24 kB 00:00 2023-12-12T09:16:48.883 INFO:teuthology.orchestra.run.smithi099.stdout:(54/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 541 kB/s | 46 kB 00:00 2023-12-12T09:16:48.917 INFO:teuthology.orchestra.run.smithi099.stdout:(55/149): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 187 kB 00:00 2023-12-12T09:16:49.043 INFO:teuthology.orchestra.run.smithi099.stdout:(56/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 282 kB 00:00 2023-12-12T09:16:49.076 INFO:teuthology.orchestra.run.smithi099.stdout:(57/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.1 MB/s | 217 kB 00:00 2023-12-12T09:16:49.101 INFO:teuthology.orchestra.run.smithi099.stdout:(58/149): openblas-0.3.21-2.el9.x86_64.rpm 189 kB/s | 34 kB 00:00 2023-12-12T09:16:49.318 INFO:teuthology.orchestra.run.smithi099.stdout:(59/149): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2023-12-12T09:16:49.418 INFO:teuthology.orchestra.run.smithi099.stdout:(60/149): postgresql-13.11-1.el9.x86_64.rpm 5.0 MB/s | 1.5 MB 00:00 2023-12-12T09:16:49.468 INFO:teuthology.orchestra.run.smithi099.stdout:(61/149): postgresql-contrib-13.11-1.el9.x86_64 2.2 MB/s | 811 kB 00:00 2023-12-12T09:16:49.493 INFO:teuthology.orchestra.run.smithi099.stdout:(62/149): postgresql-private-libs-13.11-1.el9.x 789 kB/s | 134 kB 00:00 2023-12-12T09:16:49.561 INFO:teuthology.orchestra.run.smithi099.stdout:(63/149): python3-jinja2-2.11.3-4.el9.noarch.rp 3.4 MB/s | 228 kB 00:00 2023-12-12T09:16:49.736 INFO:teuthology.orchestra.run.smithi099.stdout:(64/149): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 5.8 MB 00:00 2023-12-12T09:16:49.844 INFO:teuthology.orchestra.run.smithi099.stdout:(65/149): postgresql-server-13.11-1.el9.x86_64. 16 MB/s | 5.7 MB 00:00 2023-12-12T09:16:49.869 INFO:teuthology.orchestra.run.smithi099.stdout:(66/149): python3-jsonpatch-1.21-16.el9.noarch. 81 kB/s | 24 kB 00:00 2023-12-12T09:16:49.895 INFO:teuthology.orchestra.run.smithi099.stdout:(67/149): python3-jsonpointer-2.0-4.el9.noarch. 120 kB/s | 18 kB 00:00 2023-12-12T09:16:49.920 INFO:teuthology.orchestra.run.smithi099.stdout:(68/149): python3-markupsafe-1.1.1-12.el9.x86_6 647 kB/s | 32 kB 00:00 2023-12-12T09:16:49.962 INFO:teuthology.orchestra.run.smithi099.stdout:(69/149): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 144 kB 00:00 2023-12-12T09:16:50.113 INFO:teuthology.orchestra.run.smithi099.stdout:(70/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2023-12-12T09:16:50.146 INFO:teuthology.orchestra.run.smithi099.stdout:(71/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2023-12-12T09:16:50.171 INFO:teuthology.orchestra.run.smithi099.stdout:(72/149): python3-oauthlib-3.1.1-5.el9.noarch.r 894 kB/s | 174 kB 00:00 2023-12-12T09:16:50.196 INFO:teuthology.orchestra.run.smithi099.stdout:(73/149): python3-prettytable-0.7.2-27.el9.noar 1.7 MB/s | 41 kB 00:00 2023-12-12T09:16:50.230 INFO:teuthology.orchestra.run.smithi099.stdout:(74/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2023-12-12T09:16:50.255 INFO:teuthology.orchestra.run.smithi099.stdout:(75/149): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-12-12T09:16:50.280 INFO:teuthology.orchestra.run.smithi099.stdout:(76/149): python3-pytz-2021.1-5.el9.noarch.rpm 588 kB/s | 47 kB 00:00 2023-12-12T09:16:50.331 INFO:teuthology.orchestra.run.smithi099.stdout:(77/149): python3-requests-oauthlib-1.3.0-12.el 578 kB/s | 43 kB 00:00 2023-12-12T09:16:50.439 INFO:teuthology.orchestra.run.smithi099.stdout:(78/149): python3-toml-0.10.2-6.el9.noarch.rpm 245 kB/s | 39 kB 00:00 2023-12-12T09:16:50.623 INFO:teuthology.orchestra.run.smithi099.stdout:(79/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2023-12-12T09:16:50.627 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T09:16:50.629 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-12T09:16:50.647 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-12T09:16:50.648 INFO:teuthology.orchestra.run.smithi099.stdout:(80/149): socat-1.7.4.1-5.el9.x86_64.rpm 988 kB/s | 300 kB 00:00 2023-12-12T09:16:50.649 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-12T09:16:50.650 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-12T09:16:50.651 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-12T09:16:50.653 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-12T09:16:50.657 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-12T09:16:50.658 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-12T09:16:50.673 INFO:teuthology.orchestra.run.smithi099.stdout:(81/149): uuid-1.6.2-55.el9.x86_64.rpm 249 kB/s | 56 kB 00:00 2023-12-12T09:16:50.698 INFO:teuthology.orchestra.run.smithi099.stdout:(82/149): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-12-12T09:16:50.724 INFO:teuthology.orchestra.run.smithi099.stdout:(83/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 852 kB/s | 63 kB 00:00 2023-12-12T09:16:50.737 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2023-12-12T09:16:50.749 INFO:teuthology.orchestra.run.smithi099.stdout:(84/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 600 kB/s | 44 kB 00:00 2023-12-12T09:16:50.772 INFO:teuthology.orchestra.run.smithi084.stdout:========================================================================================== 2023-12-12T09:16:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2023-12-12T09:16:50.772 INFO:teuthology.orchestra.run.smithi084.stdout:========================================================================================== 2023-12-12T09:16:50.772 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2023-12-12T09:16:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-12T09:16:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 6.5 k 2023-12-12T09:16:50.772 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 5.2 M 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 860 k 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 141 k 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 1.5 M 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 133 k 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 1.8 M 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 7.4 M 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 50 k 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 8.6 M 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 41 M 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 262 k 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 803 k 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 217 k 2023-12-12T09:16:50.773 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 18 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 31 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 718 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 126 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-12T09:16:50.774 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 161 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 320 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 297 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 99 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 85 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.0 M 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 170 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-12T09:16:50.775 INFO:teuthology.orchestra.run.smithi084.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.3 M 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 3.0 M 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-12T09:16:50.776 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 19 M 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 28 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 2.1 M 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 243 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 4.4 M 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 18 M 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.0.0-96.gf1fbf3c5.el9 ceph-noarch 15 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 24 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-12T09:16:50.777 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 163 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 476 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 4.8 M 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-12T09:16:50.778 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 45 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.0.0-96.gf1fbf3c5.el9 ceph 129 k 2023-12-12T09:16:50.779 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-12T09:16:50.780 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-12T09:16:50.781 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-12T09:16:50.782 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-12T09:16:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:16:50.784 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2023-12-12T09:16:50.784 INFO:teuthology.orchestra.run.smithi084.stdout:========================================================================================== 2023-12-12T09:16:50.784 INFO:teuthology.orchestra.run.smithi084.stdout:Install 134 Packages 2023-12-12T09:16:50.784 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 15 Packages 2023-12-12T09:16:50.784 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:16:50.784 INFO:teuthology.orchestra.run.smithi099.stdout:(85/149): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-12-12T09:16:50.785 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 204 M 2023-12-12T09:16:50.785 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2023-12-12T09:16:50.841 INFO:teuthology.orchestra.run.smithi099.stdout:(86/149): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.8 MB/s | 803 kB 00:00 2023-12-12T09:16:50.875 INFO:teuthology.orchestra.run.smithi099.stdout:(87/149): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2023-12-12T09:16:50.917 INFO:teuthology.orchestra.run.smithi099.stdout:(88/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2023-12-12T09:16:50.967 INFO:teuthology.orchestra.run.smithi099.stdout:(89/149): python3-cryptography-36.0.1-4.el9.x86 9.3 MB/s | 1.1 MB 00:00 2023-12-12T09:16:50.992 INFO:teuthology.orchestra.run.smithi099.stdout:(90/149): python3-ply-3.11-14.el9.noarch.rpm 889 kB/s | 103 kB 00:00 2023-12-12T09:16:51.034 INFO:teuthology.orchestra.run.smithi099.stdout:(91/149): python3-requests-2.25.1-7.el9.noarch. 2.7 MB/s | 113 kB 00:00 2023-12-12T09:16:51.067 INFO:teuthology.orchestra.run.smithi099.stdout:(92/149): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2023-12-12T09:16:51.093 INFO:teuthology.orchestra.run.smithi099.stdout:(93/149): python3-urllib3-1.26.5-4.el9.noarch.r 1.8 MB/s | 187 kB 00:00 2023-12-12T09:16:51.310 INFO:teuthology.orchestra.run.smithi099.stdout:(94/149): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2023-12-12T09:16:51.603 INFO:teuthology.orchestra.run.smithi084.stdout:(1/149): ceph-19.0.0-96.gf1fbf3c5.el9.x86_64.rp 15 kB/s | 6.5 kB 00:00 2023-12-12T09:16:51.818 INFO:teuthology.orchestra.run.smithi099.stdout:(95/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 5.3 MB/s | 4.1 MB 00:00 2023-12-12T09:16:51.852 INFO:teuthology.orchestra.run.smithi099.stdout:(96/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 408 kB/s | 309 kB 00:00 2023-12-12T09:16:52.002 INFO:teuthology.orchestra.run.smithi099.stdout:(97/149): liboath-2.6.7-2.el9.x86_64.rpm 325 kB/s | 49 kB 00:00 2023-12-12T09:16:52.186 INFO:teuthology.orchestra.run.smithi099.stdout:(98/149): libunwind-1.6.2-1.el9.x86_64.rpm 369 kB/s | 67 kB 00:00 2023-12-12T09:16:52.253 INFO:teuthology.orchestra.run.smithi099.stdout:(99/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 60 kB/s | 26 kB 00:00 2023-12-12T09:16:52.336 INFO:teuthology.orchestra.run.smithi099.stdout:(100/149): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2023-12-12T09:16:52.462 INFO:teuthology.orchestra.run.smithi084.stdout:(2/149): ceph-fuse-19.0.0-96.gf1fbf3c5.el9.x86_ 1.0 MB/s | 860 kB 00:00 2023-12-12T09:16:52.478 INFO:teuthology.orchestra.run.smithi099.stdout:(101/149): libarrow-9.0.0-10.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2023-12-12T09:16:52.587 INFO:teuthology.orchestra.run.smithi099.stdout:(102/149): python3-asyncssh-2.13.2-3.el9.noarch 2.1 MB/s | 548 kB 00:00 2023-12-12T09:16:52.612 INFO:teuthology.orchestra.run.smithi099.stdout:(103/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 327 kB/s | 43 kB 00:00 2023-12-12T09:16:52.637 INFO:teuthology.orchestra.run.smithi084.stdout:(3/149): ceph-immutable-object-cache-19.0.0-96. 809 kB/s | 141 kB 00:00 2023-12-12T09:16:52.695 INFO:teuthology.orchestra.run.smithi099.stdout:(104/149): python3-cachetools-4.2.4-1.el9.noarc 299 kB/s | 32 kB 00:00 2023-12-12T09:16:52.721 INFO:teuthology.orchestra.run.smithi099.stdout:(105/149): python3-certifi-2021.10.8-2.el9.noar 139 kB/s | 15 kB 00:00 2023-12-12T09:16:52.779 INFO:teuthology.orchestra.run.smithi099.stdout:(106/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.6 MB/s | 838 kB 00:00 2023-12-12T09:16:52.830 INFO:teuthology.orchestra.run.smithi099.stdout:(107/149): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-12-12T09:16:52.872 INFO:teuthology.orchestra.run.smithi099.stdout:(108/149): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2023-12-12T09:16:52.935 INFO:teuthology.orchestra.run.smithi099.stdout:(109/149): python3-google-auth-2.23.4-1.el9.noa 1.2 MB/s | 197 kB 00:00 2023-12-12T09:16:52.956 INFO:teuthology.orchestra.run.smithi099.stdout:(110/149): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2023-12-12T09:16:52.998 INFO:teuthology.orchestra.run.smithi099.stdout:(111/149): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2023-12-12T09:16:53.073 INFO:teuthology.orchestra.run.smithi099.stdout:(112/149): python3-jaraco-collections-3.0.0-8.e 169 kB/s | 23 kB 00:00 2023-12-12T09:16:53.090 INFO:teuthology.orchestra.run.smithi099.stdout:(113/149): python3-jaraco-functools-3.5.0-2.el9 146 kB/s | 19 kB 00:00 2023-12-12T09:16:53.124 INFO:teuthology.orchestra.run.smithi099.stdout:(114/149): python3-jaraco-text-3.2.0-6.el9.noar 157 kB/s | 20 kB 00:00 2023-12-12T09:16:53.207 INFO:teuthology.orchestra.run.smithi099.stdout:(115/149): python3-jwt+crypto-2.4.0-1.el9.noarc 68 kB/s | 9.0 kB 00:00 2023-12-12T09:16:53.232 INFO:teuthology.orchestra.run.smithi099.stdout:(116/149): python3-jwt-2.4.0-1.el9.noarch.rpm 289 kB/s | 41 kB 00:00 2023-12-12T09:16:53.291 INFO:teuthology.orchestra.run.smithi099.stdout:(117/149): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2023-12-12T09:16:53.325 INFO:teuthology.orchestra.run.smithi099.stdout:(118/149): python3-logutils-0.3.5-21.el9.noarch 397 kB/s | 46 kB 00:00 2023-12-12T09:16:53.350 INFO:teuthology.orchestra.run.smithi099.stdout:(119/149): python3-more-itertools-8.12.0-2.el9. 677 kB/s | 79 kB 00:00 2023-12-12T09:16:53.400 INFO:teuthology.orchestra.run.smithi099.stdout:(120/149): python3-natsort-7.1.1-5.el9.noarch.r 533 kB/s | 58 kB 00:00 2023-12-12T09:16:53.475 INFO:teuthology.orchestra.run.smithi099.stdout:(121/149): python3-portend-3.1.0-2.el9.noarch.r 132 kB/s | 16 kB 00:00 2023-12-12T09:16:53.501 INFO:teuthology.orchestra.run.smithi099.stdout:(122/149): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2023-12-12T09:16:53.526 INFO:teuthology.orchestra.run.smithi099.stdout:(123/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 719 kB/s | 90 kB 00:00 2023-12-12T09:16:53.601 INFO:teuthology.orchestra.run.smithi099.stdout:(124/149): python3-repoze-lru-0.7-16.el9.noarch 246 kB/s | 31 kB 00:00 2023-12-12T09:16:53.660 INFO:teuthology.orchestra.run.smithi099.stdout:(125/149): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-12-12T09:16:53.685 INFO:teuthology.orchestra.run.smithi099.stdout:(126/149): python3-rsa-4.9-2.el9.noarch.rpm 373 kB/s | 59 kB 00:00 2023-12-12T09:16:53.744 INFO:teuthology.orchestra.run.smithi099.stdout:(127/149): python3-tempora-5.0.0-2.el9.noarch.r 252 kB/s | 36 kB 00:00 2023-12-12T09:16:53.786 INFO:teuthology.orchestra.run.smithi099.stdout:(128/149): python3-typing-extensions-4.4.0-2.el 408 kB/s | 51 kB 00:00 2023-12-12T09:16:53.828 INFO:teuthology.orchestra.run.smithi099.stdout:(129/149): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2023-12-12T09:16:53.878 INFO:teuthology.orchestra.run.smithi099.stdout:(130/149): python3-websocket-client-1.2.3-2.el9 672 kB/s | 90 kB 00:00 2023-12-12T09:16:53.928 INFO:teuthology.orchestra.run.smithi099.stdout:(131/149): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2023-12-12T09:16:53.962 INFO:teuthology.orchestra.run.smithi099.stdout:(132/149): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2023-12-12T09:16:54.004 INFO:teuthology.orchestra.run.smithi099.stdout:(133/149): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2023-12-12T09:16:54.121 INFO:teuthology.orchestra.run.smithi099.stdout:(134/149): thrift-0.15.0-2.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2023-12-12T09:16:54.137 INFO:teuthology.orchestra.run.smithi084.stdout:(4/149): ceph-mds-19.0.0-96.gf1fbf3c5.el9.x86_6 1.4 MB/s | 2.1 MB 00:01 2023-12-12T09:16:54.154 INFO:teuthology.orchestra.run.smithi099.stdout:(135/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-12T09:16:54.188 INFO:teuthology.orchestra.run.smithi099.stdout:(136/149): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-12T09:16:54.222 INFO:teuthology.orchestra.run.smithi099.stdout:(137/149): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-12T09:16:54.264 INFO:teuthology.orchestra.run.smithi099.stdout:(138/149): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-12T09:16:54.306 INFO:teuthology.orchestra.run.smithi099.stdout:(139/149): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-12T09:16:54.365 INFO:teuthology.orchestra.run.smithi099.stdout:(140/149): libacl-2.3.1-4.el9.x86_64.rpm 382 kB/s | 22 kB 00:00 2023-12-12T09:16:54.406 INFO:teuthology.orchestra.run.smithi099.stdout:(141/149): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2023-12-12T09:16:54.812 INFO:teuthology.orchestra.run.smithi084.stdout:(5/149): ceph-mgr-19.0.0-96.gf1fbf3c5.el9.x86_6 2.2 MB/s | 1.5 MB 00:00 2023-12-12T09:16:55.090 INFO:teuthology.orchestra.run.smithi099.stdout:(142/149): librados2-19.0.0-96.gf1fbf3c5.el9.x8 2.9 MB/s | 3.3 MB 00:01 2023-12-12T09:16:55.182 INFO:teuthology.orchestra.run.smithi099.stdout:(143/149): librbd1-19.0.0-96.gf1fbf3c5.el9.x86_ 2.6 MB/s | 3.0 MB 00:01 2023-12-12T09:16:55.516 INFO:teuthology.orchestra.run.smithi099.stdout:(144/149): NetworkManager-1.45.7-1.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2023-12-12T09:16:55.549 INFO:teuthology.orchestra.run.smithi099.stdout:(145/149): NetworkManager-team-1.45.7-1.el9.x86 118 kB/s | 43 kB 00:00 2023-12-12T09:16:55.933 INFO:teuthology.orchestra.run.smithi099.stdout:(146/149): NetworkManager-tui-1.45.7-1.el9.x86_ 593 kB/s | 246 kB 00:00 2023-12-12T09:16:56.349 INFO:teuthology.orchestra.run.smithi099.stdout:(147/149): NetworkManager-libnm-1.45.7-1.el9.x8 1.4 MB/s | 1.8 MB 00:01 2023-12-12T09:16:56.408 INFO:teuthology.orchestra.run.smithi099.stdout:(148/149): openssl-3.0.7-25.el9.x86_64.rpm 1.4 MB/s | 1.2 MB 00:00 2023-12-12T09:16:56.483 INFO:teuthology.orchestra.run.smithi099.stdout:(149/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 3.9 MB/s | 2.2 MB 00:00 2023-12-12T09:16:56.498 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-12T09:16:56.498 INFO:teuthology.orchestra.run.smithi099.stdout:Total 14 MB/s | 204 MB 00:14 2023-12-12T09:16:56.620 INFO:teuthology.orchestra.run.smithi084.stdout:(6/149): ceph-base-19.0.0-96.gf1fbf3c5.el9.x86_ 980 kB/s | 5.2 MB 00:05 2023-12-12T09:16:56.737 INFO:teuthology.orchestra.run.smithi084.stdout:(7/149): ceph-mon-19.0.0-96.gf1fbf3c5.el9.x86_6 2.3 MB/s | 4.4 MB 00:01 2023-12-12T09:16:56.912 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-12T09:16:57.189 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-12T09:16:57.189 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-12T09:16:57.604 INFO:teuthology.orchestra.run.smithi084.stdout:(8/149): ceph-common-19.0.0-96.gf1fbf3c5.el9.x8 2.9 MB/s | 19 MB 00:06 2023-12-12T09:16:57.679 INFO:teuthology.orchestra.run.smithi084.stdout:(9/149): ceph-selinux-19.0.0-96.gf1fbf3c5.el9.x 324 kB/s | 24 kB 00:00 2023-12-12T09:16:59.609 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-12T09:16:59.609 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-12T09:17:00.470 INFO:teuthology.orchestra.run.smithi084.stdout:(10/149): ceph-radosgw-19.0.0-96.gf1fbf3c5.el9. 2.3 MB/s | 8.6 MB 00:03 2023-12-12T09:17:00.654 INFO:teuthology.orchestra.run.smithi084.stdout:(11/149): cephfs-mirror-19.0.0-96.gf1fbf3c5.el9 1.2 MB/s | 217 kB 00:00 2023-12-12T09:17:00.738 INFO:teuthology.orchestra.run.smithi084.stdout:(12/149): libcephfs-devel-19.0.0-96.gf1fbf3c5.e 378 kB/s | 31 kB 00:00 2023-12-12T09:17:01.063 INFO:teuthology.orchestra.run.smithi084.stdout:(13/149): libcephfs2-19.0.0-96.gf1fbf3c5.el9.x8 2.2 MB/s | 718 kB 00:00 2023-12-12T09:17:01.180 INFO:teuthology.orchestra.run.smithi084.stdout:(14/149): libcephsqlite-19.0.0-96.gf1fbf3c5.el9 1.4 MB/s | 163 kB 00:00 2023-12-12T09:17:01.280 INFO:teuthology.orchestra.run.smithi084.stdout:(15/149): librados-devel-19.0.0-96.gf1fbf3c5.el 1.2 MB/s | 126 kB 00:00 2023-12-12T09:17:01.555 INFO:teuthology.orchestra.run.smithi084.stdout:(16/149): libradosstriper1-19.0.0-96.gf1fbf3c5. 1.7 MB/s | 476 kB 00:00 2023-12-12T09:17:03.872 INFO:teuthology.orchestra.run.smithi084.stdout:(17/149): librgw2-19.0.0-96.gf1fbf3c5.el9.x86_6 2.1 MB/s | 4.8 MB 00:02 2023-12-12T09:17:03.972 INFO:teuthology.orchestra.run.smithi084.stdout:(18/149): python3-ceph-argparse-19.0.0-96.gf1fb 456 kB/s | 45 kB 00:00 2023-12-12T09:17:04.064 INFO:teuthology.orchestra.run.smithi084.stdout:(19/149): python3-ceph-common-19.0.0-96.gf1fbf3 1.4 MB/s | 129 kB 00:00 2023-12-12T09:17:04.256 INFO:teuthology.orchestra.run.smithi084.stdout:(20/149): python3-cephfs-19.0.0-96.gf1fbf3c5.el 846 kB/s | 161 kB 00:00 2023-12-12T09:17:04.556 INFO:teuthology.orchestra.run.smithi084.stdout:(21/149): python3-rados-19.0.0-96.gf1fbf3c5.el9 1.0 MB/s | 320 kB 00:00 2023-12-12T09:17:05.015 INFO:teuthology.orchestra.run.smithi084.stdout:(22/149): python3-rbd-19.0.0-96.gf1fbf3c5.el9.x 650 kB/s | 297 kB 00:00 2023-12-12T09:17:05.749 INFO:teuthology.orchestra.run.smithi084.stdout:(23/149): python3-rgw-19.0.0-96.gf1fbf3c5.el9.x 136 kB/s | 99 kB 00:00 2023-12-12T09:17:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-12T09:17:05.957 INFO:teuthology.orchestra.run.smithi084.stdout:(24/149): rbd-fuse-19.0.0-96.gf1fbf3c5.el9.x86_ 410 kB/s | 85 kB 00:00 2023-12-12T09:17:06.049 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/164 2023-12-12T09:17:06.083 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/164 2023-12-12T09:17:06.281 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/164 2023-12-12T09:17:06.366 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/164 2023-12-12T09:17:06.399 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2023-12-12T09:17:06.507 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2023-12-12T09:17:06.816 INFO:teuthology.orchestra.run.smithi084.stdout:(25/149): ceph-osd-19.0.0-96.gf1fbf3c5.el9.x86_ 1.7 MB/s | 18 MB 00:10 2023-12-12T09:17:06.899 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2023-12-12T09:17:06.947 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:17:07.049 INFO:teuthology.orchestra.run.smithi084.stdout:(26/149): rbd-nbd-19.0.0-96.gf1fbf3c5.el9.x86_6 731 kB/s | 170 kB 00:00 2023-12-12T09:17:07.106 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:17:07.139 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:17:07.149 INFO:teuthology.orchestra.run.smithi084.stdout:(27/149): ceph-grafana-dashboards-19.0.0-96.gf1 283 kB/s | 28 kB 00:00 2023-12-12T09:17:07.253 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:17:07.288 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 10/164 2023-12-12T09:17:07.333 INFO:teuthology.orchestra.run.smithi084.stdout:(28/149): ceph-mgr-cephadm-19.0.0-96.gf1fbf3c5. 727 kB/s | 133 kB 00:00 2023-12-12T09:17:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/164 2023-12-12T09:17:07.648 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/164 2023-12-12T09:17:07.709 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/164 2023-12-12T09:17:07.761 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:17:07.922 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:17:07.945 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 15/164 2023-12-12T09:17:08.262 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 15/164 2023-12-12T09:17:08.463 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-12T09:17:08.555 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-12T09:17:08.733 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:17:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:17:08.841 INFO:teuthology.orchestra.run.smithi084.stdout:(29/149): ceph-mgr-dashboard-19.0.0-96.gf1fbf3c 1.2 MB/s | 1.8 MB 00:01 2023-12-12T09:17:08.925 INFO:teuthology.orchestra.run.smithi084.stdout:(30/149): rbd-mirror-19.0.0-96.gf1fbf3c5.el9.x8 1.0 MB/s | 3.0 MB 00:02 2023-12-12T09:17:09.129 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:17:09.208 INFO:teuthology.orchestra.run.smithi084.stdout:(31/149): ceph-mgr-modules-core-19.0.0-96.gf1fb 861 kB/s | 243 kB 00:00 2023-12-12T09:17:09.315 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/164 2023-12-12T09:17:09.325 INFO:teuthology.orchestra.run.smithi084.stdout:(32/149): ceph-mgr-rook-19.0.0-96.gf1fbf3c5.el9 434 kB/s | 50 kB 00:00 2023-12-12T09:17:09.358 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/164 2023-12-12T09:17:09.425 INFO:teuthology.orchestra.run.smithi084.stdout:(33/149): ceph-prometheus-alerts-19.0.0-96.gf1f 152 kB/s | 15 kB 00:00 2023-12-12T09:17:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/164 2023-12-12T09:17:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/164 2023-12-12T09:17:09.570 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/164 2023-12-12T09:17:09.625 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/164 2023-12-12T09:17:09.681 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/164 2023-12-12T09:17:09.693 INFO:teuthology.orchestra.run.smithi084.stdout:(34/149): ceph-volume-19.0.0-96.gf1fbf3c5.el9.n 986 kB/s | 262 kB 00:00 2023-12-12T09:17:09.782 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/164 2023-12-12T09:17:09.859 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/164 2023-12-12T09:17:09.898 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/164 2023-12-12T09:17:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2023-12-12T09:17:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x8 29/164 2023-12-12T09:17:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9. 30/164 2023-12-12T09:17:10.214 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 31/164 2023-12-12T09:17:10.359 INFO:teuthology.orchestra.run.smithi084.stdout:(35/149): cephadm-19.0.0-96.gf1fbf3c5.el9.noarc 1.2 MB/s | 803 kB 00:00 2023-12-12T09:17:10.398 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/164 2023-12-12T09:17:10.460 INFO:teuthology.orchestra.run.smithi084.stdout:(36/149): cephfs-top-19.0.0-96.gf1fbf3c5.el9.no 184 kB/s | 18 kB 00:00 2023-12-12T09:17:10.470 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/164 2023-12-12T09:17:10.643 INFO:teuthology.orchestra.run.smithi084.stdout:(37/149): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2023-12-12T09:17:10.702 INFO:teuthology.orchestra.run.smithi084.stdout:(38/149): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2023-12-12T09:17:10.735 INFO:teuthology.orchestra.run.smithi084.stdout:(39/149): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 106 kB 00:00 2023-12-12T09:17:10.769 INFO:teuthology.orchestra.run.smithi084.stdout:(40/149): elfutils-libelf-devel-0.190-1.el9.x86 657 kB/s | 21 kB 00:00 2023-12-12T09:17:10.811 INFO:teuthology.orchestra.run.smithi084.stdout:(41/149): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 307 kB 00:00 2023-12-12T09:17:10.853 INFO:teuthology.orchestra.run.smithi084.stdout:(42/149): flexiblas-3.0.4-8.el9.x86_64.rpm 771 kB/s | 32 kB 00:00 2023-12-12T09:17:10.961 INFO:teuthology.orchestra.run.smithi084.stdout:(43/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-12-12T09:17:10.995 INFO:teuthology.orchestra.run.smithi084.stdout:(44/149): flexiblas-openblas-openmp-3.0.4-8.el9 527 kB/s | 17 kB 00:00 2023-12-12T09:17:11.069 INFO:teuthology.orchestra.run.smithi084.stdout:(45/149): jq-1.6-16.el9.x86_64.rpm 2.5 MB/s | 186 kB 00:00 2023-12-12T09:17:11.104 INFO:teuthology.orchestra.run.smithi084.stdout:(46/149): libaio-devel-0.3.111-13.el9.x86_64.rp 296 kB/s | 10 kB 00:00 2023-12-12T09:17:11.146 INFO:teuthology.orchestra.run.smithi084.stdout:(47/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-12-12T09:17:11.164 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/164 2023-12-12T09:17:11.180 INFO:teuthology.orchestra.run.smithi084.stdout:(48/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-12T09:17:11.230 INFO:teuthology.orchestra.run.smithi084.stdout:(49/149): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-12T09:17:11.278 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/164 2023-12-12T09:17:11.289 INFO:teuthology.orchestra.run.smithi084.stdout:(50/149): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 578 kB 00:00 2023-12-12T09:17:11.330 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/164 2023-12-12T09:17:11.331 INFO:teuthology.orchestra.run.smithi084.stdout:(51/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 595 kB/s | 24 kB 00:00 2023-12-12T09:17:11.365 INFO:teuthology.orchestra.run.smithi084.stdout:(52/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-12T09:17:11.385 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/164 2023-12-12T09:17:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:(53/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 282 kB 00:00 2023-12-12T09:17:11.434 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 38/164 2023-12-12T09:17:11.448 INFO:teuthology.orchestra.run.smithi084.stdout:(54/149): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2023-12-12T09:17:11.490 INFO:teuthology.orchestra.run.smithi084.stdout:(55/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-12-12T09:17:11.524 INFO:teuthology.orchestra.run.smithi084.stdout:(56/149): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-12T09:17:11.626 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/164 2023-12-12T09:17:11.658 INFO:teuthology.orchestra.run.smithi084.stdout:(57/149): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2023-12-12T09:17:11.725 INFO:teuthology.orchestra.run.smithi084.stdout:(58/149): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2023-12-12T09:17:11.775 INFO:teuthology.orchestra.run.smithi084.stdout:(59/149): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2023-12-12T09:17:11.809 INFO:teuthology.orchestra.run.smithi084.stdout:(60/149): postgresql-private-libs-13.11-1.el9.x 4.0 MB/s | 134 kB 00:00 2023-12-12T09:17:11.860 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/164 2023-12-12T09:17:11.914 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/164 2023-12-12T09:17:11.959 INFO:teuthology.orchestra.run.smithi084.stdout:(61/149): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2023-12-12T09:17:12.087 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/164 2023-12-12T09:17:12.101 INFO:teuthology.orchestra.run.smithi084.stdout:(62/149): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2023-12-12T09:17:12.132 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/164 2023-12-12T09:17:12.143 INFO:teuthology.orchestra.run.smithi084.stdout:(63/149): python3-jinja2-2.11.3-4.el9.noarch.rp 5.5 MB/s | 228 kB 00:00 2023-12-12T09:17:12.198 INFO:teuthology.orchestra.run.smithi084.stdout:(64/149): python3-jsonpatch-1.21-16.el9.noarch. 450 kB/s | 24 kB 00:00 2023-12-12T09:17:12.210 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/164 2023-12-12T09:17:12.235 INFO:teuthology.orchestra.run.smithi084.stdout:(65/149): python3-jsonpointer-2.0-4.el9.noarch. 501 kB/s | 18 kB 00:00 2023-12-12T09:17:12.277 INFO:teuthology.orchestra.run.smithi084.stdout:(66/149): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-12-12T09:17:12.302 INFO:teuthology.orchestra.run.smithi084.stdout:(67/149): python3-markupsafe-1.1.1-12.el9.x86_6 1.3 MB/s | 32 kB 00:00 2023-12-12T09:17:12.304 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/164 2023-12-12T09:17:12.349 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/164 2023-12-12T09:17:12.398 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/164 2023-12-12T09:17:12.436 INFO:teuthology.orchestra.run.smithi084.stdout:(68/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-12T09:17:12.464 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/164 2023-12-12T09:17:12.478 INFO:teuthology.orchestra.run.smithi084.stdout:(69/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.2 MB/s | 217 kB 00:00 2023-12-12T09:17:12.520 INFO:teuthology.orchestra.run.smithi084.stdout:(70/149): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2023-12-12T09:17:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/164 2023-12-12T09:17:12.554 INFO:teuthology.orchestra.run.smithi084.stdout:(71/149): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-12-12T09:17:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/164 2023-12-12T09:17:12.596 INFO:teuthology.orchestra.run.smithi084.stdout:(72/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-12-12T09:17:12.637 INFO:teuthology.orchestra.run.smithi084.stdout:(73/149): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2023-12-12T09:17:12.671 INFO:teuthology.orchestra.run.smithi084.stdout:(74/149): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-12-12T09:17:12.705 INFO:teuthology.orchestra.run.smithi084.stdout:(75/149): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-12-12T09:17:12.810 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/164 2023-12-12T09:17:12.862 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/164 2023-12-12T09:17:12.908 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/164 2023-12-12T09:17:12.988 INFO:teuthology.orchestra.run.smithi084.stdout:(76/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 55 MB/s | 16 MB 00:00 2023-12-12T09:17:13.022 INFO:teuthology.orchestra.run.smithi084.stdout:(77/149): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 39 kB 00:00 2023-12-12T09:17:13.035 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/164 2023-12-12T09:17:13.064 INFO:teuthology.orchestra.run.smithi084.stdout:(78/149): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 300 kB 00:00 2023-12-12T09:17:13.080 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/164 2023-12-12T09:17:13.098 INFO:teuthology.orchestra.run.smithi084.stdout:(79/149): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2023-12-12T09:17:13.129 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/164 2023-12-12T09:17:13.131 INFO:teuthology.orchestra.run.smithi084.stdout:(80/149): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.6 MB/s | 85 kB 00:00 2023-12-12T09:17:13.161 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/164 2023-12-12T09:17:13.165 INFO:teuthology.orchestra.run.smithi084.stdout:(81/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2023-12-12T09:17:13.199 INFO:teuthology.orchestra.run.smithi084.stdout:(82/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-12T09:17:13.232 INFO:teuthology.orchestra.run.smithi084.stdout:(83/149): fuse-2.9.9-15.el9.x86_64.rpm 2.4 MB/s | 79 kB 00:00 2023-12-12T09:17:13.316 INFO:teuthology.orchestra.run.smithi084.stdout:(84/149): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.5 MB/s | 803 kB 00:00 2023-12-12T09:17:13.323 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/164 2023-12-12T09:17:13.358 INFO:teuthology.orchestra.run.smithi084.stdout:(85/149): libquadmath-11.4.1-2.3.el9.x86_64.rpm 4.7 MB/s | 195 kB 00:00 2023-12-12T09:17:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/164 2023-12-12T09:17:13.400 INFO:teuthology.orchestra.run.smithi084.stdout:(86/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.8 MB/s | 241 kB 00:00 2023-12-12T09:17:13.461 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/164 2023-12-12T09:17:13.467 INFO:teuthology.orchestra.run.smithi084.stdout:(87/149): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2023-12-12T09:17:13.500 INFO:teuthology.orchestra.run.smithi084.stdout:(88/149): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 103 kB 00:00 2023-12-12T09:17:13.534 INFO:teuthology.orchestra.run.smithi084.stdout:(89/149): python3-pycparser-2.20-6.el9.noarch.r 3.7 MB/s | 124 kB 00:00 2023-12-12T09:17:13.542 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/164 2023-12-12T09:17:13.668 INFO:teuthology.orchestra.run.smithi084.stdout:(90/149): ceph-mgr-diskprediction-local-19.0.0- 1.5 MB/s | 7.4 MB 00:04 2023-12-12T09:17:13.693 INFO:teuthology.orchestra.run.smithi084.stdout:(91/149): python3-requests-2.25.1-7.el9.noarch. 714 kB/s | 113 kB 00:00 2023-12-12T09:17:13.727 INFO:teuthology.orchestra.run.smithi084.stdout:(92/149): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-12T09:17:13.810 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/164 2023-12-12T09:17:13.870 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/164 2023-12-12T09:17:14.042 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/164 2023-12-12T09:17:14.098 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/164 2023-12-12T09:17:14.123 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/164 2023-12-12T09:17:14.161 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/164 2023-12-12T09:17:14.204 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/164 2023-12-12T09:17:14.258 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/164 2023-12-12T09:17:14.308 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/164 2023-12-12T09:17:14.370 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/164 2023-12-12T09:17:14.385 INFO:teuthology.orchestra.run.smithi084.stdout:(93/149): ceph-test-19.0.0-96.gf1fbf3c5.el9.x86 2.5 MB/s | 41 MB 00:16 2023-12-12T09:17:14.435 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/164 2023-12-12T09:17:14.485 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2023-12-12T09:17:14.615 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2023-12-12T09:17:14.653 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/164 2023-12-12T09:17:14.688 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/164 2023-12-12T09:17:14.740 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/164 2023-12-12T09:17:14.783 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/164 2023-12-12T09:17:14.844 INFO:teuthology.orchestra.run.smithi084.stdout:(94/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 676 kB/s | 309 kB 00:00 2023-12-12T09:17:14.911 INFO:teuthology.orchestra.run.smithi084.stdout:(95/149): python3-devel-3.9.17-2.el9.x86_64.rpm 207 kB/s | 245 kB 00:01 2023-12-12T09:17:14.933 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/164 2023-12-12T09:17:14.990 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/164 2023-12-12T09:17:15.133 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2023-12-12T09:17:15.169 INFO:teuthology.orchestra.run.smithi084.stdout:(96/149): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2023-12-12T09:17:15.203 INFO:teuthology.orchestra.run.smithi084.stdout:(97/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 89 kB/s | 26 kB 00:00 2023-12-12T09:17:15.205 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2023-12-12T09:17:15.245 INFO:teuthology.orchestra.run.smithi084.stdout:(98/149): liboath-2.6.7-2.el9.x86_64.rpm 653 kB/s | 49 kB 00:00 2023-12-12T09:17:15.362 INFO:teuthology.orchestra.run.smithi084.stdout:(99/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 2.5 MB/s | 4.1 MB 00:01 2023-12-12T09:17:15.387 INFO:teuthology.orchestra.run.smithi084.stdout:(100/149): libunwind-1.6.2-1.el9.x86_64.rpm 368 kB/s | 67 kB 00:00 2023-12-12T09:17:15.412 INFO:teuthology.orchestra.run.smithi084.stdout:(101/149): luarocks-3.9.2-1.el9.noarch.rpm 906 kB/s | 151 kB 00:00 2023-12-12T09:17:15.554 INFO:teuthology.orchestra.run.smithi084.stdout:(102/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 593 kB/s | 43 kB 00:00 2023-12-12T09:17:15.629 INFO:teuthology.orchestra.run.smithi084.stdout:(103/149): python3-cachetools-4.2.4-1.el9.noarc 453 kB/s | 32 kB 00:00 2023-12-12T09:17:15.688 INFO:teuthology.orchestra.run.smithi084.stdout:(104/149): python3-asyncssh-2.13.2-3.el9.noarch 1.8 MB/s | 548 kB 00:00 2023-12-12T09:17:15.713 INFO:teuthology.orchestra.run.smithi084.stdout:(105/149): python3-certifi-2021.10.8-2.el9.noar 181 kB/s | 15 kB 00:00 2023-12-12T09:17:15.763 INFO:teuthology.orchestra.run.smithi084.stdout:(106/149): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2023-12-12T09:17:15.822 INFO:teuthology.orchestra.run.smithi084.stdout:(107/149): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2023-12-12T09:17:15.848 INFO:teuthology.orchestra.run.smithi084.stdout:(108/149): python3-google-auth-2.23.4-1.el9.noa 2.3 MB/s | 197 kB 00:00 2023-12-12T09:17:15.898 INFO:teuthology.orchestra.run.smithi084.stdout:(109/149): python3-jaraco-8.2.1-3.el9.noarch.rp 143 kB/s | 11 kB 00:00 2023-12-12T09:17:15.923 INFO:teuthology.orchestra.run.smithi084.stdout:(110/149): python3-jaraco-classes-3.2.1-5.el9.n 237 kB/s | 18 kB 00:00 2023-12-12T09:17:15.965 INFO:teuthology.orchestra.run.smithi084.stdout:(111/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.4 MB/s | 838 kB 00:00 2023-12-12T09:17:15.990 INFO:teuthology.orchestra.run.smithi084.stdout:(112/149): python3-jaraco-collections-3.0.0-8.e 254 kB/s | 23 kB 00:00 2023-12-12T09:17:16.016 INFO:teuthology.orchestra.run.smithi084.stdout:(113/149): python3-jaraco-functools-3.5.0-2.el9 213 kB/s | 19 kB 00:00 2023-12-12T09:17:16.041 INFO:teuthology.orchestra.run.smithi084.stdout:(114/149): python3-jaraco-text-3.2.0-6.el9.noar 263 kB/s | 20 kB 00:00 2023-12-12T09:17:16.066 INFO:teuthology.orchestra.run.smithi084.stdout:(115/149): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-12-12T09:17:16.091 INFO:teuthology.orchestra.run.smithi084.stdout:(116/149): python3-jwt-2.4.0-1.el9.noarch.rpm 547 kB/s | 41 kB 00:00 2023-12-12T09:17:16.150 INFO:teuthology.orchestra.run.smithi084.stdout:(117/149): python3-logutils-0.3.5-21.el9.noarch 559 kB/s | 46 kB 00:00 2023-12-12T09:17:16.157 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2023-12-12T09:17:16.175 INFO:teuthology.orchestra.run.smithi084.stdout:(118/149): python3-more-itertools-8.12.0-2.el9. 952 kB/s | 79 kB 00:00 2023-12-12T09:17:16.212 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2023-12-12T09:17:16.217 INFO:teuthology.orchestra.run.smithi084.stdout:(119/149): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-12-12T09:17:16.243 INFO:teuthology.orchestra.run.smithi084.stdout:(120/149): python3-natsort-7.1.1-5.el9.noarch.r 632 kB/s | 58 kB 00:00 2023-12-12T09:17:16.255 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2023-12-12T09:17:16.276 INFO:teuthology.orchestra.run.smithi084.stdout:(121/149): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-12-12T09:17:16.287 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2023-12-12T09:17:16.301 INFO:teuthology.orchestra.run.smithi084.stdout:(122/149): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2023-12-12T09:17:16.327 INFO:teuthology.orchestra.run.smithi084.stdout:(123/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2023-12-12T09:17:16.377 INFO:teuthology.orchestra.run.smithi084.stdout:(124/149): python3-repoze-lru-0.7-16.el9.noarch 308 kB/s | 31 kB 00:00 2023-12-12T09:17:16.402 INFO:teuthology.orchestra.run.smithi084.stdout:(125/149): python3-rsa-4.9-2.el9.noarch.rpm 792 kB/s | 59 kB 00:00 2023-12-12T09:17:16.436 INFO:teuthology.orchestra.run.smithi084.stdout:(126/149): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2023-12-12T09:17:16.461 INFO:teuthology.orchestra.run.smithi084.stdout:(127/149): python3-tempora-5.0.0-2.el9.noarch.r 431 kB/s | 36 kB 00:00 2023-12-12T09:17:16.486 INFO:teuthology.orchestra.run.smithi084.stdout:(128/149): python3-typing-extensions-4.4.0-2.el 615 kB/s | 51 kB 00:00 2023-12-12T09:17:16.519 INFO:teuthology.orchestra.run.smithi084.stdout:(129/149): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-12-12T09:17:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/164 2023-12-12T09:17:16.562 INFO:teuthology.orchestra.run.smithi084.stdout:(130/149): python3-websocket-client-1.2.3-2.el9 898 kB/s | 90 kB 00:00 2023-12-12T09:17:16.567 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/164 2023-12-12T09:17:16.587 INFO:teuthology.orchestra.run.smithi084.stdout:(131/149): python3-zc-lockfile-2.0-10.el9.noarc 300 kB/s | 20 kB 00:00 2023-12-12T09:17:16.621 INFO:teuthology.orchestra.run.smithi084.stdout:(132/149): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2023-12-12T09:17:16.671 INFO:teuthology.orchestra.run.smithi084.stdout:(133/149): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-12-12T09:17:16.671 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/164 2023-12-12T09:17:16.746 INFO:teuthology.orchestra.run.smithi084.stdout:(134/149): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-12-12T09:17:16.780 INFO:teuthology.orchestra.run.smithi084.stdout:(135/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-12T09:17:16.814 INFO:teuthology.orchestra.run.smithi084.stdout:(136/149): acl-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2023-12-12T09:17:16.847 INFO:teuthology.orchestra.run.smithi084.stdout:(137/149): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-12T09:17:16.889 INFO:teuthology.orchestra.run.smithi084.stdout:(138/149): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-12T09:17:16.931 INFO:teuthology.orchestra.run.smithi084.stdout:(139/149): elfutils-libs-0.190-1.el9.x86_64.rpm 6.2 MB/s | 255 kB 00:00 2023-12-12T09:17:16.965 INFO:teuthology.orchestra.run.smithi084.stdout:(140/149): libacl-2.3.1-4.el9.x86_64.rpm 673 kB/s | 22 kB 00:00 2023-12-12T09:17:17.007 INFO:teuthology.orchestra.run.smithi084.stdout:(141/149): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2023-12-12T09:17:17.456 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/164 2023-12-12T09:17:17.490 INFO:teuthology.orchestra.run.smithi084.stdout:(142/149): librbd1-19.0.0-96.gf1fbf3c5.el9.x86_ 3.7 MB/s | 3.0 MB 00:00 2023-12-12T09:17:17.593 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/164 2023-12-12T09:17:18.065 INFO:teuthology.orchestra.run.smithi084.stdout:(143/149): librados2-19.0.0-96.gf1fbf3c5.el9.x8 2.3 MB/s | 3.3 MB 00:01 2023-12-12T09:17:18.232 INFO:teuthology.orchestra.run.smithi084.stdout:(144/149): NetworkManager-1.45.7-1.el9.x86_64.r 1.8 MB/s | 2.3 MB 00:01 2023-12-12T09:17:18.841 INFO:teuthology.orchestra.run.smithi084.stdout:(145/149): NetworkManager-team-1.45.7-1.el9.x86 56 kB/s | 43 kB 00:00 2023-12-12T09:17:18.899 INFO:teuthology.orchestra.run.smithi084.stdout:(146/149): NetworkManager-libnm-1.45.7-1.el9.x8 1.3 MB/s | 1.8 MB 00:01 2023-12-12T09:17:19.121 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/164 2023-12-12T09:17:19.225 INFO:teuthology.orchestra.run.smithi084.stdout:(147/149): NetworkManager-tui-1.45.7-1.el9.x86_ 249 kB/s | 246 kB 00:00 2023-12-12T09:17:19.590 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/164 2023-12-12T09:17:19.638 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/164 2023-12-12T09:17:19.734 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-16.el9.x86_64 95/164 2023-12-12T09:17:19.876 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 96/164 2023-12-12T09:17:19.924 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-1.el9.noarch 97/164 2023-12-12T09:17:19.950 INFO:teuthology.orchestra.run.smithi084.stdout:(148/149): openssl-3.0.7-25.el9.x86_64.rpm 1.1 MB/s | 1.2 MB 00:01 2023-12-12T09:17:19.992 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2023-12-12T09:17:20.043 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/164 2023-12-12T09:17:20.066 INFO:teuthology.orchestra.run.smithi084.stdout:(149/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 1.8 MB/s | 2.2 MB 00:01 2023-12-12T09:17:20.083 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2023-12-12T09:17:20.083 INFO:teuthology.orchestra.run.smithi084.stdout:Total 7.0 MB/s | 204 MB 00:29 2023-12-12T09:17:20.453 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2023-12-12T09:17:20.489 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 101/164 2023-12-12T09:17:20.511 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2023-12-12T09:17:20.611 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 101/164 2023-12-12T09:17:20.644 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 102/164 2023-12-12T09:17:20.699 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2023-12-12T09:17:20.792 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2023-12-12T09:17:20.792 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2023-12-12T09:17:21.207 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/164 2023-12-12T09:17:21.233 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 105/164 2023-12-12T09:17:21.307 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 105/164 2023-12-12T09:17:21.335 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 106/164 2023-12-12T09:17:22.962 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2023-12-12T09:17:22.963 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2023-12-12T09:17:23.835 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:17:23.907 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:17:24.549 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:17:24.621 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 108/164 2023-12-12T09:17:24.823 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 108/164 2023-12-12T09:17:24.823 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-12T09:17:24.823 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-12T09:17:24.823 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:25.194 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 109/164 2023-12-12T09:17:29.153 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2023-12-12T09:17:29.295 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/164 2023-12-12T09:17:29.331 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/164 2023-12-12T09:17:29.408 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/164 2023-12-12T09:17:29.458 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/164 2023-12-12T09:17:29.490 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2023-12-12T09:17:29.584 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2023-12-12T09:17:29.961 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2023-12-12T09:17:30.005 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:17:30.138 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:17:30.164 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:17:30.291 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:17:30.320 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 10/164 2023-12-12T09:17:30.385 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/164 2023-12-12T09:17:30.660 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/164 2023-12-12T09:17:30.733 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/164 2023-12-12T09:17:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:17:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:17:30.945 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 15/164 2023-12-12T09:17:31.260 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 15/164 2023-12-12T09:17:31.441 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-12T09:17:31.529 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-12T09:17:31.729 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:17:31.785 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:17:32.121 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-12T09:17:32.299 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/164 2023-12-12T09:17:32.340 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/164 2023-12-12T09:17:32.450 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/164 2023-12-12T09:17:32.528 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/164 2023-12-12T09:17:32.559 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/164 2023-12-12T09:17:32.614 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/164 2023-12-12T09:17:32.670 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/164 2023-12-12T09:17:32.773 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/164 2023-12-12T09:17:32.828 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/164 2023-12-12T09:17:32.862 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/164 2023-12-12T09:17:32.973 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2023-12-12T09:17:33.008 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x8 29/164 2023-12-12T09:17:33.058 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9. 30/164 2023-12-12T09:17:33.173 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 31/164 2023-12-12T09:17:33.355 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/164 2023-12-12T09:17:33.418 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/164 2023-12-12T09:17:34.126 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/164 2023-12-12T09:17:34.225 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/164 2023-12-12T09:17:34.272 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/164 2023-12-12T09:17:34.315 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/164 2023-12-12T09:17:34.354 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 38/164 2023-12-12T09:17:34.422 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/164 2023-12-12T09:17:34.624 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/164 2023-12-12T09:17:34.667 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/164 2023-12-12T09:17:34.806 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/164 2023-12-12T09:17:34.853 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/164 2023-12-12T09:17:34.917 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/164 2023-12-12T09:17:34.994 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/164 2023-12-12T09:17:35.037 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/164 2023-12-12T09:17:35.076 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/164 2023-12-12T09:17:35.141 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/164 2023-12-12T09:17:35.200 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/164 2023-12-12T09:17:35.259 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/164 2023-12-12T09:17:35.480 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/164 2023-12-12T09:17:35.527 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/164 2023-12-12T09:17:35.573 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/164 2023-12-12T09:17:35.699 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/164 2023-12-12T09:17:35.736 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/164 2023-12-12T09:17:35.783 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/164 2023-12-12T09:17:35.817 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/164 2023-12-12T09:17:35.968 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/164 2023-12-12T09:17:36.013 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/164 2023-12-12T09:17:36.078 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/164 2023-12-12T09:17:36.152 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/164 2023-12-12T09:17:36.414 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/164 2023-12-12T09:17:36.493 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/164 2023-12-12T09:17:36.662 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/164 2023-12-12T09:17:36.720 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/164 2023-12-12T09:17:36.745 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/164 2023-12-12T09:17:36.783 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/164 2023-12-12T09:17:36.827 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/164 2023-12-12T09:17:36.864 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/164 2023-12-12T09:17:36.916 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/164 2023-12-12T09:17:36.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/164 2023-12-12T09:17:37.039 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/164 2023-12-12T09:17:37.067 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2023-12-12T09:17:37.187 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2023-12-12T09:17:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/164 2023-12-12T09:17:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/164 2023-12-12T09:17:37.332 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/164 2023-12-12T09:17:37.372 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/164 2023-12-12T09:17:37.516 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/164 2023-12-12T09:17:37.579 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/164 2023-12-12T09:17:37.722 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2023-12-12T09:17:37.779 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 109/164 2023-12-12T09:17:37.779 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2023-12-12T09:17:37.779 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2023-12-12T09:17:37.779 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2023-12-12T09:17:37.779 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2023-12-12T09:17:37.780 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2023-12-12T09:17:37.780 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2023-12-12T09:17:37.780 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2023-12-12T09:17:37.780 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:37.801 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2023-12-12T09:17:37.987 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 110/164 2023-12-12T09:17:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 110/164 2023-12-12T09:17:38.035 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:38.035 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-12T09:17:38.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:38.795 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2023-12-12T09:17:38.841 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2023-12-12T09:17:38.875 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2023-12-12T09:17:38.907 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2023-12-12T09:17:39.150 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/164 2023-12-12T09:17:39.179 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/164 2023-12-12T09:17:39.285 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/164 2023-12-12T09:17:39.741 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 111/164 2023-12-12T09:17:39.825 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 111/164 2023-12-12T09:17:39.825 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:39.825 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-12T09:17:39.825 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T09:17:39.825 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T09:17:39.825 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:40.049 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 112/164 2023-12-12T09:17:40.079 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/164 2023-12-12T09:17:40.120 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 112/164 2023-12-12T09:17:40.120 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:40.121 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-12T09:17:40.121 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T09:17:40.121 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T09:17:40.121 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:40.215 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/164 2023-12-12T09:17:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 113/164 2023-12-12T09:17:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 113/164 2023-12-12T09:17:40.680 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:40.680 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-12T09:17:40.680 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T09:17:40.681 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T09:17:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:40.794 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2023-12-12T09:17:41.477 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 115/164 2023-12-12T09:17:41.519 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 115/164 2023-12-12T09:17:41.564 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9 116/164 2023-12-12T09:17:41.661 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el 117/164 2023-12-12T09:17:41.724 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 118/164 2023-12-12T09:17:41.726 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/164 2023-12-12T09:17:41.816 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/164 2023-12-12T09:17:41.860 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/164 2023-12-12T09:17:41.931 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.6-16.el9.x86_64 95/164 2023-12-12T09:17:42.045 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 118/164 2023-12-12T09:17:42.053 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 96/164 2023-12-12T09:17:42.083 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 119/164 2023-12-12T09:17:42.094 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-1.el9.noarch 97/164 2023-12-12T09:17:42.135 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2023-12-12T09:17:42.178 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/164 2023-12-12T09:17:42.559 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2023-12-12T09:17:42.592 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 101/164 2023-12-12T09:17:42.697 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 101/164 2023-12-12T09:17:42.731 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 102/164 2023-12-12T09:17:42.785 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2023-12-12T09:17:43.195 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 119/164 2023-12-12T09:17:43.250 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 120/164 2023-12-12T09:17:43.292 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/164 2023-12-12T09:17:43.319 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 105/164 2023-12-12T09:17:43.404 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 120/164 2023-12-12T09:17:43.420 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 105/164 2023-12-12T09:17:43.438 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 106/164 2023-12-12T09:17:43.566 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9. 121/164 2023-12-12T09:17:43.594 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 122/164 2023-12-12T09:17:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 122/164 2023-12-12T09:17:43.666 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:43.666 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-12T09:17:43.666 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T09:17:43.666 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T09:17:43.666 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:43.719 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 123/164 2023-12-12T09:17:43.759 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 123/164 2023-12-12T09:17:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 124/164 2023-12-12T09:17:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/164 2023-12-12T09:17:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 126/164 2023-12-12T09:17:44.865 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 126/164 2023-12-12T09:17:44.865 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:44.865 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-12T09:17:44.865 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T09:17:44.865 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T09:17:44.865 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:44.931 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 127/164 2023-12-12T09:17:45.021 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 127/164 2023-12-12T09:17:45.021 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:45.021 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-12T09:17:45.021 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:45.089 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 128/164 2023-12-12T09:17:45.190 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 128/164 2023-12-12T09:17:45.190 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:45.190 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-12T09:17:45.190 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T09:17:45.190 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T09:17:45.190 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:45.548 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 129/164 2023-12-12T09:17:45.618 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 129/164 2023-12-12T09:17:45.618 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:45.618 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-12T09:17:45.618 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T09:17:45.618 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T09:17:45.618 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:45.924 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:17:45.969 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:17:46.597 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 107/164 2023-12-12T09:17:46.639 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 108/164 2023-12-12T09:17:46.807 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 108/164 2023-12-12T09:17:46.807 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-12T09:17:46.807 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-12T09:17:46.807 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:17:46.865 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 109/164 2023-12-12T09:17:49.746 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 130/164 2023-12-12T09:17:49.800 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 131/164 2023-12-12T09:17:49.854 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 132/164 2023-12-12T09:17:49.887 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 133/164 2023-12-12T09:17:50.159 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 134/164 2023-12-12T09:17:50.310 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/164 2023-12-12T09:17:50.342 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 136/164 2023-12-12T09:17:50.388 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 137/164 2023-12-12T09:17:50.481 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 138/164 2023-12-12T09:17:50.553 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-12T09:17:50.603 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/164 2023-12-12T09:17:50.654 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 141/164 2023-12-12T09:17:50.702 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 142/164 2023-12-12T09:17:51.599 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:17:51.649 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:17:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:17:53.082 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 144/164 2023-12-12T09:17:53.221 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 145/164 2023-12-12T09:17:53.278 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 146/164 2023-12-12T09:17:53.345 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/164 2023-12-12T09:17:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/164 2023-12-12T09:17:53.541 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/164 2023-12-12T09:17:53.574 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/164 2023-12-12T09:17:53.608 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/164 2023-12-12T09:17:53.680 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/164 2023-12-12T09:17:53.680 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-12T09:17:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-12T09:17:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/164 2023-12-12T09:17:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/164 2023-12-12T09:17:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 156/164 2023-12-12T09:17:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-12T09:17:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-12T09:17:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-12T09:17:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:17:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:17:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:17:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:17:54.654 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:17:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 161/164 2023-12-12T09:17:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 162/164 2023-12-12T09:17:54.775 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 163/164 2023-12-12T09:17:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-12T09:17:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-12T09:17:55.146 INFO:teuthology.orchestra.run.smithi099.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-12T09:17:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:17:59.320 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 109/164 2023-12-12T09:17:59.320 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2023-12-12T09:17:59.320 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2023-12-12T09:17:59.320 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2023-12-12T09:17:59.320 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2023-12-12T09:17:59.320 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2023-12-12T09:17:59.320 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2023-12-12T09:17:59.321 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2023-12-12T09:17:59.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:17:59.534 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 110/164 2023-12-12T09:17:59.585 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 110/164 2023-12-12T09:17:59.585 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:17:59.585 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-12T09:17:59.585 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 1/164 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2/164 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 3/164 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 4/164 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 5/164 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 6/164 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 7/164 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:17:59.864 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 10/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 11/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 12/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 13/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 15/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 16/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 17/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 18/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 19/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9. 20/164 2023-12-12T09:17:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x8 21/164 2023-12-12T09:17:59.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 22/164 2023-12-12T09:17:59.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 23/164 2023-12-12T09:17:59.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 24/164 2023-12-12T09:17:59.866 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 25/164 2023-12-12T09:17:59.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 26/164 2023-12-12T09:17:59.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 27/164 2023-12-12T09:17:59.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 28/164 2023-12-12T09:17:59.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el 29/164 2023-12-12T09:17:59.879 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 30/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 31/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 32/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9. 33/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 34/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9 35/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 36/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 37/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 38/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/164 2023-12-12T09:17:59.880 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-16.el9.x86_64 47/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/164 2023-12-12T09:17:59.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/164 2023-12-12T09:17:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/164 2023-12-12T09:17:59.883 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 97/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 98/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/164 2023-12-12T09:17:59.884 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 101/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 103/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 109/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/164 2023-12-12T09:17:59.885 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/164 2023-12-12T09:17:59.886 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 115/164 2023-12-12T09:17:59.886 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 116/164 2023-12-12T09:17:59.886 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 117/164 2023-12-12T09:17:59.886 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 118/164 2023-12-12T09:17:59.886 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 119/164 2023-12-12T09:17:59.886 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 120/164 2023-12-12T09:17:59.886 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 121/164 2023-12-12T09:17:59.886 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 122/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 124/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 125/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 126/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 127/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 128/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 129/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 130/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 131/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-3.el9.x86_64 133/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 134/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 135/164 2023-12-12T09:17:59.887 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 137/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 140/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-4.el9.x86_64 141/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-3.el9.x86_64 142/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 145/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 147/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/164 2023-12-12T09:17:59.888 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 153/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 154/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 155/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 156/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 157/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 159/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 161/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 162/164 2023-12-12T09:17:59.889 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 163/164 2023-12-12T09:18:01.262 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 111/164 2023-12-12T09:18:01.342 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 111/164 2023-12-12T09:18:01.343 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:18:01.343 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-12T09:18:01.343 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T09:18:01.343 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-12T09:18:01.343 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:01.578 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 112/164 2023-12-12T09:18:01.649 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 112/164 2023-12-12T09:18:01.649 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:18:01.649 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-12T09:18:01.649 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T09:18:01.649 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-12T09:18:01.649 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 164/164 2023-12-12T09:18:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:02.062 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2023-12-12T09:18:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-12T09:18:02.062 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: acl-2.3.1-4.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-12T09:18:02.063 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.064 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-12T09:18:02.065 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-16.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-12T09:18:02.066 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2023-12-12T09:18:02.067 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-13.11-1.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-12T09:18:02.068 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-12T09:18:02.069 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-12T09:18:02.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-12T09:18:02.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.072 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-3.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-12T09:18:02.073 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:02.074 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-12T09:18:02.146 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 113/164 2023-12-12T09:18:02.221 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 113/164 2023-12-12T09:18:02.222 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:18:02.222 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-12T09:18:02.222 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T09:18:02.222 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-12T09:18:02.222 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:02.331 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2023-12-12T09:18:02.646 DEBUG:teuthology.parallel:result is None 2023-12-12T09:18:02.987 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 115/164 2023-12-12T09:18:03.023 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 115/164 2023-12-12T09:18:03.066 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9 116/164 2023-12-12T09:18:03.161 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el 117/164 2023-12-12T09:18:03.206 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 118/164 2023-12-12T09:18:03.557 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 118/164 2023-12-12T09:18:03.594 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 119/164 2023-12-12T09:18:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 119/164 2023-12-12T09:18:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 120/164 2023-12-12T09:18:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 120/164 2023-12-12T09:18:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9. 121/164 2023-12-12T09:18:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 122/164 2023-12-12T09:18:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 122/164 2023-12-12T09:18:05.136 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:18:05.137 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-12T09:18:05.137 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T09:18:05.137 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-12T09:18:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 123/164 2023-12-12T09:18:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 123/164 2023-12-12T09:18:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 124/164 2023-12-12T09:18:06.159 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/164 2023-12-12T09:18:06.191 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 126/164 2023-12-12T09:18:06.269 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 126/164 2023-12-12T09:18:06.270 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:18:06.270 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-12T09:18:06.270 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T09:18:06.270 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-12T09:18:06.270 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:06.317 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 127/164 2023-12-12T09:18:06.404 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 127/164 2023-12-12T09:18:06.405 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:18:06.405 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-12T09:18:06.405 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:06.492 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 128/164 2023-12-12T09:18:06.596 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 128/164 2023-12-12T09:18:06.597 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:18:06.597 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-12T09:18:06.597 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T09:18:06.597 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-12T09:18:06.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:06.959 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 129/164 2023-12-12T09:18:07.064 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 129/164 2023-12-12T09:18:07.064 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-12T09:18:07.064 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-12T09:18:07.064 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T09:18:07.064 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-12T09:18:07.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:11.182 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 130/164 2023-12-12T09:18:11.248 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 131/164 2023-12-12T09:18:11.311 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 132/164 2023-12-12T09:18:11.348 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 133/164 2023-12-12T09:18:11.619 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 134/164 2023-12-12T09:18:11.758 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/164 2023-12-12T09:18:11.792 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 136/164 2023-12-12T09:18:11.830 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 137/164 2023-12-12T09:18:11.927 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 138/164 2023-12-12T09:18:12.013 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-12T09:18:12.062 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/164 2023-12-12T09:18:12.116 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 141/164 2023-12-12T09:18:12.161 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 142/164 2023-12-12T09:18:13.066 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:18:13.117 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:18:13.181 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-12T09:18:14.510 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 144/164 2023-12-12T09:18:14.626 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 145/164 2023-12-12T09:18:14.687 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 146/164 2023-12-12T09:18:14.751 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/164 2023-12-12T09:18:14.904 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/164 2023-12-12T09:18:14.941 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/164 2023-12-12T09:18:14.974 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/164 2023-12-12T09:18:15.008 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/164 2023-12-12T09:18:15.049 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/164 2023-12-12T09:18:15.049 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-12T09:18:15.183 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-12T09:18:15.261 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/164 2023-12-12T09:18:15.313 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/164 2023-12-12T09:18:15.345 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 156/164 2023-12-12T09:18:15.346 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-12T09:18:15.483 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-12T09:18:15.513 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-12T09:18:15.557 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:18:15.557 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:18:15.888 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-12T09:18:15.888 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:18:16.047 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:18:16.091 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 161/164 2023-12-12T09:18:16.125 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 162/164 2023-12-12T09:18:16.159 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 163/164 2023-12-12T09:18:16.286 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-12T09:18:16.577 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-12T09:18:16.577 INFO:teuthology.orchestra.run.smithi084.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-12T09:18:16.577 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:21.130 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 1/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 3/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 4/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c 5/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 6/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 7/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 8/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 9/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 10/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 11/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 12/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 13/164 2023-12-12T09:18:21.131 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 14/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 15/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 16/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 17/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_6 18/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 19/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9. 20/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x8 21/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 22/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 23/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 24/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 25/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 26/164 2023-12-12T09:18:21.132 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 27/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 28/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el 29/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarc 30/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noa 31/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf 32/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9. 33/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 34/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9 35/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 36/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 37/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 38/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/164 2023-12-12T09:18:21.145 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.6-16.el9.x86_64 47/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/164 2023-12-12T09:18:21.146 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/164 2023-12-12T09:18:21.147 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/164 2023-12-12T09:18:21.148 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/164 2023-12-12T09:18:21.149 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 97/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 98/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 101/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 103/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/164 2023-12-12T09:18:21.150 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 109/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 115/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 116/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 117/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 118/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 119/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 120/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 121/164 2023-12-12T09:18:21.151 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 122/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 124/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 125/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 126/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 127/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 128/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 129/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 130/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 131/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-3.el9.x86_64 133/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 134/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 135/164 2023-12-12T09:18:21.152 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 137/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 140/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : acl-2.3.1-4.el9.x86_64 141/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : acl-2.3.1-3.el9.x86_64 142/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 145/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 147/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/164 2023-12-12T09:18:21.153 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 153/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 154/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 155/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 156/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 157/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 159/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 160/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 161/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 162/164 2023-12-12T09:18:21.154 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 163/164 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 164/164 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: acl-2.3.1-4.el9.x86_64 2023-12-12T09:18:23.288 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.2-8.el9.noarch 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.7.4-5.el9.x86_64 2023-12-12T09:18:23.289 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.290 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:19.0.0-96.gf1fbf3c5.el9.noarch 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.4-9.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-12T09:18:23.291 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.6-16.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-12T09:18:23.292 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-12T09:18:23.293 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-13.11-1.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.294 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-12T09:18:23.295 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-12T09:18:23.296 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-12T09:18:23.297 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.0.0-96.gf1fbf3c5.el9.x86_64 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-3.el9.x86_64 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-12T09:18:23.298 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-12T09:18:23.299 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-12T09:18:23.299 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-12T09:18:23.299 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-12T09:18:23.299 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:23.299 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2023-12-12T09:18:23.882 DEBUG:teuthology.parallel:result is None 2023-12-12T09:18:23.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:18:24.021 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-12T09:18:24.096 INFO:teuthology.orchestra.run.smithi084.stdout:19.0.0-96.gf1fbf3c5.el9 2023-12-12T09:18:24.097 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-96.gf1fbf3c5.el9 2023-12-12T09:18:24.097 INFO:teuthology.task.install:The correct ceph version 19.0.0-96.gf1fbf3c5 is installed. 2023-12-12T09:18:24.099 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:18:24.233 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-12T09:18:24.308 INFO:teuthology.orchestra.run.smithi099.stdout:19.0.0-96.gf1fbf3c5.el9 2023-12-12T09:18:24.308 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-96.gf1fbf3c5.el9 2023-12-12T09:18:24.309 INFO:teuthology.task.install:The correct ceph version 19.0.0-96.gf1fbf3c5 is installed. 2023-12-12T09:18:24.310 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-12T09:18:24.311 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:24.311 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T09:18:24.399 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:18:24.399 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T09:18:24.508 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-12T09:18:24.508 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:24.509 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T09:18:24.587 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T09:18:24.703 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:18:24.703 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T09:18:24.804 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T09:18:24.892 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-12T09:18:24.892 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:24.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T09:18:24.967 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T09:18:25.086 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:18:25.086 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T09:18:25.189 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T09:18:25.332 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-12T09:18:25.332 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:25.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T09:18:25.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T09:18:25.539 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:18:25.540 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T09:18:25.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T09:18:25.738 INFO:teuthology.run_tasks:Running task ceph... 2023-12-12T09:18:25.803 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-12T09:18:25.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2023-12-12T09:18:25.809 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2023-12-12T09:18:25.910 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-12T09:18:25.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-12T09:18:25.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-12T09:18:26.018 INFO:tasks.ceph:Creating extra log directories... 2023-12-12T09:18:26.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-12T09:18:26.024 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-12T09:18:26.125 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-12T09:18:26.125 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-12T09:18:26.126 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-12T09:18:26.126 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:26.126 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-12T09:18:26.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-12T09:18:26.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-12T09:18:26.455 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:18:26.455 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-12T09:18:26.513 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-12T09:18:26.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-12T09:18:26.893 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-12T09:18:26.893 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-12T09:18:26.893 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184', 'branch': 'wip-mchangir-testing-20231205.064351', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7488184', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing-20231205.064351'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing-20231205.064351', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, 'owner': 'mchangir', 'priority': 1000, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5473, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'sleep_before_teardown': 0, 'subset': '600/1024', 'suite': 'fs', 'suite_branch': 'wip-mchangir-testing-20231205.064351', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAqNLpf4IbFXbiM18QnkWOef8PT2IowuupE1hWdbapuXdOjF7PZrwyAYfLpYFUaSic7P/nqdQ87LHwyut5lLwnk=', 'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBONAwCdHqF9AWgE5HTVT/FvFhV6fiaVq5ALNYzBlibIW1xnpUuwLbM+Ck0NdCbwA2nxbnyN/wgTiPCSfeREef3w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-12_08:46:52', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-12T09:18:26.894 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-12T09:18:26.900 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-12T09:18:26.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2023-12-12T09:18:26.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2023-12-12T09:18:27.086 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:27.087 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T09:18:27.133 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T09:18:27.133 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2023-12-12T09:18:27.217 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T09:18:27.218 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:18:27.218 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-12T09:18:27.218 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:18:27.218 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:18:27.218 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-12-12 09:18:17.053829616 +0000 2023-12-12T09:18:27.218 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-12-12 09:15:20.120504079 +0000 2023-12-12T09:18:27.218 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-12-12 09:15:20.120504079 +0000 2023-12-12T09:18:27.218 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2023-12-12 09:15:20.120504079 +0000 2023-12-12T09:18:27.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T09:18:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-12-12T09:18:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-12-12T09:18:27.335 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000355302 s, 1.4 MB/s 2023-12-12T09:18:27.339 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T09:18:27.381 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-12-12 09:18:17.054829599 +0000 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-12-12 09:15:21.128486568 +0000 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-12-12 09:15:21.128486568 +0000 2023-12-12T09:18:27.465 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2023-12-12 09:15:21.128486568 +0000 2023-12-12T09:18:27.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T09:18:27.580 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-12-12T09:18:27.581 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-12-12T09:18:27.581 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000287767 s, 1.8 MB/s 2023-12-12T09:18:27.583 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T09:18:27.629 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2023-12-12T09:18:27.710 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T09:18:27.710 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:18:27.710 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-12T09:18:27.710 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:18:27.710 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:18:27.710 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-12-12 09:18:17.054829599 +0000 2023-12-12T09:18:27.711 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-12-12 09:15:22.144468908 +0000 2023-12-12T09:18:27.711 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-12-12 09:15:22.144468908 +0000 2023-12-12T09:18:27.711 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2023-12-12 09:15:22.144468908 +0000 2023-12-12T09:18:27.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T09:18:27.818 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-12-12T09:18:27.819 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-12-12T09:18:27.819 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000307045 s, 1.7 MB/s 2023-12-12T09:18:27.821 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T09:18:27.864 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2023-12-12T09:18:27.945 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T09:18:27.945 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:18:27.945 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-12-12T09:18:27.945 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:18:27.945 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:18:27.946 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-12-12 09:18:17.055829581 +0000 2023-12-12T09:18:27.946 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-12-12 09:15:23.163451190 +0000 2023-12-12T09:18:27.946 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-12-12 09:15:23.163451190 +0000 2023-12-12T09:18:27.946 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2023-12-12 09:15:23.163451190 +0000 2023-12-12T09:18:27.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T09:18:28.062 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-12-12T09:18:28.062 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-12-12T09:18:28.062 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000343363 s, 1.5 MB/s 2023-12-12T09:18:28.066 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T09:18:28.116 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:28.116 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:18:28.116 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T09:18:28.175 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T09:18:28.175 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2023-12-12T09:18:28.226 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T09:18:28.226 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:18:28.226 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-12T09:18:28.226 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:18:28.226 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:18:28.227 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-12-12 09:17:55.609683073 +0000 2023-12-12T09:18:28.227 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-12-12 09:15:20.106081942 +0000 2023-12-12T09:18:28.227 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-12-12 09:15:20.106081942 +0000 2023-12-12T09:18:28.227 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-12-12 09:15:20.106081942 +0000 2023-12-12T09:18:28.227 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T09:18:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-12-12T09:18:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-12-12T09:18:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000362244 s, 1.4 MB/s 2023-12-12T09:18:28.321 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T09:18:28.380 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-12-12 09:17:55.610683049 +0000 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-12-12 09:15:21.129058206 +0000 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-12-12 09:15:21.129058206 +0000 2023-12-12T09:18:28.431 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-12-12 09:15:21.129058206 +0000 2023-12-12T09:18:28.431 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T09:18:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-12-12T09:18:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-12-12T09:18:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000344804 s, 1.5 MB/s 2023-12-12T09:18:28.519 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T09:18:28.576 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2023-12-12T09:18:28.625 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T09:18:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:18:28.626 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-12T09:18:28.626 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:18:28.626 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:18:28.626 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-12-12 09:17:55.610683049 +0000 2023-12-12T09:18:28.626 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-12-12 09:15:22.187033659 +0000 2023-12-12T09:18:28.626 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-12-12 09:15:22.187033659 +0000 2023-12-12T09:18:28.626 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-12-12 09:15:22.187033659 +0000 2023-12-12T09:18:28.626 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T09:18:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-12-12T09:18:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-12-12T09:18:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000348629 s, 1.5 MB/s 2023-12-12T09:18:28.717 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T09:18:28.775 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2023-12-12T09:18:28.825 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T09:18:28.826 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T09:18:28.826 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-12-12T09:18:28.826 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T09:18:28.826 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-12-12T09:18:28.826 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-12-12 09:17:55.612683002 +0000 2023-12-12T09:18:28.826 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-12-12 09:15:23.218009737 +0000 2023-12-12T09:18:28.826 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-12-12 09:15:23.218009737 +0000 2023-12-12T09:18:28.826 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-12-12 09:15:23.218009737 +0000 2023-12-12T09:18:28.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T09:18:28.910 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-12-12T09:18:28.911 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-12-12T09:18:28.911 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000354394 s, 1.4 MB/s 2023-12-12T09:18:28.914 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T09:18:28.970 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:28.970 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-12T09:18:28.970 INFO:tasks.ceph:Generating config... 2023-12-12T09:18:28.972 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-12T09:18:28.972 INFO:tasks.ceph:[client] debug client = 20 2023-12-12T09:18:28.973 INFO:tasks.ceph:[client] debug ms = 1 2023-12-12T09:18:28.973 INFO:tasks.ceph:[client] pid file = 2023-12-12T09:18:28.973 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-12T09:18:28.973 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-12T09:18:28.973 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-12T09:18:28.973 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-12T09:18:28.973 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-12T09:18:28.973 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-12T09:18:28.974 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-12T09:18:28.975 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-12T09:18:28.975 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-12T09:18:28.975 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-12T09:18:28.975 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-12T09:18:28.975 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-12T09:18:28.975 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-12T09:18:28.975 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-12T09:18:28.975 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-12T09:18:28.975 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-12T09:18:28.976 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-12T09:18:28.976 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-12T09:18:28.976 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-12T09:18:28.976 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-12T09:18:28.976 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-12T09:18:28.976 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-12T09:18:28.976 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-12T09:18:28.976 INFO:tasks.ceph:Setting up mon.a... 2023-12-12T09:18:28.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-12T09:18:29.121 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2023-12-12T09:18:29.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-12T09:18:29.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T09:18:29.348 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.99'), ('mon.c', '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]')] 2023-12-12T09:18:29.348 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-12T09:18:29.349 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:29.349 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-12T09:18:29.401 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.99 --addv c '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:29.553 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:29.553 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 6cf288f4-52d2-4b85-a338-100a1ef88319 2023-12-12T09:18:29.553 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = pacific 2023-12-12T09:18:29.553 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2023-12-12T09:18:29.553 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 6cf288f4-52d2-4b85-a338-100a1ef88319 2023-12-12T09:18:29.553 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2023-12-12T09:18:29.553677+0000 2023-12-12T09:18:29.553 INFO:teuthology.orchestra.run.smithi084.stdout:created 2023-12-12T09:18:29.553677+0000 2023-12-12T09:18:29.553 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 16 (pacific) 2023-12-12T09:18:29.554 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2023-12-12T09:18:29.554 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2023-12-12T09:18:29.554 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2023-12-12T09:18:29.554 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2023-12-12T09:18:29.554 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-12T09:18:29.556 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-12T09:18:29.604 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6cf288f4-52d2-4b85-a338-100a1ef88319... 2023-12-12T09:18:29.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-12T09:18:29.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-12-12T09:18:29.774 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.775 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]" 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 6cf288f4-52d2-4b85-a338-100a1ef88319 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-12-12T09:18:29.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug trim objects = true 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.777 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-12-12T09:18:29.778 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-12-12T09:18:29.779 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-12-12T09:18:29.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-12T09:18:29.781 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2023-12-12T09:18:29.782 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds balancer = 20 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2023-12-12T09:18:29.783 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2023-12-12T09:18:29.784 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2023-12-12T09:18:29.784 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2023-12-12T09:18:29.784 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2023-12-12T09:18:29.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2023-12-12T09:18:29.786 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2023-12-12T09:18:29.787 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.84,172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790]" 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 6cf288f4-52d2-4b85-a338-100a1ef88319 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.788 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.789 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 20 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 20 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 10 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2023-12-12T09:18:29.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2023-12-12T09:18:29.791 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2023-12-12T09:18:29.792 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2023-12-12T09:18:29.793 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = "" 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2023-12-12T09:18:29.794 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds balancer = 20 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2023-12-12T09:18:29.795 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2023-12-12T09:18:29.828 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-12T09:18:29.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-12T09:18:29.965 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-12T09:18:29.965 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:29.965 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-12T09:18:30.016 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:30.016 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-12T09:18:30.068 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:18:30.068 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:30.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-12T09:18:30.068 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T09:18:30.210 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:18:30.210 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:30.308 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:18:30.308 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:18:30.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-12T09:18:30.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T09:18:30.464 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:18:30.464 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:30.564 INFO:tasks.ceph:Setting up mon nodes... 2023-12-12T09:18:30.564 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-12T09:18:30.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-12T09:18:30.756 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-12T09:18:30.767 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-12T09:18:30.979 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-12T09:18:30.990 INFO:tasks.ceph:Setting up mds nodes... 2023-12-12T09:18:30.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-12T09:18:31.165 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-12T09:18:31.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-12T09:18:31.269 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-12T09:18:31.457 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-12T09:18:31.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-12T09:18:31.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-12T09:18:31.753 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-12T09:18:31.762 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-12T09:18:31.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-12T09:18:32.035 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-12T09:18:32.044 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-12T09:18:32.135 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-12T09:18:32.135 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-12T09:18:32.261 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-12T09:18:32.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-12T09:18:32.448 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-12T09:18:32.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-12T09:18:32.630 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-12T09:18:32.699 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-12T09:18:32.830 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-12T09:18:32.886 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-12T09:18:32.887 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-12T09:18:32.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-12T09:18:32.989 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:32.990 INFO:tasks.ceph:role: osd.0 2023-12-12T09:18:32.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:18:32.990 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:18:33.093 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:18:33.606 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-12-12T09:18:33.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-12-12T09:18:33.612 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-12T09:18:33.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-12T09:18:33.899 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-12T09:18:33.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:33.986 INFO:tasks.ceph:role: osd.1 2023-12-12T09:18:33.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:18:33.986 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-12T09:18:34.072 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:18:34.073 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:18:34.532 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-12-12T09:18:34.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-12-12T09:18:34.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-12T09:18:34.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-12T09:18:34.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-12T09:18:34.812 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:34.812 INFO:tasks.ceph:role: osd.2 2023-12-12T09:18:34.812 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:18:34.812 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-12T09:18:34.897 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:18:34.897 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:18:34.897 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:18:34.898 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:18:34.898 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:18:34.898 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:18:34.898 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:18:34.898 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:18:34.898 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:18:34.898 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:18:35.421 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-12-12T09:18:35.425 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-12-12T09:18:35.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-12T09:18:35.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-12T09:18:35.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-12T09:18:35.781 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:35.781 INFO:tasks.ceph:role: osd.3 2023-12-12T09:18:35.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:18:35.781 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-12T09:18:35.879 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:18:35.879 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:18:35.879 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:18:35.879 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:18:35.879 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:18:35.880 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:18:35.880 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:18:35.880 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:18:35.880 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:18:35.880 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:18:36.336 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-12-12T09:18:36.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-12-12T09:18:36.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-12T09:18:36.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-12T09:18:36.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:36.676+0000 7fa7698f6500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-12T09:18:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:36.676+0000 7fa7698f6500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-12T09:18:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:36.676+0000 7fa7698f6500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T09:18:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:36.677+0000 7fa7698f6500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T09:18:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:36.677+0000 7fa7698f6500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T09:18:36.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:36.679+0000 7fa7698f6500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-12T09:18:39.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-12T09:18:39.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:40.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:40.093+0000 7f6e9ba05500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-12T09:18:40.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:40.094+0000 7f6e9ba05500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-12T09:18:40.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:40.094+0000 7f6e9ba05500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T09:18:40.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:40.094+0000 7f6e9ba05500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T09:18:40.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:40.094+0000 7f6e9ba05500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T09:18:40.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:40.096+0000 7f6e9ba05500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-12T09:18:43.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-12T09:18:43.124 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:43.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:43.264+0000 7f34b374a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-12T09:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:43.264+0000 7f34b374a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-12T09:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:43.264+0000 7f34b374a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T09:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:43.264+0000 7f34b374a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T09:18:43.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:43.264+0000 7f34b374a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T09:18:43.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:43.267+0000 7f34b374a500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-12T09:18:46.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-12T09:18:46.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:46.465+0000 7f62d2b90500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-12T09:18:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:46.465+0000 7f62d2b90500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-12T09:18:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:46.465+0000 7f62d2b90500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T09:18:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:46.465+0000 7f62d2b90500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T09:18:46.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:46.465+0000 7f62d2b90500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T09:18:46.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:18:46.468+0000 7f62d2b90500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-12T09:18:49.384 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-12T09:18:49.481 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-12T09:18:49.589 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:49.589 INFO:tasks.ceph:role: osd.4 2023-12-12T09:18:49.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:18:49.589 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:18:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:18:49.685 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:18:50.207 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-12-12T09:18:50.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-12-12T09:18:50.213 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-12T09:18:50.368 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-12T09:18:50.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-12T09:18:50.537 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:50.537 INFO:tasks.ceph:role: osd.5 2023-12-12T09:18:50.538 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:18:50.538 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:18:50.613 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:18:50.614 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:18:51.070 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-12-12T09:18:51.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-12-12T09:18:51.077 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-12T09:18:51.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-12T09:18:51.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-12T09:18:51.381 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:51.381 INFO:tasks.ceph:role: osd.6 2023-12-12T09:18:51.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:18:51.382 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-12T09:18:51.479 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:18:51.479 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:18:51.479 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:18:51.479 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:18:51.479 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:18:51.479 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:18:51.479 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:18:51.479 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:18:51.480 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:18:51.480 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:18:52.005 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-12-12T09:18:52.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-12-12T09:18:52.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-12T09:18:52.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-12T09:18:52.321 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-12T09:18:52.416 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T09:18:52.416 INFO:tasks.ceph:role: osd.7 2023-12-12T09:18:52.416 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:18:52.416 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T09:18:52.510 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T09:18:52.964 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-12-12T09:18:52.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-12-12T09:18:52.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-12T09:18:53.114 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-12T09:18:53.207 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:53.362 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:53.362+0000 7f1c5ee12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-12T09:18:53.363 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:53.363+0000 7f1c5ee12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-12T09:18:53.364 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:53.363+0000 7f1c5ee12500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T09:18:53.364 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:53.363+0000 7f1c5ee12500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T09:18:53.364 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:53.363+0000 7f1c5ee12500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T09:18:53.369 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:53.369+0000 7f1c5ee12500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-12T09:18:56.545 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-12T09:18:56.645 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:56.786 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:56.786+0000 7fe890620500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-12T09:18:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:56.787+0000 7fe890620500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-12T09:18:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:56.787+0000 7fe890620500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T09:18:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:56.787+0000 7fe890620500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T09:18:56.787 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:56.787+0000 7fe890620500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T09:18:56.789 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:56.789+0000 7fe890620500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-12T09:18:56.895 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:18:56.904 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:18:59.716 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-12T09:18:59.817 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:18:59.959 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:59.959+0000 7f221a8a7500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-12T09:18:59.960 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:59.959+0000 7f221a8a7500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-12T09:18:59.960 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:59.959+0000 7f221a8a7500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T09:18:59.960 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:59.959+0000 7f221a8a7500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T09:18:59.960 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:59.959+0000 7f221a8a7500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T09:18:59.961 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:18:59.962+0000 7f221a8a7500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-12T09:19:02.892 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-12T09:19:02.982 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:19:03.120 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:03.120+0000 7f96169e2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-12T09:19:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:03.120+0000 7f96169e2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-12T09:19:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:03.120+0000 7f96169e2500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T09:19:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:03.120+0000 7f96169e2500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T09:19:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:03.120+0000 7f96169e2500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T09:19:03.122 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:03.123+0000 7f96169e2500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-12T09:19:06.295 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-12T09:19:06.395 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-12T09:19:06.395 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:06.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-12T09:19:06.498 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:06.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-12T09:19:06.595 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:06.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-12T09:19:06.692 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:06.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-12T09:19:06.783 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:06.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-12T09:19:06.879 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:06.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-12T09:19:06.969 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:06.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-12T09:19:07.117 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:07.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-12T09:19:07.220 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:07.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-12T09:19:07.313 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:07.313 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-12T09:19:07.407 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:07.407 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-12T09:19:07.499 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:07.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-12T09:19:07.643 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:07.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-12T09:19:07.737 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:07.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-12T09:19:07.835 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:07.835 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-12T09:19:07.893 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:07.893 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-12T09:19:07.947 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:07.947 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-12T09:19:08.006 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:08.006 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-12T09:19:08.057 INFO:tasks.ceph:Adding keys to all mons... 2023-12-12T09:19:08.057 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-12T09:19:08.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-12T09:19:08.154 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBmJXhlNy8cLRAANZgrMuGBpqE0vziSKDEZZw== 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBnJXhlazPlCRAA8h1rv4l+wATTogAYJaJACA== 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBnJXhlyuNKGxAArml3MuY84tPlWVEkGXrQfA== 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBsJXhlGWtaKBAAcvay28WkisUnS9PkhhQAWQ== 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBwJXhlzLyeBRAAF0OQ1/uxjMtcH7Dlq19+wQ== 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBzJXhlDeDLDxAAs1H0Lw3yvvj26MgWz8tf+w== 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQB2JXhlCGrHGxAAcT18fJklTVxEPj2Ax9bLkw== 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2023-12-12T09:19:08.155 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBmJXhlWTtoOhAAHRRsQlAYQsSgQIzlShMGXw== 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBnJXhl2U3oLBAAamxW25qScCfsVFF8J5k66w== 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlFkIjAhAArQOrgyVa4DoHVjka8fe9IQ== 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQB9JXhlvGCgFRAANKCYQxghEUOGixr7gZ3QBA== 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCAJXhlAK3nLhAAvPsU0fD/waCxvw8zQ3L07w== 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCDJXhlXIk1ORAApKc5rcRGatUeNq+RVIh6Ng== 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCHJXhlPw0zBxAAd3PQvyZAAGDlzbPKm/0zgA== 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout:[client.2] 2023-12-12T09:19:08.156 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlei68GhAAU3Wy1eq+3Pkruvpil5J1Zg== 2023-12-12T09:19:08.157 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2023-12-12T09:19:08.157 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhl/GmeJRAAUJlsvxorGdsBuqqHSU8LWw== 2023-12-12T09:19:08.157 INFO:teuthology.orchestra.run.smithi084.stdout:[client.3] 2023-12-12T09:19:08.157 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhli8+AMRAAc4+osq4LmnMpuknxONr3YQ== 2023-12-12T09:19:08.159 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2023-12-12T09:19:08.159 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBmJXhlNy8cLRAANZgrMuGBpqE0vziSKDEZZw== 2023-12-12T09:19:08.159 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2023-12-12T09:19:08.159 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBnJXhlazPlCRAA8h1rv4l+wATTogAYJaJACA== 2023-12-12T09:19:08.159 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2023-12-12T09:19:08.159 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBnJXhlyuNKGxAArml3MuY84tPlWVEkGXrQfA== 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBsJXhlGWtaKBAAcvay28WkisUnS9PkhhQAWQ== 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBwJXhlzLyeBRAAF0OQ1/uxjMtcH7Dlq19+wQ== 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBzJXhlDeDLDxAAs1H0Lw3yvvj26MgWz8tf+w== 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQB2JXhlCGrHGxAAcT18fJklTVxEPj2Ax9bLkw== 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBmJXhlWTtoOhAAHRRsQlAYQsSgQIzlShMGXw== 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBnJXhl2U3oLBAAamxW25qScCfsVFF8J5k66w== 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBoJXhlFkIjAhAArQOrgyVa4DoHVjka8fe9IQ== 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2023-12-12T09:19:08.160 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQB9JXhlvGCgFRAANKCYQxghEUOGixr7gZ3QBA== 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCAJXhlAK3nLhAAvPsU0fD/waCxvw8zQ3L07w== 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCDJXhlXIk1ORAApKc5rcRGatUeNq+RVIh6Ng== 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCHJXhlPw0zBxAAd3PQvyZAAGDlzbPKm/0zgA== 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout:[client.2] 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBoJXhlei68GhAAU3Wy1eq+3Pkruvpil5J1Zg== 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBoJXhl/GmeJRAAUJlsvxorGdsBuqqHSU8LWw== 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout:[client.3] 2023-12-12T09:19:08.161 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBoJXhli8+AMRAAc4+osq4LmnMpuknxONr3YQ== 2023-12-12T09:19:08.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T09:19:08.171 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T09:19:08.322 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:19:08.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:19:08.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:19:08.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:19:08.617 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:08.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:08.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:08.767 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:08.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:08.914 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:09.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:09.060 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:09.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T09:19:09.212 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T09:19:09.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:19:09.362 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:19:09.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:19:09.510 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T09:19:09.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:09.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:09.784 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:09.792 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:09.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:09.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:10.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:10.086 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T09:19:10.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:19:10.240 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:19:10.386 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:19:10.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:19:10.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:19:10.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:19:10.686 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:19:10.692 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T09:19:10.841 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-12T09:19:10.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-12T09:19:10.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T09:19:11.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-12T09:19:11.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-12T09:19:11.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T09:19:11.436 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-12T09:19:11.532 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-12T09:19:11.628 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T09:19:11.779 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-12T09:19:11.864 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:19:11.873 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-12T09:19:11.925 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-12T09:19:11.925 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-12T09:19:11.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-12T09:19:11.931 INFO:tasks.ceph.mon.a:Started 2023-12-12T09:19:11.931 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-12T09:19:11.931 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-12T09:19:11.936 INFO:tasks.ceph.mon.b:Started 2023-12-12T09:19:11.936 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-12T09:19:11.937 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-12T09:19:11.942 INFO:tasks.ceph.mon.c:Started 2023-12-12T09:19:11.942 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-12T09:19:11.942 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-12T09:19:11.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-12T09:19:11.950 INFO:tasks.ceph.mgr.y:Started 2023-12-12T09:19:11.950 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-12T09:19:11.950 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-12T09:19:11.955 INFO:tasks.ceph.mgr.x:Started 2023-12-12T09:19:11.955 INFO:tasks.ceph:Setting crush tunables to default 2023-12-12T09:19:11.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2023-12-12T09:19:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.134+0000 7f6c5a0bb640 1 Processor -- start 2023-12-12T09:19:12.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.134+0000 7f6c5a0bb640 1 -- start start 2023-12-12T09:19:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.135+0000 7f6c5a0bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.135+0000 7f6c5a0bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:12.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.135+0000 7f6c5a0bb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540cdc30 con 0x7f6c540cf890 2023-12-12T09:19:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.135+0000 7f6c5a0bb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540cdea0 con 0x7f6c540cec60 2023-12-12T09:19:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.135+0000 7f6c5a0bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540ce180 con 0x7f6c540d3590 2023-12-12T09:19:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.135+0000 7f6c588b8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.135+0000 7f6c598ba640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c588b8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56750/0 (socket says 172.21.15.84:56750) 2023-12-12T09:19:12.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 learned_addr learned my addr 172.21.15.84:0/405051433 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:12.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:19:12.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:12.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-12T09:19:12.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:12.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:12.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:12.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T09:19:12.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.136+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T09:19:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.337+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.337+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-12T09:19:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.338+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.338+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.338+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T09:19:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.338+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.338+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:19:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.338+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.338+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.338+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T09:19:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.739+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.739+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:19:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.739+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.739+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.739+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T09:19:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.739+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.740+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-12T09:19:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.740+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.740+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:12.740+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T09:19:13.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.541+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:13.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.541+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:19:13.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.541+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:13.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.541+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:13.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.541+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T09:19:13.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.542+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:13.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.542+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-12T09:19:13.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.542+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:13.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.542+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:13.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:13.542+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T09:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 msgr2=0x7f6c540b5cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540d3590 0x7f6c540b5cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 msgr2=0x7f6c540d18c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c540cec60 0x7f6c540d18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 >> v1:172.21.15.99:6789/0 conn(0x7f6c540cf890 legacy=0x7f6c540cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540ce460 con 0x7f6c380036e0 2023-12-12T09:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540cdea0 con 0x7f6c38007370 2023-12-12T09:19:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.136+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.137+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.137+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.137+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.137+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T09:19:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.338+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.338+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.338+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.338+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.338+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T09:19:15.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.740+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:15.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.740+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:15.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.740+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:15.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.740+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:15.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:15.740+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T09:19:16.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:16.543+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:16.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:16.543+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:16.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:16.543+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:16.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:16.543+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:16.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:16.543+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T09:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 >> v1:172.21.15.84:6789/0 conn(0x7f6c380036e0 legacy=0x7f6c38005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:18.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 reap_dead start 2023-12-12T09:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540cdea0 con 0x7f6c38009fd0 2023-12-12T09:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540ce180 con 0x7f6c38007370 2023-12-12T09:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c38005cf0 con 0x7f6c3800aa40 2023-12-12T09:19:18.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:18.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.137+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.138+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.138+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.138+0000 7f6c590b9640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.138+0000 7f6c590b9640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.138+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.138+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T09:19:18.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.138+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T09:19:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.338+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.339+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.339+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.339+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.339+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T09:19:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.339+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.339+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.340+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:19:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.340+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.340+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.340+0000 7f6c590b9640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-12T09:19:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.340+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T09:19:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.340+0000 7f6c590b9640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.340+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.340+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-12T09:19:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.740+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.741+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.741+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.741+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.741+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T09:19:18.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.741+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.741+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:18.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.742+0000 7f6c590b9640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:19:18.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.742+0000 7f6c590b9640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.742+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.742+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-12T09:19:18.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.742+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:18.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.742+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:18.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.742+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T09:19:18.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:18.742+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-12T09:19:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.542+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.543+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.543+0000 7f6c588b8640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:19.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.543+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:19.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.543+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T09:19:19.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.543+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c590b9640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c590b9640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T09:19:19.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:19.544+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-12T09:19:21.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:21.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 msgr2=0x7f6c38006270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:19:21.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:21.137+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c3800aa40 0x7f6c38006270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:21.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:21.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 msgr2=0x7f6c38009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:19:21.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:21.137+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.99:3300/0 conn(0x7f6c38007370 0x7f6c38009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:21.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:21.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 msgr2=0x7f6c3800a410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:19:21.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:21.137+0000 7f6c4affd640 1 --2- 172.21.15.84:0/405051433 >> v2:172.21.15.84:3300/0 conn(0x7f6c38009fd0 0x7f6c3800a410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:21.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:21.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3800af10 con 0x7f6c380068c0 2023-12-12T09:19:21.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:21.137+0000 7f6c4affd640 1 -- 172.21.15.84:0/405051433 --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c38015060 con 0x7f6c38006cd0 2023-12-12T09:19:22.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.204+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459925029 0 0) 0x7f6c3800af10 con 0x7f6c380068c0 2023-12-12T09:19:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.204+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c40003520 con 0x7f6c380068c0 2023-12-12T09:19:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.205+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449810757 0 0) 0x7f6c38015060 con 0x7f6c38006cd0 2023-12-12T09:19:22.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.205+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c3800af10 con 0x7f6c38006cd0 2023-12-12T09:19:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.206+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 <== mon.1 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3533386703 0 0) 0x7f6c3800af10 con 0x7f6c38006cd0 2023-12-12T09:19:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.206+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 >> v1:172.21.15.84:6789/0 conn(0x7f6c380068c0 legacy=0x7f6c3800f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.206+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38016200 con 0x7f6c38006cd0 2023-12-12T09:19:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.206+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 <== mon.1 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f6c44016870 con 0x7f6c38006cd0 2023-12-12T09:19:22.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.206+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 >> v1:172.21.15.99:6789/0 conn(0x7f6c38006cd0 legacy=0x7f6c38012930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.207+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 reap_dead start 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.207+0000 7f6c4bfff640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003b00 0x7f6c40003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.207+0000 7f6c4bfff640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 0x7f6c40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.207+0000 7f6c4bfff640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40005380 0x7f6c4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.207+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4000c230 con 0x7f6c40005380 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.207+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4000c3a0 con 0x7f6c40003b00 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.207+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4000c560 con 0x7f6c400047c0 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.208+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40005380 0x7f6c4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:22.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.208+0000 7f6c588b8640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 0x7f6c40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:22.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.208+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003b00 0x7f6c40003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:22.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.209+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 msgr2=0x7f6c40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.209+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 0x7f6c40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.209+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003b00 msgr2=0x7f6c40003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.209+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003b00 0x7f6c40003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.209+0000 7f6c598ba640 1 -- 172.21.15.84:0/405051433 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38016200 con 0x7f6c40005380 2023-12-12T09:19:22.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.209+0000 7f6c590b9640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003b00 0x7f6c40003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:19:22.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.212+0000 7f6c598ba640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40005380 0x7f6c4000b980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c540d3970 tx=0x7f6c400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d7b774d53c3bcd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.214+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c034680 con 0x7f6c40005380 2023-12-12T09:19:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.214+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00f040 con 0x7f6c40005380 2023-12-12T09:19:22.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.214+0000 7f6c4bfff640 1 -- 172.21.15.84:0/405051433 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c034a60 con 0x7f6c40005380 2023-12-12T09:19:22.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.215+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/405051433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40005380 msgr2=0x7f6c4000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.215+0000 7f6c5a0bb640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40005380 0x7f6c4000b980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c540d3970 tx=0x7f6c400057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.216+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/405051433 shutdown_connections 2023-12-12T09:19:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.216+0000 7f6c5a0bb640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40005380 0x7f6c4000b980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.216+0000 7f6c5a0bb640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 0x7f6c40004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.216+0000 7f6c5a0bb640 1 --2- 172.21.15.84:0/405051433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003b00 0x7f6c40003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.216+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/405051433 >> 172.21.15.84:0/405051433 conn(0x7f6c5409c1f0 msgr2=0x7f6c540d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.216+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/405051433 shutdown_connections 2023-12-12T09:19:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.216+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/405051433 wait complete. 2023-12-12T09:19:22.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.224+0000 7f6c5a0bb640 1 Processor -- start 2023-12-12T09:19:22.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.224+0000 7f6c5a0bb640 1 -- start start 2023-12-12T09:19:22.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c5a0bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40003b00 0x7f6c5406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:22.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c5a0bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 0x7f6c5415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:22.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c5a0bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40005380 0x7f6c540c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:22.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c5a0bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5415a9d0 con 0x7f6c40003b00 2023-12-12T09:19:22.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c5a0bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c541f34a0 con 0x7f6c40005380 2023-12-12T09:19:22.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c5a0bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c541f39c0 con 0x7f6c400047c0 2023-12-12T09:19:22.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c590b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40003b00 0x7f6c5406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:22.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c590b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40003b00 0x7f6c5406bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42410/0 (socket says 172.21.15.84:42410) 2023-12-12T09:19:22.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c590b9640 1 -- 172.21.15.84:0/56509470 learned_addr learned my addr 172.21.15.84:0/56509470 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:22.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.225+0000 7f6c588b8640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 0x7f6c5415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:22.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.226+0000 7f6c598ba640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40005380 0x7f6c540c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:22.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.226+0000 7f6c590b9640 1 -- 172.21.15.84:0/56509470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 msgr2=0x7f6c5415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:22.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.226+0000 7f6c590b9640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 0x7f6c5415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.226+0000 7f6c590b9640 1 -- 172.21.15.84:0/56509470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40005380 msgr2=0x7f6c540c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:22.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.226+0000 7f6c590b9640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40005380 0x7f6c540c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.226+0000 7f6c590b9640 1 -- 172.21.15.84:0/56509470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c541f36e0 con 0x7f6c40003b00 2023-12-12T09:19:22.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.227+0000 7f6c590b9640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40003b00 0x7f6c5406bab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c50003f80 tx=0x7f6c50001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:22.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.227+0000 7f6c49ffb640 1 -- 172.21.15.84:0/56509470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50001d10 con 0x7f6c40003b00 2023-12-12T09:19:22.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.227+0000 7f6c49ffb640 1 -- 172.21.15.84:0/56509470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50017640 con 0x7f6c40003b00 2023-12-12T09:19:22.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.227+0000 7f6c49ffb640 1 -- 172.21.15.84:0/56509470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500179b0 con 0x7f6c40003b00 2023-12-12T09:19:22.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.227+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c541f3cb0 con 0x7f6c40003b00 2023-12-12T09:19:22.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.227+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5406b520 con 0x7f6c40003b00 2023-12-12T09:19:22.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.228+0000 7f6c49ffb640 1 -- 172.21.15.84:0/56509470 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c50017b10 con 0x7f6c40003b00 2023-12-12T09:19:22.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.228+0000 7f6c49ffb640 1 -- 172.21.15.84:0/56509470 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6c50016700 con 0x7f6c40003b00 2023-12-12T09:19:22.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.229+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540673c0 con 0x7f6c40003b00 2023-12-12T09:19:22.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.232+0000 7f6c49ffb640 1 -- 172.21.15.84:0/56509470 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6c50025060 con 0x7f6c40003b00 2023-12-12T09:19:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.305+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6c540673c0 con 0x7f6c40003b00 2023-12-12T09:19:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.310+0000 7f6c49ffb640 1 -- 172.21.15.84:0/56509470 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6c5001b070 con 0x7f6c40003b00 2023-12-12T09:19:22.311 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2023-12-12T09:19:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.311+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40003b00 msgr2=0x7f6c5406bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.311+0000 7f6c5a0bb640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40003b00 0x7f6c5406bab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c50003f80 tx=0x7f6c50001660 comp rx=0 tx=0).stop 2023-12-12T09:19:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.311+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 shutdown_connections 2023-12-12T09:19:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.311+0000 7f6c5a0bb640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40005380 0x7f6c540c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.311+0000 7f6c5a0bb640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c400047c0 0x7f6c5415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.311+0000 7f6c5a0bb640 1 --2- 172.21.15.84:0/56509470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40003b00 0x7f6c5406bab0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.311+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 >> 172.21.15.84:0/56509470 conn(0x7f6c5409c1f0 msgr2=0x7f6c540b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:22.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.311+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 shutdown_connections 2023-12-12T09:19:22.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:22.312+0000 7f6c5a0bb640 1 -- 172.21.15.84:0/56509470 wait complete. 2023-12-12T09:19:22.330 INFO:tasks.ceph:check_enable_crimson: False 2023-12-12T09:19:22.331 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-12T09:19:22.331 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:22.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-12T09:19:22.409 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:22.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-12T09:19:22.544 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:22.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-12T09:19:22.631 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:22.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-12T09:19:22.757 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:22.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-12T09:19:22.766 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:22.764+0000 7fa915a45040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-12T09:19:22.783 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:22.782+0000 7f0e59e45040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-12T09:19:22.828 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:22.827+0000 7fa915a45040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-12T09:19:22.842 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:22.841+0000 7f0e59e45040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-12T09:19:22.847 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:22.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-12T09:19:22.926 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:22.927 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-12T09:19:23.049 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:19:23.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-12T09:19:23.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 029fce1c-be3a-4373-ab0b-45cb02eccd08 0 2023-12-12T09:19:23.362 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.361+0000 7f7029648640 1 Processor -- start 2023-12-12T09:19:23.362 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.361+0000 7f7029648640 1 -- start start 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f7029648640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702406e490 0x7f702406e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f7029648640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f70240cd890 0x7f70240cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f7029648640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70240cf3e0 con 0x7f702415d1c0 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f7029648640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702406bfa0 con 0x7f70240cd890 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f7029648640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70240ce240 con 0x7f702406e490 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f70227fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702406e490 0x7f702406e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f70227fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702406e490 0x7f702406e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:43646/0 (socket says 172.21.15.99:43646) 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f70227fc640 1 -- 172.21.15.99:0/3927073520 learned_addr learned my addr 172.21.15.99:0/3927073520 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f70237fe640 1 --2- 172.21.15.99:0/3927073520 >> v2:172.21.15.84:3300/0 conn(0x7f70240cd890 0x7f70240cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f70227fc640 1 -- 172.21.15.99:0/3927073520 >> v2:172.21.15.84:3300/0 conn(0x7f70240cd890 msgr2=0x7f70240cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f70227fc640 1 --2- 172.21.15.99:0/3927073520 >> v2:172.21.15.84:3300/0 conn(0x7f70240cd890 0x7f70240cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.365 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.363+0000 7f70227fc640 1 -- 172.21.15.99:0/3927073520 >> v1:172.21.15.84:6789/0 conn(0x7f702415d1c0 legacy=0x7f702406b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.366 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.364+0000 7f70227fc640 1 -- 172.21.15.99:0/3927073520 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702406d600 con 0x7f702406e490 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.365+0000 7f70227fc640 1 --2- 172.21.15.99:0/3927073520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702406e490 0x7f702406e8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f702406d7f0 tx=0x7f701802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6193a834c3c32902 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.365+0000 7f7021ffb640 1 -- 172.21.15.99:0/3927073520 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018030840 con 0x7f702406e490 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.365+0000 7f7021ffb640 1 -- 172.21.15.99:0/3927073520 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70180309a0 con 0x7f702406e490 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.365+0000 7f7021ffb640 1 -- 172.21.15.99:0/3927073520 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018030d30 con 0x7f702406e490 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.366+0000 7f7029648640 1 -- 172.21.15.99:0/3927073520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702406e490 msgr2=0x7f702406e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.366+0000 7f7029648640 1 --2- 172.21.15.99:0/3927073520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702406e490 0x7f702406e8f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f702406d7f0 tx=0x7f701802b980 comp rx=0 tx=0).stop 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.366+0000 7f7029648640 1 -- 172.21.15.99:0/3927073520 shutdown_connections 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.366+0000 7f7029648640 1 --2- 172.21.15.99:0/3927073520 >> v2:172.21.15.84:3300/0 conn(0x7f70240cd890 0x7f70240cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.366+0000 7f7029648640 1 --2- 172.21.15.99:0/3927073520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702406e490 0x7f702406e8f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.366+0000 7f7029648640 1 -- 172.21.15.99:0/3927073520 >> 172.21.15.99:0/3927073520 conn(0x7f70240b2a20 msgr2=0x7f70240b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:23.367 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.366+0000 7f7029648640 1 -- 172.21.15.99:0/3927073520 shutdown_connections 2023-12-12T09:19:23.368 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.366+0000 7f7029648640 1 -- 172.21.15.99:0/3927073520 wait complete. 2023-12-12T09:19:23.368 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.367+0000 7f7029648640 1 Processor -- start 2023-12-12T09:19:23.368 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.368+0000 7f7029648640 1 -- start start 2023-12-12T09:19:23.370 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.368+0000 7f7029648640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f702406e490 0x7f70240c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.370 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.368+0000 7f7029648640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70240cd890 0x7f70240b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.368+0000 7f7029648640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702415d1c0 0x7f7024151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.368+0000 7f7029648640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7024151970 con 0x7f70240cd890 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.368+0000 7f7029648640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70240c6930 con 0x7f702406e490 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.368+0000 7f7029648640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70240b56c0 con 0x7f702415d1c0 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f70237fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702415d1c0 0x7f7024151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f7022ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f702406e490 0x7f70240c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f70237fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702415d1c0 0x7f7024151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:43648/0 (socket says 172.21.15.99:43648) 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f7022ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f702406e490 0x7f70240c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34056/0 (socket says 172.21.15.99:34056) 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f70237fe640 1 -- 172.21.15.99:0/3928931572 learned_addr learned my addr 172.21.15.99:0/3928931572 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f70227fc640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70240cd890 0x7f70240b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f7022ffd640 1 -- 172.21.15.99:0/3928931572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702415d1c0 msgr2=0x7f7024151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f7022ffd640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702415d1c0 0x7f7024151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f7022ffd640 1 -- 172.21.15.99:0/3928931572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70240cd890 msgr2=0x7f70240b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f7022ffd640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70240cd890 0x7f70240b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.371 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f7022ffd640 1 -- 172.21.15.99:0/3928931572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70180094d0 con 0x7f702406e490 2023-12-12T09:19:23.372 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.369+0000 7f70237fe640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702415d1c0 0x7f7024151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:19:23.372 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.370+0000 7f7022ffd640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f702406e490 0x7f70240c53d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f701400c390 tx=0x7f701400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:23.373 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.370+0000 7f700b7fe640 1 -- 172.21.15.99:0/3928931572 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70140052d0 con 0x7f702406e490 2023-12-12T09:19:23.373 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.370+0000 7f700b7fe640 1 -- 172.21.15.99:0/3928931572 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7014005430 con 0x7f702406e490 2023-12-12T09:19:23.373 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.370+0000 7f700b7fe640 1 -- 172.21.15.99:0/3928931572 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014003830 con 0x7f702406e490 2023-12-12T09:19:23.373 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.370+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70240b59a0 con 0x7f702406e490 2023-12-12T09:19:23.373 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.370+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70240c6b80 con 0x7f702406e490 2023-12-12T09:19:23.373 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.370+0000 7f700b7fe640 1 -- 172.21.15.99:0/3928931572 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7014003c90 con 0x7f702406e490 2023-12-12T09:19:23.373 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.370+0000 7f700b7fe640 1 -- 172.21.15.99:0/3928931572 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f701401c780 con 0x7f702406e490 2023-12-12T09:19:23.373 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.371+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70240673c0 con 0x7f702406e490 2023-12-12T09:19:23.375 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.374+0000 7f700b7fe640 1 -- 172.21.15.99:0/3928931572 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7014017070 con 0x7f702406e490 2023-12-12T09:19:23.441 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.439+0000 7f0e59e45040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-12T09:19:23.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.452+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "029fce1c-be3a-4373-ab0b-45cb02eccd08", "id": 0} v 0) v1 -- 0x7f702406b670 con 0x7f702406e490 2023-12-12T09:19:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.459+0000 7f700b7fe640 1 -- 172.21.15.99:0/3928931572 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "029fce1c-be3a-4373-ab0b-45cb02eccd08", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7014011e00 con 0x7f702406e490 2023-12-12T09:19:23.460 INFO:teuthology.orchestra.run.smithi099.stdout:0 2023-12-12T09:19:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f702406e490 msgr2=0x7f70240c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f702406e490 0x7f70240c53d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f701400c390 tx=0x7f701400c850 comp rx=0 tx=0).stop 2023-12-12T09:19:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 shutdown_connections 2023-12-12T09:19:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f702415d1c0 0x7f7024151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70240cd890 0x7f70240b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 --2- 172.21.15.99:0/3928931572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f702406e490 0x7f70240c53d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 >> 172.21.15.99:0/3928931572 conn(0x7f70240b2a20 msgr2=0x7f70240d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 shutdown_connections 2023-12-12T09:19:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.461+0000 7f7029648640 1 -- 172.21.15.99:0/3928931572 wait complete. 2023-12-12T09:19:23.468 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:23.467+0000 7fa915a45040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-12T09:19:23.480 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 9e830c00-995d-4b11-acf4-d3275347aac4 1 2023-12-12T09:19:23.503 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.501+0000 7f0e59e45040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-12T09:19:23.534 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:23.533+0000 7fa915a45040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-12T09:19:23.554 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.553+0000 7f0e59e45040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-12T09:19:23.589 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:23.588+0000 7fa915a45040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-12T09:19:23.616 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.615+0000 7f0e59e45040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-12T09:19:23.656 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:23.655+0000 7fa915a45040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-12T09:19:23.665 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.663+0000 7f0e59e45040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-12T09:19:23.670 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.670+0000 7f5c91f41640 1 Processor -- start 2023-12-12T09:19:23.671 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.670+0000 7f5c91f41640 1 -- start start 2023-12-12T09:19:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.671+0000 7f5c91f41640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c0cf4e0 0x7f5c8c0d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.671+0000 7f5c91f41640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8c0d2100 con 0x7f5c8c0d2d30 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.671+0000 7f5c91f41640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8c0ce440 con 0x7f5c8c15d320 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.671+0000 7f5c91f41640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0ce720 con 0x7f5c8c0cf4e0 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.671+0000 7f5c8affd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c0cf4e0 0x7f5c8c0d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.671+0000 7f5c8b7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5c8c15d320 0x7f5c8c0cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47332/0 (socket says 172.21.15.99:47332) 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.672+0000 7f5c8b7fe640 1 -- 172.21.15.99:0/2889209822 learned_addr learned my addr 172.21.15.99:0/2889209822 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.672+0000 7f5c8affd640 1 -- 172.21.15.99:0/2889209822 >> v1:172.21.15.99:6789/0 conn(0x7f5c8c15d320 legacy=0x7f5c8c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.672+0000 7f5c8affd640 1 -- 172.21.15.99:0/2889209822 >> v1:172.21.15.84:6789/0 conn(0x7f5c8c0d2d30 legacy=0x7f5c8c0d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.672+0000 7f5c8affd640 1 -- 172.21.15.99:0/2889209822 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c0cea00 con 0x7f5c8c0cf4e0 2023-12-12T09:19:23.673 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.672+0000 7f5c8a7fc640 1 -- 172.21.15.99:0/2889209822 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418412062 0 0) 0x7f5c8c0ce440 con 0x7f5c8c15d320 2023-12-12T09:19:23.674 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.673+0000 7f5c8affd640 1 --2- 172.21.15.99:0/2889209822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c0cf4e0 0x7f5c8c0d1bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5c800097d0 tx=0x7f5c8002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5774bd8e04f7397 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:23.674 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.673+0000 7f5c8a7fc640 1 -- 172.21.15.99:0/2889209822 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80031770 con 0x7f5c8c0cf4e0 2023-12-12T09:19:23.674 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.673+0000 7f5c8a7fc640 1 -- 172.21.15.99:0/2889209822 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c800318d0 con 0x7f5c8c0cf4e0 2023-12-12T09:19:23.674 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.673+0000 7f5c8a7fc640 1 -- 172.21.15.99:0/2889209822 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80031c60 con 0x7f5c8c0cf4e0 2023-12-12T09:19:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.674+0000 7f5c91f41640 1 -- 172.21.15.99:0/2889209822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c0cf4e0 msgr2=0x7f5c8c0d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.674+0000 7f5c91f41640 1 --2- 172.21.15.99:0/2889209822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c0cf4e0 0x7f5c8c0d1bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5c800097d0 tx=0x7f5c8002b810 comp rx=0 tx=0).stop 2023-12-12T09:19:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.674+0000 7f5c91f41640 1 -- 172.21.15.99:0/2889209822 shutdown_connections 2023-12-12T09:19:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.674+0000 7f5c91f41640 1 --2- 172.21.15.99:0/2889209822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c0cf4e0 0x7f5c8c0d1bc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.674+0000 7f5c91f41640 1 -- 172.21.15.99:0/2889209822 >> 172.21.15.99:0/2889209822 conn(0x7f5c8c08cb50 msgr2=0x7f5c8c09c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.674+0000 7f5c91f41640 1 -- 172.21.15.99:0/2889209822 shutdown_connections 2023-12-12T09:19:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.674+0000 7f5c91f41640 1 -- 172.21.15.99:0/2889209822 wait complete. 2023-12-12T09:19:23.677 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.676+0000 7f5c91f41640 1 Processor -- start 2023-12-12T09:19:23.677 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.676+0000 7f5c91f41640 1 -- start start 2023-12-12T09:19:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c91f41640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c8c0cf4e0 0x7f5c8c157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c91f41640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c8c0d2d30 0x7f5c8c0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c91f41640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c15d320 0x7f5c8c15e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c91f41640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c1584c0 con 0x7f5c8c0d2d30 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c91f41640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0b5ce0 con 0x7f5c8c0cf4e0 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c91f41640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0c7ec0 con 0x7f5c8c15d320 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c8b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c8c0cf4e0 0x7f5c8c157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c8bfff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c15d320 0x7f5c8c15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c8b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c8c0cf4e0 0x7f5c8c157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34058/0 (socket says 172.21.15.99:34058) 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c8b7fe640 1 -- 172.21.15.99:0/2374066163 learned_addr learned my addr 172.21.15.99:0/2374066163 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.677+0000 7f5c8affd640 1 --2- 172.21.15.99:0/2374066163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c8c0d2d30 0x7f5c8c0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c8bfff640 1 -- 172.21.15.99:0/2374066163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c8c0cf4e0 msgr2=0x7f5c8c157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c8bfff640 1 --2- 172.21.15.99:0/2374066163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c8c0cf4e0 0x7f5c8c157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c8bfff640 1 -- 172.21.15.99:0/2374066163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c8c0d2d30 msgr2=0x7f5c8c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c8bfff640 1 --2- 172.21.15.99:0/2374066163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c8c0d2d30 0x7f5c8c0c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.680 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c8bfff640 1 -- 172.21.15.99:0/2374066163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c80009400 con 0x7f5c8c15d320 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c8bfff640 1 --2- 172.21.15.99:0/2374066163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c15d320 0x7f5c8c15e980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400c780 tx=0x7f5c8400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c73fff640 1 -- 172.21.15.99:0/2374066163 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8400aa50 con 0x7f5c8c15d320 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c73fff640 1 -- 172.21.15.99:0/2374066163 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8400abb0 con 0x7f5c8c15d320 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c73fff640 1 -- 172.21.15.99:0/2374066163 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8400ce30 con 0x7f5c8c15d320 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c0c81a0 con 0x7f5c8c15d320 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c0c8760 con 0x7f5c8c15d320 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.678+0000 7f5c73fff640 1 -- 172.21.15.99:0/2374066163 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5c84012720 con 0x7f5c8c15d320 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.679+0000 7f5c73fff640 1 -- 172.21.15.99:0/2374066163 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5c8401b400 con 0x7f5c8c15d320 2023-12-12T09:19:23.681 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.679+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c072b80 con 0x7f5c8c15d320 2023-12-12T09:19:23.683 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.683+0000 7f5c73fff640 1 -- 172.21.15.99:0/2374066163 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5c8403ace0 con 0x7f5c8c15d320 2023-12-12T09:19:23.709 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:23.709+0000 7fa915a45040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-12T09:19:23.764 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.762+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9e830c00-995d-4b11-acf4-d3275347aac4", "id": 1} v 0) v1 -- 0x7f5c8c0673c0 con 0x7f5c8c15d320 2023-12-12T09:19:23.772 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.771+0000 7f5c73fff640 1 -- 172.21.15.99:0/2374066163 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e830c00-995d-4b11-acf4-d3275347aac4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5c84029070 con 0x7f5c8c15d320 2023-12-12T09:19:23.772 INFO:teuthology.orchestra.run.smithi099.stdout:1 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.772+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c15d320 msgr2=0x7f5c8c15e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.772+0000 7f5c91f41640 1 --2- 172.21.15.99:0/2374066163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c15d320 0x7f5c8c15e980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400c780 tx=0x7f5c8400cc40 comp rx=0 tx=0).stop 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.772+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 shutdown_connections 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.772+0000 7f5c91f41640 1 --2- 172.21.15.99:0/2374066163 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c8c15d320 0x7f5c8c15e980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.772+0000 7f5c91f41640 1 --2- 172.21.15.99:0/2374066163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c8c0d2d30 0x7f5c8c0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.772+0000 7f5c91f41640 1 --2- 172.21.15.99:0/2374066163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c8c0cf4e0 0x7f5c8c157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.773+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 >> 172.21.15.99:0/2374066163 conn(0x7f5c8c08cb50 msgr2=0x7f5c8c06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.773+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 shutdown_connections 2023-12-12T09:19:23.774 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.773+0000 7f5c91f41640 1 -- 172.21.15.99:0/2374066163 wait complete. 2023-12-12T09:19:23.779 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.778+0000 7f0e59e45040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-12T09:19:23.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 46def62b-336d-48c1-9f02-d82c7e7c6f26 2 2023-12-12T09:19:23.830 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:23.830+0000 7fa915a45040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-12T09:19:23.858 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.856+0000 7f0e59e45040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-12T09:19:23.911 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.909+0000 7f0e59e45040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-12T09:19:23.916 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:23.915+0000 7fa915a45040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-12T09:19:23.969 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:23.968+0000 7f0e59e45040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-12T09:19:23.973 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:23.972+0000 7fa915a45040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-12T09:19:23.977 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.976+0000 7f508e275640 1 Processor -- start 2023-12-12T09:19:23.977 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.976+0000 7f508e275640 1 -- start start 2023-12-12T09:19:23.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.978+0000 7f508e275640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f508815d320 0x7f50880d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.978+0000 7f508e275640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880d2d30 0x7f50880d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.978+0000 7f508e275640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50880d2100 con 0x7f50880cf4e0 2023-12-12T09:19:23.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.978+0000 7f508e275640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50880ce440 con 0x7f508815d320 2023-12-12T09:19:23.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.978+0000 7f508e275640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50880ce720 con 0x7f50880d2d30 2023-12-12T09:19:23.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.978+0000 7f508c812640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880d2d30 0x7f50880d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.979 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.978+0000 7f50877fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f50880cf4e0 0x7f50880cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47346/0 (socket says 172.21.15.99:47346) 2023-12-12T09:19:23.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.978+0000 7f50877fe640 1 -- 172.21.15.99:0/3928135712 learned_addr learned my addr 172.21.15.99:0/3928135712 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-12T09:19:23.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.979+0000 7f5087fff640 1 --2- 172.21.15.99:0/3928135712 >> v2:172.21.15.84:3300/0 conn(0x7f508815d320 0x7f50880d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.979+0000 7f5086ffd640 1 -- 172.21.15.99:0/3928135712 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213475294 0 0) 0x7f50880d2100 con 0x7f50880cf4e0 2023-12-12T09:19:23.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.979+0000 7f508c812640 1 -- 172.21.15.99:0/3928135712 >> v2:172.21.15.84:3300/0 conn(0x7f508815d320 msgr2=0x7f50880d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:23.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.979+0000 7f508c812640 1 --2- 172.21.15.99:0/3928135712 >> v2:172.21.15.84:3300/0 conn(0x7f508815d320 0x7f50880d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.979+0000 7f508c812640 1 -- 172.21.15.99:0/3928135712 >> v1:172.21.15.99:6789/0 conn(0x7f50880cf4e0 legacy=0x7f50880cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.980 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.979+0000 7f508c812640 1 -- 172.21.15.99:0/3928135712 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880cea00 con 0x7f50880d2d30 2023-12-12T09:19:23.981 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.980+0000 7f508c812640 1 --2- 172.21.15.99:0/3928135712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880d2d30 0x7f50880d3160 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5080009d90 tx=0x7f508002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f1b0ff11704ee1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:23.981 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.980+0000 7f5086ffd640 1 -- 172.21.15.99:0/3928135712 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508002cbc0 con 0x7f50880d2d30 2023-12-12T09:19:23.981 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.980+0000 7f5086ffd640 1 -- 172.21.15.99:0/3928135712 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508002cd20 con 0x7f50880d2d30 2023-12-12T09:19:23.981 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.980+0000 7f5086ffd640 1 -- 172.21.15.99:0/3928135712 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080034660 con 0x7f50880d2d30 2023-12-12T09:19:23.982 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.981+0000 7f508e275640 1 -- 172.21.15.99:0/3928135712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880d2d30 msgr2=0x7f50880d3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.983 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.981+0000 7f508e275640 1 --2- 172.21.15.99:0/3928135712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880d2d30 0x7f50880d3160 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5080009d90 tx=0x7f508002be10 comp rx=0 tx=0).stop 2023-12-12T09:19:23.983 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.981+0000 7f508e275640 1 -- 172.21.15.99:0/3928135712 shutdown_connections 2023-12-12T09:19:23.983 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.981+0000 7f508e275640 1 --2- 172.21.15.99:0/3928135712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880d2d30 0x7f50880d3160 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.983 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.981+0000 7f508e275640 1 --2- 172.21.15.99:0/3928135712 >> v2:172.21.15.84:3300/0 conn(0x7f508815d320 0x7f50880d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.983 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.981+0000 7f508e275640 1 -- 172.21.15.99:0/3928135712 >> 172.21.15.99:0/3928135712 conn(0x7f508808cb50 msgr2=0x7f508809c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:23.983 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.981+0000 7f508e275640 1 -- 172.21.15.99:0/3928135712 shutdown_connections 2023-12-12T09:19:23.983 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.981+0000 7f508e275640 1 -- 172.21.15.99:0/3928135712 wait complete. 2023-12-12T09:19:23.984 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.983+0000 7f508e275640 1 Processor -- start 2023-12-12T09:19:23.984 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.983+0000 7f508e275640 1 -- start start 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f508e275640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880cf4e0 0x7f508814c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f508e275640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50880d2d30 0x7f508815fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f508e275640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508815d320 0x7f5088160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f508e275640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5088160860 con 0x7f508815d320 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f508e275640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50880b1b60 con 0x7f50880d2d30 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f508e275640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50880b12c0 con 0x7f50880cf4e0 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f50877fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50880d2d30 0x7f508815fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f5087fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880cf4e0 0x7f508814c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f50877fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50880d2d30 0x7f508815fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34074/0 (socket says 172.21.15.99:34074) 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.984+0000 7f50877fe640 1 -- 172.21.15.99:0/2725489530 learned_addr learned my addr 172.21.15.99:0/2725489530 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f508c812640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508815d320 0x7f5088160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f50877fe640 1 -- 172.21.15.99:0/2725489530 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880cf4e0 msgr2=0x7f508814c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f50877fe640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880cf4e0 0x7f508814c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f50877fe640 1 -- 172.21.15.99:0/2725489530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508815d320 msgr2=0x7f5088160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f50877fe640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508815d320 0x7f5088160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f50877fe640 1 -- 172.21.15.99:0/2725489530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080009a70 con 0x7f50880d2d30 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f508c812640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508815d320 0x7f5088160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f50877fe640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50880d2d30 0x7f508815fde0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c4d0 tx=0x7f507c00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.985+0000 7f5084ff9640 1 -- 172.21.15.99:0/2725489530 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c0074e0 con 0x7f50880d2d30 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.986+0000 7f5084ff9640 1 -- 172.21.15.99:0/2725489530 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c007660 con 0x7f50880d2d30 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.986+0000 7f5084ff9640 1 -- 172.21.15.99:0/2725489530 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c004a20 con 0x7f50880d2d30 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.986+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50880b15a0 con 0x7f50880d2d30 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.986+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508814a360 con 0x7f50880d2d30 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.986+0000 7f5084ff9640 1 -- 172.21.15.99:0/2725489530 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f507c012400 con 0x7f50880d2d30 2023-12-12T09:19:23.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.986+0000 7f5084ff9640 1 -- 172.21.15.99:0/2725489530 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f507c012ad0 con 0x7f50880d2d30 2023-12-12T09:19:23.989 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.987+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5088072b80 con 0x7f50880d2d30 2023-12-12T09:19:23.992 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:23.991+0000 7f5084ff9640 1 -- 172.21.15.99:0/2725489530 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f507c018070 con 0x7f50880d2d30 2023-12-12T09:19:24.024 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:24.023+0000 7f0e59e45040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-12T09:19:24.040 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:24.039+0000 7fa915a45040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-12T09:19:24.070 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.070+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46def62b-336d-48c1-9f02-d82c7e7c6f26", "id": 2} v 0) v1 -- 0x7f508814a580 con 0x7f50880d2d30 2023-12-12T09:19:24.076 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.075+0000 7f5084ff9640 1 -- 172.21.15.99:0/2725489530 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46def62b-336d-48c1-9f02-d82c7e7c6f26", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f507c0126b0 con 0x7f50880d2d30 2023-12-12T09:19:24.077 INFO:teuthology.orchestra.run.smithi099.stdout:2 2023-12-12T09:19:24.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50880d2d30 msgr2=0x7f508815fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50880d2d30 0x7f508815fde0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c4d0 tx=0x7f507c00c990 comp rx=0 tx=0).stop 2023-12-12T09:19:24.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 shutdown_connections 2023-12-12T09:19:24.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f508815d320 0x7f5088160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50880d2d30 0x7f508815fde0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 --2- 172.21.15.99:0/2725489530 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f50880cf4e0 0x7f508814c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.078 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 >> 172.21.15.99:0/2725489530 conn(0x7f508808cb50 msgr2=0x7f508806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:24.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 shutdown_connections 2023-12-12T09:19:24.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.077+0000 7f508e275640 1 -- 172.21.15.99:0/2725489530 wait complete. 2023-12-12T09:19:24.095 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new f48e5a78-d040-4974-be61-551a7fdebb8f 3 2023-12-12T09:19:24.100 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:24.099+0000 7fa915a45040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-12T09:19:24.285 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.284+0000 7f453c93b640 1 Processor -- start 2023-12-12T09:19:24.285 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.284+0000 7f453c93b640 1 -- start start 2023-12-12T09:19:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.285+0000 7f453c93b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f453815d1a0 0x7f45380b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.285+0000 7f453c93b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45380b4390 con 0x7f4538161680 2023-12-12T09:19:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.286+0000 7f453c93b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45380b3780 con 0x7f45380d1fa0 2023-12-12T09:19:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.286+0000 7f453c93b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45380b3a60 con 0x7f453815d1a0 2023-12-12T09:19:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.286+0000 7f453659c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f45380d1fa0 0x7f4538160f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47356/0 (socket says 172.21.15.99:47356) 2023-12-12T09:19:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.286+0000 7f453659c640 1 -- 172.21.15.99:0/4023952675 learned_addr learned my addr 172.21.15.99:0/4023952675 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-12T09:19:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.286+0000 7f4536d9d640 1 --2- 172.21.15.99:0/4023952675 >> v2:172.21.15.84:3300/0 conn(0x7f453815d1a0 0x7f45380b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.286+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929203406 0 0) 0x7f45380b3780 con 0x7f45380d1fa0 2023-12-12T09:19:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.286+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4520003520 con 0x7f45380d1fa0 2023-12-12T09:19:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 <== mon.1 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804430139 0 0) 0x7f4520003520 con 0x7f45380d1fa0 2023-12-12T09:19:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 >> v2:172.21.15.84:3300/0 conn(0x7f453815d1a0 msgr2=0x7f45380b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 --2- 172.21.15.99:0/4023952675 >> v2:172.21.15.84:3300/0 conn(0x7f453815d1a0 0x7f45380b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 >> v1:172.21.15.84:6789/0 conn(0x7f4538161680 legacy=0x7f45380cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45380b3d40 con 0x7f45380d1fa0 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 <== mon.1 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f452c001670 con 0x7f45380d1fa0 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 >> v1:172.21.15.99:6789/0 conn(0x7f45380d1fa0 legacy=0x7f4538160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f4520003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45200047c0 0x7f4520004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4520005180 0x7f452000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45380b3a60 con 0x7f45200047c0 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452000c020 con 0x7f4520005180 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452000c1e0 con 0x7f4520003970 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f453759e640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4520005180 0x7f452000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f4536d9d640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f4520003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.287+0000 7f453659c640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45200047c0 0x7f4520004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.288+0000 7f4536d9d640 1 -- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4520005180 msgr2=0x7f452000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:24.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.288+0000 7f4536d9d640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4520005180 0x7f452000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.288+0000 7f4536d9d640 1 -- 172.21.15.99:0/4023952675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45200047c0 msgr2=0x7f4520004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:24.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.288+0000 7f4536d9d640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45200047c0 0x7f4520004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.288+0000 7f4536d9d640 1 -- 172.21.15.99:0/4023952675 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4520003520 con 0x7f4520003970 2023-12-12T09:19:24.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.288+0000 7f453759e640 1 -- 172.21.15.99:0/4023952675 reap_dead start 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.289+0000 7f4536d9d640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f4520003d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4528009ac0 tx=0x7f45200057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfe5996b35e3902 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.289+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802c6b0 con 0x7f4520003970 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.289+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452802c810 con 0x7f4520003970 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.289+0000 7f4535d9b640 1 -- 172.21.15.99:0/4023952675 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802cba0 con 0x7f4520003970 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.290+0000 7f453c93b640 1 -- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 msgr2=0x7f4520003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.290+0000 7f453c93b640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f4520003d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4528009ac0 tx=0x7f45200057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.290+0000 7f453c93b640 1 -- 172.21.15.99:0/4023952675 shutdown_connections 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.290+0000 7f453c93b640 1 --2- 172.21.15.99:0/4023952675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f4520003d90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.292 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.290+0000 7f453c93b640 1 -- 172.21.15.99:0/4023952675 >> 172.21.15.99:0/4023952675 conn(0x7f453809c230 msgr2=0x7f45380d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:24.293 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.290+0000 7f453c93b640 1 -- 172.21.15.99:0/4023952675 shutdown_connections 2023-12-12T09:19:24.293 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.290+0000 7f453c93b640 1 -- 172.21.15.99:0/4023952675 wait complete. 2023-12-12T09:19:24.293 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.292+0000 7f453c93b640 1 Processor -- start 2023-12-12T09:19:24.293 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.292+0000 7f453c93b640 1 -- start start 2023-12-12T09:19:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453c93b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f45381f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453c93b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45381f2640 0x7f45380d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453c93b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45380d2f20 0x7f453815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453c93b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45380d33a0 con 0x7f45381f2640 2023-12-12T09:19:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453c93b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453815eeb0 con 0x7f45380d2f20 2023-12-12T09:19:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453c93b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45381f7150 con 0x7f4520003970 2023-12-12T09:19:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45380d2f20 0x7f453815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f4536d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f45381f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45380d2f20 0x7f453815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34078/0 (socket says 172.21.15.99:34078) 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f4536d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f45381f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:43718/0 (socket says 172.21.15.99:43718) 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453759e640 1 -- 172.21.15.99:0/3009173642 learned_addr learned my addr 172.21.15.99:0/3009173642 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453659c640 1 --2- 172.21.15.99:0/3009173642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45381f2640 0x7f45380d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453759e640 1 -- 172.21.15.99:0/3009173642 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 msgr2=0x7f45381f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453759e640 1 --2- 172.21.15.99:0/3009173642 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f45381f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453759e640 1 -- 172.21.15.99:0/3009173642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45381f2640 msgr2=0x7f45380d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453759e640 1 --2- 172.21.15.99:0/3009173642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45381f2640 0x7f45380d29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.293+0000 7f453759e640 1 -- 172.21.15.99:0/3009173642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45380b6d50 con 0x7f45380d2f20 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.294+0000 7f453759e640 1 --2- 172.21.15.99:0/3009173642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45380d2f20 0x7f453815da00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45380b5be0 tx=0x7f453000fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.294+0000 7f451f7fe640 1 -- 172.21.15.99:0/3009173642 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453000fec0 con 0x7f45380d2f20 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.294+0000 7f451f7fe640 1 -- 172.21.15.99:0/3009173642 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530003b80 con 0x7f45380d2f20 2023-12-12T09:19:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.294+0000 7f451f7fe640 1 -- 172.21.15.99:0/3009173642 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45300050d0 con 0x7f45380d2f20 2023-12-12T09:19:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.294+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45380b7030 con 0x7f45380d2f20 2023-12-12T09:19:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.294+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453815f100 con 0x7f45380d2f20 2023-12-12T09:19:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.294+0000 7f451f7fe640 1 -- 172.21.15.99:0/3009173642 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4530005530 con 0x7f45380d2f20 2023-12-12T09:19:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.294+0000 7f451f7fe640 1 -- 172.21.15.99:0/3009173642 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f45300057e0 con 0x7f45380d2f20 2023-12-12T09:19:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.295+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4538072eb0 con 0x7f45380d2f20 2023-12-12T09:19:24.298 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.298+0000 7f451f7fe640 1 -- 172.21.15.99:0/3009173642 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f453000dd80 con 0x7f45380d2f20 2023-12-12T09:19:24.376 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.375+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f48e5a78-d040-4974-be61-551a7fdebb8f", "id": 3} v 0) v1 -- 0x7f45380d07b0 con 0x7f45380d2f20 2023-12-12T09:19:24.383 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.382+0000 7f451f7fe640 1 -- 172.21.15.99:0/3009173642 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f48e5a78-d040-4974-be61-551a7fdebb8f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f453000d600 con 0x7f45380d2f20 2023-12-12T09:19:24.383 INFO:teuthology.orchestra.run.smithi099.stdout:3 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45380d2f20 msgr2=0x7f453815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 --2- 172.21.15.99:0/3009173642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45380d2f20 0x7f453815da00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45380b5be0 tx=0x7f453000fc70 comp rx=0 tx=0).stop 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 shutdown_connections 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 --2- 172.21.15.99:0/3009173642 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45380d2f20 0x7f453815da00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 --2- 172.21.15.99:0/3009173642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45381f2640 0x7f45380d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 --2- 172.21.15.99:0/3009173642 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4520003970 0x7f45381f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 >> 172.21.15.99:0/3009173642 conn(0x7f453809c230 msgr2=0x7f4538160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 shutdown_connections 2023-12-12T09:19:24.385 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.383+0000 7f453c93b640 1 -- 172.21.15.99:0/3009173642 wait complete. 2023-12-12T09:19:24.399 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 83bd863a-1a5c-4700-9123-01cfa90442a3 4 2023-12-12T09:19:24.476 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:24.474+0000 7f0e59e45040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-12T09:19:24.588 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:24.587+0000 7fa915a45040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-12T09:19:24.588 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.587+0000 7ff2a359e640 1 Processor -- start 2023-12-12T09:19:24.588 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.587+0000 7ff2a359e640 1 -- start start 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a359e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2a40d1fa0 0x7ff2a4160f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a359e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff2a415d580 0x7ff2a41614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a359e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40b4390 con 0x7ff2a415d1a0 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a359e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40b3590 con 0x7ff2a40d1fa0 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a359e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40b3780 con 0x7ff2a415d580 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a259c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff2a415d1a0 0x7ff2a40b2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47360/0 (socket says 172.21.15.99:47360) 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a259c640 1 -- 172.21.15.99:0/1235192893 learned_addr learned my addr 172.21.15.99:0/1235192893 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a2d9d640 1 --2- 172.21.15.99:0/1235192893 >> v2:172.21.15.99:3300/0 conn(0x7ff2a415d580 0x7ff2a41614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff29bfff640 1 --2- 172.21.15.99:0/1235192893 >> v2:172.21.15.84:3300/0 conn(0x7ff2a40d1fa0 0x7ff2a4160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a2d9d640 1 -- 172.21.15.99:0/1235192893 >> v2:172.21.15.84:3300/0 conn(0x7ff2a40d1fa0 msgr2=0x7ff2a4160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a2d9d640 1 --2- 172.21.15.99:0/1235192893 >> v2:172.21.15.84:3300/0 conn(0x7ff2a40d1fa0 0x7ff2a4160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.591 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a2d9d640 1 -- 172.21.15.99:0/1235192893 >> v1:172.21.15.99:6789/0 conn(0x7ff2a415d1a0 legacy=0x7ff2a40b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.592 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.589+0000 7ff2a2d9d640 1 -- 172.21.15.99:0/1235192893 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40b3a60 con 0x7ff2a415d580 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.591+0000 7ff2a2d9d640 1 --2- 172.21.15.99:0/1235192893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d580 0x7ff2a41614b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40ca050 tx=0x7ff29c02bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a8d2a27e96311a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.591+0000 7ff2a1d9b640 1 -- 172.21.15.99:0/1235192893 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c02cc70 con 0x7ff2a415d580 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.591+0000 7ff2a1d9b640 1 -- 172.21.15.99:0/1235192893 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c02cdd0 con 0x7ff2a415d580 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.591+0000 7ff2a1d9b640 1 -- 172.21.15.99:0/1235192893 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c034660 con 0x7ff2a415d580 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.591+0000 7ff2a359e640 1 -- 172.21.15.99:0/1235192893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d580 msgr2=0x7ff2a41614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.591+0000 7ff2a359e640 1 --2- 172.21.15.99:0/1235192893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d580 0x7ff2a41614b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40ca050 tx=0x7ff29c02bec0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.592+0000 7ff2a359e640 1 -- 172.21.15.99:0/1235192893 shutdown_connections 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.592+0000 7ff2a359e640 1 --2- 172.21.15.99:0/1235192893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d580 0x7ff2a41614b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.592+0000 7ff2a359e640 1 --2- 172.21.15.99:0/1235192893 >> v2:172.21.15.84:3300/0 conn(0x7ff2a40d1fa0 0x7ff2a4160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.592+0000 7ff2a359e640 1 -- 172.21.15.99:0/1235192893 >> 172.21.15.99:0/1235192893 conn(0x7ff2a409c230 msgr2=0x7ff2a40d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.592+0000 7ff2a359e640 1 -- 172.21.15.99:0/1235192893 shutdown_connections 2023-12-12T09:19:24.593 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.592+0000 7ff2a359e640 1 -- 172.21.15.99:0/1235192893 wait complete. 2023-12-12T09:19:24.594 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.593+0000 7ff2a359e640 1 Processor -- start 2023-12-12T09:19:24.594 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.594+0000 7ff2a359e640 1 -- start start 2023-12-12T09:19:24.596 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.594+0000 7ff2a359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a40d1fa0 0x7ff2a41f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.596 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.594+0000 7ff2a359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d1a0 0x7ff2a41f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.596 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a359e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2a415d580 0x7ff2a4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a359e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415f670 con 0x7ff2a40d1fa0 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a359e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415f950 con 0x7ff2a415d1a0 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a359e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415fc30 con 0x7ff2a415d580 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff29bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d1a0 0x7ff2a41f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a2d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2a415d580 0x7ff2a4160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff29bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d1a0 0x7ff2a41f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34096/0 (socket says 172.21.15.99:34096) 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a2d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2a415d580 0x7ff2a4160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:43730/0 (socket says 172.21.15.99:43730) 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff29bfff640 1 -- 172.21.15.99:0/2812786305 learned_addr learned my addr 172.21.15.99:0/2812786305 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a259c640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a40d1fa0 0x7ff2a41f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff29bfff640 1 -- 172.21.15.99:0/2812786305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2a415d580 msgr2=0x7ff2a4160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff29bfff640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2a415d580 0x7ff2a4160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff29bfff640 1 -- 172.21.15.99:0/2812786305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a40d1fa0 msgr2=0x7ff2a41f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff29bfff640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a40d1fa0 0x7ff2a41f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.597 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff29bfff640 1 -- 172.21.15.99:0/2812786305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009a70 con 0x7ff2a415d1a0 2023-12-12T09:19:24.598 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a2d9d640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2a415d580 0x7ff2a4160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:19:24.598 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.595+0000 7ff2a259c640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a40d1fa0 0x7ff2a41f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:19:24.598 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.596+0000 7ff29bfff640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d1a0 0x7ff2a41f6780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00d7d0 tx=0x7ff28c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:24.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.596+0000 7ff29affd640 1 -- 172.21.15.99:0/2812786305 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00b6c0 con 0x7ff2a415d1a0 2023-12-12T09:19:24.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.596+0000 7ff29affd640 1 -- 172.21.15.99:0/2812786305 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c00b820 con 0x7ff2a415d1a0 2023-12-12T09:19:24.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.596+0000 7ff29affd640 1 -- 172.21.15.99:0/2812786305 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00bbb0 con 0x7ff2a415d1a0 2023-12-12T09:19:24.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.596+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a415ff10 con 0x7ff2a415d1a0 2023-12-12T09:19:24.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.596+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a41f2730 con 0x7ff2a415d1a0 2023-12-12T09:19:24.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.596+0000 7ff29affd640 1 -- 172.21.15.99:0/2812786305 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff28c01e760 con 0x7ff2a415d1a0 2023-12-12T09:19:24.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.596+0000 7ff29affd640 1 -- 172.21.15.99:0/2812786305 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff28c0149e0 con 0x7ff2a415d1a0 2023-12-12T09:19:24.599 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.597+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a4072eb0 con 0x7ff2a415d1a0 2023-12-12T09:19:24.600 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.599+0000 7ff29affd640 1 -- 172.21.15.99:0/2812786305 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff28c014ba0 con 0x7ff2a415d1a0 2023-12-12T09:19:24.635 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:24.634+0000 7f0e59e45040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-12T09:19:24.678 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.677+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "83bd863a-1a5c-4700-9123-01cfa90442a3", "id": 4} v 0) v1 -- 0x7ff2a40d07b0 con 0x7ff2a415d1a0 2023-12-12T09:19:24.686 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.685+0000 7ff29affd640 1 -- 172.21.15.99:0/2812786305 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83bd863a-1a5c-4700-9123-01cfa90442a3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff28c014d40 con 0x7ff2a415d1a0 2023-12-12T09:19:24.687 INFO:teuthology.orchestra.run.smithi099.stdout:4 2023-12-12T09:19:24.688 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.686+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d1a0 msgr2=0x7ff2a41f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.688 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.686+0000 7ff2a359e640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d1a0 0x7ff2a41f6780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00d7d0 tx=0x7ff28c00dc90 comp rx=0 tx=0).stop 2023-12-12T09:19:24.688 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.687+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 shutdown_connections 2023-12-12T09:19:24.688 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.687+0000 7ff2a359e640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff2a415d580 0x7ff2a4160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.688 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.687+0000 7ff2a359e640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2a415d1a0 0x7ff2a41f6780 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.688 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.687+0000 7ff2a359e640 1 --2- 172.21.15.99:0/2812786305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a40d1fa0 0x7ff2a41f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.688 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.687+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 >> 172.21.15.99:0/2812786305 conn(0x7ff2a409c230 msgr2=0x7ff2a40b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:24.688 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.687+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 shutdown_connections 2023-12-12T09:19:24.689 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.687+0000 7ff2a359e640 1 -- 172.21.15.99:0/2812786305 wait complete. 2023-12-12T09:19:24.706 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a 5 2023-12-12T09:19:24.759 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:24.758+0000 7fa915a45040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-12T09:19:24.760 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:24.759+0000 7f0e59e45040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-12T09:19:24.813 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:24.812+0000 7f0e59e45040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-12T09:19:24.888 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.887+0000 7f8a6215c640 1 Processor -- start 2023-12-12T09:19:24.888 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.887+0000 7f8a6215c640 1 -- start start 2023-12-12T09:19:24.889 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.888+0000 7f8a6215c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c1682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.889 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.888+0000 7f8a6215c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5c0b4390 con 0x7f8a5c15d1a0 2023-12-12T09:19:24.889 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.888+0000 7f8a6215c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5c0b3780 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.889 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.888+0000 7f8a6215c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c0b3590 con 0x7f8a5c161680 2023-12-12T09:19:24.890 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.888+0000 7f8a6195b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c1682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.890 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.888+0000 7f8a60959640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8a5c0d1fa0 0x7f8a5c160f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47370/0 (socket says 172.21.15.99:47370) 2023-12-12T09:19:24.890 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.888+0000 7f8a60959640 1 -- 172.21.15.99:0/1633671896 learned_addr learned my addr 172.21.15.99:0/1633671896 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-12T09:19:24.890 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.889+0000 7f8a6195b640 1 -- 172.21.15.99:0/1633671896 >> v1:172.21.15.99:6789/0 conn(0x7f8a5c0d1fa0 legacy=0x7f8a5c160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.890 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.889+0000 7f8a5bfff640 1 -- 172.21.15.99:0/1633671896 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470403334 0 0) 0x7f8a5c0b3780 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.891 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.889+0000 7f8a6195b640 1 -- 172.21.15.99:0/1633671896 >> v1:172.21.15.84:6789/0 conn(0x7f8a5c15d1a0 legacy=0x7f8a5c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.891 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.889+0000 7f8a6195b640 1 -- 172.21.15.99:0/1633671896 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c0b3a60 con 0x7f8a5c161680 2023-12-12T09:19:24.891 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.890+0000 7f8a6195b640 1 --2- 172.21.15.99:0/1633671896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c1682a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a540097d0 tx=0x7f8a5402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=367b61cde2b76abb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:24.891 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.890+0000 7f8a5bfff640 1 -- 172.21.15.99:0/1633671896 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54031890 con 0x7f8a5c161680 2023-12-12T09:19:24.892 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.890+0000 7f8a5bfff640 1 -- 172.21.15.99:0/1633671896 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a540319f0 con 0x7f8a5c161680 2023-12-12T09:19:24.892 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.890+0000 7f8a5bfff640 1 -- 172.21.15.99:0/1633671896 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a54031d80 con 0x7f8a5c161680 2023-12-12T09:19:24.892 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.891+0000 7f8a6215c640 1 -- 172.21.15.99:0/1633671896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 msgr2=0x7f8a5c1682a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.892 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.891+0000 7f8a6215c640 1 --2- 172.21.15.99:0/1633671896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c1682a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a540097d0 tx=0x7f8a5402b930 comp rx=0 tx=0).stop 2023-12-12T09:19:24.893 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.891+0000 7f8a6215c640 1 -- 172.21.15.99:0/1633671896 shutdown_connections 2023-12-12T09:19:24.893 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.891+0000 7f8a6215c640 1 --2- 172.21.15.99:0/1633671896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c1682a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.893 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.891+0000 7f8a6215c640 1 -- 172.21.15.99:0/1633671896 >> 172.21.15.99:0/1633671896 conn(0x7f8a5c09c230 msgr2=0x7f8a5c0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:24.893 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.891+0000 7f8a6215c640 1 -- 172.21.15.99:0/1633671896 shutdown_connections 2023-12-12T09:19:24.893 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.891+0000 7f8a6215c640 1 -- 172.21.15.99:0/1633671896 wait complete. 2023-12-12T09:19:24.894 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.893+0000 7f8a6215c640 1 Processor -- start 2023-12-12T09:19:24.894 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.893+0000 7f8a6215c640 1 -- start start 2023-12-12T09:19:24.896 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6215c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a5c0d1fa0 0x7f8a5c1f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.896 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6215c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a5c15d1a0 0x7f8a5c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.896 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6215c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6215c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c1f6680 con 0x7f8a5c15d1a0 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6215c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c1f39b0 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6215c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c1f3c90 con 0x7f8a5c161680 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6115a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a5c0d1fa0 0x7f8a5c1f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6195b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6115a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a5c0d1fa0 0x7f8a5c1f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34106/0 (socket says 172.21.15.99:34106) 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6115a640 1 -- 172.21.15.99:0/3874675002 learned_addr learned my addr 172.21.15.99:0/3874675002 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6195b640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.99:43744/0 (socket says 172.21.15.99:43744) 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a60959640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a5c15d1a0 0x7f8a5c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6115a640 1 -- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 msgr2=0x7f8a5c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6115a640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6115a640 1 -- 172.21.15.99:0/3874675002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a5c15d1a0 msgr2=0x7f8a5c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6115a640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a5c15d1a0 0x7f8a5c1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.897 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6115a640 1 -- 172.21.15.99:0/3874675002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a54009400 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a6195b640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.894+0000 7f8a60959640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a5c15d1a0 0x7f8a5c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.895+0000 7f8a6115a640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a5c0d1fa0 0x7f8a5c1f5ab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c870 tx=0x7f8a4c00cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.895+0000 7f8a59ffb640 1 -- 172.21.15.99:0/3874675002 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c003b70 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.895+0000 7f8a59ffb640 1 -- 172.21.15.99:0/3874675002 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c003cf0 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.895+0000 7f8a59ffb640 1 -- 172.21.15.99:0/3874675002 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c00aa90 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.895+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5c158950 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.895+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c158f10 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.895+0000 7f8a59ffb640 1 -- 172.21.15.99:0/3874675002 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8a4c0050d0 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.898 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.895+0000 7f8a59ffb640 1 -- 172.21.15.99:0/3874675002 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8a4c0126a0 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.899 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.896+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5c072eb0 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.899 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.898+0000 7f8a59ffb640 1 -- 172.21.15.99:0/3874675002 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8a4c005380 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.900 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:24.899+0000 7fa915a45040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-12T09:19:24.924 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:24.923+0000 7f0e59e45040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-12T09:19:24.956 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:24.955+0000 7fa915a45040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-12T09:19:24.977 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.976+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a", "id": 5} v 0) v1 -- 0x7f8a5c0d07b0 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.985 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.984+0000 7f8a59ffb640 1 -- 172.21.15.99:0/3874675002 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8a4c005520 con 0x7f8a5c0d1fa0 2023-12-12T09:19:24.985 INFO:teuthology.orchestra.run.smithi099.stdout:5 2023-12-12T09:19:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a5c0d1fa0 msgr2=0x7f8a5c1f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a5c0d1fa0 0x7f8a5c1f5ab0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00c870 tx=0x7f8a4c00cd30 comp rx=0 tx=0).stop 2023-12-12T09:19:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 shutdown_connections 2023-12-12T09:19:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a5c161680 0x7f8a5c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a5c15d1a0 0x7f8a5c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 --2- 172.21.15.99:0/3874675002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a5c0d1fa0 0x7f8a5c1f5ab0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 >> 172.21.15.99:0/3874675002 conn(0x7f8a5c09c230 msgr2=0x7f8a5c160cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 shutdown_connections 2023-12-12T09:19:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:24.985+0000 7f8a6215c640 1 -- 172.21.15.99:0/3874675002 wait complete. 2023-12-12T09:19:25.003 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 067ae6ca-66a7-4152-9e03-01718c782591 6 2023-12-12T09:19:25.035 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:25.034+0000 7f0e59e45040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-12T09:19:25.076 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:25.074+0000 7fa915a45040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-12T09:19:25.190 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.189+0000 7ffb29872640 1 Processor -- start 2023-12-12T09:19:25.191 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.189+0000 7ffb29872640 1 -- start start 2023-12-12T09:19:25.193 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.191+0000 7ffb29872640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb2415b1d0 0x7ffb240cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.193 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.191+0000 7ffb29872640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb240d1a00 0x7ffb240cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.193 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.191+0000 7ffb29872640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb240ce810 con 0x7ffb2415b5b0 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.191+0000 7ffb29872640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb240cfe80 con 0x7ffb2415b1d0 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.191+0000 7ffb29872640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb240cf9b0 con 0x7ffb240d1a00 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.192+0000 7ffb237fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb240d1a00 0x7ffb240cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.192+0000 7ffb237fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb240d1a00 0x7ffb240cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34114/0 (socket says 172.21.15.99:34114) 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.192+0000 7ffb237fe640 1 -- 172.21.15.99:0/1128007854 learned_addr learned my addr 172.21.15.99:0/1128007854 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.192+0000 7ffb22ffd640 1 --2- 172.21.15.99:0/1128007854 >> v2:172.21.15.84:3300/0 conn(0x7ffb2415b1d0 0x7ffb240cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.192+0000 7ffb237fe640 1 -- 172.21.15.99:0/1128007854 >> v2:172.21.15.84:3300/0 conn(0x7ffb2415b1d0 msgr2=0x7ffb240cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.192+0000 7ffb237fe640 1 --2- 172.21.15.99:0/1128007854 >> v2:172.21.15.84:3300/0 conn(0x7ffb2415b1d0 0x7ffb240cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.192+0000 7ffb237fe640 1 -- 172.21.15.99:0/1128007854 >> v1:172.21.15.84:6789/0 conn(0x7ffb2415b5b0 legacy=0x7ffb240cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.192+0000 7ffb237fe640 1 -- 172.21.15.99:0/1128007854 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240cb9f0 con 0x7ffb240d1a00 2023-12-12T09:19:25.195 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:25.193+0000 7fa915a45040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-12T09:19:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.193+0000 7ffb237fe640 1 --2- 172.21.15.99:0/1128007854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb240d1a00 0x7ffb240cd840 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb24071f40 tx=0x7ffb1c02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1dd4e56c9123fd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.193+0000 7ffb227fc640 1 -- 172.21.15.99:0/1128007854 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c02cb20 con 0x7ffb240d1a00 2023-12-12T09:19:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb227fc640 1 -- 172.21.15.99:0/1128007854 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c02cc80 con 0x7ffb240d1a00 2023-12-12T09:19:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb227fc640 1 -- 172.21.15.99:0/1128007854 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0343f0 con 0x7ffb240d1a00 2023-12-12T09:19:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb29872640 1 -- 172.21.15.99:0/1128007854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb240d1a00 msgr2=0x7ffb240cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb29872640 1 --2- 172.21.15.99:0/1128007854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb240d1a00 0x7ffb240cd840 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffb24071f40 tx=0x7ffb1c02bf80 comp rx=0 tx=0).stop 2023-12-12T09:19:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb29872640 1 -- 172.21.15.99:0/1128007854 shutdown_connections 2023-12-12T09:19:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb29872640 1 --2- 172.21.15.99:0/1128007854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb240d1a00 0x7ffb240cd840 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb29872640 1 --2- 172.21.15.99:0/1128007854 >> v2:172.21.15.84:3300/0 conn(0x7ffb2415b1d0 0x7ffb240cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb29872640 1 -- 172.21.15.99:0/1128007854 >> 172.21.15.99:0/1128007854 conn(0x7ffb240d0ee0 msgr2=0x7ffb240d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb29872640 1 -- 172.21.15.99:0/1128007854 shutdown_connections 2023-12-12T09:19:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.194+0000 7ffb29872640 1 -- 172.21.15.99:0/1128007854 wait complete. 2023-12-12T09:19:25.197 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:25.193+0000 7f0e59e45040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-12T09:19:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.196+0000 7ffb29872640 1 Processor -- start 2023-12-12T09:19:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.196+0000 7ffb29872640 1 -- start start 2023-12-12T09:19:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.197+0000 7ffb29872640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb240d1a00 0x7ffb2406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.197+0000 7ffb29872640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb2415b1d0 0x7ffb24158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.197+0000 7ffb29872640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb241e4c50 0x7ffb24155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.197+0000 7ffb29872640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb24158a70 con 0x7ffb2415b1d0 2023-12-12T09:19:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.197+0000 7ffb29872640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb24159440 con 0x7ffb241e4c50 2023-12-12T09:19:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.197+0000 7ffb29872640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240ca6d0 con 0x7ffb240d1a00 2023-12-12T09:19:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb241e4c50 0x7ffb24155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb22ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb240d1a00 0x7ffb2406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb241e4c50 0x7ffb24155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34116/0 (socket says 172.21.15.99:34116) 2023-12-12T09:19:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 -- 172.21.15.99:0/2076135853 learned_addr learned my addr 172.21.15.99:0/2076135853 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:25.200 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb1bfff640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb2415b1d0 0x7ffb24158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.200 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 -- 172.21.15.99:0/2076135853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb240d1a00 msgr2=0x7ffb2406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb240d1a00 0x7ffb2406cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 -- 172.21.15.99:0/2076135853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb2415b1d0 msgr2=0x7ffb24158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb2415b1d0 0x7ffb24158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 -- 172.21.15.99:0/2076135853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c009b30 con 0x7ffb241e4c50 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb22ffd640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb240d1a00 0x7ffb2406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.198+0000 7ffb237fe640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb241e4c50 0x7ffb24155550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009f40 tx=0x7ffb1c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.199+0000 7ffb20ff9640 1 -- 172.21.15.99:0/2076135853 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c007e70 con 0x7ffb241e4c50 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.199+0000 7ffb20ff9640 1 -- 172.21.15.99:0/2076135853 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c009510 con 0x7ffb241e4c50 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.199+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb240ca940 con 0x7ffb241e4c50 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.199+0000 7ffb20ff9640 1 -- 172.21.15.99:0/2076135853 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c03e690 con 0x7ffb241e4c50 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.199+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2406d540 con 0x7ffb241e4c50 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.199+0000 7ffb20ff9640 1 -- 172.21.15.99:0/2076135853 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffb1c03eaf0 con 0x7ffb241e4c50 2023-12-12T09:19:25.201 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.199+0000 7ffb20ff9640 1 -- 172.21.15.99:0/2076135853 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ffb1c03eda0 con 0x7ffb241e4c50 2023-12-12T09:19:25.202 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.200+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb24158c20 con 0x7ffb241e4c50 2023-12-12T09:19:25.203 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.202+0000 7ffb20ff9640 1 -- 172.21.15.99:0/2076135853 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ffb1c067ce0 con 0x7ffb241e4c50 2023-12-12T09:19:25.245 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:25.244+0000 7f0e59e45040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-12T09:19:25.282 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.281+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "067ae6ca-66a7-4152-9e03-01718c782591", "id": 6} v 0) v1 -- 0x7ffb24072eb0 con 0x7ffb241e4c50 2023-12-12T09:19:25.289 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.288+0000 7ffb20ff9640 1 -- 172.21.15.99:0/2076135853 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "067ae6ca-66a7-4152-9e03-01718c782591", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffb1c056070 con 0x7ffb241e4c50 2023-12-12T09:19:25.289 INFO:teuthology.orchestra.run.smithi099.stdout:6 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.289+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb241e4c50 msgr2=0x7ffb24155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.289+0000 7ffb29872640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb241e4c50 0x7ffb24155550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009f40 tx=0x7ffb1c004a40 comp rx=0 tx=0).stop 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.289+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 shutdown_connections 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.289+0000 7ffb29872640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb241e4c50 0x7ffb24155550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.289+0000 7ffb29872640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb2415b1d0 0x7ffb24158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.289+0000 7ffb29872640 1 --2- 172.21.15.99:0/2076135853 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb240d1a00 0x7ffb2406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.289+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 >> 172.21.15.99:0/2076135853 conn(0x7ffb240d0ee0 msgr2=0x7ffb240c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.290+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 shutdown_connections 2023-12-12T09:19:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.290+0000 7ffb29872640 1 -- 172.21.15.99:0/2076135853 wait complete. 2023-12-12T09:19:25.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 96538787-6328-4c1b-8fb9-8b6f1efe26ce 7 2023-12-12T09:19:25.370 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:25.369+0000 7fa915a45040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-12T09:19:25.403 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:25.401+0000 7f0e59e45040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-12T09:19:25.424 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:25.423+0000 7fa915a45040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-12T09:19:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.492+0000 7f641b59e640 1 Processor -- start 2023-12-12T09:19:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.492+0000 7f641b59e640 1 -- start start 2023-12-12T09:19:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.493+0000 7f641b59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cf890 0x7f641c0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.493+0000 7f641b59e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f641c0cec60 0x7f641c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.493+0000 7f641b59e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641c0cdc30 con 0x7f641c0d3590 2023-12-12T09:19:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.493+0000 7f641b59e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641c0d01b0 con 0x7f641c0cec60 2023-12-12T09:19:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.493+0000 7f641b59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0cdea0 con 0x7f641c0cf890 2023-12-12T09:19:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.493+0000 7f641a59c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cf890 0x7f641c0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f6413fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f641c0cec60 0x7f641c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f641ad9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f641c0d3590 0x7f641c160cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47380/0 (socket says 172.21.15.99:47380) 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f641ad9d640 1 -- 172.21.15.99:0/354703336 learned_addr learned my addr 172.21.15.99:0/354703336 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f641a59c640 1 -- 172.21.15.99:0/354703336 >> v2:172.21.15.99:3300/0 conn(0x7f641c0cec60 msgr2=0x7f641c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f641a59c640 1 --2- 172.21.15.99:0/354703336 >> v2:172.21.15.99:3300/0 conn(0x7f641c0cec60 0x7f641c0d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f6419d9b640 1 -- 172.21.15.99:0/354703336 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988299209 0 0) 0x7f641c0cdc30 con 0x7f641c0d3590 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f641a59c640 1 -- 172.21.15.99:0/354703336 >> v1:172.21.15.99:6789/0 conn(0x7f641c0d3590 legacy=0x7f641c160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f641a59c640 1 -- 172.21.15.99:0/354703336 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c0ce180 con 0x7f641c0cf890 2023-12-12T09:19:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.494+0000 7f6413fff640 1 --2- 172.21.15.99:0/354703336 >> v2:172.21.15.99:3300/0 conn(0x7f641c0cec60 0x7f641c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:19:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.495+0000 7f641a59c640 1 --2- 172.21.15.99:0/354703336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cf890 0x7f641c0cfc70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f640c0097a0 tx=0x7f640c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3311920ac104e03 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.495+0000 7f6419d9b640 1 -- 172.21.15.99:0/354703336 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c02d040 con 0x7f641c0cf890 2023-12-12T09:19:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.495+0000 7f6419d9b640 1 -- 172.21.15.99:0/354703336 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c031810 con 0x7f641c0cf890 2023-12-12T09:19:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.495+0000 7f6419d9b640 1 -- 172.21.15.99:0/354703336 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c031ba0 con 0x7f641c0cf890 2023-12-12T09:19:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.496+0000 7f641b59e640 1 -- 172.21.15.99:0/354703336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cf890 msgr2=0x7f641c0cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.496+0000 7f641b59e640 1 --2- 172.21.15.99:0/354703336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cf890 0x7f641c0cfc70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f640c0097a0 tx=0x7f640c02b8b0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.496+0000 7f641b59e640 1 -- 172.21.15.99:0/354703336 shutdown_connections 2023-12-12T09:19:25.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.496+0000 7f641b59e640 1 --2- 172.21.15.99:0/354703336 >> v2:172.21.15.99:3300/0 conn(0x7f641c0cec60 0x7f641c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.496+0000 7f641b59e640 1 --2- 172.21.15.99:0/354703336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cf890 0x7f641c0cfc70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.496+0000 7f641b59e640 1 -- 172.21.15.99:0/354703336 >> 172.21.15.99:0/354703336 conn(0x7f641c09c1f0 msgr2=0x7f641c0d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:25.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.496+0000 7f641b59e640 1 -- 172.21.15.99:0/354703336 shutdown_connections 2023-12-12T09:19:25.498 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.496+0000 7f641b59e640 1 -- 172.21.15.99:0/354703336 wait complete. 2023-12-12T09:19:25.499 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.498+0000 7f641b59e640 1 Processor -- start 2023-12-12T09:19:25.499 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.498+0000 7f641b59e640 1 -- start start 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f641b59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cec60 0x7f641c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f641b59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f641c0cf890 0x7f641c0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f641b59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c0d3590 0x7f641c0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f641b59e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0cd170 con 0x7f641c0d3590 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f641b59e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c15c510 con 0x7f641c0cf890 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f641b59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c1e5990 con 0x7f641c0cec60 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f6413fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f641c0cf890 0x7f641c0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f641a59c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cec60 0x7f641c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.500 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f6413fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f641c0cf890 0x7f641c0cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34136/0 (socket says 172.21.15.99:34136) 2023-12-12T09:19:25.501 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f6413fff640 1 -- 172.21.15.99:0/3707260736 learned_addr learned my addr 172.21.15.99:0/3707260736 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f6413fff640 1 -- 172.21.15.99:0/3707260736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cec60 msgr2=0x7f641c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f6413fff640 1 --2- 172.21.15.99:0/3707260736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cec60 0x7f641c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f641ad9d640 1 --2- 172.21.15.99:0/3707260736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c0d3590 0x7f641c0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f6413fff640 1 -- 172.21.15.99:0/3707260736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c0d3590 msgr2=0x7f641c0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f6413fff640 1 --2- 172.21.15.99:0/3707260736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c0d3590 0x7f641c0c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.499+0000 7f6413fff640 1 -- 172.21.15.99:0/3707260736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404009400 con 0x7f641c0cf890 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.500+0000 7f6413fff640 1 --2- 172.21.15.99:0/3707260736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f641c0cf890 0x7f641c0cc940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f640400ebe0 tx=0x7f640400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.500+0000 7f6412ffd640 1 -- 172.21.15.99:0/3707260736 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404009760 con 0x7f641c0cf890 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.500+0000 7f6412ffd640 1 -- 172.21.15.99:0/3707260736 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640400cc30 con 0x7f641c0cf890 2023-12-12T09:19:25.502 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.500+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c009400 con 0x7f641c0cf890 2023-12-12T09:19:25.503 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.500+0000 7f6412ffd640 1 -- 172.21.15.99:0/3707260736 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640400eee0 con 0x7f641c0cf890 2023-12-12T09:19:25.503 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.500+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641c1e5f50 con 0x7f641c0cf890 2023-12-12T09:19:25.503 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.500+0000 7f6412ffd640 1 -- 172.21.15.99:0/3707260736 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6404005c90 con 0x7f641c0cf890 2023-12-12T09:19:25.503 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.500+0000 7f6412ffd640 1 -- 172.21.15.99:0/3707260736 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6404013ad0 con 0x7f641c0cf890 2023-12-12T09:19:25.503 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.501+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c073100 con 0x7f641c0cf890 2023-12-12T09:19:25.504 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.503+0000 7f6412ffd640 1 -- 172.21.15.99:0/3707260736 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6404021060 con 0x7f641c0cf890 2023-12-12T09:19:25.582 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.581+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96538787-6328-4c1b-8fb9-8b6f1efe26ce", "id": 7} v 0) v1 -- 0x7f641c0673c0 con 0x7f641c0cf890 2023-12-12T09:19:25.592 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.591+0000 7f6412ffd640 1 -- 172.21.15.99:0/3707260736 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96538787-6328-4c1b-8fb9-8b6f1efe26ce", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6404017070 con 0x7f641c0cf890 2023-12-12T09:19:25.592 INFO:teuthology.orchestra.run.smithi099.stdout:7 2023-12-12T09:19:25.593 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:25.591+0000 7fa915a45040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-12T09:19:25.594 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.592+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f641c0cf890 msgr2=0x7f641c0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.594 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.592+0000 7f641b59e640 1 --2- 172.21.15.99:0/3707260736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f641c0cf890 0x7f641c0cc940 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f640400ebe0 tx=0x7f640400c520 comp rx=0 tx=0).stop 2023-12-12T09:19:25.594 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.593+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 shutdown_connections 2023-12-12T09:19:25.594 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.593+0000 7f641b59e640 1 --2- 172.21.15.99:0/3707260736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f641c0d3590 0x7f641c0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.594 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.593+0000 7f641b59e640 1 --2- 172.21.15.99:0/3707260736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f641c0cf890 0x7f641c0cc940 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.594 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.593+0000 7f641b59e640 1 --2- 172.21.15.99:0/3707260736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f641c0cec60 0x7f641c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.595 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.593+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 >> 172.21.15.99:0/3707260736 conn(0x7f641c09c1f0 msgr2=0x7f641c0b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:25.595 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.593+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 shutdown_connections 2023-12-12T09:19:25.595 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:19:25.593+0000 7f641b59e640 1 -- 172.21.15.99:0/3707260736 wait complete. 2023-12-12T09:19:25.609 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-12T09:19:25.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-12T09:19:25.616 INFO:tasks.ceph.osd.0:Started 2023-12-12T09:19:25.616 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-12T09:19:25.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-12T09:19:25.623 INFO:tasks.ceph.osd.1:Started 2023-12-12T09:19:25.623 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-12T09:19:25.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-12T09:19:25.629 INFO:tasks.ceph.osd.2:Started 2023-12-12T09:19:25.629 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-12T09:19:25.629 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-12T09:19:25.634 INFO:tasks.ceph.osd.3:Started 2023-12-12T09:19:25.634 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-12T09:19:25.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-12T09:19:25.643 INFO:tasks.ceph.osd.4:Started 2023-12-12T09:19:25.643 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-12T09:19:25.643 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-12T09:19:25.651 INFO:tasks.ceph.osd.5:Started 2023-12-12T09:19:25.651 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-12T09:19:25.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-12T09:19:25.657 INFO:tasks.ceph.osd.6:Started 2023-12-12T09:19:25.657 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-12T09:19:25.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-12T09:19:25.663 INFO:tasks.ceph.osd.7:Started 2023-12-12T09:19:25.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:25.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.870+0000 7fa562d48640 1 Processor -- start 2023-12-12T09:19:25.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.870+0000 7fa562d48640 1 -- start start 2023-12-12T09:19:25.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa562d48640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa55c15d490 0x7fa55c0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa562d48640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa55c0d1e00 0x7fa55c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa562d48640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0afd40 con 0x7fa55c0d3d60 2023-12-12T09:19:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa562d48640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0b0090 con 0x7fa55c0d1e00 2023-12-12T09:19:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa562d48640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0ce860 con 0x7fa55c15d490 2023-12-12T09:19:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa5612e5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa55c0d1e00 0x7fa55c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa5612e5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa55c0d1e00 0x7fa55c0b04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42466/0 (socket says 172.21.15.84:42466) 2023-12-12T09:19:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa5612e5640 1 -- 172.21.15.84:0/339850459 learned_addr learned my addr 172.21.15.84:0/339850459 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:25.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.871+0000 7fa560ae4640 1 --2- 172.21.15.84:0/339850459 >> v2:172.21.15.99:3300/0 conn(0x7fa55c15d490 0x7fa55c0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.872+0000 7fa5612e5640 1 -- 172.21.15.84:0/339850459 >> v2:172.21.15.99:3300/0 conn(0x7fa55c15d490 msgr2=0x7fa55c0d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.872+0000 7fa5612e5640 1 --2- 172.21.15.84:0/339850459 >> v2:172.21.15.99:3300/0 conn(0x7fa55c15d490 0x7fa55c0d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.872+0000 7fa5612e5640 1 -- 172.21.15.84:0/339850459 >> v1:172.21.15.84:6789/0 conn(0x7fa55c0d3d60 legacy=0x7fa55c0d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.872+0000 7fa5612e5640 1 -- 172.21.15.84:0/339850459 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0ceb40 con 0x7fa55c0d1e00 2023-12-12T09:19:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.873+0000 7fa5612e5640 1 --2- 172.21.15.84:0/339850459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d1e00 0x7fa55c0b04b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0b5cd0 tx=0x7fa55402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae45fa3e2f6db1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.873+0000 7fa55b7fe640 1 -- 172.21.15.84:0/339850459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55402c9f0 con 0x7fa55c0d1e00 2023-12-12T09:19:25.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.873+0000 7fa55b7fe640 1 -- 172.21.15.84:0/339850459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55402cb50 con 0x7fa55c0d1e00 2023-12-12T09:19:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.873+0000 7fa55b7fe640 1 -- 172.21.15.84:0/339850459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540343f0 con 0x7fa55c0d1e00 2023-12-12T09:19:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.874+0000 7fa562d48640 1 -- 172.21.15.84:0/339850459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d1e00 msgr2=0x7fa55c0b04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.874+0000 7fa562d48640 1 --2- 172.21.15.84:0/339850459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d1e00 0x7fa55c0b04b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0b5cd0 tx=0x7fa55402be50 comp rx=0 tx=0).stop 2023-12-12T09:19:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.874+0000 7fa562d48640 1 -- 172.21.15.84:0/339850459 shutdown_connections 2023-12-12T09:19:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.874+0000 7fa562d48640 1 --2- 172.21.15.84:0/339850459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d1e00 0x7fa55c0b04b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.874+0000 7fa562d48640 1 --2- 172.21.15.84:0/339850459 >> v2:172.21.15.99:3300/0 conn(0x7fa55c15d490 0x7fa55c0d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.874+0000 7fa562d48640 1 -- 172.21.15.84:0/339850459 >> 172.21.15.84:0/339850459 conn(0x7fa55c09c450 msgr2=0x7fa55c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:25.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.874+0000 7fa562d48640 1 -- 172.21.15.84:0/339850459 shutdown_connections 2023-12-12T09:19:25.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.874+0000 7fa562d48640 1 -- 172.21.15.84:0/339850459 wait complete. 2023-12-12T09:19:25.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.876+0000 7fa562d48640 1 Processor -- start 2023-12-12T09:19:25.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.876+0000 7fa562d48640 1 -- start start 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa562d48640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa55c0d1e00 0x7fa55c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa562d48640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d3d60 0x7fa55c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa562d48640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa55c15d490 0x7fa55c0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa562d48640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0b6290 con 0x7fa55c0d3d60 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa562d48640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c1f6a80 con 0x7fa55c0d1e00 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa562d48640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c1f6f10 con 0x7fa55c15d490 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa55bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d3d60 0x7fa55c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa5612e5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa55c15d490 0x7fa55c0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa560ae4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa55c0d1e00 0x7fa55c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa55bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d3d60 0x7fa55c06c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58576/0 (socket says 172.21.15.84:58576) 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa5612e5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa55c15d490 0x7fa55c0c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:57994/0 (socket says 172.21.15.84:57994) 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa55bfff640 1 -- 172.21.15.84:0/2131056311 learned_addr learned my addr 172.21.15.84:0/2131056311 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa560ae4640 1 -- 172.21.15.84:0/2131056311 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa55c15d490 msgr2=0x7fa55c0c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa560ae4640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa55c15d490 0x7fa55c0c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa560ae4640 1 -- 172.21.15.84:0/2131056311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d3d60 msgr2=0x7fa55c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa560ae4640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d3d60 0x7fa55c06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.877+0000 7fa560ae4640 1 -- 172.21.15.84:0/2131056311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554009b30 con 0x7fa55c0d1e00 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.878+0000 7fa5612e5640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa55c15d490 0x7fa55c0c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.878+0000 7fa55bfff640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d3d60 0x7fa55c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:19:25.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.878+0000 7fa560ae4640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa55c0d1e00 0x7fa55c06c280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa55000e870 tx=0x7fa55000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.878+0000 7fa5597fa640 1 -- 172.21.15.84:0/2131056311 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000ee60 con 0x7fa55c0d1e00 2023-12-12T09:19:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.878+0000 7fa5597fa640 1 -- 172.21.15.84:0/2131056311 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55000c940 con 0x7fa55c0d1e00 2023-12-12T09:19:25.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.878+0000 7fa5597fa640 1 -- 172.21.15.84:0/2131056311 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000ccd0 con 0x7fa55c0d1e00 2023-12-12T09:19:25.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.879+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c1f6150 con 0x7fa55c0d1e00 2023-12-12T09:19:25.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.879+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c1f6710 con 0x7fa55c0d1e00 2023-12-12T09:19:25.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.879+0000 7fa5597fa640 1 -- 172.21.15.84:0/2131056311 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa550005c90 con 0x7fa55c0d1e00 2023-12-12T09:19:25.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.879+0000 7fa5597fa640 1 -- 172.21.15.84:0/2131056311 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa55000ce30 con 0x7fa55c0d1e00 2023-12-12T09:19:25.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.880+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c072b80 con 0x7fa55c0d1e00 2023-12-12T09:19:25.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.882+0000 7fa5597fa640 1 -- 172.21.15.84:0/2131056311 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa550021060 con 0x7fa55c0d1e00 2023-12-12T09:19:25.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.946+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa55c0673c0 con 0x7fa55c0d1e00 2023-12-12T09:19:25.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.947+0000 7fa5597fa640 1 -- 172.21.15.84:0/2131056311 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa550029020 con 0x7fa55c0d1e00 2023-12-12T09:19:25.948 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:25.948 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:25.584361+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa55c0d1e00 msgr2=0x7fa55c06c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa55c0d1e00 0x7fa55c06c280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa55000e870 tx=0x7fa55000ed30 comp rx=0 tx=0).stop 2023-12-12T09:19:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 shutdown_connections 2023-12-12T09:19:25.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa55c15d490 0x7fa55c0c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa55c0d3d60 0x7fa55c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 --2- 172.21.15.84:0/2131056311 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa55c0d1e00 0x7fa55c06c280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 >> 172.21.15.84:0/2131056311 conn(0x7fa55c09c450 msgr2=0x7fa55c15c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 shutdown_connections 2023-12-12T09:19:25.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:25.948+0000 7fa562d48640 1 -- 172.21.15.84:0/2131056311 wait complete. 2023-12-12T09:19:25.965 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-12T09:19:25.965 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-12T09:19:26.334 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-12-12T09:19:26.333+0000 7f1f4c5ad500 -1 Falling back to public interface 2023-12-12T09:19:26.339 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-12-12T09:19:26.338+0000 7fe7b0c0c500 -1 Falling back to public interface 2023-12-12T09:19:26.344 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-12-12T09:19:26.343+0000 7f7a7ca12500 -1 Falling back to public interface 2023-12-12T09:19:26.351 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-12-12T09:19:26.350+0000 7fe752d1a500 -1 Falling back to public interface 2023-12-12T09:19:26.361 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-12-12T09:19:26.360+0000 7f2edc6da500 -1 Falling back to public interface 2023-12-12T09:19:26.362 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-12-12T09:19:26.361+0000 7f8af6e0e500 -1 Falling back to public interface 2023-12-12T09:19:26.386 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-12-12T09:19:26.385+0000 7f1f54ba9500 -1 Falling back to public interface 2023-12-12T09:19:26.395 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-12-12T09:19:26.394+0000 7f6884337500 -1 Falling back to public interface 2023-12-12T09:19:26.522 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:26.520+0000 7f0e59e45040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-12T09:19:26.664 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:26.663+0000 7fa915a45040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-12T09:19:26.771 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:26.849 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:26.849+0000 7f0e59e45040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-12T09:19:26.912 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:26.912+0000 7f0e59e45040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-12T09:19:26.937 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.937+0000 7f915cf33640 1 Processor -- start 2023-12-12T09:19:26.938 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.938+0000 7f915cf33640 1 -- start start 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915cf33640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9158143970 0x7f91580ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915cf33640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f915815e230 0x7f9158070210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915cf33640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580b3790 con 0x7f91580b2d10 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915cf33640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91580cd740 con 0x7f9158143970 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915cf33640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9158143d50 con 0x7f915815e230 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9158143970 0x7f91580ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9158143970 0x7f91580ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58588/0 (socket says 172.21.15.84:58588) 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915659c640 1 -- 172.21.15.84:0/1346944705 learned_addr learned my addr 172.21.15.84:0/1346944705 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:26.940 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f9156d9d640 1 --2- 172.21.15.84:0/1346944705 >> v2:172.21.15.99:3300/0 conn(0x7f915815e230 0x7f9158070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:26.941 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915659c640 1 -- 172.21.15.84:0/1346944705 >> v2:172.21.15.99:3300/0 conn(0x7f915815e230 msgr2=0x7f9158070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:26.941 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915659c640 1 --2- 172.21.15.84:0/1346944705 >> v2:172.21.15.99:3300/0 conn(0x7f915815e230 0x7f9158070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:26.941 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915659c640 1 -- 172.21.15.84:0/1346944705 >> v1:172.21.15.99:6789/0 conn(0x7f91580b2d10 legacy=0x7f915815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:26.941 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.939+0000 7f915659c640 1 -- 172.21.15.84:0/1346944705 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91580cd950 con 0x7f9158143970 2023-12-12T09:19:26.942 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.940+0000 7f915659c640 1 --2- 172.21.15.84:0/1346944705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9158143970 0x7f91580ce710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f91580b46a0 tx=0x7f914802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fec4239203100b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:26.942 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.941+0000 7f915559a640 1 -- 172.21.15.84:0/1346944705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148031870 con 0x7f9158143970 2023-12-12T09:19:26.942 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.941+0000 7f915559a640 1 -- 172.21.15.84:0/1346944705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91480319d0 con 0x7f9158143970 2023-12-12T09:19:26.942 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.941+0000 7f915559a640 1 -- 172.21.15.84:0/1346944705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148031d60 con 0x7f9158143970 2023-12-12T09:19:26.942 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.941+0000 7f915cf33640 1 -- 172.21.15.84:0/1346944705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9158143970 msgr2=0x7f91580ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:26.942 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.941+0000 7f915cf33640 1 --2- 172.21.15.84:0/1346944705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9158143970 0x7f91580ce710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f91580b46a0 tx=0x7f914802b910 comp rx=0 tx=0).stop 2023-12-12T09:19:26.942 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.942+0000 7f915cf33640 1 -- 172.21.15.84:0/1346944705 shutdown_connections 2023-12-12T09:19:26.942 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.942+0000 7f915cf33640 1 --2- 172.21.15.84:0/1346944705 >> v2:172.21.15.99:3300/0 conn(0x7f915815e230 0x7f9158070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:26.943 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.942+0000 7f915cf33640 1 --2- 172.21.15.84:0/1346944705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9158143970 0x7f91580ce710 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:26.943 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.942+0000 7f915cf33640 1 -- 172.21.15.84:0/1346944705 >> 172.21.15.84:0/1346944705 conn(0x7f915806a500 msgr2=0x7f915806a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:26.943 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.942+0000 7f915cf33640 1 -- 172.21.15.84:0/1346944705 shutdown_connections 2023-12-12T09:19:26.943 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.942+0000 7f915cf33640 1 -- 172.21.15.84:0/1346944705 wait complete. 2023-12-12T09:19:26.943 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.943+0000 7f915cf33640 1 Processor -- start 2023-12-12T09:19:26.943 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.943+0000 7f915cf33640 1 -- start start 2023-12-12T09:19:26.946 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.944+0000 7f915cf33640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91580b2d10 0x7f91580aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:26.946 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.944+0000 7f915cf33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158143970 0x7f91581530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:26.946 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.944+0000 7f915cf33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f915815e230 0x7f9158159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:26.946 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.944+0000 7f915cf33640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158154510 con 0x7f915815e230 2023-12-12T09:19:26.946 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.944+0000 7f915cf33640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158153900 con 0x7f9158143970 2023-12-12T09:19:26.946 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.944+0000 7f915cf33640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9158153be0 con 0x7f91580b2d10 2023-12-12T09:19:26.946 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f915815e230 0x7f9158159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:26.946 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f915815e230 0x7f9158159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58594/0 (socket says 172.21.15.84:58594) 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 -- 172.21.15.84:0/1222690489 learned_addr learned my addr 172.21.15.84:0/1222690489 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9155d9b640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158143970 0x7f91581530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f915659c640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91580b2d10 0x7f91580aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 -- 172.21.15.84:0/1222690489 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91580b2d10 msgr2=0x7f91580aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91580b2d10 0x7f91580aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 -- 172.21.15.84:0/1222690489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158143970 msgr2=0x7f91581530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158143970 0x7f91581530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 -- 172.21.15.84:0/1222690489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91480094d0 con 0x7f915815e230 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9156d9d640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f915815e230 0x7f9158159270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9150007e40 tx=0x7f915000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.945+0000 7f9146ffd640 1 -- 172.21.15.84:0/1222690489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150014620 con 0x7f915815e230 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.946+0000 7f9146ffd640 1 -- 172.21.15.84:0/1222690489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000ee90 con 0x7f915815e230 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.946+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9158153ec0 con 0x7f915815e230 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.946+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91581535f0 con 0x7f915815e230 2023-12-12T09:19:26.947 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.946+0000 7f9146ffd640 1 -- 172.21.15.84:0/1222690489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500149e0 con 0x7f915815e230 2023-12-12T09:19:26.948 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.946+0000 7f9146ffd640 1 -- 172.21.15.84:0/1222690489 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f915001e460 con 0x7f915815e230 2023-12-12T09:19:26.948 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.946+0000 7f9146ffd640 1 -- 172.21.15.84:0/1222690489 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f915001db30 con 0x7f915815e230 2023-12-12T09:19:26.948 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.947+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91580abf00 con 0x7f915815e230 2023-12-12T09:19:26.950 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:26.950+0000 7f9146ffd640 1 -- 172.21.15.84:0/1222690489 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f915001dd90 con 0x7f915815e230 2023-12-12T09:19:26.973 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:26.972+0000 7fa915a45040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-12T09:19:27.032 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.031+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f915815e840 con 0x7f915815e230 2023-12-12T09:19:27.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.032+0000 7f9146ffd640 1 -- 172.21.15.84:0/1222690489 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f915001d460 con 0x7f915815e230 2023-12-12T09:19:27.033 INFO:teuthology.misc.health.smithi084.stdout: 2023-12-12T09:19:27.033 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:25.584361+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:27.034 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:27.032+0000 7fa915a45040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-12T09:19:27.035 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.033+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f915815e230 msgr2=0x7f9158159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:27.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.033+0000 7f915cf33640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f915815e230 0x7f9158159270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9150007e40 tx=0x7f915000e4b0 comp rx=0 tx=0).stop 2023-12-12T09:19:27.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.033+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 shutdown_connections 2023-12-12T09:19:27.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.033+0000 7f915cf33640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f915815e230 0x7f9158159270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:27.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.033+0000 7f915cf33640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158143970 0x7f91581530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:27.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.033+0000 7f915cf33640 1 --2- 172.21.15.84:0/1222690489 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91580b2d10 0x7f91580aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:27.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.033+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 >> 172.21.15.84:0/1222690489 conn(0x7f915806a500 msgr2=0x7f91580af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:27.037 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.034+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 shutdown_connections 2023-12-12T09:19:27.037 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:27.034+0000 7f915cf33640 1 -- 172.21.15.84:0/1222690489 wait complete. 2023-12-12T09:19:27.046 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-12T09:19:27.049 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:27.050+0000 7f0e59e45040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-12T09:19:27.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:19:27.063 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:19:27.160 INFO:tasks.ceph.mgr.x.smithi099.stderr:2023-12-12T09:19:27.158+0000 7fa915a45040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-12T09:19:28.088 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:28.088+0000 7f0dfb1c8640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-12T09:19:28.093 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-12-12T09:19:28.093+0000 7f0dfb1c8640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-12T09:19:29.654 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-12-12T09:19:29.653+0000 7f1f4c5ad500 -1 osd.4 0 log_to_monitors true 2023-12-12T09:19:29.678 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-12-12T09:19:29.678+0000 7f2edc6da500 -1 osd.1 0 log_to_monitors true 2023-12-12T09:19:29.888 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-12-12T09:19:29.887+0000 7f7a7ca12500 -1 osd.7 0 log_to_monitors true 2023-12-12T09:19:29.921 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-12-12T09:19:29.921+0000 7f8af6e0e500 -1 osd.0 0 log_to_monitors true 2023-12-12T09:19:29.940 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-12-12T09:19:29.940+0000 7fe752d1a500 -1 osd.2 0 log_to_monitors true 2023-12-12T09:19:29.948 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-12-12T09:19:29.947+0000 7f1f54ba9500 -1 osd.6 0 log_to_monitors true 2023-12-12T09:19:29.977 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-12-12T09:19:29.976+0000 7f6884337500 -1 osd.5 0 log_to_monitors true 2023-12-12T09:19:30.104 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-12-12T09:19:30.104+0000 7fe7b0c0c500 -1 osd.3 0 log_to_monitors true 2023-12-12T09:19:33.205 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-12-12T09:19:33.203+0000 7f2ed8668640 -1 osd.1 0 waiting for initial osdmap 2023-12-12T09:19:33.215 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-12-12T09:19:33.215+0000 7f2ed048f640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:19:33.233 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-12-12T09:19:33.233+0000 7fe74eca8640 -1 osd.2 0 waiting for initial osdmap 2023-12-12T09:19:33.236 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-12-12T09:19:33.236+0000 7f8af2d9c640 -1 osd.0 0 waiting for initial osdmap 2023-12-12T09:19:33.237 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-12-12T09:19:33.237+0000 7fe746acf640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:19:33.256 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-12-12T09:19:33.256+0000 7f8aeabc3640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:19:33.517 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-12-12T09:19:33.517+0000 7f1f50b37640 -1 osd.6 0 waiting for initial osdmap 2023-12-12T09:19:33.528 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-12-12T09:19:33.529+0000 7f1f4853d640 -1 osd.4 0 waiting for initial osdmap 2023-12-12T09:19:33.531 INFO:tasks.ceph.osd.6.smithi099.stderr:2023-12-12T09:19:33.528+0000 7f1f4895e640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:19:33.534 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-12-12T09:19:33.534+0000 7f7a78309640 -1 osd.7 0 waiting for initial osdmap 2023-12-12T09:19:33.536 INFO:tasks.ceph.osd.4.smithi099.stderr:2023-12-12T09:19:33.537+0000 7f1f40364640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:19:33.542 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-12-12T09:19:33.542+0000 7fe7acd46640 -1 osd.3 0 waiting for initial osdmap 2023-12-12T09:19:33.544 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-12-12T09:19:33.544+0000 7f6880ad9640 -1 osd.5 0 waiting for initial osdmap 2023-12-12T09:19:33.544 INFO:tasks.ceph.osd.7.smithi099.stderr:2023-12-12T09:19:33.544+0000 7f7a70130640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:19:33.549 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-12-12T09:19:33.549+0000 7fe7a4359640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:19:33.551 INFO:tasks.ceph.osd.5.smithi099.stderr:2023-12-12T09:19:33.551+0000 7f68780ec640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T09:19:33.851 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:34.030 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.030+0000 7f22d40f3640 1 Processor -- start 2023-12-12T09:19:34.031 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.030+0000 7f22d40f3640 1 -- start start 2023-12-12T09:19:34.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.032+0000 7f22d40f3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22cc155760 0x7f22cc0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.032+0000 7f22d40f3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc15c3d0 con 0x7f22cc0ccdd0 2023-12-12T09:19:34.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.032+0000 7f22d40f3640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc0b3280 con 0x7f22cc15bf20 2023-12-12T09:19:34.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.032+0000 7f22d40f3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0b3f00 con 0x7f22cc155760 2023-12-12T09:19:34.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.032+0000 7f22d1e8f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22cc155760 0x7f22cc0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.032+0000 7f22d2690640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f22cc0ccdd0 0x7f22cc06c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54992/0 (socket says 172.21.15.84:54992) 2023-12-12T09:19:34.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.032+0000 7f22d2690640 1 -- 172.21.15.84:0/2074635546 learned_addr learned my addr 172.21.15.84:0/2074635546 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:34.033 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.032+0000 7f22d1e8f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22cc155760 0x7f22cc0ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58704/0 (socket says 172.21.15.84:58704) 2023-12-12T09:19:34.034 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.033+0000 7f22d1e8f640 1 -- 172.21.15.84:0/2074635546 >> v1:172.21.15.99:6789/0 conn(0x7f22cc15bf20 legacy=0x7f22cc0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:34.034 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.033+0000 7f22d1e8f640 1 -- 172.21.15.84:0/2074635546 >> v1:172.21.15.84:6789/0 conn(0x7f22cc0ccdd0 legacy=0x7f22cc06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.034 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.033+0000 7f22d1e8f640 1 -- 172.21.15.84:0/2074635546 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0b3560 con 0x7f22cc155760 2023-12-12T09:19:34.034 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.033+0000 7f22d0e8d640 1 -- 172.21.15.84:0/2074635546 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198859881 0 0) 0x7f22cc15c3d0 con 0x7f22cc0ccdd0 2023-12-12T09:19:34.034 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.034+0000 7f22d1e8f640 1 --2- 172.21.15.84:0/2074635546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc0ce820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009d90 tx=0x7f22c002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a01685ffced7af server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.035 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d0e8d640 1 -- 172.21.15.84:0/2074635546 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c002cbd0 con 0x7f22cc155760 2023-12-12T09:19:34.035 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d0e8d640 1 -- 172.21.15.84:0/2074635546 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c002cd30 con 0x7f22cc155760 2023-12-12T09:19:34.035 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d0e8d640 1 -- 172.21.15.84:0/2074635546 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c002cea0 con 0x7f22cc155760 2023-12-12T09:19:34.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d40f3640 1 -- 172.21.15.84:0/2074635546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 msgr2=0x7f22cc0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d40f3640 1 --2- 172.21.15.84:0/2074635546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc0ce820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009d90 tx=0x7f22c002be20 comp rx=0 tx=0).stop 2023-12-12T09:19:34.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d40f3640 1 -- 172.21.15.84:0/2074635546 shutdown_connections 2023-12-12T09:19:34.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d40f3640 1 --2- 172.21.15.84:0/2074635546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc0ce820 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d40f3640 1 -- 172.21.15.84:0/2074635546 >> 172.21.15.84:0/2074635546 conn(0x7f22cc06a500 msgr2=0x7f22cc06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:34.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.035+0000 7f22d40f3640 1 -- 172.21.15.84:0/2074635546 shutdown_connections 2023-12-12T09:19:34.036 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.036+0000 7f22d40f3640 1 -- 172.21.15.84:0/2074635546 wait complete. 2023-12-12T09:19:34.037 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.037+0000 7f22d40f3640 1 Processor -- start 2023-12-12T09:19:34.037 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.037+0000 7f22d40f3640 1 -- start start 2023-12-12T09:19:34.039 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.038+0000 7f22d40f3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22cc0ccdd0 0x7f22cc14f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.039 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.038+0000 7f22d40f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.039 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.038+0000 7f22d40f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22cc15bf20 0x7f22cc1386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.039 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.038+0000 7f22d40f3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc14f590 con 0x7f22cc155760 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.038+0000 7f22d40f3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc14dfb0 con 0x7f22cc15bf20 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.038+0000 7f22d40f3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc14e290 con 0x7f22cc0ccdd0 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc137d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58714/0 (socket says 172.21.15.84:58714) 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 -- 172.21.15.84:0/3476921435 learned_addr learned my addr 172.21.15.84:0/3476921435 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 -- 172.21.15.84:0/3476921435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22cc0ccdd0 msgr2=0x7f22cc14f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d1e8f640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22cc0ccdd0 0x7f22cc14f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d2690640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22cc15bf20 0x7f22cc1386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22cc0ccdd0 0x7f22cc14f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 -- 172.21.15.84:0/3476921435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22cc15bf20 msgr2=0x7f22cc1386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22cc15bf20 0x7f22cc1386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 -- 172.21.15.84:0/3476921435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0009a70 con 0x7f22cc155760 2023-12-12T09:19:34.040 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22d168e640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc137d00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f22b800b3f0 tx=0x7f22b800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.041 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.039+0000 7f22ca7fc640 1 -- 172.21.15.84:0/3476921435 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011830 con 0x7f22cc155760 2023-12-12T09:19:34.041 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.040+0000 7f22ca7fc640 1 -- 172.21.15.84:0/3476921435 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8011990 con 0x7f22cc155760 2023-12-12T09:19:34.041 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.040+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc14e570 con 0x7f22cc155760 2023-12-12T09:19:34.041 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.040+0000 7f22ca7fc640 1 -- 172.21.15.84:0/3476921435 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011d40 con 0x7f22cc155760 2023-12-12T09:19:34.042 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.040+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc14eb30 con 0x7f22cc155760 2023-12-12T09:19:34.042 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.041+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc14ed20 con 0x7f22cc155760 2023-12-12T09:19:34.042 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.041+0000 7f22ca7fc640 1 -- 172.21.15.84:0/3476921435 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f22b801a400 con 0x7f22cc155760 2023-12-12T09:19:34.042 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.042+0000 7f22ca7fc640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b006adb0 0x7f22b006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.043 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.042+0000 7f22ca7fc640 1 -- 172.21.15.84:0/3476921435 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f22b8088750 con 0x7f22cc155760 2023-12-12T09:19:34.043 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.043+0000 7f22d1e8f640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b006adb0 0x7f22b006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.043 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.043+0000 7f22d1e8f640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b006adb0 0x7f22b006d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22c0036000 tx=0x7f22c0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.047 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.047+0000 7f22ca7fc640 1 -- 172.21.15.84:0/3476921435 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22b8054540 con 0x7f22cc155760 2023-12-12T09:19:34.245 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.244+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22cc0673c0 con 0x7f22cc155760 2023-12-12T09:19:34.246 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.245+0000 7f22ca7fc640 1 -- 172.21.15.84:0/3476921435 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10824 (secure 0 0 0) 0x7f22b8015070 con 0x7f22cc155760 2023-12-12T09:19:34.246 INFO:teuthology.misc.health.smithi084.stdout: 2023-12-12T09:19:34.246 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":14,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:34.202127+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:34.248 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b006adb0 msgr2=0x7f22b006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.248 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b006adb0 0x7f22b006d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22c0036000 tx=0x7f22c0030000 comp rx=0 tx=0).stop 2023-12-12T09:19:34.248 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 msgr2=0x7f22cc137d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.248 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc137d00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f22b800b3f0 tx=0x7f22b800b8b0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.249 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 shutdown_connections 2023-12-12T09:19:34.249 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22cc15bf20 0x7f22cc1386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.249 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b006adb0 0x7f22b006d270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.249 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22cc155760 0x7f22cc137d00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.249 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 --2- 172.21.15.84:0/3476921435 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22cc0ccdd0 0x7f22cc14f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.249 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.247+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 >> 172.21.15.84:0/3476921435 conn(0x7f22cc06a500 msgr2=0x7f22cc159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:34.249 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.248+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 shutdown_connections 2023-12-12T09:19:34.249 INFO:teuthology.misc.health.smithi084.stderr:2023-12-12T09:19:34.248+0000 7f22d40f3640 1 -- 172.21.15.84:0/3476921435 wait complete. 2023-12-12T09:19:34.260 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-12T09:19:34.261 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-12T09:19:34.261 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T09:19:34.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T09:19:34.268 INFO:tasks.ceph.mds.a:Started 2023-12-12T09:19:34.268 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T09:19:34.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T09:19:34.275 INFO:tasks.ceph.mds.c:Started 2023-12-12T09:19:34.275 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T09:19:34.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T09:19:34.285 INFO:tasks.ceph.mds.b:Started 2023-12-12T09:19:34.285 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T09:19:34.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T09:19:34.294 INFO:tasks.ceph.mds.d:Started 2023-12-12T09:19:34.294 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-12T09:19:34.294 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:34.413 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-12-12T09:19:34.420 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-12-12T09:19:34.438 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2023-12-12T09:19:34.445 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2023-12-12T09:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.470+0000 7f2bfb64b640 1 Processor -- start 2023-12-12T09:19:34.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.471+0000 7f2bfb64b640 1 -- start start 2023-12-12T09:19:34.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bfb64b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2bf415d490 0x7f2bf40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bfb64b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf40d3d60 0x7f2bf40d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bfb64b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bf40d1c30 0x7f2bf40cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bfb64b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf40b0090 con 0x7f2bf40d1c30 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bfb64b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf40d20a0 con 0x7f2bf415d490 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bfb64b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40afd40 con 0x7f2bf40d3d60 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf9be8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bf40d1c30 0x7f2bf40cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf9be8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2bf40d1c30 0x7f2bf40cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58750/0 (socket says 172.21.15.84:58750) 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf9be8640 1 -- 172.21.15.84:0/4277842029 learned_addr learned my addr 172.21.15.84:0/4277842029 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf93e7640 1 --2- 172.21.15.84:0/4277842029 >> v2:172.21.15.99:3300/0 conn(0x7f2bf415d490 0x7f2bf40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf8be6640 1 --2- 172.21.15.84:0/4277842029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf40d3d60 0x7f2bf40d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf9be8640 1 -- 172.21.15.84:0/4277842029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf40d3d60 msgr2=0x7f2bf40d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:34.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf9be8640 1 --2- 172.21.15.84:0/4277842029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf40d3d60 0x7f2bf40d16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf9be8640 1 -- 172.21.15.84:0/4277842029 >> v2:172.21.15.99:3300/0 conn(0x7f2bf415d490 msgr2=0x7f2bf40d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:34.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf9be8640 1 --2- 172.21.15.84:0/4277842029 >> v2:172.21.15.99:3300/0 conn(0x7f2bf415d490 0x7f2bf40d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.472+0000 7f2bf9be8640 1 -- 172.21.15.84:0/4277842029 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40ce860 con 0x7f2bf40d1c30 2023-12-12T09:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.473+0000 7f2bf9be8640 1 --2- 172.21.15.84:0/4277842029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d1c30 0x7f2bf40cf740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40b5cd0 tx=0x7f2bec02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1234578d8bef0bba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2be7fff640 1 -- 172.21.15.84:0/4277842029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec02c9f0 con 0x7f2bf40d1c30 2023-12-12T09:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2be7fff640 1 -- 172.21.15.84:0/4277842029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec02cb50 con 0x7f2bf40d1c30 2023-12-12T09:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2be7fff640 1 -- 172.21.15.84:0/4277842029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0343f0 con 0x7f2bf40d1c30 2023-12-12T09:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 -- 172.21.15.84:0/4277842029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d1c30 msgr2=0x7f2bf40cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/4277842029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d1c30 0x7f2bf40cf740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40b5cd0 tx=0x7f2bec02be50 comp rx=0 tx=0).stop 2023-12-12T09:19:34.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 -- 172.21.15.84:0/4277842029 shutdown_connections 2023-12-12T09:19:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/4277842029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d1c30 0x7f2bf40cf740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/4277842029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf40d3d60 0x7f2bf40d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/4277842029 >> v2:172.21.15.99:3300/0 conn(0x7f2bf415d490 0x7f2bf40d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 -- 172.21.15.84:0/4277842029 >> 172.21.15.84:0/4277842029 conn(0x7f2bf409c450 msgr2=0x7f2bf40d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 -- 172.21.15.84:0/4277842029 shutdown_connections 2023-12-12T09:19:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.474+0000 7f2bfb64b640 1 -- 172.21.15.84:0/4277842029 wait complete. 2023-12-12T09:19:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.476+0000 7f2bfb64b640 1 Processor -- start 2023-12-12T09:19:34.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.476+0000 7f2bfb64b640 1 -- start start 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bfb64b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bf40d1c30 0x7f2bf40cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bfb64b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d3d60 0x7f2bf40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bfb64b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf415d490 0x7f2bf4160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bfb64b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf4160740 con 0x7f2bf40d3d60 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bfb64b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40ca360 con 0x7f2bf40d1c30 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bfb64b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40ca640 con 0x7f2bf415d490 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf8be6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d3d60 0x7f2bf40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf8be6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d3d60 0x7f2bf40cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58764/0 (socket says 172.21.15.84:58764) 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf8be6640 1 -- 172.21.15.84:0/1287584789 learned_addr learned my addr 172.21.15.84:0/1287584789 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:34.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf9be8640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf415d490 0x7f2bf4160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf93e7640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bf40d1c30 0x7f2bf40cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf8be6640 1 -- 172.21.15.84:0/1287584789 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf415d490 msgr2=0x7f2bf4160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf8be6640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf415d490 0x7f2bf4160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf8be6640 1 -- 172.21.15.84:0/1287584789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bf40d1c30 msgr2=0x7f2bf40cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf8be6640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bf40d1c30 0x7f2bf40cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.477+0000 7f2bf8be6640 1 -- 172.21.15.84:0/1287584789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009b30 con 0x7f2bf40d3d60 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.478+0000 7f2bf8be6640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d3d60 0x7f2bf40cb120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2be800d800 tx=0x7f2be800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.478+0000 7f2be5ffb640 1 -- 172.21.15.84:0/1287584789 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80096a0 con 0x7f2bf40d3d60 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.478+0000 7f2be5ffb640 1 -- 172.21.15.84:0/1287584789 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be8009800 con 0x7f2bf40d3d60 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.478+0000 7f2be5ffb640 1 -- 172.21.15.84:0/1287584789 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8009990 con 0x7f2bf40d3d60 2023-12-12T09:19:34.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.478+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf40ca920 con 0x7f2bf40d3d60 2023-12-12T09:19:34.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.478+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf4152610 con 0x7f2bf40d3d60 2023-12-12T09:19:34.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.479+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf4072b80 con 0x7f2bf40d3d60 2023-12-12T09:19:34.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.480+0000 7f2be5ffb640 1 -- 172.21.15.84:0/1287584789 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f2be8009af0 con 0x7f2bf40d3d60 2023-12-12T09:19:34.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.481+0000 7f2be5ffb640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bd806adb0 0x7f2bd806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.481+0000 7f2be5ffb640 1 -- 172.21.15.84:0/1287584789 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f2be8089520 con 0x7f2bf40d3d60 2023-12-12T09:19:34.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.481+0000 7f2bf93e7640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bd806adb0 0x7f2bd806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.481+0000 7f2bf93e7640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bd806adb0 0x7f2bd806d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006fd0 tx=0x7f2bf0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.485+0000 7f2be5ffb640 1 -- 172.21.15.84:0/1287584789 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2be8054b70 con 0x7f2bf40d3d60 2023-12-12T09:19:34.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.666+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bf40673c0 con 0x7f2bf40d3d60 2023-12-12T09:19:34.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.667+0000 7f2be5ffb640 1 -- 172.21.15.84:0/1287584789 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10824 (secure 0 0 0) 0x7f2be800b3a0 con 0x7f2bf40d3d60 2023-12-12T09:19:34.668 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:34.668 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":14,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:34.202127+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:34.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bd806adb0 msgr2=0x7f2bd806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bd806adb0 0x7f2bd806d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006fd0 tx=0x7f2bf0008040 comp rx=0 tx=0).stop 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d3d60 msgr2=0x7f2bf40cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d3d60 0x7f2bf40cb120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2be800d800 tx=0x7f2be800dcc0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 shutdown_connections 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bf415d490 0x7f2bf4160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bd806adb0 0x7f2bd806d270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bf40d3d60 0x7f2bf40cb120 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 --2- 172.21.15.84:0/1287584789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bf40d1c30 0x7f2bf40cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 >> 172.21.15.84:0/1287584789 conn(0x7f2bf409c450 msgr2=0x7f2bf40b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 shutdown_connections 2023-12-12T09:19:34.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.670+0000 7f2bfb64b640 1 -- 172.21.15.84:0/1287584789 wait complete. 2023-12-12T09:19:34.687 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-12-12T09:19:34.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:19:34.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.890+0000 7f94fb590640 1 Processor -- start 2023-12-12T09:19:34.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.891+0000 7f94fb590640 1 -- start start 2023-12-12T09:19:34.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.892+0000 7f94fb590640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f94f4142f40 0x7f94f415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.892+0000 7f94fb590640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94f40b4ba0 0x7f94f415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.892+0000 7f94fb590640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f40b3b60 con 0x7f94f413ff90 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.892+0000 7f94fb590640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f415e6d0 con 0x7f94f40b4ba0 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.892+0000 7f94fb590640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f415e420 con 0x7f94f4142f40 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f9b2d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94f40b4ba0 0x7f94f415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f932c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f94f413ff90 0x7f94f4142830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54998/0 (socket says 172.21.15.84:54998) 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f932c640 1 -- 172.21.15.84:0/29042545 learned_addr learned my addr 172.21.15.84:0/29042545 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f8b2b640 1 --2- 172.21.15.84:0/29042545 >> v2:172.21.15.99:3300/0 conn(0x7f94f4142f40 0x7f94f415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f9b2d640 1 -- 172.21.15.84:0/29042545 >> v2:172.21.15.99:3300/0 conn(0x7f94f4142f40 msgr2=0x7f94f415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f9b2d640 1 --2- 172.21.15.84:0/29042545 >> v2:172.21.15.99:3300/0 conn(0x7f94f4142f40 0x7f94f415d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f9b2d640 1 -- 172.21.15.84:0/29042545 >> v1:172.21.15.84:6789/0 conn(0x7f94f413ff90 legacy=0x7f94f4142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f3fff640 1 -- 172.21.15.84:0/29042545 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354573707 0 0) 0x7f94f40b3b60 con 0x7f94f413ff90 2023-12-12T09:19:34.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.893+0000 7f94f9b2d640 1 -- 172.21.15.84:0/29042545 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40b3de0 con 0x7f94f40b4ba0 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.894+0000 7f94f9b2d640 1 --2- 172.21.15.84:0/29042545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f415dee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94f406fde0 tx=0x7f94ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981a24b15857d75f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94f3fff640 1 -- 172.21.15.84:0/29042545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec031830 con 0x7f94f40b4ba0 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94f3fff640 1 -- 172.21.15.84:0/29042545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec031990 con 0x7f94f40b4ba0 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94f3fff640 1 -- 172.21.15.84:0/29042545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec031d20 con 0x7f94f40b4ba0 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94fb590640 1 -- 172.21.15.84:0/29042545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 msgr2=0x7f94f415dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94fb590640 1 --2- 172.21.15.84:0/29042545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f415dee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94f406fde0 tx=0x7f94ec02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94fb590640 1 -- 172.21.15.84:0/29042545 shutdown_connections 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94fb590640 1 --2- 172.21.15.84:0/29042545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f415dee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94fb590640 1 --2- 172.21.15.84:0/29042545 >> v2:172.21.15.99:3300/0 conn(0x7f94f4142f40 0x7f94f415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94fb590640 1 -- 172.21.15.84:0/29042545 >> 172.21.15.84:0/29042545 conn(0x7f94f406c3d0 msgr2=0x7f94f406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:34.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.895+0000 7f94fb590640 1 -- 172.21.15.84:0/29042545 shutdown_connections 2023-12-12T09:19:34.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.896+0000 7f94fb590640 1 -- 172.21.15.84:0/29042545 wait complete. 2023-12-12T09:19:34.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.897+0000 7f94fb590640 1 Processor -- start 2023-12-12T09:19:34.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.897+0000 7f94fb590640 1 -- start start 2023-12-12T09:19:34.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.898+0000 7f94fb590640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f4140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.898+0000 7f94fb590640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94f413ff90 0x7f94f4140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.898+0000 7f94fb590640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94f4142f40 0x7f94f40ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.898+0000 7f94fb590640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4136eb0 con 0x7f94f40b4ba0 2023-12-12T09:19:34.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.898+0000 7f94fb590640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40aeba0 con 0x7f94f413ff90 2023-12-12T09:19:34.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.898+0000 7f94fb590640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40adf90 con 0x7f94f4142f40 2023-12-12T09:19:34.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f4140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f4140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58774/0 (socket says 172.21.15.84:58774) 2023-12-12T09:19:34.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 -- 172.21.15.84:0/1443460064 learned_addr learned my addr 172.21.15.84:0/1443460064 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:34.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f8b2b640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94f413ff90 0x7f94f4140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f9b2d640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94f4142f40 0x7f94f40ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 -- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94f4142f40 msgr2=0x7f94f40ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94f4142f40 0x7f94f40ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 -- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94f413ff90 msgr2=0x7f94f4140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94f413ff90 0x7f94f4140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 -- 172.21.15.84:0/1443460064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec009400 con 0x7f94f40b4ba0 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f9b2d640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94f4142f40 0x7f94f40ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.899+0000 7f94f932c640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f4140640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94e800c890 tx=0x7f94e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.900+0000 7f94f1ffb640 1 -- 172.21.15.84:0/1443460064 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e800a640 con 0x7f94f40b4ba0 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.900+0000 7f94f1ffb640 1 -- 172.21.15.84:0/1443460064 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e800a7c0 con 0x7f94f40b4ba0 2023-12-12T09:19:34.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.900+0000 7f94f1ffb640 1 -- 172.21.15.84:0/1443460064 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e800ab70 con 0x7f94f40b4ba0 2023-12-12T09:19:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.900+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f40ae270 con 0x7f94f40b4ba0 2023-12-12T09:19:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.900+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f40ae830 con 0x7f94f40b4ba0 2023-12-12T09:19:34.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.901+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f40673c0 con 0x7f94f40b4ba0 2023-12-12T09:19:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.902+0000 7f94f1ffb640 1 -- 172.21.15.84:0/1443460064 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f94e800acd0 con 0x7f94f40b4ba0 2023-12-12T09:19:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.903+0000 7f94f1ffb640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f94d806adb0 0x7f94d806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.903+0000 7f94f1ffb640 1 -- 172.21.15.84:0/1443460064 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f94e80885f0 con 0x7f94f40b4ba0 2023-12-12T09:19:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.903+0000 7f94f8b2b640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f94d806adb0 0x7f94d806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:34.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.904+0000 7f94f8b2b640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f94d806adb0 0x7f94d806d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f94f415abd0 tx=0x7f94e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:34.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:34.908+0000 7f94f1ffb640 1 -- 172.21.15.84:0/1443460064 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94e8053bb0 con 0x7f94f40b4ba0 2023-12-12T09:19:35.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.143+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94f4070210 con 0x7f94f40b4ba0 2023-12-12T09:19:35.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.147+0000 7f94f1ffb640 1 -- 172.21.15.84:0/1443460064 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f94e8018020 con 0x7f94f40b4ba0 2023-12-12T09:19:35.148 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:35.148 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-12T09:19:35.148 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2023-12-12T09:19:35.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f94d806adb0 msgr2=0x7f94d806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:35.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f94d806adb0 0x7f94d806d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f94f415abd0 tx=0x7f94e0008040 comp rx=0 tx=0).stop 2023-12-12T09:19:35.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 msgr2=0x7f94f4140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f4140640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f94e800c890 tx=0x7f94e800cd50 comp rx=0 tx=0).stop 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 shutdown_connections 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94f4142f40 0x7f94f40ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94f413ff90 0x7f94f4140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f94d806adb0 0x7f94d806d270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 --2- 172.21.15.84:0/1443460064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94f40b4ba0 0x7f94f4140640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 >> 172.21.15.84:0/1443460064 conn(0x7f94f406c3d0 msgr2=0x7f94f415b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 shutdown_connections 2023-12-12T09:19:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:35.150+0000 7f94fb590640 1 -- 172.21.15.84:0/1443460064 wait complete. 2023-12-12T09:19:37.167 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:19:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.386+0000 7f1809e90640 1 Processor -- start 2023-12-12T09:19:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.386+0000 7f1809e90640 1 -- start start 2023-12-12T09:19:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.387+0000 7f1809e90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18040b4ba0 0x7f180415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.387+0000 7f1809e90640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18040b3b60 con 0x7f180413ff90 2023-12-12T09:19:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.387+0000 7f1809e90640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18040b3de0 con 0x7f1804142f40 2023-12-12T09:19:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.387+0000 7f1809e90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180415e6d0 con 0x7f18040b4ba0 2023-12-12T09:19:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.388+0000 7f18037fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f180413ff90 0x7f1804142830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36266/0 (socket says 172.21.15.84:36266) 2023-12-12T09:19:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.388+0000 7f18037fe640 1 -- 172.21.15.84:0/3764164021 learned_addr learned my addr 172.21.15.84:0/3764164021 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.388+0000 7f1803fff640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18040b4ba0 0x7f180415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.388+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752624580 0 0) 0x7f18040b3b60 con 0x7f180413ff90 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.388+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f0003520 con 0x7f180413ff90 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2285511075 0 0) 0x7f17f0003520 con 0x7f180413ff90 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18040b4ba0 msgr2=0x7f180415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18040b4ba0 0x7f180415e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 >> v1:172.21.15.99:6789/0 conn(0x7f1804142f40 legacy=0x7f180415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040b40c0 con 0x7f180413ff90 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f17f4001670 con 0x7f180413ff90 2023-12-12T09:19:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 >> v1:172.21.15.84:6789/0 conn(0x7f180413ff90 legacy=0x7f1804142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18040b4ba0 0x7f17f00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0003f20 0x7f17f00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f0004d00 0x7f17f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180415e6d0 con 0x7f17f0004d00 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f000ba60 con 0x7f17f0003f20 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f000bc20 con 0x7f18040b4ba0 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f1803fff640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f0004d00 0x7f17f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.389+0000 7f17fbfff640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0003f20 0x7f17f00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.390+0000 7f18037fe640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18040b4ba0 0x7f17f00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.390+0000 7f1803fff640 1 -- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18040b4ba0 msgr2=0x7f17f00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.390+0000 7f1803fff640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f18040b4ba0 0x7f17f00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.390+0000 7f1803fff640 1 -- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0003f20 msgr2=0x7f17f00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.390+0000 7f1803fff640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0003f20 0x7f17f00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.390+0000 7f1803fff640 1 -- 172.21.15.84:0/3764164021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0003520 con 0x7f17f0004d00 2023-12-12T09:19:37.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.391+0000 7f1803fff640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f0004d00 0x7f17f0005180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009fc0 tx=0x7f17f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac9cc3e81da694a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.391+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc02cc20 con 0x7f17f0004d00 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.391+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc00f040 con 0x7f17f0004d00 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.391+0000 7f1802ffd640 1 -- 172.21.15.84:0/3764164021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc034440 con 0x7f17f0004d00 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.392+0000 7f1809e90640 1 -- 172.21.15.84:0/3764164021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f0004d00 msgr2=0x7f17f0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.392+0000 7f1809e90640 1 --2- 172.21.15.84:0/3764164021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17f0004d00 0x7f17f0005180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009fc0 tx=0x7f17f00057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.392+0000 7f1803fff640 1 -- 172.21.15.84:0/3764164021 reap_dead start 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.392+0000 7f1809e90640 1 -- 172.21.15.84:0/3764164021 shutdown_connections 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.392+0000 7f1809e90640 1 -- 172.21.15.84:0/3764164021 >> 172.21.15.84:0/3764164021 conn(0x7f180406c3d0 msgr2=0x7f180406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.392+0000 7f1809e90640 1 -- 172.21.15.84:0/3764164021 shutdown_connections 2023-12-12T09:19:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.392+0000 7f1809e90640 1 -- 172.21.15.84:0/3764164021 wait complete. 2023-12-12T09:19:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.394+0000 7f1809e90640 1 Processor -- start 2023-12-12T09:19:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.394+0000 7f1809e90640 1 -- start start 2023-12-12T09:19:37.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1809e90640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0004d00 0x7f18041561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1809e90640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1804156720 0x7f18041584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1809e90640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18041589e0 0x7f18041f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1809e90640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18040b0580 con 0x7f18041589e0 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1809e90640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1804152640 con 0x7f17f0004d00 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1809e90640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1804156e60 con 0x7f1804156720 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1803fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18041589e0 0x7f18041f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1803fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18041589e0 0x7f18041f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43166/0 (socket says 172.21.15.84:43166) 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f1803fff640 1 -- 172.21.15.84:0/3421842459 learned_addr learned my addr 172.21.15.84:0/3421842459 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f18037fe640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0004d00 0x7f18041561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.395+0000 7f17fbfff640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1804156720 0x7f18041584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1803fff640 1 -- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1804156720 msgr2=0x7f18041584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1803fff640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1804156720 0x7f18041584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1803fff640 1 -- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0004d00 msgr2=0x7f18041561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1803fff640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0004d00 0x7f18041561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1803fff640 1 -- 172.21.15.84:0/3421842459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18041528e0 con 0x7f18041589e0 2023-12-12T09:19:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f18037fe640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0004d00 0x7f18041561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f17fbfff640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1804156720 0x7f18041584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1803fff640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18041589e0 0x7f18041f6100 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17fc002230 tx=0x7f17fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1800ff9640 1 -- 172.21.15.84:0/3421842459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc043070 con 0x7f18041589e0 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1800ff9640 1 -- 172.21.15.84:0/3421842459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc034ad0 con 0x7f18041589e0 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1804152bc0 con 0x7f18041589e0 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1800ff9640 1 -- 172.21.15.84:0/3421842459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc034e80 con 0x7f18041589e0 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.396+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1804156b80 con 0x7f18041589e0 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.397+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1804071b50 con 0x7f18041589e0 2023-12-12T09:19:37.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.398+0000 7f1800ff9640 1 -- 172.21.15.84:0/3421842459 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f17fc03e440 con 0x7f18041589e0 2023-12-12T09:19:37.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.399+0000 7f1800ff9640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17e406adb0 0x7f17e406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.399+0000 7f1800ff9640 1 -- 172.21.15.84:0/3421842459 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f17fc0aae60 con 0x7f18041589e0 2023-12-12T09:19:37.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.400+0000 7f18037fe640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17e406adb0 0x7f17e406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.400+0000 7f18037fe640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17e406adb0 0x7f17e406d270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17f4001c90 tx=0x7f17f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:37.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.404+0000 7f1800ff9640 1 -- 172.21.15.84:0/3421842459 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17fc076330 con 0x7f18041589e0 2023-12-12T09:19:37.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.579+0000 7f1800ff9640 1 -- 172.21.15.84:0/3421842459 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17fc0b0020 con 0x7f18041589e0 2023-12-12T09:19:37.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.638+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18040673c0 con 0x7f18041589e0 2023-12-12T09:19:37.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.639+0000 7f1800ff9640 1 -- 172.21.15.84:0/3421842459 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f17fc091710 con 0x7f18041589e0 2023-12-12T09:19:37.639 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:37.640 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-12T09:19:37.640 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2023-12-12T09:19:37.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17e406adb0 msgr2=0x7f17e406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17e406adb0 0x7f17e406d270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17f4001c90 tx=0x7f17f4009040 comp rx=0 tx=0).stop 2023-12-12T09:19:37.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18041589e0 msgr2=0x7f18041f6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18041589e0 0x7f18041f6100 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17fc002230 tx=0x7f17fc009750 comp rx=0 tx=0).stop 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 shutdown_connections 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17e406adb0 0x7f17e406d270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18041589e0 0x7f18041f6100 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1804156720 0x7f18041584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 --2- 172.21.15.84:0/3421842459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17f0004d00 0x7f18041561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 >> 172.21.15.84:0/3421842459 conn(0x7f180406c3d0 msgr2=0x7f1804141b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 shutdown_connections 2023-12-12T09:19:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.642+0000 7f1809e90640 1 -- 172.21.15.84:0/3421842459 wait complete. 2023-12-12T09:19:37.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:37.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.855+0000 7f2d4f95a640 1 Processor -- start 2023-12-12T09:19:37.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.855+0000 7f2d4f95a640 1 -- start start 2023-12-12T09:19:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.856+0000 7f2d4f95a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2d4815d490 0x7f2d480d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.856+0000 7f2d4f95a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d480d3d60 0x7f2d480d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.856+0000 7f2d4f95a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d480afd40 con 0x7f2d480d1c30 2023-12-12T09:19:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.856+0000 7f2d4f95a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d480b0090 con 0x7f2d4815d490 2023-12-12T09:19:37.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.856+0000 7f2d4f95a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480d20a0 con 0x7f2d480d3d60 2023-12-12T09:19:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.857+0000 7f2d4cef5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d480d3d60 0x7f2d480d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.857+0000 7f2d4d6f6640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2d4815d490 0x7f2d480d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.857+0000 7f2d4d6f6640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2d4815d490 0x7f2d480d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:53686/0 (socket says 172.21.15.84:53686) 2023-12-12T09:19:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.857+0000 7f2d4d6f6640 1 -- 172.21.15.84:0/574708410 learned_addr learned my addr 172.21.15.84:0/574708410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.858+0000 7f2d4d6f6640 1 -- 172.21.15.84:0/574708410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d480d3d60 msgr2=0x7f2d480d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.858+0000 7f2d4d6f6640 1 --2- 172.21.15.84:0/574708410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d480d3d60 0x7f2d480d16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.858+0000 7f2d4d6f6640 1 -- 172.21.15.84:0/574708410 >> v1:172.21.15.99:6789/0 conn(0x7f2d480d1c30 legacy=0x7f2d480cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.858+0000 7f2d4d6f6640 1 -- 172.21.15.84:0/574708410 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d480ce860 con 0x7f2d4815d490 2023-12-12T09:19:37.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.859+0000 7f2d4d6f6640 1 --2- 172.21.15.84:0/574708410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d4815d490 0x7f2d480d3820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d440098a0 tx=0x7f2d4402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b6f3aff79587c35 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:37.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.859+0000 7f2d3ffff640 1 -- 172.21.15.84:0/574708410 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44031640 con 0x7f2d4815d490 2023-12-12T09:19:37.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.859+0000 7f2d3ffff640 1 -- 172.21.15.84:0/574708410 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d440317a0 con 0x7f2d4815d490 2023-12-12T09:19:37.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.859+0000 7f2d3ffff640 1 -- 172.21.15.84:0/574708410 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44031b30 con 0x7f2d4815d490 2023-12-12T09:19:37.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.860+0000 7f2d4f95a640 1 -- 172.21.15.84:0/574708410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d4815d490 msgr2=0x7f2d480d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.860+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/574708410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d4815d490 0x7f2d480d3820 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d440098a0 tx=0x7f2d4402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.860+0000 7f2d4f95a640 1 -- 172.21.15.84:0/574708410 shutdown_connections 2023-12-12T09:19:37.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.860+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/574708410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d480d3d60 0x7f2d480d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.860+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/574708410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d4815d490 0x7f2d480d3820 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.860+0000 7f2d4f95a640 1 -- 172.21.15.84:0/574708410 >> 172.21.15.84:0/574708410 conn(0x7f2d4809c450 msgr2=0x7f2d480d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:37.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.860+0000 7f2d4f95a640 1 -- 172.21.15.84:0/574708410 shutdown_connections 2023-12-12T09:19:37.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.860+0000 7f2d4f95a640 1 -- 172.21.15.84:0/574708410 wait complete. 2023-12-12T09:19:37.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.862+0000 7f2d4f95a640 1 Processor -- start 2023-12-12T09:19:37.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.862+0000 7f2d4f95a640 1 -- start start 2023-12-12T09:19:37.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4f95a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d480d1c30 0x7f2d48152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4f95a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d480d3d60 0x7f2d480b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4f95a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d4815d490 0x7f2d4815f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4f95a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480c93f0 con 0x7f2d480d1c30 2023-12-12T09:19:37.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4f95a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4815f770 con 0x7f2d480d3d60 2023-12-12T09:19:37.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4f95a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480b5cd0 con 0x7f2d4815d490 2023-12-12T09:19:37.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4d6f6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d480d1c30 0x7f2d48152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4d6f6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d480d1c30 0x7f2d48152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43172/0 (socket says 172.21.15.84:43172) 2023-12-12T09:19:37.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4d6f6640 1 -- 172.21.15.84:0/36524404 learned_addr learned my addr 172.21.15.84:0/36524404 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4def7640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d4815d490 0x7f2d4815f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.863+0000 7f2d4cef5640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d480d3d60 0x7f2d480b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4d6f6640 1 -- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d4815d490 msgr2=0x7f2d4815f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4d6f6640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d4815d490 0x7f2d4815f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4d6f6640 1 -- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d480d3d60 msgr2=0x7f2d480b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4d6f6640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d480d3d60 0x7f2d480b8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4d6f6640 1 -- 172.21.15.84:0/36524404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440094d0 con 0x7f2d480d1c30 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4def7640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d4815d490 0x7f2d4815f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4cef5640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d480d3d60 0x7f2d480b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:37.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4d6f6640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d480d1c30 0x7f2d48152730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d440098a0 tx=0x7f2d440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:37.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d3dffb640 1 -- 172.21.15.84:0/36524404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4403a930 con 0x7f2d480d1c30 2023-12-12T09:19:37.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d3dffb640 1 -- 172.21.15.84:0/36524404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4403aa90 con 0x7f2d480d1c30 2023-12-12T09:19:37.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4815dc20 con 0x7f2d480d1c30 2023-12-12T09:19:37.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d3dffb640 1 -- 172.21.15.84:0/36524404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4403ae40 con 0x7f2d480d1c30 2023-12-12T09:19:37.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.864+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d480c8e30 con 0x7f2d480d1c30 2023-12-12T09:19:37.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.865+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d48072b80 con 0x7f2d480d1c30 2023-12-12T09:19:37.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.866+0000 7f2d3dffb640 1 -- 172.21.15.84:0/36524404 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d4402f050 con 0x7f2d480d1c30 2023-12-12T09:19:37.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.867+0000 7f2d3dffb640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2d2c06ae40 0x7f2d2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:37.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.867+0000 7f2d3dffb640 1 -- 172.21.15.84:0/36524404 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2d440ab200 con 0x7f2d480d1c30 2023-12-12T09:19:37.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.867+0000 7f2d4cef5640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2d2c06ae40 0x7f2d2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:37.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.868+0000 7f2d4cef5640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2d2c06ae40 0x7f2d2c06d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d480a0fb0 tx=0x7f2d38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:37.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:37.872+0000 7f2d3dffb640 1 -- 172.21.15.84:0/36524404 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d44076600 con 0x7f2d480d1c30 2023-12-12T09:19:38.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.070+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d480673c0 con 0x7f2d480d1c30 2023-12-12T09:19:38.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.072+0000 7f2d3dffb640 1 -- 172.21.15.84:0/36524404 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f2d44079c20 con 0x7f2d480d1c30 2023-12-12T09:19:38.072 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:38.072 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:37.543242+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2d2c06ae40 msgr2=0x7f2d2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2d2c06ae40 0x7f2d2c06d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d480a0fb0 tx=0x7f2d38008040 comp rx=0 tx=0).stop 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d480d1c30 msgr2=0x7f2d48152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d480d1c30 0x7f2d48152730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d440098a0 tx=0x7f2d440046c0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 shutdown_connections 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d4815d490 0x7f2d4815f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d480d3d60 0x7f2d480b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2d2c06ae40 0x7f2d2c06d300 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d480a0fb0 tx=0x7f2d38008040 comp rx=0 tx=0).stop 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 --2- 172.21.15.84:0/36524404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d480d1c30 0x7f2d48152730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 >> 172.21.15.84:0/36524404 conn(0x7f2d4809c450 msgr2=0x7f2d480b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 shutdown_connections 2023-12-12T09:19:38.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.074+0000 7f2d4f95a640 1 -- 172.21.15.84:0/36524404 wait complete. 2023-12-12T09:19:38.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:19:38.092 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:19:38.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.283+0000 7f9a52207640 1 Processor -- start 2023-12-12T09:19:38.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.283+0000 7f9a52207640 1 -- start start 2023-12-12T09:19:38.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.284+0000 7f9a52207640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9a4c06e490 0x7f9a4c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.284+0000 7f9a52207640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c0cf3e0 con 0x7f9a4c15d1c0 2023-12-12T09:19:38.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.284+0000 7f9a52207640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c06d600 con 0x7f9a4c0cd890 2023-12-12T09:19:38.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.284+0000 7f9a52207640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4c06bfa0 con 0x7f9a4c06e490 2023-12-12T09:19:38.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.284+0000 7f9a4b7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9a4c15d1c0 0x7f9a4c06b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36274/0 (socket says 172.21.15.84:36274) 2023-12-12T09:19:38.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.284+0000 7f9a4b7fe640 1 -- 172.21.15.84:0/2232043265 learned_addr learned my addr 172.21.15.84:0/2232043265 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:38.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a43fff640 1 --2- 172.21.15.84:0/2232043265 >> v2:172.21.15.99:3300/0 conn(0x7f9a4c06e490 0x7f9a4c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522934331 0 0) 0x7f9a4c0cf3e0 con 0x7f9a4c15d1c0 2023-12-12T09:19:38.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a38003520 con 0x7f9a4c15d1c0 2023-12-12T09:19:38.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 858820332 0 0) 0x7f9a38003520 con 0x7f9a4c15d1c0 2023-12-12T09:19:38.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 >> v2:172.21.15.99:3300/0 conn(0x7f9a4c06e490 msgr2=0x7f9a4c06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:38.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 --2- 172.21.15.84:0/2232043265 >> v2:172.21.15.99:3300/0 conn(0x7f9a4c06e490 0x7f9a4c06e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 >> v1:172.21.15.99:6789/0 conn(0x7f9a4c0cd890 legacy=0x7f9a4c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:38.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c06efe0 con 0x7f9a4c15d1c0 2023-12-12T09:19:38.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f9a3c001670 con 0x7f9a4c15d1c0 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 >> v1:172.21.15.84:6789/0 conn(0x7f9a4c15d1c0 legacy=0x7f9a4c06b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a380039c0 0x7f9a38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a380047c0 0x7f9a38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38005180 0x7f9a3800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c06bfa0 con 0x7f9a38005180 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3800c050 con 0x7f9a380047c0 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.285+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3800c210 con 0x7f9a380039c0 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a4bfff640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38005180 0x7f9a3800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a43fff640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a380047c0 0x7f9a38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a4b7fe640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a380039c0 0x7f9a38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a4bfff640 1 -- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a380039c0 msgr2=0x7f9a38003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a4bfff640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a380039c0 0x7f9a38003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a4bfff640 1 -- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a380047c0 msgr2=0x7f9a38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a4bfff640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a380047c0 0x7f9a38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a4bfff640 1 -- 172.21.15.84:0/2232043265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a38003520 con 0x7f9a38005180 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.286+0000 7f9a43fff640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a380047c0 0x7f9a38004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.288+0000 7f9a4bfff640 1 -- 172.21.15.84:0/2232043265 reap_dead start 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.288+0000 7f9a4bfff640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38005180 0x7f9a3800b980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a440044b0 tx=0x7f9a380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcbfdb72bcf0b5e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.288+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44006d50 con 0x7f9a38005180 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.288+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a44007020 con 0x7f9a38005180 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.288+0000 7f9a4affd640 1 -- 172.21.15.84:0/2232043265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a440073d0 con 0x7f9a38005180 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.289+0000 7f9a52207640 1 -- 172.21.15.84:0/2232043265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38005180 msgr2=0x7f9a3800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.289+0000 7f9a52207640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38005180 0x7f9a3800b980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a440044b0 tx=0x7f9a380057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.289+0000 7f9a52207640 1 -- 172.21.15.84:0/2232043265 shutdown_connections 2023-12-12T09:19:38.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.289+0000 7f9a52207640 1 --2- 172.21.15.84:0/2232043265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a38005180 0x7f9a3800b980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.289+0000 7f9a52207640 1 -- 172.21.15.84:0/2232043265 >> 172.21.15.84:0/2232043265 conn(0x7f9a4c0b2a20 msgr2=0x7f9a4c0b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:38.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.289+0000 7f9a52207640 1 -- 172.21.15.84:0/2232043265 shutdown_connections 2023-12-12T09:19:38.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.289+0000 7f9a52207640 1 -- 172.21.15.84:0/2232043265 wait complete. 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.291+0000 7f9a52207640 1 Processor -- start 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.291+0000 7f9a52207640 1 -- start start 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a52207640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a38005180 0x7f9a4c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a52207640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a4c15aa80 0x7f9a4c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a52207640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a4c09eb10 0x7f9a4c159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a52207640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c49e0 con 0x7f9a4c15aa80 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a52207640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c4cc0 con 0x7f9a38005180 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a52207640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c4fa0 con 0x7f9a4c09eb10 2023-12-12T09:19:38.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a43fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a4c15aa80 0x7f9a4c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a43fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a4c15aa80 0x7f9a4c159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43194/0 (socket says 172.21.15.84:43194) 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.292+0000 7f9a43fff640 1 -- 172.21.15.84:0/4063829953 learned_addr learned my addr 172.21.15.84:0/4063829953 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a4b7fe640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a38005180 0x7f9a4c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a4bfff640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a4c09eb10 0x7f9a4c159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a43fff640 1 -- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a4c09eb10 msgr2=0x7f9a4c159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a43fff640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a4c09eb10 0x7f9a4c159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a43fff640 1 -- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a38005180 msgr2=0x7f9a4c158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a43fff640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a38005180 0x7f9a4c158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a43fff640 1 -- 172.21.15.84:0/4063829953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c15d720 con 0x7f9a4c15aa80 2023-12-12T09:19:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a4b7fe640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a38005180 0x7f9a4c158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a43fff640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a4c15aa80 0x7f9a4c159140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a34011540 tx=0x7f9a34011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a48ff9640 1 -- 172.21.15.84:0/4063829953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a34015870 con 0x7f9a4c15aa80 2023-12-12T09:19:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a48ff9640 1 -- 172.21.15.84:0/4063829953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a340159d0 con 0x7f9a4c15aa80 2023-12-12T09:19:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c0c5280 con 0x7f9a4c15aa80 2023-12-12T09:19:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.293+0000 7f9a48ff9640 1 -- 172.21.15.84:0/4063829953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a34015d40 con 0x7f9a4c15aa80 2023-12-12T09:19:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.294+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c1f29a0 con 0x7f9a4c15aa80 2023-12-12T09:19:38.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.295+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4c0673c0 con 0x7f9a4c15aa80 2023-12-12T09:19:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.296+0000 7f9a48ff9640 1 -- 172.21.15.84:0/4063829953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a3400f460 con 0x7f9a4c15aa80 2023-12-12T09:19:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.296+0000 7f9a48ff9640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9a2c06ae40 0x7f9a2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.297+0000 7f9a48ff9640 1 -- 172.21.15.84:0/4063829953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a34089b20 con 0x7f9a4c15aa80 2023-12-12T09:19:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.297+0000 7f9a4b7fe640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9a2c06ae40 0x7f9a2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.298+0000 7f9a4b7fe640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9a2c06ae40 0x7f9a2c06d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0057f0 tx=0x7f9a3c000f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:38.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.301+0000 7f9a48ff9640 1 -- 172.21.15.84:0/4063829953 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a34054fd0 con 0x7f9a4c15aa80 2023-12-12T09:19:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.489+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a4c06b670 con 0x7f9a4c15aa80 2023-12-12T09:19:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.490+0000 7f9a48ff9640 1 -- 172.21.15.84:0/4063829953 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a340585f0 con 0x7f9a4c15aa80 2023-12-12T09:19:38.490 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9a2c06ae40 msgr2=0x7f9a2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9a2c06ae40 0x7f9a2c06d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0057f0 tx=0x7f9a3c000f90 comp rx=0 tx=0).stop 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a4c15aa80 msgr2=0x7f9a4c159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a4c15aa80 0x7f9a4c159140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a34011540 tx=0x7f9a34011a00 comp rx=0 tx=0).stop 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 shutdown_connections 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9a4c09eb10 0x7f9a4c159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9a2c06ae40 0x7f9a2c06d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a4c15aa80 0x7f9a4c159140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 --2- 172.21.15.84:0/4063829953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a38005180 0x7f9a4c158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.492+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 >> 172.21.15.84:0/4063829953 conn(0x7f9a4c0b2a20 msgr2=0x7f9a4c160d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.493+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 shutdown_connections 2023-12-12T09:19:38.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.493+0000 7f9a52207640 1 -- 172.21.15.84:0/4063829953 wait complete. 2023-12-12T09:19:38.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:19:38.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.704+0000 7fcd7f941640 1 Processor -- start 2023-12-12T09:19:38.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.704+0000 7fcd7f941640 1 -- start start 2023-12-12T09:19:38.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.705+0000 7fcd7f941640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.705+0000 7fcd7f941640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd780b4ba0 0x7fcd78142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.705+0000 7fcd7f941640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fcd7815d9a0 0x7fcd7815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.705+0000 7fcd7f941640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7815e6d0 con 0x7fcd780b4ba0 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.705+0000 7fcd7f941640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd780b3b60 con 0x7fcd7815d9a0 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.705+0000 7fcd7f941640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd780b3de0 con 0x7fcd7813ff90 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7cedc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd780b4ba0 0x7fcd78142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7cedc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcd780b4ba0 0x7fcd78142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43196/0 (socket says 172.21.15.84:43196) 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7cedc640 1 -- 172.21.15.84:0/3765579919 learned_addr learned my addr 172.21.15.84:0/3765579919 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7d6dd640 1 --2- 172.21.15.84:0/3765579919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7dede640 1 --2- 172.21.15.84:0/3765579919 >> v2:172.21.15.99:3300/0 conn(0x7fcd7815d9a0 0x7fcd7815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7cedc640 1 -- 172.21.15.84:0/3765579919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 msgr2=0x7fcd78142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7cedc640 1 --2- 172.21.15.84:0/3765579919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7cedc640 1 -- 172.21.15.84:0/3765579919 >> v2:172.21.15.99:3300/0 conn(0x7fcd7815d9a0 msgr2=0x7fcd7815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7cedc640 1 --2- 172.21.15.84:0/3765579919 >> v2:172.21.15.99:3300/0 conn(0x7fcd7815d9a0 0x7fcd7815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7cedc640 1 -- 172.21.15.84:0/3765579919 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd780b40c0 con 0x7fcd780b4ba0 2023-12-12T09:19:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.706+0000 7fcd7d6dd640 1 --2- 172.21.15.84:0/3765579919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:19:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.707+0000 7fcd7cedc640 1 --2- 172.21.15.84:0/3765579919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd780b4ba0 0x7fcd78142d70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd7806e050 tx=0x7fcd6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2ed839fe318382 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd6bfff640 1 -- 172.21.15.84:0/3765579919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c031870 con 0x7fcd780b4ba0 2023-12-12T09:19:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd6bfff640 1 -- 172.21.15.84:0/3765579919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c0319d0 con 0x7fcd780b4ba0 2023-12-12T09:19:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd6bfff640 1 -- 172.21.15.84:0/3765579919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c031d60 con 0x7fcd780b4ba0 2023-12-12T09:19:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 -- 172.21.15.84:0/3765579919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd780b4ba0 msgr2=0x7fcd78142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 --2- 172.21.15.84:0/3765579919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd780b4ba0 0x7fcd78142d70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd7806e050 tx=0x7fcd6c02b910 comp rx=0 tx=0).stop 2023-12-12T09:19:38.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 -- 172.21.15.84:0/3765579919 shutdown_connections 2023-12-12T09:19:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 --2- 172.21.15.84:0/3765579919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd780b4ba0 0x7fcd78142d70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 --2- 172.21.15.84:0/3765579919 >> v2:172.21.15.99:3300/0 conn(0x7fcd7815d9a0 0x7fcd7815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 --2- 172.21.15.84:0/3765579919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 -- 172.21.15.84:0/3765579919 >> 172.21.15.84:0/3765579919 conn(0x7fcd7806c3d0 msgr2=0x7fcd7806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 -- 172.21.15.84:0/3765579919 shutdown_connections 2023-12-12T09:19:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.708+0000 7fcd7f941640 1 -- 172.21.15.84:0/3765579919 wait complete. 2023-12-12T09:19:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.710+0000 7fcd7f941640 1 Processor -- start 2023-12-12T09:19:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.710+0000 7fcd7f941640 1 -- start start 2023-12-12T09:19:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7f941640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd780b4ba0 0x7fcd78070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7f941640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78139890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7f941640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7815d9a0 0x7fcd78152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7f941640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7813a350 con 0x7fcd7815d9a0 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7f941640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7813a630 con 0x7fcd780b4ba0 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7f941640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7813a910 con 0x7fcd7813ff90 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7dede640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7815d9a0 0x7fcd78152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7dede640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7815d9a0 0x7fcd78152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43198/0 (socket says 172.21.15.84:43198) 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7dede640 1 -- 172.21.15.84:0/1985822869 learned_addr learned my addr 172.21.15.84:0/1985822869 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.711+0000 7fcd7cedc640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7d6dd640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd780b4ba0 0x7fcd78070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7dede640 1 -- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 msgr2=0x7fcd78139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7dede640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7dede640 1 -- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd780b4ba0 msgr2=0x7fcd78070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7dede640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd780b4ba0 0x7fcd78070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7dede640 1 -- 172.21.15.84:0/1985822869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0094d0 con 0x7fcd7815d9a0 2023-12-12T09:19:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7d6dd640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd780b4ba0 0x7fcd78070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:19:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7dede640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7815d9a0 0x7fcd78152f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd70007e40 tx=0x7fcd7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd69ffb640 1 -- 172.21.15.84:0/1985822869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70014620 con 0x7fcd7815d9a0 2023-12-12T09:19:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd69ffb640 1 -- 172.21.15.84:0/1985822869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7000ee90 con 0x7fcd7815d9a0 2023-12-12T09:19:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7813abf0 con 0x7fcd7815d9a0 2023-12-12T09:19:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.712+0000 7fcd69ffb640 1 -- 172.21.15.84:0/1985822869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700149e0 con 0x7fcd7815d9a0 2023-12-12T09:19:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.713+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd78138010 con 0x7fcd7815d9a0 2023-12-12T09:19:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.714+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd781381a0 con 0x7fcd7815d9a0 2023-12-12T09:19:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.714+0000 7fcd69ffb640 1 -- 172.21.15.84:0/1985822869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd70014b40 con 0x7fcd7815d9a0 2023-12-12T09:19:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.715+0000 7fcd69ffb640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd5c06ae40 0x7fcd5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.716+0000 7fcd69ffb640 1 -- 172.21.15.84:0/1985822869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd70089bd0 con 0x7fcd7815d9a0 2023-12-12T09:19:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.716+0000 7fcd7d6dd640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd5c06ae40 0x7fcd5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.716+0000 7fcd7d6dd640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd5c06ae40 0x7fcd5c06d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c940 tx=0x7fcd74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:38.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.720+0000 7fcd69ffb640 1 -- 172.21.15.84:0/1985822869 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd70054fd0 con 0x7fcd7815d9a0 2023-12-12T09:19:38.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.907+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcd7813b110 con 0x7fcd7815d9a0 2023-12-12T09:19:38.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.907+0000 7fcd69ffb640 1 -- 172.21.15.84:0/1985822869 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcd7813b110 con 0x7fcd7815d9a0 2023-12-12T09:19:38.908 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-12-12T09:19:38.908 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:19:38.908 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-12-12T09:19:38.908 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-12-12T09:19:38.908 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:19:38.908 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-12-12T09:19:38.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd5c06ae40 msgr2=0x7fcd5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd5c06ae40 0x7fcd5c06d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c940 tx=0x7fcd74008040 comp rx=0 tx=0).stop 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7815d9a0 msgr2=0x7fcd78152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7815d9a0 0x7fcd78152f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd70007e40 tx=0x7fcd7000e4b0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 shutdown_connections 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd5c06ae40 0x7fcd5c06d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd7815d9a0 0x7fcd78152f50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcd7813ff90 0x7fcd78139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 --2- 172.21.15.84:0/1985822869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd780b4ba0 0x7fcd78070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 >> 172.21.15.84:0/1985822869 conn(0x7fcd7806c3d0 msgr2=0x7fcd78142a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 shutdown_connections 2023-12-12T09:19:38.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:38.910+0000 7fcd7f941640 1 -- 172.21.15.84:0/1985822869 wait complete. 2023-12-12T09:19:38.927 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T09:19:38.928 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T09:19:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.146+0000 7fd74f72c640 1 Processor -- start 2023-12-12T09:19:39.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.146+0000 7fd74f72c640 1 -- start start 2023-12-12T09:19:39.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74f72c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd74806ca70 0x7fd74806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:39.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74f72c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd74806c560 0x7fd7480b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:39.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74f72c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd748070130 con 0x7fd748160ea0 2023-12-12T09:19:39.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74f72c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74806d390 con 0x7fd74806c560 2023-12-12T09:19:39.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74f72c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7480b3e40 con 0x7fd74806ca70 2023-12-12T09:19:39.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74ccc7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd74806c560 0x7fd7480b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:39.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74ccc7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd74806c560 0x7fd7480b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43200/0 (socket says 172.21.15.84:43200) 2023-12-12T09:19:39.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74ccc7640 1 -- 172.21.15.84:0/622344644 learned_addr learned my addr 172.21.15.84:0/622344644 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:39.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.148+0000 7fd74dcc9640 1 --1- 172.21.15.84:0/622344644 >> v1:172.21.15.84:6789/0 conn(0x7fd748160ea0 0x7fd748161330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36276/0 (socket says 172.21.15.84:36276) 2023-12-12T09:19:39.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.149+0000 7fd74d4c8640 1 --2- 172.21.15.84:0/622344644 >> v2:172.21.15.99:3300/0 conn(0x7fd74806ca70 0x7fd74806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:39.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.149+0000 7fd74ccc7640 1 -- 172.21.15.84:0/622344644 >> v2:172.21.15.99:3300/0 conn(0x7fd74806ca70 msgr2=0x7fd74806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:39.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.149+0000 7fd74ccc7640 1 --2- 172.21.15.84:0/622344644 >> v2:172.21.15.99:3300/0 conn(0x7fd74806ca70 0x7fd74806ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:39.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.149+0000 7fd74ccc7640 1 -- 172.21.15.84:0/622344644 >> v1:172.21.15.84:6789/0 conn(0x7fd748160ea0 legacy=0x7fd748161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:39.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.149+0000 7fd74ccc7640 1 -- 172.21.15.84:0/622344644 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480ccb40 con 0x7fd74806c560 2023-12-12T09:19:39.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.150+0000 7fd74ccc7640 1 --2- 172.21.15.84:0/622344644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74806c560 0x7fd7480b3540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd738009870 tx=0x7fd73802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea4b1edc2abbe13 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:39.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.150+0000 7fd73ffff640 1 -- 172.21.15.84:0/622344644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738031870 con 0x7fd74806c560 2023-12-12T09:19:39.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.150+0000 7fd73ffff640 1 -- 172.21.15.84:0/622344644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380319d0 con 0x7fd74806c560 2023-12-12T09:19:39.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.150+0000 7fd73ffff640 1 -- 172.21.15.84:0/622344644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738031d60 con 0x7fd74806c560 2023-12-12T09:19:39.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.151+0000 7fd74f72c640 1 -- 172.21.15.84:0/622344644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74806c560 msgr2=0x7fd7480b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:39.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.151+0000 7fd74f72c640 1 --2- 172.21.15.84:0/622344644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74806c560 0x7fd7480b3540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd738009870 tx=0x7fd73802b910 comp rx=0 tx=0).stop 2023-12-12T09:19:39.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.151+0000 7fd74f72c640 1 -- 172.21.15.84:0/622344644 shutdown_connections 2023-12-12T09:19:39.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.151+0000 7fd74f72c640 1 --2- 172.21.15.84:0/622344644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd74806c560 0x7fd7480b3540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:39.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.151+0000 7fd74f72c640 1 --2- 172.21.15.84:0/622344644 >> v2:172.21.15.99:3300/0 conn(0x7fd74806ca70 0x7fd74806ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:39.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.151+0000 7fd74f72c640 1 -- 172.21.15.84:0/622344644 >> 172.21.15.84:0/622344644 conn(0x7fd7480b0970 msgr2=0x7fd7480b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:39.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.151+0000 7fd74f72c640 1 -- 172.21.15.84:0/622344644 shutdown_connections 2023-12-12T09:19:39.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.151+0000 7fd74f72c640 1 -- 172.21.15.84:0/622344644 wait complete. 2023-12-12T09:19:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.153+0000 7fd74f72c640 1 Processor -- start 2023-12-12T09:19:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.153+0000 7fd74f72c640 1 -- start start 2023-12-12T09:19:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74f72c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74806c560 0x7fd748161310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74f72c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd74806ca70 0x7fd748161850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74f72c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd748160ea0 0x7fd748149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74f72c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74809aee0 con 0x7fd748160ea0 2023-12-12T09:19:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74f72c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74809b1c0 con 0x7fd74806c560 2023-12-12T09:19:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74f72c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74809b4a0 con 0x7fd74806ca70 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74dcc9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd748160ea0 0x7fd748149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74dcc9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd748160ea0 0x7fd748149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43214/0 (socket says 172.21.15.84:43214) 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74dcc9640 1 -- 172.21.15.84:0/3152391422 learned_addr learned my addr 172.21.15.84:0/3152391422 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74d4c8640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74806c560 0x7fd748161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74ccc7640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd74806ca70 0x7fd748161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74dcc9640 1 -- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd74806ca70 msgr2=0x7fd748161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74dcc9640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd74806ca70 0x7fd748161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74dcc9640 1 -- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74806c560 msgr2=0x7fd748161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74dcc9640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74806c560 0x7fd748161310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74dcc9640 1 -- 172.21.15.84:0/3152391422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094d0 con 0x7fd748160ea0 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.154+0000 7fd74ccc7640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd74806ca70 0x7fd748161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.155+0000 7fd74dcc9640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd748160ea0 0x7fd748149420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd74000c730 tx=0x7fd74000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.155+0000 7fd73dffb640 1 -- 172.21.15.84:0/3152391422 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000ce40 con 0x7fd748160ea0 2023-12-12T09:19:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.155+0000 7fd73dffb640 1 -- 172.21.15.84:0/3152391422 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74000a640 con 0x7fd748160ea0 2023-12-12T09:19:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.155+0000 7fd73dffb640 1 -- 172.21.15.84:0/3152391422 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000a9f0 con 0x7fd748160ea0 2023-12-12T09:19:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.155+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74809b780 con 0x7fd748160ea0 2023-12-12T09:19:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.155+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74809ab40 con 0x7fd748160ea0 2023-12-12T09:19:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.156+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd748067f60 con 0x7fd748160ea0 2023-12-12T09:19:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.157+0000 7fd73dffb640 1 -- 172.21.15.84:0/3152391422 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd74000ab50 con 0x7fd748160ea0 2023-12-12T09:19:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.158+0000 7fd73dffb640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd72c06ae70 0x7fd72c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.158+0000 7fd73dffb640 1 -- 172.21.15.84:0/3152391422 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd740088990 con 0x7fd748160ea0 2023-12-12T09:19:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.158+0000 7fd74d4c8640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd72c06ae70 0x7fd72c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.158+0000 7fd74d4c8640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd72c06ae70 0x7fd72c06d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd744006fd0 tx=0x7fd744008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.162+0000 7fd73dffb640 1 -- 172.21.15.84:0/3152391422 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd740053da0 con 0x7fd748160ea0 2023-12-12T09:19:39.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:39.358+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd74809bca0 con 0x7fd748160ea0 2023-12-12T09:19:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.085+0000 7fd73dffb640 1 -- 172.21.15.84:0/3152391422 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd74809bca0 con 0x7fd748160ea0 2023-12-12T09:19:40.086 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-12-12T09:19:40.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.089+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd72c06ae70 msgr2=0x7fd72c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:40.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.089+0000 7fd74f72c640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd72c06ae70 0x7fd72c06d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd744006fd0 tx=0x7fd744008040 comp rx=0 tx=0).stop 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd748160ea0 msgr2=0x7fd748149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd748160ea0 0x7fd748149420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd74000c730 tx=0x7fd74000cbf0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 shutdown_connections 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd72c06ae70 0x7fd72c06d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd748160ea0 0x7fd748149420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd74806ca70 0x7fd748161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 --2- 172.21.15.84:0/3152391422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd74806c560 0x7fd748161310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 >> 172.21.15.84:0/3152391422 conn(0x7fd7480b0970 msgr2=0x7fd7480af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 shutdown_connections 2023-12-12T09:19:40.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.090+0000 7fd74f72c640 1 -- 172.21.15.84:0/3152391422 wait complete. 2023-12-12T09:19:40.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-12T09:19:40.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.316+0000 7fddda71a640 1 Processor -- start 2023-12-12T09:19:40.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.316+0000 7fddda71a640 1 -- start start 2023-12-12T09:19:40.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddda71a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40cec60 0x7fddd40d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddda71a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddd40d3590 0x7fddd40b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddda71a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd40cdc30 con 0x7fddd40cf890 2023-12-12T09:19:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddda71a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40cdea0 con 0x7fddd40d3590 2023-12-12T09:19:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddda71a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40ce180 con 0x7fddd40cec60 2023-12-12T09:19:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddd9f19640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fddd40d3590 0x7fddd40b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddd9718640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fddd40cf890 0x7fddd40cfc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:52846/0 (socket says 172.21.15.84:52846) 2023-12-12T09:19:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddd9718640 1 -- 172.21.15.84:0/2867554694 learned_addr learned my addr 172.21.15.84:0/2867554694 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.318+0000 7fddd8f17640 1 --2- 172.21.15.84:0/2867554694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40cec60 0x7fddd40d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.319+0000 7fddd9f19640 1 -- 172.21.15.84:0/2867554694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40cec60 msgr2=0x7fddd40d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.319+0000 7fddd9f19640 1 --2- 172.21.15.84:0/2867554694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40cec60 0x7fddd40d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.319+0000 7fddd9f19640 1 -- 172.21.15.84:0/2867554694 >> v1:172.21.15.99:6789/0 conn(0x7fddd40cf890 legacy=0x7fddd40cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.319+0000 7fddd9f19640 1 -- 172.21.15.84:0/2867554694 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40ce460 con 0x7fddd40d3590 2023-12-12T09:19:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.320+0000 7fddd9f19640 1 --2- 172.21.15.84:0/2867554694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40d3590 0x7fddd40b5cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0097a0 tx=0x7fddcc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce18a605b01831fb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.320+0000 7fddd3fff640 1 -- 172.21.15.84:0/2867554694 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc031830 con 0x7fddd40d3590 2023-12-12T09:19:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.320+0000 7fddd3fff640 1 -- 172.21.15.84:0/2867554694 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc031990 con 0x7fddd40d3590 2023-12-12T09:19:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.320+0000 7fddd3fff640 1 -- 172.21.15.84:0/2867554694 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc031d20 con 0x7fddd40d3590 2023-12-12T09:19:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.321+0000 7fddda71a640 1 -- 172.21.15.84:0/2867554694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40d3590 msgr2=0x7fddd40b5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.321+0000 7fddda71a640 1 --2- 172.21.15.84:0/2867554694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40d3590 0x7fddd40b5cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0097a0 tx=0x7fddcc02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.321+0000 7fddda71a640 1 -- 172.21.15.84:0/2867554694 shutdown_connections 2023-12-12T09:19:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.321+0000 7fddda71a640 1 --2- 172.21.15.84:0/2867554694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40d3590 0x7fddd40b5cd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.321+0000 7fddda71a640 1 --2- 172.21.15.84:0/2867554694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40cec60 0x7fddd40d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.321+0000 7fddda71a640 1 -- 172.21.15.84:0/2867554694 >> 172.21.15.84:0/2867554694 conn(0x7fddd409c1f0 msgr2=0x7fddd40d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.321+0000 7fddda71a640 1 -- 172.21.15.84:0/2867554694 shutdown_connections 2023-12-12T09:19:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.321+0000 7fddda71a640 1 -- 172.21.15.84:0/2867554694 wait complete. 2023-12-12T09:19:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.323+0000 7fddda71a640 1 Processor -- start 2023-12-12T09:19:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.323+0000 7fddda71a640 1 -- start start 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddda71a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40cec60 0x7fddd40c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddda71a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cf890 0x7fddd4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddda71a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40d3590 0x7fddd41f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddda71a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40c8ff0 con 0x7fddd40cec60 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddda71a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40b6c90 con 0x7fddd40cf890 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddda71a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40b6f70 con 0x7fddd40d3590 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddd9718640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40cec60 0x7fddd40c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddd9718640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40cec60 0x7fddd40c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43246/0 (socket says 172.21.15.84:43246) 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddd9718640 1 -- 172.21.15.84:0/2491277252 learned_addr learned my addr 172.21.15.84:0/2491277252 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddd9f19640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40d3590 0x7fddd41f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.324+0000 7fddd9718640 1 -- 172.21.15.84:0/2491277252 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40d3590 msgr2=0x7fddd41f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd9718640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40d3590 0x7fddd41f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd9718640 1 -- 172.21.15.84:0/2491277252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cf890 msgr2=0x7fddd4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd9718640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cf890 0x7fddd4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd9718640 1 -- 172.21.15.84:0/2491277252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009400 con 0x7fddd40cec60 2023-12-12T09:19:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd9f19640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40d3590 0x7fddd41f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:19:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd9718640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40cec60 0x7fddd40c8790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddc4002230 tx=0x7fddc400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd1ffb640 1 -- 172.21.15.84:0/2491277252 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400ad40 con 0x7fddd40cec60 2023-12-12T09:19:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd1ffb640 1 -- 172.21.15.84:0/2491277252 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4012400 con 0x7fddd40cec60 2023-12-12T09:19:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd40b7250 con 0x7fddd40cec60 2023-12-12T09:19:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddd1ffb640 1 -- 172.21.15.84:0/2491277252 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400aea0 con 0x7fddd40cec60 2023-12-12T09:19:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.325+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd40c8cd0 con 0x7fddd40cec60 2023-12-12T09:19:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.326+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd40b7770 con 0x7fddd40cec60 2023-12-12T09:19:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.328+0000 7fddd1ffb640 1 -- 172.21.15.84:0/2491277252 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fddc4007070 con 0x7fddd40cec60 2023-12-12T09:19:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.329+0000 7fddd1ffb640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fddc006ae40 0x7fddc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.329+0000 7fddd1ffb640 1 -- 172.21.15.84:0/2491277252 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fddc4089650 con 0x7fddd40cec60 2023-12-12T09:19:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.330+0000 7fddd8f17640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fddc006ae40 0x7fddc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:40.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.330+0000 7fddd8f17640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fddc006ae40 0x7fddc006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fddc8006fd0 tx=0x7fddc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.333+0000 7fddd1ffb640 1 -- 172.21.15.84:0/2491277252 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fddc40549c0 con 0x7fddd40cec60 2023-12-12T09:19:40.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:40.527+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fddd40b7770 con 0x7fddd40cec60 2023-12-12T09:19:41.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.091+0000 7fddd1ffb640 1 -- 172.21.15.84:0/2491277252 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fddd40b7770 con 0x7fddd40cec60 2023-12-12T09:19:41.092 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-12-12T09:19:41.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.095+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fddc006ae40 msgr2=0x7fddc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:41.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.095+0000 7fddda71a640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fddc006ae40 0x7fddc006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fddc8006fd0 tx=0x7fddc8008040 comp rx=0 tx=0).stop 2023-12-12T09:19:41.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.095+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40cec60 msgr2=0x7fddd40c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:41.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.095+0000 7fddda71a640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40cec60 0x7fddd40c8790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddc4002230 tx=0x7fddc400a430 comp rx=0 tx=0).stop 2023-12-12T09:19:41.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.096+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 shutdown_connections 2023-12-12T09:19:41.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.096+0000 7fddda71a640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fddd40d3590 0x7fddd41f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.096+0000 7fddda71a640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fddd40cf890 0x7fddd4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.096+0000 7fddda71a640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fddc006ae40 0x7fddc006d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.096+0000 7fddda71a640 1 --2- 172.21.15.84:0/2491277252 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd40cec60 0x7fddd40c8790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.096+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 >> 172.21.15.84:0/2491277252 conn(0x7fddd409c1f0 msgr2=0x7fddd40cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.098+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 shutdown_connections 2023-12-12T09:19:41.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.098+0000 7fddda71a640 1 -- 172.21.15.84:0/2491277252 wait complete. 2023-12-12T09:19:41.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T09:19:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.320+0000 7f8084a23640 1 Processor -- start 2023-12-12T09:19:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.320+0000 7f8084a23640 1 -- start start 2023-12-12T09:19:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.321+0000 7f8084a23640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800cdfa0 0x7f808006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.321+0000 7f8084a23640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80800cf3e0 con 0x7f808006e490 2023-12-12T09:19:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.322+0000 7f8084a23640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808006d600 con 0x7f808015d1c0 2023-12-12T09:19:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.322+0000 7f8084a23640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808006bfa0 con 0x7f80800cdfa0 2023-12-12T09:19:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.322+0000 7f807dd9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f808006e490 0x7f80800cd890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36282/0 (socket says 172.21.15.84:36282) 2023-12-12T09:19:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.322+0000 7f807dd9b640 1 -- 172.21.15.84:0/1740677191 learned_addr learned my addr 172.21.15.84:0/1740677191 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.322+0000 7f807ed9d640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800cdfa0 0x7f808006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.322+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737470466 0 0) 0x7f80800cf3e0 con 0x7f808006e490 2023-12-12T09:19:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.322+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8068003520 con 0x7f808006e490 2023-12-12T09:19:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2680277658 0 0) 0x7f8068003520 con 0x7f808006e490 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800cdfa0 msgr2=0x7f808006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800cdfa0 0x7f808006e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 >> v1:172.21.15.99:6789/0 conn(0x7f808015d1c0 legacy=0x7f808006b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808006efe0 con 0x7f808006e490 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f8074001670 con 0x7f808006e490 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 >> v1:172.21.15.84:6789/0 conn(0x7f808006e490 legacy=0x7f80800cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680039a0 0x7f8068003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800cdfa0 0x7f80680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8068004d00 0x7f8068005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808006bfa0 con 0x7f80680039a0 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806800ba60 con 0x7f8068004d00 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806800bc20 con 0x7f80800cdfa0 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807e59c640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680039a0 0x7f8068003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.323+0000 7f807ed9d640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8068004d00 0x7f8068005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.324+0000 7f807e59c640 1 -- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800cdfa0 msgr2=0x7f80680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.324+0000 7f807e59c640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800cdfa0 0x7f80680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.324+0000 7f807e59c640 1 -- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8068004d00 msgr2=0x7f8068005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.324+0000 7f807e59c640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8068004d00 0x7f8068005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.324+0000 7f807e59c640 1 -- 172.21.15.84:0/1740677191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068003520 con 0x7f80680039a0 2023-12-12T09:19:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.324+0000 7f807ed9d640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8068004d00 0x7f8068005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f807e59c640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680039a0 0x7f8068003dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8070001720 tx=0x7f80680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be43946d9494861 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700052d0 con 0x7f80680039a0 2023-12-12T09:19:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807002e050 con 0x7f80680039a0 2023-12-12T09:19:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f807d59a640 1 -- 172.21.15.84:0/1740677191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700035f0 con 0x7f80680039a0 2023-12-12T09:19:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f8084a23640 1 -- 172.21.15.84:0/1740677191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680039a0 msgr2=0x7f8068003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f8084a23640 1 --2- 172.21.15.84:0/1740677191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680039a0 0x7f8068003dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8070001720 tx=0x7f80680057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f807ed9d640 1 -- 172.21.15.84:0/1740677191 reap_dead start 2023-12-12T09:19:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f8084a23640 1 -- 172.21.15.84:0/1740677191 shutdown_connections 2023-12-12T09:19:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.325+0000 7f8084a23640 1 -- 172.21.15.84:0/1740677191 >> 172.21.15.84:0/1740677191 conn(0x7f80800b2a20 msgr2=0x7f80800b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.326+0000 7f8084a23640 1 -- 172.21.15.84:0/1740677191 shutdown_connections 2023-12-12T09:19:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.326+0000 7f8084a23640 1 -- 172.21.15.84:0/1740677191 wait complete. 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.327+0000 7f8084a23640 1 Processor -- start 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.328+0000 7f8084a23640 1 -- start start 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.328+0000 7f8084a23640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680039a0 0x7f80801f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.328+0000 7f8084a23640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80801f00e0 0x7f80800b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.328+0000 7f8084a23640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800b62f0 0x7f80801f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.328+0000 7f8084a23640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808015fe80 con 0x7f80801f00e0 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.328+0000 7f8084a23640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808015f9f0 con 0x7f80680039a0 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.328+0000 7f8084a23640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80801f3c80 con 0x7f80800b62f0 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80801f00e0 0x7f80800b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80801f00e0 0x7f80800b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43268/0 (socket says 172.21.15.84:43268) 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 -- 172.21.15.84:0/2597313739 learned_addr learned my addr 172.21.15.84:0/2597313739 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807ed9d640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800b62f0 0x7f80801f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807e59c640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680039a0 0x7f80801f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 -- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800b62f0 msgr2=0x7f80801f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800b62f0 0x7f80801f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 -- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680039a0 msgr2=0x7f80801f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680039a0 0x7f80801f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 -- 172.21.15.84:0/2597313739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808015d720 con 0x7f80801f00e0 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807e59c640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680039a0 0x7f80801f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.329+0000 7f807dd9b640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80801f00e0 0x7f80800b5db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f807400c6b0 tx=0x7f807400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.330+0000 7f806effd640 1 -- 172.21.15.84:0/2597313739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740072d0 con 0x7f80801f00e0 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.330+0000 7f806effd640 1 -- 172.21.15.84:0/2597313739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8074007450 con 0x7f80801f00e0 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.330+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80800b6750 con 0x7f80801f00e0 2023-12-12T09:19:41.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.330+0000 7f806effd640 1 -- 172.21.15.84:0/2597313739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740047e0 con 0x7f80801f00e0 2023-12-12T09:19:41.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.330+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808015f0c0 con 0x7f80801f00e0 2023-12-12T09:19:41.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.331+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808015fba0 con 0x7f80801f00e0 2023-12-12T09:19:41.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.332+0000 7f806effd640 1 -- 172.21.15.84:0/2597313739 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8074004960 con 0x7f80801f00e0 2023-12-12T09:19:41.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.333+0000 7f806effd640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f806006ae40 0x7f806006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:41.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.333+0000 7f806effd640 1 -- 172.21.15.84:0/2597313739 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8074088d30 con 0x7f80801f00e0 2023-12-12T09:19:41.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.333+0000 7f807e59c640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f806006ae40 0x7f806006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:41.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.334+0000 7f807e59c640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f806006ae40 0x7f806006d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8070033000 tx=0x7f8070009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:41.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.338+0000 7f806effd640 1 -- 172.21.15.84:0/2597313739 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f808015fba0 con 0x7f80801f00e0 2023-12-12T09:19:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:41.563+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f808015fba0 con 0x7f80801f00e0 2023-12-12T09:19:42.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.106+0000 7f806effd640 1 -- 172.21.15.84:0/2597313739 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f808015fba0 con 0x7f80801f00e0 2023-12-12T09:19:42.107 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2023-12-12T09:19:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.109+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f806006ae40 msgr2=0x7f806006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.109+0000 7f8084a23640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f806006ae40 0x7f806006d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8070033000 tx=0x7f8070009030 comp rx=0 tx=0).stop 2023-12-12T09:19:42.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.109+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80801f00e0 msgr2=0x7f80800b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.109+0000 7f8084a23640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80801f00e0 0x7f80800b5db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f807400c6b0 tx=0x7f807400cb70 comp rx=0 tx=0).stop 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.110+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 shutdown_connections 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.110+0000 7f8084a23640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80800b62f0 0x7f80801f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.110+0000 7f8084a23640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f806006ae40 0x7f806006d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.110+0000 7f8084a23640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80801f00e0 0x7f80800b5db0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.110+0000 7f8084a23640 1 --2- 172.21.15.84:0/2597313739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680039a0 0x7f80801f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.110+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 >> 172.21.15.84:0/2597313739 conn(0x7f80800b2a20 msgr2=0x7f80800b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.110+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 shutdown_connections 2023-12-12T09:19:42.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.110+0000 7f8084a23640 1 -- 172.21.15.84:0/2597313739 wait complete. 2023-12-12T09:19:42.134 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-12T09:19:42.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-12T09:19:42.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.324+0000 7fbd4b189640 1 Processor -- start 2023-12-12T09:19:42.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.325+0000 7fbd4b189640 1 -- start start 2023-12-12T09:19:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.326+0000 7fbd4b189640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4406ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.326+0000 7fbd4b189640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd44070130 con 0x7fbd440cd900 2023-12-12T09:19:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.326+0000 7fbd4b189640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4406d390 con 0x7fbd4406c560 2023-12-12T09:19:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.326+0000 7fbd4b189640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440b3c50 con 0x7fbd4406ca70 2023-12-12T09:19:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd49726640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbd440cd900 0x7fbd440cdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36296/0 (socket says 172.21.15.84:36296) 2023-12-12T09:19:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd49726640 1 -- 172.21.15.84:0/3967435589 learned_addr learned my addr 172.21.15.84:0/3967435589 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd48f25640 1 --2- 172.21.15.84:0/3967435589 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4406ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd437fe640 1 -- 172.21.15.84:0/3967435589 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777691994 0 0) 0x7fbd44070130 con 0x7fbd440cd900 2023-12-12T09:19:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd437fe640 1 -- 172.21.15.84:0/3967435589 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd30003520 con 0x7fbd440cd900 2023-12-12T09:19:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd48f25640 1 -- 172.21.15.84:0/3967435589 >> v1:172.21.15.99:6789/0 conn(0x7fbd4406c560 legacy=0x7fbd440b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd437fe640 1 -- 172.21.15.84:0/3967435589 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3669812063 0 0) 0x7fbd30003520 con 0x7fbd440cd900 2023-12-12T09:19:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd48f25640 1 -- 172.21.15.84:0/3967435589 >> v1:172.21.15.84:6789/0 conn(0x7fbd440cd900 legacy=0x7fbd440cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.327+0000 7fbd48f25640 1 -- 172.21.15.84:0/3967435589 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440b3e40 con 0x7fbd4406ca70 2023-12-12T09:19:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.329+0000 7fbd48f25640 1 --2- 172.21.15.84:0/3967435589 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4406ce50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbd340097d0 tx=0x7fbd3402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=498c75a022cc324a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.329+0000 7fbd437fe640 1 -- 172.21.15.84:0/3967435589 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c0019f0 con 0x7fbd4406ca70 2023-12-12T09:19:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.329+0000 7fbd437fe640 1 -- 172.21.15.84:0/3967435589 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3402e050 con 0x7fbd4406ca70 2023-12-12T09:19:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.329+0000 7fbd437fe640 1 -- 172.21.15.84:0/3967435589 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd34030710 con 0x7fbd4406ca70 2023-12-12T09:19:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.330+0000 7fbd4b189640 1 -- 172.21.15.84:0/3967435589 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 msgr2=0x7fbd4406ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.330+0000 7fbd4b189640 1 --2- 172.21.15.84:0/3967435589 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4406ce50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbd340097d0 tx=0x7fbd3402b770 comp rx=0 tx=0).stop 2023-12-12T09:19:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.330+0000 7fbd4b189640 1 -- 172.21.15.84:0/3967435589 shutdown_connections 2023-12-12T09:19:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.330+0000 7fbd4b189640 1 --2- 172.21.15.84:0/3967435589 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4406ce50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.330+0000 7fbd4b189640 1 -- 172.21.15.84:0/3967435589 >> 172.21.15.84:0/3967435589 conn(0x7fbd440b0970 msgr2=0x7fbd440b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.330+0000 7fbd4b189640 1 -- 172.21.15.84:0/3967435589 shutdown_connections 2023-12-12T09:19:42.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.330+0000 7fbd4b189640 1 -- 172.21.15.84:0/3967435589 wait complete. 2023-12-12T09:19:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.332+0000 7fbd4b189640 1 Processor -- start 2023-12-12T09:19:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.332+0000 7fbd4b189640 1 -- start start 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.333+0000 7fbd4b189640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd4406c560 0x7fbd440aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.333+0000 7fbd4b189640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.333+0000 7fbd4b189640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440cd900 0x7fbd4409afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.333+0000 7fbd4b189640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4409c1f0 con 0x7fbd440cd900 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.333+0000 7fbd4b189640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4409b5e0 con 0x7fbd4406c560 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.333+0000 7fbd4b189640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4409b8c0 con 0x7fbd4406ca70 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440cd900 0x7fbd4409afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440cd900 0x7fbd4409afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43284/0 (socket says 172.21.15.84:43284) 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 -- 172.21.15.84:0/3203970742 learned_addr learned my addr 172.21.15.84:0/3203970742 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd48f25640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd4406c560 0x7fbd440aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd43fff640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 -- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 msgr2=0x7fbd4409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4409aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 -- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd4406c560 msgr2=0x7fbd440aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd4406c560 0x7fbd440aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 -- 172.21.15.84:0/3203970742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd34009400 con 0x7fbd440cd900 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd43fff640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd49726640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440cd900 0x7fbd4409afb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c001f70 tx=0x7fbd3c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.334+0000 7fbd417fa640 1 -- 172.21.15.84:0/3203970742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012400 con 0x7fbd440cd900 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.335+0000 7fbd417fa640 1 -- 172.21.15.84:0/3203970742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c012560 con 0x7fbd440cd900 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.335+0000 7fbd417fa640 1 -- 172.21.15.84:0/3203970742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012910 con 0x7fbd440cd900 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.335+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4409bba0 con 0x7fbd440cd900 2023-12-12T09:19:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.335+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd440af2c0 con 0x7fbd440cd900 2023-12-12T09:19:42.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.336+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd44067f60 con 0x7fbd440cd900 2023-12-12T09:19:42.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.337+0000 7fbd417fa640 1 -- 172.21.15.84:0/3203970742 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd3c012a70 con 0x7fbd440cd900 2023-12-12T09:19:42.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.338+0000 7fbd417fa640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbd2406ae40 0x7fbd2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:42.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.338+0000 7fbd417fa640 1 -- 172.21.15.84:0/3203970742 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd3c089df0 con 0x7fbd440cd900 2023-12-12T09:19:42.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.338+0000 7fbd48f25640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbd2406ae40 0x7fbd2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:42.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.339+0000 7fbd48f25640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbd2406ae40 0x7fbd2406d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd34034000 tx=0x7fbd34008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.343+0000 7fbd417fa640 1 -- 172.21.15.84:0/3203970742 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd3c054ea0 con 0x7fbd440cd900 2023-12-12T09:19:42.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.559+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fbd440673c0 con 0x7fbd440cd900 2023-12-12T09:19:42.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.831+0000 7fbd417fa640 1 -- 172.21.15.84:0/3203970742 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fbd3c0584c0 con 0x7fbd440cd900 2023-12-12T09:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.835+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbd2406ae40 msgr2=0x7fbd2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.835+0000 7fbd4b189640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbd2406ae40 0x7fbd2406d300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbd34034000 tx=0x7fbd34008030 comp rx=0 tx=0).stop 2023-12-12T09:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440cd900 msgr2=0x7fbd4409afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440cd900 0x7fbd4409afb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c001f70 tx=0x7fbd3c00a430 comp rx=0 tx=0).stop 2023-12-12T09:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 shutdown_connections 2023-12-12T09:19:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbd2406ae40 0x7fbd2406d300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd440cd900 0x7fbd4409afb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbd4406ca70 0x7fbd4409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 --2- 172.21.15.84:0/3203970742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd4406c560 0x7fbd440aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:42.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 >> 172.21.15.84:0/3203970742 conn(0x7fbd440b0970 msgr2=0x7fbd440cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:42.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 shutdown_connections 2023-12-12T09:19:42.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:42.836+0000 7fbd4b189640 1 -- 172.21.15.84:0/3203970742 wait complete. 2023-12-12T09:19:42.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:19:43.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.070+0000 7fdc86361640 1 Processor -- start 2023-12-12T09:19:43.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.070+0000 7fdc86361640 1 -- start start 2023-12-12T09:19:43.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.072+0000 7fdc86361640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc801579c0 0x7fdc800ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:43.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.072+0000 7fdc86361640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc8006d3b0 0x7fdc8006d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:43.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.072+0000 7fdc86361640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8006dd40 con 0x7fdc800adb40 2023-12-12T09:19:43.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.072+0000 7fdc86361640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8015e750 con 0x7fdc8006d3b0 2023-12-12T09:19:43.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.072+0000 7fdc86361640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc800ad0e0 con 0x7fdc801579c0 2023-12-12T09:19:43.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.072+0000 7fdc848fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc8006d3b0 0x7fdc8006d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:43.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.072+0000 7fdc848fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdc8006d3b0 0x7fdc8006d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43290/0 (socket says 172.21.15.84:43290) 2023-12-12T09:19:43.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.072+0000 7fdc848fe640 1 -- 172.21.15.84:0/3142012952 learned_addr learned my addr 172.21.15.84:0/3142012952 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:43.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.073+0000 7fdc7ffff640 1 --2- 172.21.15.84:0/3142012952 >> v2:172.21.15.99:3300/0 conn(0x7fdc801579c0 0x7fdc800ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:43.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.073+0000 7fdc848fe640 1 -- 172.21.15.84:0/3142012952 >> v2:172.21.15.99:3300/0 conn(0x7fdc801579c0 msgr2=0x7fdc800ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:43.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.073+0000 7fdc848fe640 1 --2- 172.21.15.84:0/3142012952 >> v2:172.21.15.99:3300/0 conn(0x7fdc801579c0 0x7fdc800ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:43.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.073+0000 7fdc848fe640 1 -- 172.21.15.84:0/3142012952 >> v1:172.21.15.84:6789/0 conn(0x7fdc800adb40 legacy=0x7fdc8015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:43.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.073+0000 7fdc848fe640 1 -- 172.21.15.84:0/3142012952 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc800ad3c0 con 0x7fdc8006d3b0 2023-12-12T09:19:43.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.075+0000 7fdc848fe640 1 --2- 172.21.15.84:0/3142012952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc8006d3b0 0x7fdc8006d800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc800741f0 tx=0x7fdc7802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84693acc1fa6d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:43.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.075+0000 7fdc7f7fe640 1 -- 172.21.15.84:0/3142012952 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78030860 con 0x7fdc8006d3b0 2023-12-12T09:19:43.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.075+0000 7fdc7f7fe640 1 -- 172.21.15.84:0/3142012952 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc780309c0 con 0x7fdc8006d3b0 2023-12-12T09:19:43.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.075+0000 7fdc7f7fe640 1 -- 172.21.15.84:0/3142012952 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78030d50 con 0x7fdc8006d3b0 2023-12-12T09:19:43.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.076+0000 7fdc86361640 1 -- 172.21.15.84:0/3142012952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc8006d3b0 msgr2=0x7fdc8006d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.076+0000 7fdc86361640 1 --2- 172.21.15.84:0/3142012952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc8006d3b0 0x7fdc8006d800 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc800741f0 tx=0x7fdc7802b9a0 comp rx=0 tx=0).stop 2023-12-12T09:19:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.076+0000 7fdc86361640 1 -- 172.21.15.84:0/3142012952 shutdown_connections 2023-12-12T09:19:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.076+0000 7fdc86361640 1 --2- 172.21.15.84:0/3142012952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc8006d3b0 0x7fdc8006d800 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.076+0000 7fdc86361640 1 --2- 172.21.15.84:0/3142012952 >> v2:172.21.15.99:3300/0 conn(0x7fdc801579c0 0x7fdc800ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.076+0000 7fdc86361640 1 -- 172.21.15.84:0/3142012952 >> 172.21.15.84:0/3142012952 conn(0x7fdc800b0860 msgr2=0x7fdc800b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.076+0000 7fdc86361640 1 -- 172.21.15.84:0/3142012952 shutdown_connections 2023-12-12T09:19:43.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.076+0000 7fdc86361640 1 -- 172.21.15.84:0/3142012952 wait complete. 2023-12-12T09:19:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.078+0000 7fdc86361640 1 Processor -- start 2023-12-12T09:19:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.078+0000 7fdc86361640 1 -- start start 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc86361640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8006d3b0 0x7fdc80159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc86361640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc800adb40 0x7fdc80148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc86361640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc801579c0 0x7fdc8015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc86361640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc80158c10 con 0x7fdc800adb40 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc86361640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc80148c60 con 0x7fdc8006d3b0 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc86361640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc80157f90 con 0x7fdc801579c0 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc777fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc800adb40 0x7fdc80148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc777fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc800adb40 0x7fdc80148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43292/0 (socket says 172.21.15.84:43292) 2023-12-12T09:19:43.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.079+0000 7fdc777fe640 1 -- 172.21.15.84:0/2965404877 learned_addr learned my addr 172.21.15.84:0/2965404877 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc777fe640 1 -- 172.21.15.84:0/2965404877 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc801579c0 msgr2=0x7fdc8015fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc777fe640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc801579c0 0x7fdc8015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc777fe640 1 -- 172.21.15.84:0/2965404877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8006d3b0 msgr2=0x7fdc80159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc777fe640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8006d3b0 0x7fdc80159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc777fe640 1 -- 172.21.15.84:0/2965404877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc780094d0 con 0x7fdc800adb40 2023-12-12T09:19:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc777fe640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc800adb40 0x7fdc80148720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c400 tx=0x7fdc6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc7d7fa640 1 -- 172.21.15.84:0/2965404877 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc680052d0 con 0x7fdc800adb40 2023-12-12T09:19:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc7d7fa640 1 -- 172.21.15.84:0/2965404877 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc68005430 con 0x7fdc800adb40 2023-12-12T09:19:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc7d7fa640 1 -- 172.21.15.84:0/2965404877 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68003830 con 0x7fdc800adb40 2023-12-12T09:19:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc80158270 con 0x7fdc800adb40 2023-12-12T09:19:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.080+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc80158830 con 0x7fdc800adb40 2023-12-12T09:19:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.081+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc800673c0 con 0x7fdc800adb40 2023-12-12T09:19:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.082+0000 7fdc7d7fa640 1 -- 172.21.15.84:0/2965404877 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc68003990 con 0x7fdc800adb40 2023-12-12T09:19:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.084+0000 7fdc7d7fa640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdc6006ae70 0x7fdc6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.084+0000 7fdc7d7fa640 1 -- 172.21.15.84:0/2965404877 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fdc68088c50 con 0x7fdc800adb40 2023-12-12T09:19:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.084+0000 7fdc7ffff640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdc6006ae70 0x7fdc6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:43.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.085+0000 7fdc7ffff640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdc6006ae70 0x7fdc6006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc700070b0 tx=0x7fdc70007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:43.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.089+0000 7fdc7d7fa640 1 -- 172.21.15.84:0/2965404877 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc68053af0 con 0x7fdc800adb40 2023-12-12T09:19:43.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:43.282+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdc8006dd40 con 0x7fdc800adb40 2023-12-12T09:19:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.146+0000 7fdc7d7fa640 1 -- 172.21.15.84:0/2965404877 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fdc8006dd40 con 0x7fdc800adb40 2023-12-12T09:19:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' created 2023-12-12T09:19:45.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.149+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdc6006ae70 msgr2=0x7fdc6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:45.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.149+0000 7fdc86361640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdc6006ae70 0x7fdc6006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc700070b0 tx=0x7fdc70007040 comp rx=0 tx=0).stop 2023-12-12T09:19:45.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.149+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc800adb40 msgr2=0x7fdc80148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:45.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc800adb40 0x7fdc80148720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c400 tx=0x7fdc6800c8c0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 shutdown_connections 2023-12-12T09:19:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdc801579c0 0x7fdc8015fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdc6006ae70 0x7fdc6006d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc800adb40 0x7fdc80148720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 --2- 172.21.15.84:0/2965404877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8006d3b0 0x7fdc80159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 >> 172.21.15.84:0/2965404877 conn(0x7fdc800b0860 msgr2=0x7fdc8015c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 shutdown_connections 2023-12-12T09:19:45.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.150+0000 7fdc86361640 1 -- 172.21.15.84:0/2965404877 wait complete. 2023-12-12T09:19:45.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-12T09:19:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.365+0000 7fb458c61640 1 Processor -- start 2023-12-12T09:19:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.366+0000 7fb458c61640 1 -- start start 2023-12-12T09:19:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.367+0000 7fb458c61640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb45415d260 0x7fb4540ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.367+0000 7fb458c61640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb454071220 con 0x7fb454160e90 2023-12-12T09:19:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.367+0000 7fb458c61640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4540cec30 con 0x7fb4540cfca0 2023-12-12T09:19:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.367+0000 7fb458c61640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45406e2e0 con 0x7fb45415d260 2023-12-12T09:19:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.367+0000 7fb449d9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb454160e90 0x7fb45406dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36314/0 (socket says 172.21.15.84:36314) 2023-12-12T09:19:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.367+0000 7fb449d9b640 1 -- 172.21.15.84:0/811951866 learned_addr learned my addr 172.21.15.84:0/811951866 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb45259c640 1 --2- 172.21.15.84:0/811951866 >> v2:172.21.15.99:3300/0 conn(0x7fb45415d260 0x7fb4540ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753982176 0 0) 0x7fb454071220 con 0x7fb454160e90 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440003520 con 0x7fb454160e90 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3280221733 0 0) 0x7fb440003520 con 0x7fb454160e90 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 >> v2:172.21.15.99:3300/0 conn(0x7fb45415d260 msgr2=0x7fb4540ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 --2- 172.21.15.84:0/811951866 >> v2:172.21.15.99:3300/0 conn(0x7fb45415d260 0x7fb4540ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 >> v1:172.21.15.99:6789/0 conn(0x7fb4540cfca0 legacy=0x7fb454071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540cef10 con 0x7fb454160e90 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fb43c001670 con 0x7fb454160e90 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 >> v1:172.21.15.84:6789/0 conn(0x7fb454160e90 legacy=0x7fb45406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb440003a50 0x7fb440003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400047c0 0x7fb440004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4400051d0 0x7fb44000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45406e2e0 con 0x7fb4400047c0 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44000c100 con 0x7fb440003a50 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.368+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44000c2c0 con 0x7fb4400051d0 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb449d9b640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400047c0 0x7fb440004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb45259c640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb440003a50 0x7fb440003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb449d9b640 1 -- 172.21.15.84:0/811951866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4400051d0 msgr2=0x7fb44000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb449d9b640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4400051d0 0x7fb44000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb449d9b640 1 -- 172.21.15.84:0/811951866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb440003a50 msgr2=0x7fb440003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb449d9b640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb440003a50 0x7fb440003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb449d9b640 1 -- 172.21.15.84:0/811951866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440003520 con 0x7fb4400047c0 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb452d9d640 1 -- 172.21.15.84:0/811951866 reap_dead start 2023-12-12T09:19:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.369+0000 7fb45259c640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb440003a50 0x7fb440003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.370+0000 7fb449d9b640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400047c0 0x7fb440004c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c210 tx=0x7fb4400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8af886e9591bc41 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.370+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c005ad0 con 0x7fb4400047c0 2023-12-12T09:19:45.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.370+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c005c50 con 0x7fb4400047c0 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.370+0000 7fb451d9b640 1 -- 172.21.15.84:0/811951866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c02c8d0 con 0x7fb4400047c0 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.371+0000 7fb458c61640 1 -- 172.21.15.84:0/811951866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400047c0 msgr2=0x7fb440004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.371+0000 7fb458c61640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400047c0 0x7fb440004c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c210 tx=0x7fb4400057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.371+0000 7fb458c61640 1 -- 172.21.15.84:0/811951866 shutdown_connections 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.371+0000 7fb458c61640 1 --2- 172.21.15.84:0/811951866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4400047c0 0x7fb440004c40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.371+0000 7fb458c61640 1 -- 172.21.15.84:0/811951866 >> 172.21.15.84:0/811951866 conn(0x7fb45406b7f0 msgr2=0x7fb45406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.371+0000 7fb458c61640 1 -- 172.21.15.84:0/811951866 shutdown_connections 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.371+0000 7fb458c61640 1 -- 172.21.15.84:0/811951866 wait complete. 2023-12-12T09:19:45.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.373+0000 7fb458c61640 1 Processor -- start 2023-12-12T09:19:45.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.373+0000 7fb458c61640 1 -- start start 2023-12-12T09:19:45.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb458c61640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4400047c0 0x7fb454148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb458c61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4540c4cf0 0x7fb45414a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb458c61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45414ad70 0x7fb45414c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb458c61640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45414f650 con 0x7fb45414ad70 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb458c61640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540c5590 con 0x7fb4540c4cf0 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb458c61640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb454149d70 con 0x7fb4400047c0 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb452d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45414ad70 0x7fb45414c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb452d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45414ad70 0x7fb45414c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43306/0 (socket says 172.21.15.84:43306) 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.374+0000 7fb452d9d640 1 -- 172.21.15.84:0/3875301324 learned_addr learned my addr 172.21.15.84:0/3875301324 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb449d9b640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4540c4cf0 0x7fb45414a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb45259c640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4400047c0 0x7fb454148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb452d9d640 1 -- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4400047c0 msgr2=0x7fb454148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb452d9d640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4400047c0 0x7fb454148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb452d9d640 1 -- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4540c4cf0 msgr2=0x7fb45414a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb452d9d640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4540c4cf0 0x7fb45414a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb452d9d640 1 -- 172.21.15.84:0/3875301324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4540c52b0 con 0x7fb45414ad70 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb449d9b640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4540c4cf0 0x7fb45414a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb452d9d640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45414ad70 0x7fb45414c6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb45409e050 tx=0x7fb44c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb44b7fe640 1 -- 172.21.15.84:0/3875301324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0072e0 con 0x7fb45414ad70 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb44b7fe640 1 -- 172.21.15.84:0/3875301324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c007440 con 0x7fb45414ad70 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45414a030 con 0x7fb45414ad70 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb44b7fe640 1 -- 172.21.15.84:0/3875301324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0057c0 con 0x7fb45414ad70 2023-12-12T09:19:45.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.375+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb454148e60 con 0x7fb45414ad70 2023-12-12T09:19:45.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.377+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45414a550 con 0x7fb45414ad70 2023-12-12T09:19:45.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.378+0000 7fb44b7fe640 1 -- 172.21.15.84:0/3875301324 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb44c005920 con 0x7fb45414ad70 2023-12-12T09:19:45.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.379+0000 7fb44b7fe640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb43406ae40 0x7fb43406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:45.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.379+0000 7fb44b7fe640 1 -- 172.21.15.84:0/3875301324 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb44c088a70 con 0x7fb45414ad70 2023-12-12T09:19:45.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.379+0000 7fb45259c640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb43406ae40 0x7fb43406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:45.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.380+0000 7fb45259c640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb43406ae40 0x7fb43406d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb454068f30 tx=0x7fb44400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.384+0000 7fb44b7fe640 1 -- 172.21.15.84:0/3875301324 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb45414a550 con 0x7fb45414ad70 2023-12-12T09:19:45.443 INFO:tasks.ceph.mds.b.smithi099.stderr:2023-12-12T09:19:45.443+0000 7f0fdfa5b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:19:45.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:45.573+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb45414a550 con 0x7fb45414ad70 2023-12-12T09:19:46.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.151+0000 7fb44b7fe640 1 -- 172.21.15.84:0/3875301324 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb45414a550 con 0x7fb45414ad70 2023-12-12T09:19:46.152 INFO:teuthology.orchestra.run.smithi084.stderr:set pool 4 allow_ec_overwrites to true 2023-12-12T09:19:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.154+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb43406ae40 msgr2=0x7fb43406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.154+0000 7fb458c61640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb43406ae40 0x7fb43406d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb454068f30 tx=0x7fb44400b040 comp rx=0 tx=0).stop 2023-12-12T09:19:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45414ad70 msgr2=0x7fb45414c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45414ad70 0x7fb45414c6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb45409e050 tx=0x7fb44c00c820 comp rx=0 tx=0).stop 2023-12-12T09:19:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 shutdown_connections 2023-12-12T09:19:46.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb43406ae40 0x7fb43406d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb45414ad70 0x7fb45414c6f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4540c4cf0 0x7fb45414a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 --2- 172.21.15.84:0/3875301324 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4400047c0 0x7fb454148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 >> 172.21.15.84:0/3875301324 conn(0x7fb45406b7f0 msgr2=0x7fb454161350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 shutdown_connections 2023-12-12T09:19:46.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.155+0000 7fb458c61640 1 -- 172.21.15.84:0/3875301324 wait complete. 2023-12-12T09:19:46.194 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-12T09:19:46.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.376+0000 7f478759e640 1 Processor -- start 2023-12-12T09:19:46.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.377+0000 7f478759e640 1 -- start start 2023-12-12T09:19:46.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.378+0000 7f478759e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47880d1af0 0x7f47880cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:46.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.378+0000 7f478759e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4788160cb0 con 0x7f47880b7ac0 2023-12-12T09:19:46.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.378+0000 7f478759e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47880b8cc0 con 0x7f47880b88e0 2023-12-12T09:19:46.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.378+0000 7f478759e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880d3c70 con 0x7f47880d1af0 2023-12-12T09:19:46.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.378+0000 7f4786d9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f47880b7ac0 0x7f47880cdf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55450/0 (socket says 172.21.15.84:55450) 2023-12-12T09:19:46.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.378+0000 7f4786d9d640 1 -- 172.21.15.84:0/1468265906 learned_addr learned my addr 172.21.15.84:0/1468265906 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:46.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f4785d9b640 1 --2- 172.21.15.84:0/1468265906 >> v2:172.21.15.99:3300/0 conn(0x7f47880d1af0 0x7f47880cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799830023 0 0) 0x7f4788160cb0 con 0x7f47880b7ac0 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4774003520 con 0x7f47880b7ac0 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2038272392 0 0) 0x7f4774003520 con 0x7f47880b7ac0 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 >> v2:172.21.15.99:3300/0 conn(0x7f47880d1af0 msgr2=0x7f47880cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 --2- 172.21.15.84:0/1468265906 >> v2:172.21.15.99:3300/0 conn(0x7f47880d1af0 0x7f47880cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 >> v1:172.21.15.99:6789/0 conn(0x7f47880b88e0 legacy=0x7f47880d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880b5cf0 con 0x7f47880b7ac0 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f47800019f0 con 0x7f47880b7ac0 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 >> v1:172.21.15.84:6789/0 conn(0x7f47880b7ac0 legacy=0x7f47880cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740039e0 0x7f4774003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:46.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740047c0 0x7f4774004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4774005180 0x7f477400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880d3c70 con 0x7f47740047c0 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477400c090 con 0x7f4774005180 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.379+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477400c250 con 0x7f47740039e0 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4785d9b640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740047c0 0x7f4774004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4785d9b640 1 -- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740039e0 msgr2=0x7f4774003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f478659c640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740039e0 0x7f4774003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4786d9d640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4774005180 0x7f477400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4785d9b640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740039e0 0x7f4774003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4785d9b640 1 -- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4774005180 msgr2=0x7f477400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4785d9b640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4774005180 0x7f477400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4785d9b640 1 -- 172.21.15.84:0/1468265906 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774003520 con 0x7f47740047c0 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f478659c640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740039e0 0x7f4774003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:46.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4786d9d640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4774005180 0x7f477400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:46.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.380+0000 7f4786d9d640 1 -- 172.21.15.84:0/1468265906 reap_dead start 2023-12-12T09:19:46.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.381+0000 7f4785d9b640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740047c0 0x7f4774004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4770009ac0 tx=0x7f47740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fae0955771637d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.381+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477002c6b0 con 0x7f47740047c0 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477002c810 con 0x7f47740047c0 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478559a640 1 -- 172.21.15.84:0/1468265906 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477002cba0 con 0x7f47740047c0 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478759e640 1 -- 172.21.15.84:0/1468265906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740047c0 msgr2=0x7f4774004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478759e640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740047c0 0x7f4774004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4770009ac0 tx=0x7f47740057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478759e640 1 -- 172.21.15.84:0/1468265906 shutdown_connections 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478759e640 1 --2- 172.21.15.84:0/1468265906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47740047c0 0x7f4774004c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478759e640 1 -- 172.21.15.84:0/1468265906 >> 172.21.15.84:0/1468265906 conn(0x7f47880d2e00 msgr2=0x7f47880d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478759e640 1 -- 172.21.15.84:0/1468265906 shutdown_connections 2023-12-12T09:19:46.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.382+0000 7f478759e640 1 -- 172.21.15.84:0/1468265906 wait complete. 2023-12-12T09:19:46.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.384+0000 7f478759e640 1 Processor -- start 2023-12-12T09:19:46.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.384+0000 7f478759e640 1 -- start start 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.385+0000 7f478759e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740047c0 0x7f47880caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.385+0000 7f478759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47881f3470 0x7f47880cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.385+0000 7f478759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47880b4a20 0x7f478815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.385+0000 7f478759e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880cc180 con 0x7f47880b4a20 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.385+0000 7f478759e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880cb500 con 0x7f47881f3470 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.385+0000 7f478759e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880cb7e0 con 0x7f47740047c0 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47880b4a20 0x7f478815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47880b4a20 0x7f478815a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35222/0 (socket says 172.21.15.84:35222) 2023-12-12T09:19:46.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 -- 172.21.15.84:0/2855063012 learned_addr learned my addr 172.21.15.84:0/2855063012 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4785d9b640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47881f3470 0x7f47880cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:46.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f478659c640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740047c0 0x7f47880caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 -- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740047c0 msgr2=0x7f47880caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740047c0 0x7f47880caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 -- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47881f3470 msgr2=0x7f47880cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47881f3470 0x7f47880cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 -- 172.21.15.84:0/2855063012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880cbac0 con 0x7f47880b4a20 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f478659c640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740047c0 0x7f47880caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.386+0000 7f4786d9d640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47880b4a20 0x7f478815a030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4780000f80 tx=0x7f478000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.387+0000 7f477effd640 1 -- 172.21.15.84:0/2855063012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000bb80 con 0x7f47880b4a20 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.387+0000 7f477effd640 1 -- 172.21.15.84:0/2855063012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000bce0 con 0x7f47880b4a20 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.387+0000 7f477effd640 1 -- 172.21.15.84:0/2855063012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780007350 con 0x7f47880b4a20 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.387+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47880cbda0 con 0x7f47880b4a20 2023-12-12T09:19:46.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.387+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47880ccae0 con 0x7f47880b4a20 2023-12-12T09:19:46.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.388+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47880cc2c0 con 0x7f47880b4a20 2023-12-12T09:19:46.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.389+0000 7f477effd640 1 -- 172.21.15.84:0/2855063012 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47800074b0 con 0x7f47880b4a20 2023-12-12T09:19:46.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.390+0000 7f477effd640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476806ae40 0x7f476806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:46.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.390+0000 7f477effd640 1 -- 172.21.15.84:0/2855063012 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f4780089820 con 0x7f47880b4a20 2023-12-12T09:19:46.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.390+0000 7f478659c640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476806ae40 0x7f476806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:46.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.391+0000 7f478659c640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476806ae40 0x7f476806d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4778000c00 tx=0x7f4778009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:46.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.394+0000 7f477effd640 1 -- 172.21.15.84:0/2855063012 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47880cc2c0 con 0x7f47880b4a20 2023-12-12T09:19:46.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:46.617+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f47880cc2c0 con 0x7f47880b4a20 2023-12-12T09:19:47.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.177+0000 7f477effd640 1 -- 172.21.15.84:0/2855063012 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f47880cc2c0 con 0x7f47880b4a20 2023-12-12T09:19:47.177 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 4 to fsmap 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476806ae40 msgr2=0x7f476806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476806ae40 0x7f476806d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4778000c00 tx=0x7f4778009040 comp rx=0 tx=0).stop 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47880b4a20 msgr2=0x7f478815a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47880b4a20 0x7f478815a030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4780000f80 tx=0x7f478000b4a0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 shutdown_connections 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476806ae40 0x7f476806d300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47880b4a20 0x7f478815a030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47881f3470 0x7f47880cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 --2- 172.21.15.84:0/2855063012 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47740047c0 0x7f47880caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.181+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 >> 172.21.15.84:0/2855063012 conn(0x7f47880d2e00 msgr2=0x7f47880d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.182+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 shutdown_connections 2023-12-12T09:19:47.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.182+0000 7f478759e640 1 -- 172.21.15.84:0/2855063012 wait complete. 2023-12-12T09:19:47.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:19:47.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.415+0000 7fbf9afa9640 1 Processor -- start 2023-12-12T09:19:47.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.415+0000 7fbf9afa9640 1 -- start start 2023-12-12T09:19:47.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.417+0000 7fbf9afa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf94143d20 0x7fbf940b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.417+0000 7fbf9afa9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf940ce550 0x7fbf940b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.417+0000 7fbf9afa9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf940cea30 con 0x7fbf941447f0 2023-12-12T09:19:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.417+0000 7fbf9afa9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf940702b0 con 0x7fbf940ce550 2023-12-12T09:19:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.417+0000 7fbf9afa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94070590 con 0x7fbf94143d20 2023-12-12T09:19:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.417+0000 7fbf93fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf940ce550 0x7fbf940b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.417+0000 7fbf93fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbf940ce550 0x7fbf940b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35236/0 (socket says 172.21.15.84:35236) 2023-12-12T09:19:47.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.417+0000 7fbf93fff640 1 -- 172.21.15.84:0/2975887896 learned_addr learned my addr 172.21.15.84:0/2975887896 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:47.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.418+0000 7fbf98d45640 1 --2- 172.21.15.84:0/2975887896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf94143d20 0x7fbf940b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.418+0000 7fbf93fff640 1 -- 172.21.15.84:0/2975887896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf94143d20 msgr2=0x7fbf940b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:47.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.418+0000 7fbf93fff640 1 --2- 172.21.15.84:0/2975887896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf94143d20 0x7fbf940b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.418+0000 7fbf93fff640 1 -- 172.21.15.84:0/2975887896 >> v1:172.21.15.84:6789/0 conn(0x7fbf941447f0 legacy=0x7fbf9415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.418+0000 7fbf93fff640 1 -- 172.21.15.84:0/2975887896 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94070870 con 0x7fbf940ce550 2023-12-12T09:19:47.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.418+0000 7fbf98d45640 1 --2- 172.21.15.84:0/2975887896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf94143d20 0x7fbf940b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:47.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.419+0000 7fbf93fff640 1 --2- 172.21.15.84:0/2975887896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf940ce550 0x7fbf940b4610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009870 tx=0x7fbf8402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c0612649562f3f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:47.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.419+0000 7fbf937fe640 1 -- 172.21.15.84:0/2975887896 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84030840 con 0x7fbf940ce550 2023-12-12T09:19:47.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.419+0000 7fbf937fe640 1 -- 172.21.15.84:0/2975887896 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf840309a0 con 0x7fbf940ce550 2023-12-12T09:19:47.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.419+0000 7fbf937fe640 1 -- 172.21.15.84:0/2975887896 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84030d30 con 0x7fbf940ce550 2023-12-12T09:19:47.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.420+0000 7fbf9afa9640 1 -- 172.21.15.84:0/2975887896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf940ce550 msgr2=0x7fbf940b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.420+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/2975887896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf940ce550 0x7fbf940b4610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009870 tx=0x7fbf8402b980 comp rx=0 tx=0).stop 2023-12-12T09:19:47.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.420+0000 7fbf9afa9640 1 -- 172.21.15.84:0/2975887896 shutdown_connections 2023-12-12T09:19:47.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.420+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/2975887896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf940ce550 0x7fbf940b4610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.420+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/2975887896 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf94143d20 0x7fbf940b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.420+0000 7fbf9afa9640 1 -- 172.21.15.84:0/2975887896 >> 172.21.15.84:0/2975887896 conn(0x7fbf9406c3d0 msgr2=0x7fbf9406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:47.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.420+0000 7fbf9afa9640 1 -- 172.21.15.84:0/2975887896 shutdown_connections 2023-12-12T09:19:47.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.420+0000 7fbf9afa9640 1 -- 172.21.15.84:0/2975887896 wait complete. 2023-12-12T09:19:47.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.422+0000 7fbf9afa9640 1 Processor -- start 2023-12-12T09:19:47.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.422+0000 7fbf9afa9640 1 -- start start 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf9afa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf940ce550 0x7fbf9415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf9afa9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf94143d20 0x7fbf941405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf9afa9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf941447f0 0x7fbf9413acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf9afa9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9415da10 con 0x7fbf94143d20 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf9afa9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9415cd90 con 0x7fbf941447f0 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf9afa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9415d070 con 0x7fbf940ce550 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf93fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf94143d20 0x7fbf941405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf93fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf94143d20 0x7fbf941405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35246/0 (socket says 172.21.15.84:35246) 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf93fff640 1 -- 172.21.15.84:0/1921793905 learned_addr learned my addr 172.21.15.84:0/1921793905 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf93fff640 1 -- 172.21.15.84:0/1921793905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf940ce550 msgr2=0x7fbf9415c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf93fff640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf940ce550 0x7fbf9415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf93fff640 1 -- 172.21.15.84:0/1921793905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf941447f0 msgr2=0x7fbf9413acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf93fff640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf941447f0 0x7fbf9413acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.423+0000 7fbf93fff640 1 -- 172.21.15.84:0/1921793905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840094d0 con 0x7fbf94143d20 2023-12-12T09:19:47.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.424+0000 7fbf93fff640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf94143d20 0x7fbf941405d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf84000c00 tx=0x7fbf84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:47.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.424+0000 7fbf917fa640 1 -- 172.21.15.84:0/1921793905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84030810 con 0x7fbf94143d20 2023-12-12T09:19:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.424+0000 7fbf917fa640 1 -- 172.21.15.84:0/1921793905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84043400 con 0x7fbf94143d20 2023-12-12T09:19:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.424+0000 7fbf917fa640 1 -- 172.21.15.84:0/1921793905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840437d0 con 0x7fbf94143d20 2023-12-12T09:19:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.424+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9415d350 con 0x7fbf94143d20 2023-12-12T09:19:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.424+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf94140b10 con 0x7fbf94143d20 2023-12-12T09:19:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.425+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9415db50 con 0x7fbf94143d20 2023-12-12T09:19:47.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.426+0000 7fbf917fa640 1 -- 172.21.15.84:0/1921793905 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf84043930 con 0x7fbf94143d20 2023-12-12T09:19:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.427+0000 7fbf917fa640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf8006ae40 0x7fbf8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.427+0000 7fbf917fa640 1 -- 172.21.15.84:0/1921793905 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf8403e070 con 0x7fbf94143d20 2023-12-12T09:19:47.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.427+0000 7fbf98d45640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf8006ae40 0x7fbf8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.428+0000 7fbf98d45640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf8006ae40 0x7fbf8006d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf88006fd0 tx=0x7fbf88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.432+0000 7fbf917fa640 1 -- 172.21.15.84:0/1921793905 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf9415db50 con 0x7fbf94143d20 2023-12-12T09:19:47.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.644+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf9415db50 con 0x7fbf94143d20 2023-12-12T09:19:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.646+0000 7fbf917fa640 1 -- 172.21.15.84:0/1921793905 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fbf9415db50 con 0x7fbf94143d20 2023-12-12T09:19:47.646 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:47.646 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:19:46.619045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-12T09:19:47.646 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.648+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf8006ae40 msgr2=0x7fbf8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.648+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf8006ae40 0x7fbf8006d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf88006fd0 tx=0x7fbf88008040 comp rx=0 tx=0).stop 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.648+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf94143d20 msgr2=0x7fbf941405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.648+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf94143d20 0x7fbf941405d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf84000c00 tx=0x7fbf84004730 comp rx=0 tx=0).stop 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.649+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 shutdown_connections 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.649+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf941447f0 0x7fbf9413acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.649+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf8006ae40 0x7fbf8006d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.649+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf94143d20 0x7fbf941405d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.649+0000 7fbf9afa9640 1 --2- 172.21.15.84:0/1921793905 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf940ce550 0x7fbf9415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.649+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 >> 172.21.15.84:0/1921793905 conn(0x7fbf9406c3d0 msgr2=0x7fbf9406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:47.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.649+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 shutdown_connections 2023-12-12T09:19:47.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.649+0000 7fbf9afa9640 1 -- 172.21.15.84:0/1921793905 wait complete. 2023-12-12T09:19:47.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:47.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.874+0000 7f0a7f4e6640 1 Processor -- start 2023-12-12T09:19:47.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.874+0000 7f0a7f4e6640 1 -- start start 2023-12-12T09:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.876+0000 7f0a7f4e6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a78144740 0x7f0a7806de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.876+0000 7f0a7f4e6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a78144b20 con 0x7f0a7815f4f0 2023-12-12T09:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.876+0000 7f0a7f4e6640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7806d670 con 0x7f0a7815e950 2023-12-12T09:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.876+0000 7f0a7f4e6640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7806cdd0 con 0x7f0a78144740 2023-12-12T09:19:47.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.876+0000 7f0a7e4e4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a78144740 0x7f0a7806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.876+0000 7f0a7e4e4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a78144740 0x7f0a7806de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35258/0 (socket says 172.21.15.84:35258) 2023-12-12T09:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.876+0000 7f0a7e4e4640 1 -- 172.21.15.84:0/1115519732 learned_addr learned my addr 172.21.15.84:0/1115519732 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.876+0000 7f0a7ece5640 1 --1- 172.21.15.84:0/1115519732 >> v1:172.21.15.84:6789/0 conn(0x7f0a7815f4f0 0x7f0a780705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55466/0 (socket says 172.21.15.84:55466) 2023-12-12T09:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.877+0000 7f0a7e4e4640 1 -- 172.21.15.84:0/1115519732 >> v1:172.21.15.99:6789/0 conn(0x7f0a7815e950 legacy=0x7f0a7815ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.877+0000 7f0a7e4e4640 1 -- 172.21.15.84:0/1115519732 >> v1:172.21.15.84:6789/0 conn(0x7f0a7815f4f0 legacy=0x7f0a780705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.877+0000 7f0a7e4e4640 1 -- 172.21.15.84:0/1115519732 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7806d0b0 con 0x7f0a78144740 2023-12-12T09:19:47.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.877+0000 7f0a7d4e2640 1 -- 172.21.15.84:0/1115519732 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180154131 0 0) 0x7f0a78144b20 con 0x7f0a7815f4f0 2023-12-12T09:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.878+0000 7f0a7e4e4640 1 --2- 172.21.15.84:0/1115519732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a78144740 0x7f0a7806de80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009870 tx=0x7f0a7402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef90af46c987c765 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.878+0000 7f0a7d4e2640 1 -- 172.21.15.84:0/1115519732 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7402f840 con 0x7f0a78144740 2023-12-12T09:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.878+0000 7f0a7d4e2640 1 -- 172.21.15.84:0/1115519732 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7402f9a0 con 0x7f0a78144740 2023-12-12T09:19:47.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.878+0000 7f0a7d4e2640 1 -- 172.21.15.84:0/1115519732 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7402fd30 con 0x7f0a78144740 2023-12-12T09:19:47.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.879+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1115519732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a78144740 msgr2=0x7f0a7806de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.879+0000 7f0a7f4e6640 1 --2- 172.21.15.84:0/1115519732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a78144740 0x7f0a7806de80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009870 tx=0x7f0a7402ba20 comp rx=0 tx=0).stop 2023-12-12T09:19:47.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.879+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1115519732 shutdown_connections 2023-12-12T09:19:47.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.879+0000 7f0a7f4e6640 1 --2- 172.21.15.84:0/1115519732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a78144740 0x7f0a7806de80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.879+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1115519732 >> 172.21.15.84:0/1115519732 conn(0x7f0a780b07f0 msgr2=0x7f0a780b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:47.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.879+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1115519732 shutdown_connections 2023-12-12T09:19:47.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.879+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1115519732 wait complete. 2023-12-12T09:19:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.881+0000 7f0a7f4e6640 1 Processor -- start 2023-12-12T09:19:47.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.881+0000 7f0a7f4e6640 1 -- start start 2023-12-12T09:19:47.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7f4e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a78144740 0x7f0a7815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7f4e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a7815e950 0x7f0a78141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7f4e6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a7815f4f0 0x7f0a7815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7f4e6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a781e4770 con 0x7f0a7815e950 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7f4e6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a781e4980 con 0x7f0a78144740 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7f4e6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a781e4c60 con 0x7f0a7815f4f0 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7dce3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a7815e950 0x7f0a78141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7dce3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a7815e950 0x7f0a78141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35262/0 (socket says 172.21.15.84:35262) 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.882+0000 7f0a7dce3640 1 -- 172.21.15.84:0/1626014062 learned_addr learned my addr 172.21.15.84:0/1626014062 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7e4e4640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a78144740 0x7f0a7815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7ece5640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a7815f4f0 0x7f0a7815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7dce3640 1 -- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a7815f4f0 msgr2=0x7f0a7815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7dce3640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a7815f4f0 0x7f0a7815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7dce3640 1 -- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a78144740 msgr2=0x7f0a7815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7dce3640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a78144740 0x7f0a7815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7dce3640 1 -- 172.21.15.84:0/1626014062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740094d0 con 0x7f0a7815e950 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7e4e4640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a78144740 0x7f0a7815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7dce3640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a7815e950 0x7f0a78141080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800c450 tx=0x7f0a6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a6effd640 1 -- 172.21.15.84:0/1626014062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a680052d0 con 0x7f0a7815e950 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a6effd640 1 -- 172.21.15.84:0/1626014062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a68005430 con 0x7f0a7815e950 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a6effd640 1 -- 172.21.15.84:0/1626014062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68012870 con 0x7f0a7815e950 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a781e4f40 con 0x7f0a7815e950 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.883+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a781e5500 con 0x7f0a7815e950 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.884+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a781e5720 con 0x7f0a7815e950 2023-12-12T09:19:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.885+0000 7f0a6effd640 1 -- 172.21.15.84:0/1626014062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a680129d0 con 0x7f0a7815e950 2023-12-12T09:19:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.886+0000 7f0a6effd640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a5c06ae40 0x7f0a5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.886+0000 7f0a6effd640 1 -- 172.21.15.84:0/1626014062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a680894e0 con 0x7f0a7815e950 2023-12-12T09:19:47.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.887+0000 7f0a7e4e4640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a5c06ae40 0x7f0a5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:47.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.887+0000 7f0a7e4e4640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a5c06ae40 0x7f0a5c06d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a74036000 tx=0x7f0a74039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:47.891+0000 7f0a6effd640 1 -- 172.21.15.84:0/1626014062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a68054200 con 0x7f0a7815e950 2023-12-12T09:19:48.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.086+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a780673c0 con 0x7f0a7815e950 2023-12-12T09:19:48.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.089+0000 7f0a6effd640 1 -- 172.21.15.84:0/1626014062 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18275 (secure 0 0 0) 0x7f0a68057820 con 0x7f0a7815e950 2023-12-12T09:19:48.090 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:48.090 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:46.618788+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:48.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a5c06ae40 msgr2=0x7f0a5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a5c06ae40 0x7f0a5c06d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a74036000 tx=0x7f0a74039040 comp rx=0 tx=0).stop 2023-12-12T09:19:48.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a7815e950 msgr2=0x7f0a78141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a7815e950 0x7f0a78141080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800c450 tx=0x7f0a6800c910 comp rx=0 tx=0).stop 2023-12-12T09:19:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 shutdown_connections 2023-12-12T09:19:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a7815f4f0 0x7f0a7815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a5c06ae40 0x7f0a5c06d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a7815e950 0x7f0a78141080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 --2- 172.21.15.84:0/1626014062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a78144740 0x7f0a7815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 >> 172.21.15.84:0/1626014062 conn(0x7f0a780b07f0 msgr2=0x7f0a7813fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 shutdown_connections 2023-12-12T09:19:48.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.092+0000 7f0a7f4e6640 1 -- 172.21.15.84:0/1626014062 wait complete. 2023-12-12T09:19:48.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:48.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.302+0000 7f348bb61640 1 Processor -- start 2023-12-12T09:19:48.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.302+0000 7f348bb61640 1 -- start start 2023-12-12T09:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.304+0000 7f348bb61640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f348413dae0 0x7f348413f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.304+0000 7f348bb61640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3484140270 con 0x7f3484071bb0 2023-12-12T09:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.304+0000 7f348bb61640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840cd850 con 0x7f34840ce330 2023-12-12T09:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.304+0000 7f348bb61640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34840cdb30 con 0x7f348413dae0 2023-12-12T09:19:48.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.304+0000 7f34898fd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3484071bb0 0x7f3484071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55468/0 (socket says 172.21.15.84:55468) 2023-12-12T09:19:48.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.304+0000 7f34898fd640 1 -- 172.21.15.84:0/624119300 learned_addr learned my addr 172.21.15.84:0/624119300 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:48.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f348a0fe640 1 --2- 172.21.15.84:0/624119300 >> v2:172.21.15.99:3300/0 conn(0x7f348413dae0 0x7f348413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837523504 0 0) 0x7f3484140270 con 0x7f3484071bb0 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3470003520 con 0x7f3484071bb0 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283448777 0 0) 0x7f3470003520 con 0x7f3484071bb0 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 >> v2:172.21.15.99:3300/0 conn(0x7f348413dae0 msgr2=0x7f348413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 --2- 172.21.15.84:0/624119300 >> v2:172.21.15.99:3300/0 conn(0x7f348413dae0 0x7f348413f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 >> v1:172.21.15.99:6789/0 conn(0x7f34840ce330 legacy=0x7f348413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840cde10 con 0x7f3484071bb0 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f3480001670 con 0x7f3484071bb0 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 >> v1:172.21.15.84:6789/0 conn(0x7f3484071bb0 legacy=0x7f3484071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3470003970 0x7f3470003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34700047c0 0x7f3470004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f347000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34840cdb30 con 0x7f3470005180 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347000e230 con 0x7f3470003970 2023-12-12T09:19:48.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.305+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347000e3f0 con 0x7f34700047c0 2023-12-12T09:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.306+0000 7f348a0fe640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f347000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.306+0000 7f34898fd640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3470003970 0x7f3470003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.306+0000 7f34890fc640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34700047c0 0x7f3470004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.306+0000 7f348a0fe640 1 -- 172.21.15.84:0/624119300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34700047c0 msgr2=0x7f3470004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.306+0000 7f348a0fe640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34700047c0 0x7f3470004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.306+0000 7f348a0fe640 1 -- 172.21.15.84:0/624119300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3470003970 msgr2=0x7f3470003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.306+0000 7f348a0fe640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3470003970 0x7f3470003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.306+0000 7f348a0fe640 1 -- 172.21.15.84:0/624119300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3470003520 con 0x7f3470005180 2023-12-12T09:19:48.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.307+0000 7f348a0fe640 1 -- 172.21.15.84:0/624119300 reap_dead start 2023-12-12T09:19:48.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.307+0000 7f348a0fe640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f347000b980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f347c009f90 tx=0x7f34700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3591483c53f6913c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:48.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.307+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c02cc20 con 0x7f3470005180 2023-12-12T09:19:48.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.307+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c00f040 con 0x7f3470005180 2023-12-12T09:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.307+0000 7f34888fb640 1 -- 172.21.15.84:0/624119300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c034440 con 0x7f3470005180 2023-12-12T09:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.308+0000 7f348bb61640 1 -- 172.21.15.84:0/624119300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 msgr2=0x7f347000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.308+0000 7f348bb61640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f347000b980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f347c009f90 tx=0x7f34700057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.308+0000 7f348bb61640 1 -- 172.21.15.84:0/624119300 shutdown_connections 2023-12-12T09:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.308+0000 7f348bb61640 1 --2- 172.21.15.84:0/624119300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f347000b980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.308+0000 7f348bb61640 1 -- 172.21.15.84:0/624119300 >> 172.21.15.84:0/624119300 conn(0x7f348406c3d0 msgr2=0x7f348406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.308+0000 7f348bb61640 1 -- 172.21.15.84:0/624119300 shutdown_connections 2023-12-12T09:19:48.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.308+0000 7f348bb61640 1 -- 172.21.15.84:0/624119300 wait complete. 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.310+0000 7f348bb61640 1 Processor -- start 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.310+0000 7f348bb61640 1 -- start start 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f348bb61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f348413c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f348bb61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f348414fd90 0x7f3484158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f348bb61640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3484159300 0x7f34840b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f348bb61640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484152a10 con 0x7f3470005180 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f348bb61640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3484159780 con 0x7f348414fd90 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f348bb61640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34841e4d40 con 0x7f3484159300 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34898fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f348413c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34898fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f348413c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35278/0 (socket says 172.21.15.84:35278) 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34898fd640 1 -- 172.21.15.84:0/447933705 learned_addr learned my addr 172.21.15.84:0/447933705 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34898fd640 1 -- 172.21.15.84:0/447933705 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3484159300 msgr2=0x7f34840b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34898fd640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3484159300 0x7f34840b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34898fd640 1 -- 172.21.15.84:0/447933705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f348414fd90 msgr2=0x7f3484158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34890fc640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f348414fd90 0x7f3484158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34898fd640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f348414fd90 0x7f3484158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.311+0000 7f34898fd640 1 -- 172.21.15.84:0/447933705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34841e5020 con 0x7f3470005180 2023-12-12T09:19:48.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.312+0000 7f34898fd640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f348413c170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f348000e700 tx=0x7f348000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.312+0000 7f347a7fc640 1 -- 172.21.15.84:0/447933705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000ee10 con 0x7f3470005180 2023-12-12T09:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.312+0000 7f347a7fc640 1 -- 172.21.15.84:0/447933705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348000c8d0 con 0x7f3470005180 2023-12-12T09:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.312+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3484152630 con 0x7f3470005180 2023-12-12T09:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.312+0000 7f347a7fc640 1 -- 172.21.15.84:0/447933705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000cc80 con 0x7f3470005180 2023-12-12T09:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.312+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34841507c0 con 0x7f3470005180 2023-12-12T09:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.313+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3484152b50 con 0x7f3470005180 2023-12-12T09:19:48.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.314+0000 7f347a7fc640 1 -- 172.21.15.84:0/447933705 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f348001d460 con 0x7f3470005180 2023-12-12T09:19:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.315+0000 7f347a7fc640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f346806ae40 0x7f346806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.315+0000 7f347a7fc640 1 -- 172.21.15.84:0/447933705 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3480089880 con 0x7f3470005180 2023-12-12T09:19:48.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.315+0000 7f34890fc640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f346806ae40 0x7f346806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.316+0000 7f34890fc640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f346806ae40 0x7f346806d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3474000c00 tx=0x7f3474009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:48.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.319+0000 7f347a7fc640 1 -- 172.21.15.84:0/447933705 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3484152b50 con 0x7f3470005180 2023-12-12T09:19:48.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.497+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3484152b50 con 0x7f3470005180 2023-12-12T09:19:48.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.498+0000 7f347a7fc640 1 -- 172.21.15.84:0/447933705 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f3484152b50 con 0x7f3470005180 2023-12-12T09:19:48.499 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:48.499 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:48.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f346806ae40 msgr2=0x7f346806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f346806ae40 0x7f346806d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3474000c00 tx=0x7f3474009040 comp rx=0 tx=0).stop 2023-12-12T09:19:48.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 msgr2=0x7f348413c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f348413c170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f348000e700 tx=0x7f348000ebc0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 shutdown_connections 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3484159300 0x7f34840b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f348414fd90 0x7f3484158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f346806ae40 0x7f346806d300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 --2- 172.21.15.84:0/447933705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3470005180 0x7f348413c170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 >> 172.21.15.84:0/447933705 conn(0x7f348406c3d0 msgr2=0x7f348406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 shutdown_connections 2023-12-12T09:19:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.501+0000 7f348bb61640 1 -- 172.21.15.84:0/447933705 wait complete. 2023-12-12T09:19:48.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:19:48.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.741+0000 7fa66b210640 1 Processor -- start 2023-12-12T09:19:48.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.741+0000 7fa66b210640 1 -- start start 2023-12-12T09:19:48.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.742+0000 7fa66b210640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640ce330 0x7fa66413d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.742+0000 7fa66b210640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa6640ce790 0x7fa66413d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.742+0000 7fa66b210640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa664140270 con 0x7fa664071bb0 2023-12-12T09:19:48.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.742+0000 7fa66b210640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640cd850 con 0x7fa6640ce790 2023-12-12T09:19:48.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.742+0000 7fa66b210640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640cdb30 con 0x7fa6640ce330 2023-12-12T09:19:48.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.742+0000 7fa668fac640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa664071bb0 0x7fa664071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55480/0 (socket says 172.21.15.84:55480) 2023-12-12T09:19:48.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.742+0000 7fa668fac640 1 -- 172.21.15.84:0/218741899 learned_addr learned my addr 172.21.15.84:0/218741899 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:48.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa663fff640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640ce330 0x7fa66413d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6697ad640 1 --2- 172.21.15.84:0/218741899 >> v2:172.21.15.99:3300/0 conn(0x7fa6640ce790 0x7fa66413d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929713450 0 0) 0x7fa664140270 con 0x7fa664071bb0 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa654003520 con 0x7fa664071bb0 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3279096154 0 0) 0x7fa654003520 con 0x7fa664071bb0 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640ce330 msgr2=0x7fa66413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640ce330 0x7fa66413d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 >> v2:172.21.15.99:3300/0 conn(0x7fa6640ce790 msgr2=0x7fa66413d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 --2- 172.21.15.84:0/218741899 >> v2:172.21.15.99:3300/0 conn(0x7fa6640ce790 0x7fa66413d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640cde10 con 0x7fa664071bb0 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa658001670 con 0x7fa664071bb0 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 >> v1:172.21.15.84:6789/0 conn(0x7fa664071bb0 legacy=0x7fa664071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa654003970 0x7fa654003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6540047c0 0x7fa654004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640ce330 0x7fa654005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640cd850 con 0x7fa654003970 2023-12-12T09:19:48.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640cdb30 con 0x7fa6540047c0 2023-12-12T09:19:48.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.743+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65400b980 con 0x7fa6640ce330 2023-12-12T09:19:48.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.744+0000 7fa668fac640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa654003970 0x7fa654003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.744+0000 7fa668fac640 1 -- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640ce330 msgr2=0x7fa654005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:48.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.744+0000 7fa668fac640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640ce330 0x7fa654005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.744+0000 7fa668fac640 1 -- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6540047c0 msgr2=0x7fa654004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:48.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.744+0000 7fa668fac640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6540047c0 0x7fa654004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.744+0000 7fa668fac640 1 -- 172.21.15.84:0/218741899 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654003520 con 0x7fa654003970 2023-12-12T09:19:48.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.745+0000 7fa668fac640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa654003970 0x7fa654003d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa658007cf0 tx=0x7fa6540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67447845e3584868 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:48.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.745+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65802ece0 con 0x7fa654003970 2023-12-12T09:19:48.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.745+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65802ee40 con 0x7fa654003970 2023-12-12T09:19:48.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.745+0000 7fa6637fe640 1 -- 172.21.15.84:0/218741899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658005b10 con 0x7fa654003970 2023-12-12T09:19:48.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.746+0000 7fa66b210640 1 -- 172.21.15.84:0/218741899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa654003970 msgr2=0x7fa654003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.746+0000 7fa66b210640 1 --2- 172.21.15.84:0/218741899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa654003970 0x7fa654003d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa658007cf0 tx=0x7fa6540057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.746+0000 7fa6697ad640 1 -- 172.21.15.84:0/218741899 reap_dead start 2023-12-12T09:19:48.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.746+0000 7fa66b210640 1 -- 172.21.15.84:0/218741899 shutdown_connections 2023-12-12T09:19:48.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.746+0000 7fa66b210640 1 -- 172.21.15.84:0/218741899 >> 172.21.15.84:0/218741899 conn(0x7fa66406c3d0 msgr2=0x7fa66406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:48.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.746+0000 7fa66b210640 1 -- 172.21.15.84:0/218741899 shutdown_connections 2023-12-12T09:19:48.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.746+0000 7fa66b210640 1 -- 172.21.15.84:0/218741899 wait complete. 2023-12-12T09:19:48.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.748+0000 7fa66b210640 1 Processor -- start 2023-12-12T09:19:48.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.748+0000 7fa66b210640 1 -- start start 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa66b210640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa654003970 0x7fa6641f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa66b210640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6640c6b10 0x7fa6640c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa66b210640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640c5440 0x7fa6640c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa66b210640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664139e50 con 0x7fa6640c6b10 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa66b210640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640c5a70 con 0x7fa654003970 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa66b210640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640c5d50 con 0x7fa6640c5440 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa663fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6640c6b10 0x7fa6640c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa663fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6640c6b10 0x7fa6640c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35302/0 (socket says 172.21.15.84:35302) 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.749+0000 7fa663fff640 1 -- 172.21.15.84:0/2110576237 learned_addr learned my addr 172.21.15.84:0/2110576237 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa668fac640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa654003970 0x7fa6641f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa663fff640 1 -- 172.21.15.84:0/2110576237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640c5440 msgr2=0x7fa6640c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa6697ad640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640c5440 0x7fa6640c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa663fff640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640c5440 0x7fa6640c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa663fff640 1 -- 172.21.15.84:0/2110576237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa654003970 msgr2=0x7fa6641f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa663fff640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa654003970 0x7fa6641f2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa663fff640 1 -- 172.21.15.84:0/2110576237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640c6030 con 0x7fa6640c6b10 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa663fff640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6640c6b10 0x7fa6640c4f00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa65000e7a0 tx=0x7fa65000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa6617fa640 1 -- 172.21.15.84:0/2110576237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65000eeb0 con 0x7fa6640c6b10 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa6617fa640 1 -- 172.21.15.84:0/2110576237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65000c940 con 0x7fa6640c6b10 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6640c6310 con 0x7fa6640c6b10 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa6617fa640 1 -- 172.21.15.84:0/2110576237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65000cd10 con 0x7fa6640c6b10 2023-12-12T09:19:48.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.750+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6640c4a40 con 0x7fa6640c6b10 2023-12-12T09:19:48.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.752+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6640673c0 con 0x7fa6640c6b10 2023-12-12T09:19:48.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.752+0000 7fa6617fa640 1 -- 172.21.15.84:0/2110576237 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa650013470 con 0x7fa6640c6b10 2023-12-12T09:19:48.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.754+0000 7fa6617fa640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa64806ae40 0x7fa64806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:48.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.754+0000 7fa6617fa640 1 -- 172.21.15.84:0/2110576237 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa650089a70 con 0x7fa6640c6b10 2023-12-12T09:19:48.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.754+0000 7fa668fac640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa64806ae40 0x7fa64806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:48.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.755+0000 7fa668fac640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa64806ae40 0x7fa64806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa658036000 tx=0x7fa658007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:48.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.758+0000 7fa6617fa640 1 -- 172.21.15.84:0/2110576237 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa650054830 con 0x7fa6640c6b10 2023-12-12T09:19:48.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.969+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6640ade90 con 0x7fa6640c6b10 2023-12-12T09:19:48.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.970+0000 7fa6617fa640 1 -- 172.21.15.84:0/2110576237 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fa650017090 con 0x7fa6640c6b10 2023-12-12T09:19:48.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:48.971 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:19:46.619045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-12T09:19:48.971 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa64806ae40 msgr2=0x7fa64806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa64806ae40 0x7fa64806d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa658036000 tx=0x7fa658007000 comp rx=0 tx=0).stop 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6640c6b10 msgr2=0x7fa6640c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6640c6b10 0x7fa6640c4f00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa65000e7a0 tx=0x7fa65000ec60 comp rx=0 tx=0).stop 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 shutdown_connections 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6640c5440 0x7fa6640c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa64806ae40 0x7fa64806d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6640c6b10 0x7fa6640c4f00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 --2- 172.21.15.84:0/2110576237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa654003970 0x7fa6641f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 >> 172.21.15.84:0/2110576237 conn(0x7fa66406c3d0 msgr2=0x7fa6640ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:48.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 shutdown_connections 2023-12-12T09:19:48.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:48.973+0000 7fa66b210640 1 -- 172.21.15.84:0/2110576237 wait complete. 2023-12-12T09:19:48.991 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:49.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.193+0000 7fa9dca15640 1 Processor -- start 2023-12-12T09:19:49.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.193+0000 7fa9dca15640 1 -- start start 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9dca15640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 0x7fa9d8071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9dca15640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d80cea30 con 0x7fa9d8143d20 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9dca15640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d80702b0 con 0x7fa9d80b47e0 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9dca15640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d8070590 con 0x7fa9d80ce550 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9d659c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa9d8143d20 0x7fa9d80b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55494/0 (socket says 172.21.15.84:55494) 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9d659c640 1 -- 172.21.15.84:0/1362430547 learned_addr learned my addr 172.21.15.84:0/1362430547 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305333032 0 0) 0x7fa9d80cea30 con 0x7fa9d8143d20 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c0003520 con 0x7fa9d8143d20 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.195+0000 7fa9d6d9d640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 0x7fa9d8071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:49.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440674122 0 0) 0x7fa9c0003520 con 0x7fa9d8143d20 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 msgr2=0x7fa9d8071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 0x7fa9d8071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 >> v1:172.21.15.99:6789/0 conn(0x7fa9d80b47e0 legacy=0x7fa9d8071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8070870 con 0x7fa9d8143d20 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa9c8001670 con 0x7fa9d8143d20 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 >> v1:172.21.15.84:6789/0 conn(0x7fa9d8143d20 legacy=0x7fa9d80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9c00039a0 0x7fa9c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 0x7fa9c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9c0004d00 0x7fa9c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d8070590 con 0x7fa9c00039a0 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c000bae0 con 0x7fa9c0004d00 2023-12-12T09:19:49.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c000bca0 con 0x7fa9d80ce550 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d659c640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9c00039a0 0x7fa9c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d5d9b640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 0x7fa9c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d6d9d640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9c0004d00 0x7fa9c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d659c640 1 -- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 msgr2=0x7fa9c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d659c640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 0x7fa9c00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d659c640 1 -- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9c0004d00 msgr2=0x7fa9c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d659c640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9c0004d00 0x7fa9c0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d659c640 1 -- 172.21.15.84:0/1362430547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c0003520 con 0x7fa9c00039a0 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.196+0000 7fa9d5d9b640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9d80ce550 0x7fa9c00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.197+0000 7fa9d659c640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9c00039a0 0x7fa9c0003da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800c210 tx=0x7fa9c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8de3c834937e565 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8005ad0 con 0x7fa9c00039a0 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8005c50 con 0x7fa9c00039a0 2023-12-12T09:19:49.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9d559a640 1 -- 172.21.15.84:0/1362430547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c802c830 con 0x7fa9c00039a0 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9dca15640 1 -- 172.21.15.84:0/1362430547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9c00039a0 msgr2=0x7fa9c0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9dca15640 1 --2- 172.21.15.84:0/1362430547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9c00039a0 0x7fa9c0003da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800c210 tx=0x7fa9c00057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9d6d9d640 1 -- 172.21.15.84:0/1362430547 reap_dead start 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9dca15640 1 -- 172.21.15.84:0/1362430547 shutdown_connections 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9dca15640 1 -- 172.21.15.84:0/1362430547 >> 172.21.15.84:0/1362430547 conn(0x7fa9d806c3d0 msgr2=0x7fa9d806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9dca15640 1 -- 172.21.15.84:0/1362430547 shutdown_connections 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.198+0000 7fa9dca15640 1 -- 172.21.15.84:0/1362430547 wait complete. 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.200+0000 7fa9dca15640 1 Processor -- start 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.200+0000 7fa9dca15640 1 -- start start 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9dca15640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9c00039a0 0x7fa9d80ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9dca15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d80acad0 0x7fa9d815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9dca15640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d81e2060 0x7fa9d81e2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9dca15640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d81e2a50 con 0x7fa9d80acad0 2023-12-12T09:19:49.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9dca15640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80aa4b0 con 0x7fa9d81e2060 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9dca15640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80ad370 con 0x7fa9c00039a0 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9d5d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d80acad0 0x7fa9d815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9d5d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d80acad0 0x7fa9d815a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35314/0 (socket says 172.21.15.84:35314) 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.201+0000 7fa9d5d9b640 1 -- 172.21.15.84:0/311499181 learned_addr learned my addr 172.21.15.84:0/311499181 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9d659c640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9c00039a0 0x7fa9d80ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9d6d9d640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d81e2060 0x7fa9d81e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9d5d9b640 1 -- 172.21.15.84:0/311499181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9c00039a0 msgr2=0x7fa9d80ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9d5d9b640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9c00039a0 0x7fa9d80ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9d5d9b640 1 -- 172.21.15.84:0/311499181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d81e2060 msgr2=0x7fa9d81e2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9d5d9b640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d81e2060 0x7fa9d81e2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9d5d9b640 1 -- 172.21.15.84:0/311499181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d815acf0 con 0x7fa9d80acad0 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9d5d9b640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d80acad0 0x7fa9d815a7b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00d590 tx=0x7fa9cc00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:49.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9c6ffd640 1 -- 172.21.15.84:0/311499181 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc007220 con 0x7fa9d80acad0 2023-12-12T09:19:49.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9c6ffd640 1 -- 172.21.15.84:0/311499181 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0073a0 con 0x7fa9d80acad0 2023-12-12T09:19:49.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d80ad090 con 0x7fa9d80acad0 2023-12-12T09:19:49.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9c6ffd640 1 -- 172.21.15.84:0/311499181 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0067d0 con 0x7fa9d80acad0 2023-12-12T09:19:49.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.202+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d80aa980 con 0x7fa9d80acad0 2023-12-12T09:19:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.203+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d80673c0 con 0x7fa9d80acad0 2023-12-12T09:19:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.204+0000 7fa9c6ffd640 1 -- 172.21.15.84:0/311499181 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9cc006930 con 0x7fa9d80acad0 2023-12-12T09:19:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.205+0000 7fa9c6ffd640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9b806ae40 0x7fa9b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.205+0000 7fa9c6ffd640 1 -- 172.21.15.84:0/311499181 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9cc089740 con 0x7fa9d80acad0 2023-12-12T09:19:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.205+0000 7fa9d659c640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9b806ae40 0x7fa9b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:49.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.206+0000 7fa9d659c640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9b806ae40 0x7fa9b806d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8034000 tx=0x7fa9c8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:49.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.209+0000 7fa9c6ffd640 1 -- 172.21.15.84:0/311499181 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9cc054460 con 0x7fa9d80acad0 2023-12-12T09:19:49.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.400+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9d806e3b0 con 0x7fa9d80acad0 2023-12-12T09:19:49.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.403+0000 7fa9c6ffd640 1 -- 172.21.15.84:0/311499181 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7fa9cc057a80 con 0x7fa9d80acad0 2023-12-12T09:19:49.404 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:49.404 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9b806ae40 msgr2=0x7fa9b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9b806ae40 0x7fa9b806d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8034000 tx=0x7fa9c8009030 comp rx=0 tx=0).stop 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d80acad0 msgr2=0x7fa9d815a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d80acad0 0x7fa9d815a7b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00d590 tx=0x7fa9cc00da50 comp rx=0 tx=0).stop 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 shutdown_connections 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d81e2060 0x7fa9d81e2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9b806ae40 0x7fa9b806d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9d80acad0 0x7fa9d815a7b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 --2- 172.21.15.84:0/311499181 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9c00039a0 0x7fa9d80ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:49.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.406+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 >> 172.21.15.84:0/311499181 conn(0x7fa9d806c3d0 msgr2=0x7fa9d81412a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:49.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.407+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 shutdown_connections 2023-12-12T09:19:49.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:49.407+0000 7fa9dca15640 1 -- 172.21.15.84:0/311499181 wait complete. 2023-12-12T09:19:49.828 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T09:19:41.565378+0000', 'modified': '2023-12-12T09:19:46.619045+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6833/3738121458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6832', 'nonce': 3738121458}, {'type': 'v1', 'addr': '172.21.15.99:6833', 'nonce': 3738121458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-12T09:19:49.829 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T09:19:49.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-12T09:19:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.053+0000 7f27527be640 1 Processor -- start 2023-12-12T09:19:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.053+0000 7f27527be640 1 -- start start 2023-12-12T09:19:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.055+0000 7f27527be640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f274c06d230 0x7f274c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.055+0000 7f27527be640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0cffd0 con 0x7f274c06e3e0 2023-12-12T09:19:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.055+0000 7f27527be640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0cf160 con 0x7f274c06f300 2023-12-12T09:19:50.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.055+0000 7f27527be640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c0cf400 con 0x7f274c06d230 2023-12-12T09:19:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.055+0000 7f274b7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f274c06e3e0 0x7f274c15cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55504/0 (socket says 172.21.15.84:55504) 2023-12-12T09:19:50.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.055+0000 7f274b7fe640 1 -- 172.21.15.84:0/347567017 learned_addr learned my addr 172.21.15.84:0/347567017 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:50.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316451384 0 0) 0x7f274c0cffd0 con 0x7f274c06e3e0 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274bfff640 1 --2- 172.21.15.84:0/347567017 >> v2:172.21.15.99:3300/0 conn(0x7f274c06d230 0x7f274c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2738003520 con 0x7f274c06e3e0 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1439707843 0 0) 0x7f2738003520 con 0x7f274c06e3e0 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 >> v2:172.21.15.99:3300/0 conn(0x7f274c06d230 msgr2=0x7f274c0cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 --2- 172.21.15.84:0/347567017 >> v2:172.21.15.99:3300/0 conn(0x7f274c06d230 0x7f274c0cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 >> v1:172.21.15.99:6789/0 conn(0x7f274c06f300 legacy=0x7f274c15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c06d610 con 0x7f274c06e3e0 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2734001670 con 0x7f274c06e3e0 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 >> v1:172.21.15.84:6789/0 conn(0x7f274c06e3e0 legacy=0x7f274c15cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f2738003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f27380047c0 0x7f2738004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2738005180 0x7f273800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0cf400 con 0x7f2738003970 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273800c0b0 con 0x7f2738005180 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273800c270 con 0x7f27380047c0 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.056+0000 7f274bfff640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f2738003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.057+0000 7f2750d5b640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2738005180 0x7f273800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.057+0000 7f274b7fe640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f27380047c0 0x7f2738004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.057+0000 7f274bfff640 1 -- 172.21.15.84:0/347567017 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f27380047c0 msgr2=0x7f2738004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.057+0000 7f274bfff640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f27380047c0 0x7f2738004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.057+0000 7f274bfff640 1 -- 172.21.15.84:0/347567017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2738005180 msgr2=0x7f273800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.057+0000 7f274bfff640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2738005180 0x7f273800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.057+0000 7f274bfff640 1 -- 172.21.15.84:0/347567017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738003520 con 0x7f2738003970 2023-12-12T09:19:50.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.057+0000 7f2750d5b640 1 -- 172.21.15.84:0/347567017 reap_dead start 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.058+0000 7f274bfff640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f2738003d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f273c007330 tx=0x7f27380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ed5fa1a2915b47 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.058+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c02cca0 con 0x7f2738003970 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.058+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c02ce00 con 0x7f2738003970 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.058+0000 7f274affd640 1 -- 172.21.15.84:0/347567017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c034660 con 0x7f2738003970 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.059+0000 7f27527be640 1 -- 172.21.15.84:0/347567017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 msgr2=0x7f2738003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.059+0000 7f27527be640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f2738003d70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f273c007330 tx=0x7f27380057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.059+0000 7f27527be640 1 -- 172.21.15.84:0/347567017 shutdown_connections 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.059+0000 7f27527be640 1 --2- 172.21.15.84:0/347567017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f2738003d70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.059+0000 7f27527be640 1 -- 172.21.15.84:0/347567017 >> 172.21.15.84:0/347567017 conn(0x7f274c0d0e90 msgr2=0x7f274c0d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.059+0000 7f27527be640 1 -- 172.21.15.84:0/347567017 shutdown_connections 2023-12-12T09:19:50.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.059+0000 7f27527be640 1 -- 172.21.15.84:0/347567017 wait complete. 2023-12-12T09:19:50.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.061+0000 7f27527be640 1 Processor -- start 2023-12-12T09:19:50.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.061+0000 7f27527be640 1 -- start start 2023-12-12T09:19:50.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f27527be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f274c15a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f27527be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c15d3b0 0x7f274c157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f27527be640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f274c157e60 0x7f274c1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f27527be640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1589b0 con 0x7f2738003970 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f27527be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0c5430 con 0x7f274c15d3b0 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f27527be640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0c5710 con 0x7f274c157e60 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f274c15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f274c15a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35340/0 (socket says 172.21.15.84:35340) 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274bfff640 1 -- 172.21.15.84:0/234175081 learned_addr learned my addr 172.21.15.84:0/234175081 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274bfff640 1 -- 172.21.15.84:0/234175081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f274c157e60 msgr2=0x7f274c1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274bfff640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f274c157e60 0x7f274c1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274b7fe640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c15d3b0 0x7f274c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274bfff640 1 -- 172.21.15.84:0/234175081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c15d3b0 msgr2=0x7f274c157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274bfff640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c15d3b0 0x7f274c157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.062+0000 7f274bfff640 1 -- 172.21.15.84:0/234175081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0c59f0 con 0x7f2738003970 2023-12-12T09:19:50.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.063+0000 7f274bfff640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f274c15a580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f273c02c640 tx=0x7f273c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.063+0000 7f2748ff9640 1 -- 172.21.15.84:0/234175081 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c003990 con 0x7f2738003970 2023-12-12T09:19:50.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.063+0000 7f2748ff9640 1 -- 172.21.15.84:0/234175081 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c003af0 con 0x7f2738003970 2023-12-12T09:19:50.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.063+0000 7f2748ff9640 1 -- 172.21.15.84:0/234175081 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c003ea0 con 0x7f2738003970 2023-12-12T09:19:50.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.063+0000 7f27527be640 1 -- 172.21.15.84:0/234175081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c0c5cd0 con 0x7f2738003970 2023-12-12T09:19:50.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.063+0000 7f27527be640 1 -- 172.21.15.84:0/234175081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c15d830 con 0x7f2738003970 2023-12-12T09:19:50.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.065+0000 7f2748ff9640 1 -- 172.21.15.84:0/234175081 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f273c004000 con 0x7f2738003970 2023-12-12T09:19:50.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.066+0000 7f2748ff9640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f272c06ae40 0x7f272c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.066+0000 7f2748ff9640 1 -- 172.21.15.84:0/234175081 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f273c0abf80 con 0x7f2738003970 2023-12-12T09:19:50.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.066+0000 7f274b7fe640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f272c06ae40 0x7f272c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.067+0000 7f274b7fe640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f272c06ae40 0x7f272c06d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27340017a0 tx=0x7f2734009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.067+0000 7f275542b740 1 Processor -- start 2023-12-12T09:19:50.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.067+0000 7f275542b740 1 -- start start 2023-12-12T09:19:50.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f275542b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab2353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f275542b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab2052c0 0x5559ab232280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f275542b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2327c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f275542b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ab177f40 con 0x5559ab235010 2023-12-12T09:19:50.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f275542b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ab175630 con 0x5559ab208b90 2023-12-12T09:19:50.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f275542b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559ab170f20 con 0x5559ab2052c0 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f274bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab2353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f274bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab2353f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35350/0 (socket says 172.21.15.84:35350) 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.068+0000 7f274bfff640 1 -- 172.21.15.84:0/3410945735 learned_addr learned my addr 172.21.15.84:0/3410945735 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f274bfff640 1 -- 172.21.15.84:0/3410945735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab2052c0 msgr2=0x5559ab232280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f274bfff640 1 --2- 172.21.15.84:0/3410945735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab2052c0 0x5559ab232280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f274bfff640 1 -- 172.21.15.84:0/3410945735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 msgr2=0x5559ab2327c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f274bfff640 1 --2- 172.21.15.84:0/3410945735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f274bfff640 1 -- 172.21.15.84:0/3410945735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ab133910 con 0x5559ab235010 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f274bfff640 1 --2- 172.21.15.84:0/3410945735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab2353f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f273c037040 tx=0x7f273c07a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb5e26d3f728fca server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f2741ffb640 1 -- 172.21.15.84:0/3410945735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c07ebe0 con 0x5559ab235010 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f2741ffb640 1 -- 172.21.15.84:0/3410945735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c082d90 con 0x5559ab235010 2023-12-12T09:19:50.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.069+0000 7f2741ffb640 1 -- 172.21.15.84:0/3410945735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c009be0 con 0x5559ab235010 2023-12-12T09:19:50.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 -- 172.21.15.84:0/3410945735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 msgr2=0x5559ab2353f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 --2- 172.21.15.84:0/3410945735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab2353f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f273c037040 tx=0x7f273c07a3f0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 -- 172.21.15.84:0/3410945735 shutdown_connections 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 --2- 172.21.15.84:0/3410945735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2327c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 --2- 172.21.15.84:0/3410945735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab2052c0 0x5559ab232280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 --2- 172.21.15.84:0/3410945735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab2353f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 -- 172.21.15.84:0/3410945735 >> 172.21.15.84:0/3410945735 conn(0x5559ab207530 msgr2=0x5559ab24fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 -- 172.21.15.84:0/3410945735 shutdown_connections 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.070+0000 7f275542b740 1 -- 172.21.15.84:0/3410945735 wait complete. 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.071+0000 7f275542b740 1 -- start start 2023-12-12T09:19:50.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.071+0000 7f275542b740 1 Processor -- start 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f275542b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f275542b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab24d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f275542b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab237970 0x5559ab237df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f275542b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ab10d2f0 con 0x5559ab237970 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f275542b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ab12ac70 con 0x5559ab208b90 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f275542b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559aaed3f20 con 0x5559ab235010 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f275542b740 10 client.0 _ll_register_callbacks cb 0x5559ab12f3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f2750d5b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab237970 0x5559ab237df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f2750d5b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab237970 0x5559ab237df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35356/0 (socket says 172.21.15.84:35356) 2023-12-12T09:19:50.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.072+0000 7f2750d5b640 1 -- 172.21.15.84:0/2433607007 learned_addr learned my addr 172.21.15.84:0/2433607007 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f274bfff640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f274b7fe640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab24d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f2750d5b640 1 -- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 msgr2=0x5559ab24d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f2750d5b640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab24d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f2750d5b640 1 -- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 msgr2=0x5559ab2635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f2750d5b640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2635f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f2750d5b640 1 -- 172.21.15.84:0/2433607007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c15d830 con 0x5559ab237970 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f274b7fe640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab24d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f274bfff640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2635f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f2750d5b640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab237970 0x5559ab237df0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f274c070500 tx=0x7f274400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94b731b2bba2a4d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f272affd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f272affd640 1 -- 172.21.15.84:0/2433607007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274400ebc0 con 0x5559ab237970 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f272affd640 1 -- 172.21.15.84:0/2433607007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f274400ed20 con 0x5559ab237970 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f275542b740 1 -- 172.21.15.84:0/2433607007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559ab169db0 con 0x5559ab237970 2023-12-12T09:19:50.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f272affd640 1 -- 172.21.15.84:0/2433607007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274400eee0 con 0x5559ab237970 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f275542b740 10 client.4398 fetch_fsmap learned FSMap version 7 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.073+0000 7f275542b740 1 -- 172.21.15.84:0/2433607007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5559ab16f5a0 con 0x5559ab237970 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.074+0000 7f272affd640 1 -- 172.21.15.84:0/2433607007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559ab169db0 con 0x5559ab237970 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.074+0000 7f272affd640 1 -- 172.21.15.84:0/2433607007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f274401c350 con 0x5559ab237970 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.074+0000 7f275542b740 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.074+0000 7f275542b740 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.074+0000 7f275542b740 20 client.4398 populate_metadata read hostname 'smithi084' 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.074+0000 7f275542b740 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x5559ab26b340 0x5559ab26d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.074+0000 7f275542b740 4 client.4398 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.074+0000 7f275542b740 1 -- 172.21.15.84:0/2433607007 --> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559ab169ad0 con 0x5559ab26b340 2023-12-12T09:19:50.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.075+0000 7f274bfff640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x5559ab26b340 0x5559ab26d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.075+0000 7f274bfff640 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x5559ab26b340 0x5559ab26d730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f19f0183b5c0847d server_cookie=b693a682d4e5f356 in_seq=0 out_seq=0 2023-12-12T09:19:50.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.075+0000 7f272affd640 10 client.4398 ms_handle_connect on v2:172.21.15.99:6832/3738121458 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f272affd640 1 -- 172.21.15.84:0/2433607007 <== mds.0 v2:172.21.15.99:6832/3738121458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5559ab169ad0 con 0x5559ab26b340 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f272affd640 10 client.4398 handle_command_reply: tid=0 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 client.4398 shutdown 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 -- 172.21.15.84:0/2433607007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab237970 msgr2=0x5559ab237df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab237970 0x5559ab237df0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f274c070500 tx=0x7f274400e530 comp rx=0 tx=0).stop 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 -- 172.21.15.84:0/2433607007 shutdown_connections 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x5559ab26b340 0x5559ab26d730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab237970 0x5559ab237df0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab24d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 --2- 172.21.15.84:0/2433607007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2635f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f272affd640 0 client.4398 ms_handle_reset on v2:172.21.15.99:6832/3738121458 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 -- 172.21.15.84:0/2433607007 >> 172.21.15.84:0/2433607007 conn(0x5559ab2052c0 msgr2=0x5559ab238db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:50.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.078+0000 7f275542b740 1 -- 172.21.15.84:0/2433607007 shutdown_connections 2023-12-12T09:19:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.079+0000 7f275542b740 1 -- 172.21.15.84:0/2433607007 wait complete. 2023-12-12T09:19:50.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.079+0000 7f275542b740 20 client.4398 trim_cache size 0 max 16384 2023-12-12T09:19:50.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.096+0000 7f275542b740 1 Processor -- start 2023-12-12T09:19:50.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.096+0000 7f275542b740 1 -- start start 2023-12-12T09:19:50.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.096+0000 7f275542b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab208b90 0x5559ab24e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.096+0000 7f275542b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab262570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.096+0000 7f275542b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab237970 0x5559ab262ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.096+0000 7f275542b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ab24f590 con 0x5559ab208b90 2023-12-12T09:19:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.096+0000 7f275542b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ab21bb00 con 0x5559ab237970 2023-12-12T09:19:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.096+0000 7f275542b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559ab25f930 con 0x5559ab235010 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab208b90 0x5559ab24e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab208b90 0x5559ab24e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35362/0 (socket says 172.21.15.84:35362) 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 -- 172.21.15.84:0/2762191512 learned_addr learned my addr 172.21.15.84:0/2762191512 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f2750d5b640 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab237970 0x5559ab262ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274b7fe640 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab262570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 -- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 msgr2=0x5559ab262570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab262570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 -- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab237970 msgr2=0x5559ab262ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab237970 0x5559ab262ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 -- 172.21.15.84:0/2762191512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559ab10cb80 con 0x5559ab208b90 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f2750d5b640 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab237970 0x5559ab262ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.097+0000 7f274bfff640 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab208b90 0x5559ab24e6e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f273c07a430 tx=0x7f273c00b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c658547a88ecac8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f27427fc640 1 -- 172.21.15.84:0/2762191512 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c078e30 con 0x5559ab208b90 2023-12-12T09:19:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f27427fc640 1 -- 172.21.15.84:0/2762191512 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c009be0 con 0x5559ab208b90 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f27427fc640 1 -- 172.21.15.84:0/2762191512 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c092180 con 0x5559ab208b90 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 -- 172.21.15.84:0/2762191512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab208b90 msgr2=0x5559ab24e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab208b90 0x5559ab24e6e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f273c07a430 tx=0x7f273c00b030 comp rx=0 tx=0).stop 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 -- 172.21.15.84:0/2762191512 shutdown_connections 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab237970 0x5559ab262ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab235010 0x5559ab262570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 --2- 172.21.15.84:0/2762191512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab208b90 0x5559ab24e6e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 -- 172.21.15.84:0/2762191512 >> 172.21.15.84:0/2762191512 conn(0x5559ab2052c0 msgr2=0x5559ab206640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 -- 172.21.15.84:0/2762191512 shutdown_connections 2023-12-12T09:19:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.098+0000 7f275542b740 1 -- 172.21.15.84:0/2762191512 wait complete. 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.099+0000 7f275542b740 1 -- start start 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.099+0000 7f275542b740 1 Processor -- start 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f275542b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f275542b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab21ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f275542b740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab237970 0x5559ab232450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f275542b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ab2637e0 con 0x5559ab235010 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f275542b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559ab263590 con 0x5559ab208b90 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f275542b740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559ab26a160 con 0x5559ab237970 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f275542b740 10 client.0 _ll_register_callbacks cb 0x7f2744007cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f274b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab21ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f274b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab21ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35378/0 (socket says 172.21.15.84:35378) 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.100+0000 7f274b7fe640 1 -- 172.21.15.84:0/3888387397 learned_addr learned my addr 172.21.15.84:0/3888387397 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f274b7fe640 1 -- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab237970 msgr2=0x5559ab232450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f274b7fe640 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab237970 0x5559ab232450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f274b7fe640 1 -- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 msgr2=0x5559ab2c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f274b7fe640 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f274b7fe640 1 -- 172.21.15.84:0/3888387397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559ab133910 con 0x5559ab235010 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f274b7fe640 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab21ce00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f274c02cee0 tx=0x7f2734001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d52cdad3940fc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f272affd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f272affd640 1 -- 172.21.15.84:0/3888387397 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400c050 con 0x5559ab235010 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f272affd640 1 -- 172.21.15.84:0/3888387397 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2734022de0 con 0x5559ab235010 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f275542b740 1 -- 172.21.15.84:0/3888387397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f273c082d90 con 0x5559ab235010 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f272affd640 1 -- 172.21.15.84:0/3888387397 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f273400eea0 con 0x5559ab235010 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.101+0000 7f275542b740 10 client.4404 fetch_fsmap learned FSMap version 7 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f275542b740 1 -- 172.21.15.84:0/3888387397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5559ab132170 con 0x5559ab235010 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f272affd640 1 -- 172.21.15.84:0/3888387397 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c082d90 con 0x5559ab235010 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f272affd640 1 -- 172.21.15.84:0/3888387397 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f2734013680 con 0x5559ab235010 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f275542b740 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2023-12-12T09:19:50.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f275542b740 10 client.4404 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-12T09:19:50.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f275542b740 20 client.4404 populate_metadata read hostname 'smithi084' 2023-12-12T09:19:50.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f275542b740 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x5559ab230390 0x5559ab25e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f275542b740 4 client.4404 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T09:19:50.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f275542b740 1 -- 172.21.15.84:0/3888387397 --> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5559aae716c0 con 0x5559ab230390 2023-12-12T09:19:50.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.102+0000 7f274bfff640 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x5559ab230390 0x5559ab25e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.103+0000 7f274bfff640 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x5559ab230390 0x5559ab25e220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=229cd6bbc338ab80 server_cookie=6b8096f5e06d3ba0 in_seq=0 out_seq=0 2023-12-12T09:19:50.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.103+0000 7f272affd640 10 client.4404 ms_handle_connect on v2:172.21.15.99:6832/3738121458 2023-12-12T09:19:50.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f272affd640 1 -- 172.21.15.84:0/3888387397 <== mds.0 v2:172.21.15.99:6832/3738121458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+316 (crc 0 0 0) 0x5559aae716c0 con 0x5559ab230390 2023-12-12T09:19:50.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f272affd640 10 client.4404 handle_command_reply: tid=0 2023-12-12T09:19:50.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 client.4404 shutdown 2023-12-12T09:19:50.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 -- 172.21.15.84:0/3888387397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 msgr2=0x5559ab21ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab21ce00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f274c02cee0 tx=0x7f2734001a00 comp rx=0 tx=0).stop 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 -- 172.21.15.84:0/3888387397 shutdown_connections 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x5559ab230390 0x5559ab25e220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x5559ab237970 0x5559ab232450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5559ab235010 0x5559ab21ce00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 --2- 172.21.15.84:0/3888387397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559ab208b90 0x5559ab2c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f272affd640 0 client.4404 ms_handle_reset on v2:172.21.15.99:6832/3738121458 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 -- 172.21.15.84:0/3888387397 >> 172.21.15.84:0/3888387397 conn(0x5559ab2052c0 msgr2=0x5559ab24e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 -- 172.21.15.84:0/3888387397 shutdown_connections 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 1 -- 172.21.15.84:0/3888387397 wait complete. 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.104+0000 7f275542b740 20 client.4404 trim_cache size 0 max 16384 2023-12-12T09:19:50.107 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "6cf288f4-52d2-4b85-a338-100a1ef88319", 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4255, 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 7.995579352, 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 7, 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 26, 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 25, 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 15.66197223 2023-12-12T09:19:50.108 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:19:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 -- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f272c06ae40 msgr2=0x7f272c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f272c06ae40 0x7f272c06d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f27340017a0 tx=0x7f2734009040 comp rx=0 tx=0).stop 2023-12-12T09:19:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 -- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 msgr2=0x7f274c15a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f274c15a580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f273c02c640 tx=0x7f273c004ab0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 -- 172.21.15.84:0/234175081 shutdown_connections 2023-12-12T09:19:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f274c157e60 0x7f274c1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c15d3b0 0x7f274c157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f272c06ae40 0x7f272c06d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 --2- 172.21.15.84:0/234175081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2738003970 0x7f274c15a580 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 -- 172.21.15.84:0/234175081 >> 172.21.15.84:0/234175081 conn(0x7f274c0d0e90 msgr2=0x7f274c06c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 -- 172.21.15.84:0/234175081 shutdown_connections 2023-12-12T09:19:50.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.105+0000 7f27527be640 1 -- 172.21.15.84:0/234175081 wait complete. 2023-12-12T09:19:50.122 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T09:19:50.122 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-12T09:19:50.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:19:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.325+0000 7f72b271d640 1 Processor -- start 2023-12-12T09:19:50.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.325+0000 7f72b271d640 1 -- start start 2023-12-12T09:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.326+0000 7f72b271d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f72ac13dae0 0x7f72ac13f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.326+0000 7f72b271d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac140270 con 0x7f72ac071bb0 2023-12-12T09:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.326+0000 7f72b271d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac0cd850 con 0x7f72ac0ce330 2023-12-12T09:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.326+0000 7f72b271d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac0cdb30 con 0x7f72ac13dae0 2023-12-12T09:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.327+0000 7f72abfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f72ac071bb0 0x7f72ac071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55508/0 (socket says 172.21.15.84:55508) 2023-12-12T09:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.327+0000 7f72abfff640 1 -- 172.21.15.84:0/2982425149 learned_addr learned my addr 172.21.15.84:0/2982425149 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.327+0000 7f72b0cba640 1 --2- 172.21.15.84:0/2982425149 >> v2:172.21.15.84:3300/0 conn(0x7f72ac13dae0 0x7f72ac13f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.327+0000 7f72ab7fe640 1 -- 172.21.15.84:0/2982425149 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314898575 0 0) 0x7f72ac140270 con 0x7f72ac071bb0 2023-12-12T09:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.327+0000 7f72b0cba640 1 -- 172.21.15.84:0/2982425149 >> v1:172.21.15.99:6789/0 conn(0x7f72ac0ce330 legacy=0x7f72ac13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.327+0000 7f72b0cba640 1 -- 172.21.15.84:0/2982425149 >> v1:172.21.15.84:6789/0 conn(0x7f72ac071bb0 legacy=0x7f72ac071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.327+0000 7f72b0cba640 1 -- 172.21.15.84:0/2982425149 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac0cde10 con 0x7f72ac13dae0 2023-12-12T09:19:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.328+0000 7f72b0cba640 1 --2- 172.21.15.84:0/2982425149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac13dae0 0x7f72ac13f510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009dc0 tx=0x7f72a402e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda88c32b279c18a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72ab7fe640 1 -- 172.21.15.84:0/2982425149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a402ee50 con 0x7f72ac13dae0 2023-12-12T09:19:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72ab7fe640 1 -- 172.21.15.84:0/2982425149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4036440 con 0x7f72ac13dae0 2023-12-12T09:19:50.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72ab7fe640 1 -- 172.21.15.84:0/2982425149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a40367d0 con 0x7f72ac13dae0 2023-12-12T09:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72b271d640 1 -- 172.21.15.84:0/2982425149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac13dae0 msgr2=0x7f72ac13f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72b271d640 1 --2- 172.21.15.84:0/2982425149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac13dae0 0x7f72ac13f510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009dc0 tx=0x7f72a402e0a0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72b271d640 1 -- 172.21.15.84:0/2982425149 shutdown_connections 2023-12-12T09:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72b271d640 1 --2- 172.21.15.84:0/2982425149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac13dae0 0x7f72ac13f510 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72b271d640 1 -- 172.21.15.84:0/2982425149 >> 172.21.15.84:0/2982425149 conn(0x7f72ac06c3d0 msgr2=0x7f72ac06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.329+0000 7f72b271d640 1 -- 172.21.15.84:0/2982425149 shutdown_connections 2023-12-12T09:19:50.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.330+0000 7f72b271d640 1 -- 172.21.15.84:0/2982425149 wait complete. 2023-12-12T09:19:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.331+0000 7f72b271d640 1 Processor -- start 2023-12-12T09:19:50.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.331+0000 7f72b271d640 1 -- start start 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.332+0000 7f72b271d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72ac071bb0 0x7f72ac150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.332+0000 7f72b271d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0ce330 0x7f72ac12f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.332+0000 7f72b271d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac158dc0 0x7f72ac159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.332+0000 7f72b271d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac1597b0 con 0x7f72ac158dc0 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.332+0000 7f72b271d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac151230 con 0x7f72ac0ce330 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.332+0000 7f72b271d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac12fe00 con 0x7f72ac071bb0 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac158dc0 0x7f72ac159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac158dc0 0x7f72ac159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35386/0 (socket says 172.21.15.84:35386) 2023-12-12T09:19:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 -- 172.21.15.84:0/641314108 learned_addr learned my addr 172.21.15.84:0/641314108 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72abfff640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72ac071bb0 0x7f72ac150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 -- 172.21.15.84:0/641314108 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72ac071bb0 msgr2=0x7f72ac150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72ac071bb0 0x7f72ac150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72a3fff640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0ce330 0x7f72ac12f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 -- 172.21.15.84:0/641314108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0ce330 msgr2=0x7f72ac12f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0ce330 0x7f72ac12f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 -- 172.21.15.84:0/641314108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4009a70 con 0x7f72ac158dc0 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.333+0000 7f72b0cba640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac158dc0 0x7f72ac159270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f72a4039040 tx=0x7f72a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.334+0000 7f72a97fa640 1 -- 172.21.15.84:0/641314108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4041470 con 0x7f72ac158dc0 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.334+0000 7f72a97fa640 1 -- 172.21.15.84:0/641314108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a40415d0 con 0x7f72ac158dc0 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.334+0000 7f72a97fa640 1 -- 172.21.15.84:0/641314108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a40419c0 con 0x7f72ac158dc0 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.334+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac1e0990 con 0x7f72ac158dc0 2023-12-12T09:19:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.334+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac1e0f50 con 0x7f72ac158dc0 2023-12-12T09:19:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.335+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac0ce7a0 con 0x7f72ac158dc0 2023-12-12T09:19:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.336+0000 7f72a97fa640 1 -- 172.21.15.84:0/641314108 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72a403d070 con 0x7f72ac158dc0 2023-12-12T09:19:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.337+0000 7f72a97fa640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f728c06ae70 0x7f728c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.337+0000 7f72a97fa640 1 -- 172.21.15.84:0/641314108 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f72a40abff0 con 0x7f72ac158dc0 2023-12-12T09:19:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.337+0000 7f72abfff640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f728c06ae70 0x7f728c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.338+0000 7f72abfff640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f728c06ae70 0x7f728c06d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f729c007fd0 tx=0x7f729c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:50.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.341+0000 7f72a97fa640 1 -- 172.21.15.84:0/641314108 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72ac0ce7a0 con 0x7f72ac158dc0 2023-12-12T09:19:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.564+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72ac0ce7a0 con 0x7f72ac158dc0 2023-12-12T09:19:50.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.565+0000 7f72a97fa640 1 -- 172.21.15.84:0/641314108 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f72ac0ce7a0 con 0x7f72ac158dc0 2023-12-12T09:19:50.565 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T09:19:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f728c06ae70 msgr2=0x7f728c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f728c06ae70 0x7f728c06d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f729c007fd0 tx=0x7f729c009040 comp rx=0 tx=0).stop 2023-12-12T09:19:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac158dc0 msgr2=0x7f72ac159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac158dc0 0x7f72ac159270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f72a4039040 tx=0x7f72a4004a40 comp rx=0 tx=0).stop 2023-12-12T09:19:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 shutdown_connections 2023-12-12T09:19:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f728c06ae70 0x7f728c06d330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72ac158dc0 0x7f72ac159270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72ac0ce330 0x7f72ac12f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 --2- 172.21.15.84:0/641314108 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72ac071bb0 0x7f72ac150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 >> 172.21.15.84:0/641314108 conn(0x7f72ac06c3d0 msgr2=0x7f72ac0af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 shutdown_connections 2023-12-12T09:19:50.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:50.568+0000 7f72b271d640 1 -- 172.21.15.84:0/641314108 wait complete. 2023-12-12T09:19:50.586 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T09:19:50.586 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:19:50.586 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:19:50.587 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-12T09:19:50.587 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-12T09:19:50.587 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T09:19:50.587 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:19:50.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:19:50.587 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-12T09:19:50.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:50.587 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:19:50.639 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:19:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:19:50.639 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:19:50.640 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:19:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:19:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42213sec preferred_lft 42213sec 2023-12-12T09:19:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:19:50.641 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:19:50.642 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T09:19:50.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:50.642 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:19:50.642 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:19:50.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-12-12T09:19:50.642 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-12-12T09:19:50.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-12-12T09:19:50.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T09:19:50.643 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:19:51.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:51.092 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:19:51.172 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:19:51.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:51.175 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:19:51.235 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:19:51.235 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:19:51.235 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:19:51.235 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:19:51.235 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:19:51.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:51.236 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:19:51.236 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:19:51.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:19:51.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:19:51.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:19:51.236 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:19:51.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:51.985 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:19:52.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:52.043 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-12-12T09:19:52.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:52.099 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:19:52.099 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:19:52.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T09:19:52.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-12T09:19:52.099 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:19:52.243 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-12T09:19:52.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:52.243 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:19:52.243 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:19:52.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-12T09:19:52.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T09:19:52.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-12T09:19:52.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-12T09:19:52.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-12T09:19:52.244 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:19:52.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:52.519 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:19:52.519 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:19:52.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-12-12T09:19:52.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T09:19:52.519 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:19:52.678 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-12T09:19:52.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:19:52.678 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-12T09:19:52.722 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-12T09:19:52.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:19:52.722 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-12T09:19:52.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:19:52.931 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:19:52.972 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:19:52.973 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:19:52.974 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:19:52.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:19:52.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:19:52.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:19:52.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:19:52.975 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:19:52.975 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:19:52.975 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T09:19:52.975 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T09:19:52.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:52.976 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:19:53.066 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:19:53.066 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-12T09:19:53.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:19:53.195 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:19:53.235 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:19:53.235 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:19:53.235 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:19:53.235 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:19:53.236 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T09:19:53.237 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T09:19:53.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:53.238 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:19:53.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:2023-12-12T09:19:53.307+0000 7f8d7d03a480 -1 init, newargv = 0x55fe3dc81f60 newargc=15 2023-12-12T09:19:53.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[94872]: starting ceph client 2023-12-12T09:19:53.320 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[94872]: starting fuse 2023-12-12T09:19:53.325 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:19:53.326 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-12T09:19:53.326 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:19:53.327 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:19:53.328 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:19:53.328 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:19:53.328 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:19:53.328 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.admin")) 2023-12-12T09:19:53.328 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:19:53.518 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.admin.94872.asok 2023-12-12T09:19:53.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:19:53.534 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.94872.asok 2023-12-12T09:19:53.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:53.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.94872.asok status 2023-12-12T09:19:53.763 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:19:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:19:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:19:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:19:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "admin", 2023-12-12T09:19:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:19:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-12T09:19:53.763 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "94872", 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4419, 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4419 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:19:53.764 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 4089678208 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 4089678208 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4419 192.168.0.1:0/4089678208", 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/4089678208", 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 7, 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 26, 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:19:53.765 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:19:53.766 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:19:53.766 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:19:53.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:53.777 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:19:53.777 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-12T09:19:53.818 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:19:53.818 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-12T09:19:53.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:53.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-12T09:19:53.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:53.954 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-12T09:19:54.041 INFO:teuthology.orchestra.run.smithi084.stdout:# file: . 2023-12-12T09:19:54.042 INFO:teuthology.orchestra.run.smithi084.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-12T09:19:54.042 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:54.043 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:54.043 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:19:54.097 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:54.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.307+0000 7f2f03223640 1 Processor -- start 2023-12-12T09:19:54.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.307+0000 7f2f03223640 1 -- start start 2023-12-12T09:19:54.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.309+0000 7f2f03223640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc0ce330 0x7f2efc13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.309+0000 7f2f03223640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2efc0ce790 0x7f2efc13d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.309+0000 7f2f03223640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc140270 con 0x7f2efc071bb0 2023-12-12T09:19:54.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.309+0000 7f2f03223640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc0cd850 con 0x7f2efc0ce790 2023-12-12T09:19:54.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.309+0000 7f2f03223640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0cdb30 con 0x7f2efc0ce330 2023-12-12T09:19:54.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.309+0000 7f2f00fbf640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2efc071bb0 0x7f2efc071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55524/0 (socket says 172.21.15.84:55524) 2023-12-12T09:19:54.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.309+0000 7f2f00fbf640 1 -- 172.21.15.84:0/434422506 learned_addr learned my addr 172.21.15.84:0/434422506 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efbfff640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc0ce330 0x7f2efc13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849068279 0 0) 0x7f2efc140270 con 0x7f2efc071bb0 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eec003520 con 0x7f2efc071bb0 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2f017c0640 1 --2- 172.21.15.84:0/434422506 >> v2:172.21.15.99:3300/0 conn(0x7f2efc0ce790 0x7f2efc13d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3800184456 0 0) 0x7f2eec003520 con 0x7f2efc071bb0 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc0ce330 msgr2=0x7f2efc13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc0ce330 0x7f2efc13d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 >> v2:172.21.15.99:3300/0 conn(0x7f2efc0ce790 msgr2=0x7f2efc13d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 --2- 172.21.15.84:0/434422506 >> v2:172.21.15.99:3300/0 conn(0x7f2efc0ce790 0x7f2efc13d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0cde10 con 0x7f2efc071bb0 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2ef0001670 con 0x7f2efc071bb0 2023-12-12T09:19:54.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 >> v1:172.21.15.84:6789/0 conn(0x7f2efc071bb0 legacy=0x7f2efc071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc0ce330 0x7f2eec003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec003ef0 0x7f2eec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eec004d00 0x7f2eec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0cd850 con 0x7f2eec004d00 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0cdb30 con 0x7f2eec003ef0 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.310+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec00b9d0 con 0x7f2efc0ce330 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.311+0000 7f2f017c0640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eec004d00 0x7f2eec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.311+0000 7f2efbfff640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec003ef0 0x7f2eec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.311+0000 7f2f00fbf640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc0ce330 0x7f2eec003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.311+0000 7f2f017c0640 1 -- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc0ce330 msgr2=0x7f2eec003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.311+0000 7f2f017c0640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc0ce330 0x7f2eec003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.311+0000 7f2f017c0640 1 -- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec003ef0 msgr2=0x7f2eec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.311+0000 7f2f017c0640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec003ef0 0x7f2eec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.311+0000 7f2f017c0640 1 -- 172.21.15.84:0/434422506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec003520 con 0x7f2eec004d00 2023-12-12T09:19:54.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.312+0000 7f2f017c0640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eec004d00 0x7f2eec005180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4007360 tx=0x7f2eec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7eb2d65e26d5b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:54.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef402ccf0 con 0x7f2eec004d00 2023-12-12T09:19:54.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef402ce50 con 0x7f2eec004d00 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2efb7fe640 1 -- 172.21.15.84:0/434422506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4034660 con 0x7f2eec004d00 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2f03223640 1 -- 172.21.15.84:0/434422506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eec004d00 msgr2=0x7f2eec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2f03223640 1 --2- 172.21.15.84:0/434422506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eec004d00 0x7f2eec005180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4007360 tx=0x7f2eec0057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2f017c0640 1 -- 172.21.15.84:0/434422506 reap_dead start 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2f03223640 1 -- 172.21.15.84:0/434422506 shutdown_connections 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2f03223640 1 -- 172.21.15.84:0/434422506 >> 172.21.15.84:0/434422506 conn(0x7f2efc06c3d0 msgr2=0x7f2efc06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2f03223640 1 -- 172.21.15.84:0/434422506 shutdown_connections 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.313+0000 7f2f03223640 1 -- 172.21.15.84:0/434422506 wait complete. 2023-12-12T09:19:54.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.315+0000 7f2f03223640 1 Processor -- start 2023-12-12T09:19:54.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.315+0000 7f2f03223640 1 -- start start 2023-12-12T09:19:54.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.316+0000 7f2f03223640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec004d00 0x7f2efc0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.316+0000 7f2f03223640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc1f2120 0x7f2efc13f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.316+0000 7f2f03223640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2efc1f25a0 0x7f2efc13f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.316+0000 7f2f03223640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c40f0 con 0x7f2efc1f25a0 2023-12-12T09:19:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.316+0000 7f2f03223640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c43d0 con 0x7f2eec004d00 2023-12-12T09:19:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.316+0000 7f2f03223640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c46b0 con 0x7f2efc1f2120 2023-12-12T09:19:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.316+0000 7f2f017c0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2efc1f25a0 0x7f2efc13f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f017c0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2efc1f25a0 0x7f2efc13f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35396/0 (socket says 172.21.15.84:35396) 2023-12-12T09:19:54.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f017c0640 1 -- 172.21.15.84:0/3896514294 learned_addr learned my addr 172.21.15.84:0/3896514294 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:54.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f00fbf640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec004d00 0x7f2efc0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2efbfff640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc1f2120 0x7f2efc13f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f017c0640 1 -- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc1f2120 msgr2=0x7f2efc13f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f017c0640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc1f2120 0x7f2efc13f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f017c0640 1 -- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec004d00 msgr2=0x7f2efc0c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f017c0640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec004d00 0x7f2efc0c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f017c0640 1 -- 172.21.15.84:0/3896514294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0c4990 con 0x7f2efc1f25a0 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f00fbf640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec004d00 0x7f2efc0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2f017c0640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2efc1f25a0 0x7f2efc13f820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4007360 tx=0x7f2ef4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.317+0000 7f2ef97fa640 1 -- 172.21.15.84:0/3896514294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4045070 con 0x7f2efc1f25a0 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.318+0000 7f2ef97fa640 1 -- 172.21.15.84:0/3896514294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef4034e60 con 0x7f2efc1f25a0 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.318+0000 7f2ef97fa640 1 -- 172.21.15.84:0/3896514294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4003bb0 con 0x7f2efc1f25a0 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.318+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc0c4c70 con 0x7f2efc1f25a0 2023-12-12T09:19:54.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.318+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc0c8530 con 0x7f2efc1f25a0 2023-12-12T09:19:54.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.319+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc0673c0 con 0x7f2efc1f25a0 2023-12-12T09:19:54.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.320+0000 7f2ef97fa640 1 -- 172.21.15.84:0/3896514294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ef403b040 con 0x7f2efc1f25a0 2023-12-12T09:19:54.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.321+0000 7f2ef97fa640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ee006ae40 0x7f2ee006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.321+0000 7f2ef97fa640 1 -- 172.21.15.84:0/3896514294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ef40aadf0 con 0x7f2efc1f25a0 2023-12-12T09:19:54.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.321+0000 7f2f00fbf640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ee006ae40 0x7f2ee006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.322+0000 7f2f00fbf640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ee006ae40 0x7f2ee006d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0001050 tx=0x7f2ef0001d70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:54.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.325+0000 7f2ef97fa640 1 -- 172.21.15.84:0/3896514294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ef4075cc0 con 0x7f2efc1f25a0 2023-12-12T09:19:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.518+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2efc0ae710 con 0x7f2efc1f25a0 2023-12-12T09:19:54.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.520+0000 7f2ef97fa640 1 -- 172.21.15.84:0/3896514294 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f2ef4039090 con 0x7f2efc1f25a0 2023-12-12T09:19:54.520 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:54.520 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ee006ae40 msgr2=0x7f2ee006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ee006ae40 0x7f2ee006d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0001050 tx=0x7f2ef0001d70 comp rx=0 tx=0).stop 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2efc1f25a0 msgr2=0x7f2efc13f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2efc1f25a0 0x7f2efc13f820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4007360 tx=0x7f2ef4004ab0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 shutdown_connections 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ee006ae40 0x7f2ee006d300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2efc1f25a0 0x7f2efc13f820 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2efc1f2120 0x7f2efc13f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 --2- 172.21.15.84:0/3896514294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2eec004d00 0x7f2efc0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 >> 172.21.15.84:0/3896514294 conn(0x7f2efc06c3d0 msgr2=0x7f2efc1506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 shutdown_connections 2023-12-12T09:19:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.523+0000 7f2f03223640 1 -- 172.21.15.84:0/3896514294 wait complete. 2023-12-12T09:19:54.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:19:54.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:19:54.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.762+0000 7feb6a978640 1 Processor -- start 2023-12-12T09:19:54.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.762+0000 7feb6a978640 1 -- start start 2023-12-12T09:19:54.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.764+0000 7feb6a978640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feb640b40d0 0x7feb6406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.764+0000 7feb6a978640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb6415be60 0x7feb6413e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.764+0000 7feb6a978640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb640ceb80 con 0x7feb640ce6f0 2023-12-12T09:19:54.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.764+0000 7feb6a978640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb640ce260 con 0x7feb6415be60 2023-12-12T09:19:54.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.764+0000 7feb6a978640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb640cd930 con 0x7feb640b40d0 2023-12-12T09:19:54.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.764+0000 7feb68f15640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb6415be60 0x7feb6413e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.764+0000 7feb68f15640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb6415be60 0x7feb6413e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35412/0 (socket says 172.21.15.84:35412) 2023-12-12T09:19:54.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.764+0000 7feb68f15640 1 -- 172.21.15.84:0/3615366990 learned_addr learned my addr 172.21.15.84:0/3615366990 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:54.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.765+0000 7feb63fff640 1 --2- 172.21.15.84:0/3615366990 >> v2:172.21.15.99:3300/0 conn(0x7feb640b40d0 0x7feb6406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.765+0000 7feb68f15640 1 -- 172.21.15.84:0/3615366990 >> v2:172.21.15.99:3300/0 conn(0x7feb640b40d0 msgr2=0x7feb6406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.765+0000 7feb68f15640 1 --2- 172.21.15.84:0/3615366990 >> v2:172.21.15.99:3300/0 conn(0x7feb640b40d0 0x7feb6406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.765+0000 7feb68f15640 1 -- 172.21.15.84:0/3615366990 >> v1:172.21.15.99:6789/0 conn(0x7feb640ce6f0 legacy=0x7feb640b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.765+0000 7feb68f15640 1 -- 172.21.15.84:0/3615366990 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb640cdc10 con 0x7feb6415be60 2023-12-12T09:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.766+0000 7feb68f15640 1 --2- 172.21.15.84:0/3615366990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb6413e750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feb640b4d90 tx=0x7feb5c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd9bbcecc0d002c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.766+0000 7feb62ffd640 1 -- 172.21.15.84:0/3615366990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c02ca80 con 0x7feb6415be60 2023-12-12T09:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.766+0000 7feb62ffd640 1 -- 172.21.15.84:0/3615366990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c02cbe0 con 0x7feb6415be60 2023-12-12T09:19:54.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.766+0000 7feb62ffd640 1 -- 172.21.15.84:0/3615366990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0343f0 con 0x7feb6415be60 2023-12-12T09:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.767+0000 7feb6a978640 1 -- 172.21.15.84:0/3615366990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 msgr2=0x7feb6413e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.767+0000 7feb6a978640 1 --2- 172.21.15.84:0/3615366990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb6413e750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feb640b4d90 tx=0x7feb5c02bee0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.767+0000 7feb6a978640 1 -- 172.21.15.84:0/3615366990 shutdown_connections 2023-12-12T09:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.767+0000 7feb6a978640 1 --2- 172.21.15.84:0/3615366990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb6413e750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.767+0000 7feb6a978640 1 --2- 172.21.15.84:0/3615366990 >> v2:172.21.15.99:3300/0 conn(0x7feb640b40d0 0x7feb6406dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.767+0000 7feb6a978640 1 -- 172.21.15.84:0/3615366990 >> 172.21.15.84:0/3615366990 conn(0x7feb640b0ac0 msgr2=0x7feb640b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.767+0000 7feb6a978640 1 -- 172.21.15.84:0/3615366990 shutdown_connections 2023-12-12T09:19:54.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.767+0000 7feb6a978640 1 -- 172.21.15.84:0/3615366990 wait complete. 2023-12-12T09:19:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.769+0000 7feb6a978640 1 Processor -- start 2023-12-12T09:19:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.769+0000 7feb6a978640 1 -- start start 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb6a978640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb640b40d0 0x7feb64158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb6a978640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb640ce6f0 0x7feb6413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb6a978640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb64140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb6a978640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb64158750 con 0x7feb6415be60 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb6a978640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6413bd20 con 0x7feb640b40d0 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb6a978640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6413f490 con 0x7feb640ce6f0 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb68f15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb64140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb68f15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb64140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35426/0 (socket says 172.21.15.84:35426) 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb68f15640 1 -- 172.21.15.84:0/4291010864 learned_addr learned my addr 172.21.15.84:0/4291010864 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb63fff640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb640b40d0 0x7feb64158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb637fe640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb640ce6f0 0x7feb6413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb68f15640 1 -- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb640ce6f0 msgr2=0x7feb6413b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb68f15640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb640ce6f0 0x7feb6413b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb68f15640 1 -- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb640b40d0 msgr2=0x7feb64158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb68f15640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb640b40d0 0x7feb64158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb68f15640 1 -- 172.21.15.84:0/4291010864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c009b30 con 0x7feb6415be60 2023-12-12T09:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.770+0000 7feb63fff640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb640b40d0 0x7feb64158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.771+0000 7feb637fe640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb640ce6f0 0x7feb6413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.771+0000 7feb68f15640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb64140210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb5c036040 tx=0x7feb5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.771+0000 7feb60ff9640 1 -- 172.21.15.84:0/4291010864 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c009510 con 0x7feb6415be60 2023-12-12T09:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.771+0000 7feb60ff9640 1 -- 172.21.15.84:0/4291010864 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c03e450 con 0x7feb6415be60 2023-12-12T09:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.771+0000 7feb60ff9640 1 -- 172.21.15.84:0/4291010864 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c03e7e0 con 0x7feb6415be60 2023-12-12T09:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.771+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6413f730 con 0x7feb6415be60 2023-12-12T09:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.771+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6413fcf0 con 0x7feb6415be60 2023-12-12T09:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.772+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb640673c0 con 0x7feb6415be60 2023-12-12T09:19:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.773+0000 7feb60ff9640 1 -- 172.21.15.84:0/4291010864 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb5c02cd50 con 0x7feb6415be60 2023-12-12T09:19:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.774+0000 7feb60ff9640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb5006ae40 0x7feb5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:54.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.774+0000 7feb60ff9640 1 -- 172.21.15.84:0/4291010864 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb5c0ac470 con 0x7feb6415be60 2023-12-12T09:19:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.774+0000 7feb63fff640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb5006ae40 0x7feb5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:54.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.775+0000 7feb63fff640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb5006ae40 0x7feb5006d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb54006fd0 tx=0x7feb54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:54.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.779+0000 7feb60ff9640 1 -- 172.21.15.84:0/4291010864 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb5c077220 con 0x7feb6415be60 2023-12-12T09:19:54.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.973+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb6406d6a0 con 0x7feb6415be60 2023-12-12T09:19:54.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.974+0000 7feb60ff9640 1 -- 172.21.15.84:0/4291010864 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb5c03e940 con 0x7feb6415be60 2023-12-12T09:19:54.974 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.976+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb5006ae40 msgr2=0x7feb5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.976+0000 7feb6a978640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb5006ae40 0x7feb5006d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb54006fd0 tx=0x7feb54008040 comp rx=0 tx=0).stop 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.976+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 msgr2=0x7feb64140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.976+0000 7feb6a978640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb64140210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb5c036040 tx=0x7feb5c004a40 comp rx=0 tx=0).stop 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.977+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 shutdown_connections 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.977+0000 7feb6a978640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb5006ae40 0x7feb5006d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.977+0000 7feb6a978640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb6415be60 0x7feb64140210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.977+0000 7feb6a978640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb640ce6f0 0x7feb6413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.977+0000 7feb6a978640 1 --2- 172.21.15.84:0/4291010864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb640b40d0 0x7feb64158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:54.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.977+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 >> 172.21.15.84:0/4291010864 conn(0x7feb640b0ac0 msgr2=0x7feb64070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:54.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.977+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 shutdown_connections 2023-12-12T09:19:54.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:54.977+0000 7feb6a978640 1 -- 172.21.15.84:0/4291010864 wait complete. 2023-12-12T09:19:54.995 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:19:55.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.204+0000 7f5beb37d640 1 Processor -- start 2023-12-12T09:19:55.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.204+0000 7f5beb37d640 1 -- start start 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.205+0000 7f5beb37d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5be41609f0 0x7f5be40d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.205+0000 7f5beb37d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5be40b2610 0x7f5be40b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.205+0000 7f5beb37d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40d3dc0 con 0x7f5be40b1ee0 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5beb37d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40b2ad0 con 0x7f5be40b2610 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5beb37d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40b2db0 con 0x7f5be41609f0 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5be8918640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5be40b2610 0x7f5be40b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5be8918640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5be40b2610 0x7f5be40b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35430/0 (socket says 172.21.15.84:35430) 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5be8918640 1 -- 172.21.15.84:0/3809966430 learned_addr learned my addr 172.21.15.84:0/3809966430 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5be9119640 1 --2- 172.21.15.84:0/3809966430 >> v2:172.21.15.99:3300/0 conn(0x7f5be41609f0 0x7f5be40d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5be8918640 1 -- 172.21.15.84:0/3809966430 >> v2:172.21.15.99:3300/0 conn(0x7f5be41609f0 msgr2=0x7f5be40d3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5be8918640 1 --2- 172.21.15.84:0/3809966430 >> v2:172.21.15.99:3300/0 conn(0x7f5be41609f0 0x7f5be40d3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5be8918640 1 -- 172.21.15.84:0/3809966430 >> v1:172.21.15.99:6789/0 conn(0x7f5be40b1ee0 legacy=0x7f5be40cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.206+0000 7f5be8918640 1 -- 172.21.15.84:0/3809966430 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40b3090 con 0x7f5be40b2610 2023-12-12T09:19:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.207+0000 7f5be8918640 1 --2- 172.21.15.84:0/3809966430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be40b2610 0x7f5be40b35b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5be406af80 tx=0x7f5bd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1650f9bde35c830 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.208+0000 7f5bdbfff640 1 -- 172.21.15.84:0/3809966430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4031870 con 0x7f5be40b2610 2023-12-12T09:19:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.208+0000 7f5bdbfff640 1 -- 172.21.15.84:0/3809966430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd40319d0 con 0x7f5be40b2610 2023-12-12T09:19:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.208+0000 7f5bdbfff640 1 -- 172.21.15.84:0/3809966430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4031d60 con 0x7f5be40b2610 2023-12-12T09:19:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.209+0000 7f5beb37d640 1 -- 172.21.15.84:0/3809966430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be40b2610 msgr2=0x7f5be40b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.209+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3809966430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be40b2610 0x7f5be40b35b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5be406af80 tx=0x7f5bd402b910 comp rx=0 tx=0).stop 2023-12-12T09:19:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.209+0000 7f5beb37d640 1 -- 172.21.15.84:0/3809966430 shutdown_connections 2023-12-12T09:19:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.209+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3809966430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be40b2610 0x7f5be40b35b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.209+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3809966430 >> v2:172.21.15.99:3300/0 conn(0x7f5be41609f0 0x7f5be40d3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.209+0000 7f5beb37d640 1 -- 172.21.15.84:0/3809966430 >> 172.21.15.84:0/3809966430 conn(0x7f5be409c3d0 msgr2=0x7f5be40d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.209+0000 7f5beb37d640 1 -- 172.21.15.84:0/3809966430 shutdown_connections 2023-12-12T09:19:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.209+0000 7f5beb37d640 1 -- 172.21.15.84:0/3809966430 wait complete. 2023-12-12T09:19:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.211+0000 7f5beb37d640 1 Processor -- start 2023-12-12T09:19:55.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.211+0000 7f5beb37d640 1 -- start start 2023-12-12T09:19:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5beb37d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be40b1ee0 0x7f5be4146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5beb37d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b2610 0x7f5be41531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5beb37d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be41609f0 0x7f5be40d1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5beb37d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41472d0 con 0x7f5be41609f0 2023-12-12T09:19:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5beb37d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40b8060 con 0x7f5be40b1ee0 2023-12-12T09:19:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5beb37d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40b8340 con 0x7f5be40b2610 2023-12-12T09:19:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5be991a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be41609f0 0x7f5be40d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5be991a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be41609f0 0x7f5be40d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35438/0 (socket says 172.21.15.84:35438) 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.212+0000 7f5be991a640 1 -- 172.21.15.84:0/3346489657 learned_addr learned my addr 172.21.15.84:0/3346489657 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be9119640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be40b1ee0 0x7f5be4146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be8918640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b2610 0x7f5be41531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be991a640 1 -- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b2610 msgr2=0x7f5be41531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be991a640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b2610 0x7f5be41531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be991a640 1 -- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be40b1ee0 msgr2=0x7f5be4146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be991a640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be40b1ee0 0x7f5be4146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be991a640 1 -- 172.21.15.84:0/3346489657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd40094d0 con 0x7f5be41609f0 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be8918640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b2610 0x7f5be41531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:55.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5be991a640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be41609f0 0x7f5be40d1500 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c780 tx=0x7f5bdc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5bd9ffb640 1 -- 172.21.15.84:0/3346489657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc003d80 con 0x7f5be41609f0 2023-12-12T09:19:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5bd9ffb640 1 -- 172.21.15.84:0/3346489657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00ce90 con 0x7f5be41609f0 2023-12-12T09:19:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5bd9ffb640 1 -- 172.21.15.84:0/3346489657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0052b0 con 0x7f5be41609f0 2023-12-12T09:19:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.213+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be40b8620 con 0x7f5be41609f0 2023-12-12T09:19:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.214+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40b8c70 con 0x7f5be41609f0 2023-12-12T09:19:55.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.215+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be4144330 con 0x7f5be41609f0 2023-12-12T09:19:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.215+0000 7f5bd9ffb640 1 -- 172.21.15.84:0/3346489657 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5bdc005410 con 0x7f5be41609f0 2023-12-12T09:19:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.216+0000 7f5bd9ffb640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5bc806ae40 0x7f5bc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.216+0000 7f5bd9ffb640 1 -- 172.21.15.84:0/3346489657 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5bdc088f00 con 0x7f5be41609f0 2023-12-12T09:19:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.216+0000 7f5be9119640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5bc806ae40 0x7f5bc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.217+0000 7f5be9119640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5bc806ae40 0x7f5bc806d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5be0006fd0 tx=0x7f5be0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:55.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.221+0000 7f5bd9ffb640 1 -- 172.21.15.84:0/3346489657 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5be4144330 con 0x7f5be41609f0 2023-12-12T09:19:55.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.412+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5be4144330 con 0x7f5be41609f0 2023-12-12T09:19:55.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.413+0000 7f5bd9ffb640 1 -- 172.21.15.84:0/3346489657 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5be4144330 con 0x7f5be41609f0 2023-12-12T09:19:55.413 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:19:55.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5bc806ae40 msgr2=0x7f5bc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5bc806ae40 0x7f5bc806d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5be0006fd0 tx=0x7f5be0008040 comp rx=0 tx=0).stop 2023-12-12T09:19:55.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be41609f0 msgr2=0x7f5be40d1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be41609f0 0x7f5be40d1500 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00c780 tx=0x7f5bdc00cc40 comp rx=0 tx=0).stop 2023-12-12T09:19:55.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 shutdown_connections 2023-12-12T09:19:55.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5bc806ae40 0x7f5bc806d300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5be41609f0 0x7f5be40d1500 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5be40b2610 0x7f5be41531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 --2- 172.21.15.84:0/3346489657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5be40b1ee0 0x7f5be4146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 >> 172.21.15.84:0/3346489657 conn(0x7f5be409c3d0 msgr2=0x7f5be415f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:55.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 shutdown_connections 2023-12-12T09:19:55.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.416+0000 7f5beb37d640 1 -- 172.21.15.84:0/3346489657 wait complete. 2023-12-12T09:19:55.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:19:55.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.637+0000 7f0b9b472640 1 Processor -- start 2023-12-12T09:19:55.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.638+0000 7f0b9b472640 1 -- start start 2023-12-12T09:19:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.639+0000 7f0b9b472640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 0x7f0b940d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.639+0000 7f0b9b472640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0b940cf4e0 0x7f0b940cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.639+0000 7f0b9b472640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b940d2100 con 0x7f0b940d2d30 2023-12-12T09:19:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.639+0000 7f0b9b472640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940ce440 con 0x7f0b940cf4e0 2023-12-12T09:19:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.639+0000 7f0b9b472640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940ce720 con 0x7f0b9415d320 2023-12-12T09:19:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.639+0000 7f0b98a0d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0b940cf4e0 0x7f0b940cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.639+0000 7f0b98a0d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0b940cf4e0 0x7f0b940cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35450/0 (socket says 172.21.15.84:35450) 2023-12-12T09:19:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.640+0000 7f0b98a0d640 1 -- 172.21.15.84:0/513053844 learned_addr learned my addr 172.21.15.84:0/513053844 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:55.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.640+0000 7f0b9920e640 1 --2- 172.21.15.84:0/513053844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 0x7f0b940d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.640+0000 7f0b98a0d640 1 -- 172.21.15.84:0/513053844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 msgr2=0x7f0b940d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:55.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.640+0000 7f0b98a0d640 1 --2- 172.21.15.84:0/513053844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 0x7f0b940d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.640+0000 7f0b98a0d640 1 -- 172.21.15.84:0/513053844 >> v1:172.21.15.99:6789/0 conn(0x7f0b940d2d30 legacy=0x7f0b940d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:55.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.640+0000 7f0b98a0d640 1 -- 172.21.15.84:0/513053844 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940cea00 con 0x7f0b940cf4e0 2023-12-12T09:19:55.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.641+0000 7f0b98a0d640 1 --2- 172.21.15.84:0/513053844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940cf4e0 0x7f0b940cdbd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009870 tx=0x7f0b8402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31665a0fa7e2c8d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b8bfff640 1 -- 172.21.15.84:0/513053844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b840317c0 con 0x7f0b940cf4e0 2023-12-12T09:19:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b8bfff640 1 -- 172.21.15.84:0/513053844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b84031920 con 0x7f0b940cf4e0 2023-12-12T09:19:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b8bfff640 1 -- 172.21.15.84:0/513053844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84031cb0 con 0x7f0b940cf4e0 2023-12-12T09:19:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b9b472640 1 -- 172.21.15.84:0/513053844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940cf4e0 msgr2=0x7f0b940cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b9b472640 1 --2- 172.21.15.84:0/513053844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940cf4e0 0x7f0b940cdbd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b84009870 tx=0x7f0b8402b860 comp rx=0 tx=0).stop 2023-12-12T09:19:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b9b472640 1 -- 172.21.15.84:0/513053844 shutdown_connections 2023-12-12T09:19:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b9b472640 1 --2- 172.21.15.84:0/513053844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940cf4e0 0x7f0b940cdbd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b9b472640 1 --2- 172.21.15.84:0/513053844 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 0x7f0b940d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.642+0000 7f0b9b472640 1 -- 172.21.15.84:0/513053844 >> 172.21.15.84:0/513053844 conn(0x7f0b9408cb50 msgr2=0x7f0b9409c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.643+0000 7f0b9b472640 1 -- 172.21.15.84:0/513053844 shutdown_connections 2023-12-12T09:19:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.643+0000 7f0b9b472640 1 -- 172.21.15.84:0/513053844 wait complete. 2023-12-12T09:19:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.644+0000 7f0b9b472640 1 Processor -- start 2023-12-12T09:19:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.644+0000 7f0b9b472640 1 -- start start 2023-12-12T09:19:55.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.645+0000 7f0b9b472640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b940cf4e0 0x7f0b940cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.645+0000 7f0b9b472640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940d2d30 0x7f0b940b8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.645+0000 7f0b9b472640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 0x7f0b9415e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.645+0000 7f0b9b472640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9415eb90 con 0x7f0b940d2d30 2023-12-12T09:19:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.645+0000 7f0b9b472640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940cacd0 con 0x7f0b940cf4e0 2023-12-12T09:19:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.645+0000 7f0b9b472640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9415e8c0 con 0x7f0b9415d320 2023-12-12T09:19:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940d2d30 0x7f0b940b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940d2d30 0x7f0b940b8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35458/0 (socket says 172.21.15.84:35458) 2023-12-12T09:19:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 -- 172.21.15.84:0/2884961735 learned_addr learned my addr 172.21.15.84:0/2884961735 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:55.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b9920e640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b940cf4e0 0x7f0b940cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b99a0f640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 0x7f0b9415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 -- 172.21.15.84:0/2884961735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 msgr2=0x7f0b9415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 0x7f0b9415e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 -- 172.21.15.84:0/2884961735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b940cf4e0 msgr2=0x7f0b940cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b940cf4e0 0x7f0b940cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 -- 172.21.15.84:0/2884961735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b840094d0 con 0x7f0b940d2d30 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.646+0000 7f0b98a0d640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940d2d30 0x7f0b940b8800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b84000c00 tx=0x7f0b840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.647+0000 7f0b89ffb640 1 -- 172.21.15.84:0/2884961735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84032860 con 0x7f0b940d2d30 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.647+0000 7f0b89ffb640 1 -- 172.21.15.84:0/2884961735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b840329c0 con 0x7f0b940d2d30 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.647+0000 7f0b89ffb640 1 -- 172.21.15.84:0/2884961735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84032d70 con 0x7f0b940d2d30 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.647+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b940ca3a0 con 0x7f0b940d2d30 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.647+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b940ca960 con 0x7f0b940d2d30 2023-12-12T09:19:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.648+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b94072b80 con 0x7f0b940d2d30 2023-12-12T09:19:55.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.649+0000 7f0b89ffb640 1 -- 172.21.15.84:0/2884961735 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b8404e450 con 0x7f0b940d2d30 2023-12-12T09:19:55.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.650+0000 7f0b89ffb640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b7806ae40 0x7f0b7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:55.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.650+0000 7f0b89ffb640 1 -- 172.21.15.84:0/2884961735 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b840abb00 con 0x7f0b940d2d30 2023-12-12T09:19:55.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.650+0000 7f0b9920e640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b7806ae40 0x7f0b7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:55.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.650+0000 7f0b9920e640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b7806ae40 0x7f0b7806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b90006fd0 tx=0x7f0b90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:55.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.654+0000 7f0b89ffb640 1 -- 172.21.15.84:0/2884961735 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b840768c0 con 0x7f0b940d2d30 2023-12-12T09:19:55.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.846+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b940673c0 con 0x7f0b940d2d30 2023-12-12T09:19:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.847+0000 7f0b89ffb640 1 -- 172.21.15.84:0/2884961735 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b84079ee0 con 0x7f0b940d2d30 2023-12-12T09:19:55.847 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:19:55.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b7806ae40 msgr2=0x7f0b7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b7806ae40 0x7f0b7806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0b90006fd0 tx=0x7f0b90008040 comp rx=0 tx=0).stop 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940d2d30 msgr2=0x7f0b940b8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940d2d30 0x7f0b940b8800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b84000c00 tx=0x7f0b840046c0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 shutdown_connections 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b9415d320 0x7f0b9415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b7806ae40 0x7f0b7806d300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b940d2d30 0x7f0b940b8800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 --2- 172.21.15.84:0/2884961735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b940cf4e0 0x7f0b940cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 >> 172.21.15.84:0/2884961735 conn(0x7f0b9408cb50 msgr2=0x7f0b9406ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 shutdown_connections 2023-12-12T09:19:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:55.849+0000 7f0b9b472640 1 -- 172.21.15.84:0/2884961735 wait complete. 2023-12-12T09:19:55.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:19:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.076+0000 7f0a57017640 1 Processor -- start 2023-12-12T09:19:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.076+0000 7f0a57017640 1 -- start start 2023-12-12T09:19:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a57017640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a500ad610 0x7f0a500ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a57017640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a50070130 0x7f0a50070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a57017640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a50070ad0 con 0x7f0a50070f30 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a57017640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500b3c40 con 0x7f0a500ad610 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a57017640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a50071a80 con 0x7f0a50070130 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a54db3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a500ad610 0x7f0a500ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a555b4640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0a50070f30 0x7f0a50071370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39842/0 (socket says 172.21.15.84:39842) 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a555b4640 1 -- 172.21.15.84:0/402609419 learned_addr learned my addr 172.21.15.84:0/402609419 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a54db3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a500ad610 0x7f0a500ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55406/0 (socket says 172.21.15.84:55406) 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a4ffff640 1 --2- 172.21.15.84:0/402609419 >> v2:172.21.15.99:3300/0 conn(0x7f0a50070130 0x7f0a50070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a54db3640 1 -- 172.21.15.84:0/402609419 >> v2:172.21.15.99:3300/0 conn(0x7f0a50070130 msgr2=0x7f0a50070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a54db3640 1 --2- 172.21.15.84:0/402609419 >> v2:172.21.15.99:3300/0 conn(0x7f0a50070130 0x7f0a50070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a54db3640 1 -- 172.21.15.84:0/402609419 >> v1:172.21.15.84:6789/0 conn(0x7f0a50070f30 legacy=0x7f0a50071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.078+0000 7f0a54db3640 1 -- 172.21.15.84:0/402609419 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500acbe0 con 0x7f0a500ad610 2023-12-12T09:19:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.080+0000 7f0a54db3640 1 --2- 172.21.15.84:0/402609419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a500ac6a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a5006bb00 tx=0x7f0a4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39deef964f0c03aa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.080+0000 7f0a4f7fe640 1 -- 172.21.15.84:0/402609419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4402e070 con 0x7f0a500ad610 2023-12-12T09:19:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.080+0000 7f0a4f7fe640 1 -- 172.21.15.84:0/402609419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a440315a0 con 0x7f0a500ad610 2023-12-12T09:19:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.080+0000 7f0a4f7fe640 1 -- 172.21.15.84:0/402609419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44031930 con 0x7f0a500ad610 2023-12-12T09:19:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.080+0000 7f0a57017640 1 -- 172.21.15.84:0/402609419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 msgr2=0x7f0a500ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.080+0000 7f0a57017640 1 --2- 172.21.15.84:0/402609419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a500ac6a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a5006bb00 tx=0x7f0a4402b840 comp rx=0 tx=0).stop 2023-12-12T09:19:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.081+0000 7f0a57017640 1 -- 172.21.15.84:0/402609419 shutdown_connections 2023-12-12T09:19:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.081+0000 7f0a57017640 1 --2- 172.21.15.84:0/402609419 >> v2:172.21.15.99:3300/0 conn(0x7f0a50070130 0x7f0a50070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.081+0000 7f0a57017640 1 --2- 172.21.15.84:0/402609419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a500ac6a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.081+0000 7f0a57017640 1 -- 172.21.15.84:0/402609419 >> 172.21.15.84:0/402609419 conn(0x7f0a500b0900 msgr2=0x7f0a500b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.081+0000 7f0a57017640 1 -- 172.21.15.84:0/402609419 shutdown_connections 2023-12-12T09:19:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.081+0000 7f0a57017640 1 -- 172.21.15.84:0/402609419 wait complete. 2023-12-12T09:19:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.082+0000 7f0a57017640 1 Processor -- start 2023-12-12T09:19:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.083+0000 7f0a57017640 1 -- start start 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a57017640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a50070130 0x7f0a50158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a57017640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a50070f30 0x7f0a501e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a57017640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a501e7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a57017640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501e4bc0 con 0x7f0a500ad610 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a57017640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501e3f30 con 0x7f0a50070f30 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a57017640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501e4e80 con 0x7f0a50070130 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a555b4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a501e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a555b4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a501e7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55420/0 (socket says 172.21.15.84:55420) 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a555b4640 1 -- 172.21.15.84:0/2686586852 learned_addr learned my addr 172.21.15.84:0/2686586852 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a54db3640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a50070130 0x7f0a50158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a4ffff640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a50070f30 0x7f0a501e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a555b4640 1 -- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a50070130 msgr2=0x7f0a50158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a555b4640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a50070130 0x7f0a50158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a555b4640 1 -- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a50070f30 msgr2=0x7f0a501e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a555b4640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a50070f30 0x7f0a501e73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a555b4640 1 -- 172.21.15.84:0/2686586852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44009400 con 0x7f0a500ad610 2023-12-12T09:19:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.084+0000 7f0a54db3640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a50070130 0x7f0a50158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:19:56.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.085+0000 7f0a555b4640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a501e7900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800cbc0 tx=0x7f0a4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.085+0000 7f0a4d7fa640 1 -- 172.21.15.84:0/2686586852 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800ad40 con 0x7f0a500ad610 2023-12-12T09:19:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.085+0000 7f0a4d7fa640 1 -- 172.21.15.84:0/2686586852 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a48012400 con 0x7f0a500ad610 2023-12-12T09:19:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.085+0000 7f0a4d7fa640 1 -- 172.21.15.84:0/2686586852 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800aea0 con 0x7f0a500ad610 2023-12-12T09:19:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.085+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a501e5160 con 0x7f0a500ad610 2023-12-12T09:19:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.085+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a501e31d0 con 0x7f0a500ad610 2023-12-12T09:19:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.086+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a500673c0 con 0x7f0a500ad610 2023-12-12T09:19:56.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.087+0000 7f0a4d7fa640 1 -- 172.21.15.84:0/2686586852 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a48007070 con 0x7f0a500ad610 2023-12-12T09:19:56.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.088+0000 7f0a4d7fa640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a3406ae70 0x7f0a3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.088+0000 7f0a4d7fa640 1 -- 172.21.15.84:0/2686586852 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0a480897c0 con 0x7f0a500ad610 2023-12-12T09:19:56.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.088+0000 7f0a54db3640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a3406ae70 0x7f0a3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.089+0000 7f0a54db3640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a3406ae70 0x7f0a3406d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a44036000 tx=0x7f0a4403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:56.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.092+0000 7f0a4d7fa640 1 -- 172.21.15.84:0/2686586852 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a48054590 con 0x7f0a500ad610 2023-12-12T09:19:56.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.280+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0a501e5350 con 0x7f0a500ad610 2023-12-12T09:19:56.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.281+0000 7f0a4d7fa640 1 -- 172.21.15.84:0/2686586852 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0a48017020 con 0x7f0a500ad610 2023-12-12T09:19:56.281 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:19:56.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a3406ae70 msgr2=0x7f0a3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a3406ae70 0x7f0a3406d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0a44036000 tx=0x7f0a4403d040 comp rx=0 tx=0).stop 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 msgr2=0x7f0a501e7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a501e7900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800cbc0 tx=0x7f0a4800a430 comp rx=0 tx=0).stop 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 shutdown_connections 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a3406ae70 0x7f0a3406d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a500ad610 0x7f0a501e7900 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a50070f30 0x7f0a501e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 --2- 172.21.15.84:0/2686586852 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a50070130 0x7f0a50158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 >> 172.21.15.84:0/2686586852 conn(0x7f0a500b0900 msgr2=0x7f0a5015a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 shutdown_connections 2023-12-12T09:19:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.284+0000 7f0a57017640 1 -- 172.21.15.84:0/2686586852 wait complete. 2023-12-12T09:19:56.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:19:56.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.495+0000 7f6e6d2b4640 1 Processor -- start 2023-12-12T09:19:56.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.496+0000 7f6e6d2b4640 1 -- start start 2023-12-12T09:19:56.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e6d2b4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e680b24f0 0x7f6e680b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e6d2b4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e680b30b0 0x7f6e6815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e6d2b4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e6815a800 0x7f6e6815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e6d2b4640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e68153ff0 con 0x7f6e680b30b0 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e6d2b4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680b3ca0 con 0x7f6e6815a800 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e6d2b4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680b2e10 con 0x7f6e680b24f0 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e5e7fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e680b30b0 0x7f6e6815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e5e7fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e680b30b0 0x7f6e6815a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55432/0 (socket says 172.21.15.84:55432) 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e5e7fc640 1 -- 172.21.15.84:0/545309048 learned_addr learned my addr 172.21.15.84:0/545309048 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e66ffd640 1 --2- 172.21.15.84:0/545309048 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e680b24f0 0x7f6e680b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e5e7fc640 1 -- 172.21.15.84:0/545309048 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e680b24f0 msgr2=0x7f6e680b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e5e7fc640 1 --2- 172.21.15.84:0/545309048 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e680b24f0 0x7f6e680b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e5e7fc640 1 -- 172.21.15.84:0/545309048 >> v2:172.21.15.99:3300/0 conn(0x7f6e6815a800 msgr2=0x7f6e6815d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e5e7fc640 1 --2- 172.21.15.84:0/545309048 >> v2:172.21.15.99:3300/0 conn(0x7f6e6815a800 0x7f6e6815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.498+0000 7f6e5e7fc640 1 -- 172.21.15.84:0/545309048 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680b3ef0 con 0x7f6e680b30b0 2023-12-12T09:19:56.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.500+0000 7f6e5e7fc640 1 --2- 172.21.15.84:0/545309048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e6815a2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e680cc910 tx=0x7f6e5002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9ac8d6058752a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:56.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.500+0000 7f6e667fc640 1 -- 172.21.15.84:0/545309048 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50031860 con 0x7f6e680b30b0 2023-12-12T09:19:56.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.500+0000 7f6e667fc640 1 -- 172.21.15.84:0/545309048 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e500319c0 con 0x7f6e680b30b0 2023-12-12T09:19:56.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.500+0000 7f6e667fc640 1 -- 172.21.15.84:0/545309048 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50031d50 con 0x7f6e680b30b0 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.500+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/545309048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 msgr2=0x7f6e6815a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.500+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/545309048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e6815a2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6e680cc910 tx=0x7f6e5002b900 comp rx=0 tx=0).stop 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.501+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/545309048 shutdown_connections 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.501+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/545309048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e6815a2c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.501+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/545309048 >> v2:172.21.15.99:3300/0 conn(0x7f6e6815a800 0x7f6e6815d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.501+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/545309048 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e680b24f0 0x7f6e680b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.501+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/545309048 >> 172.21.15.84:0/545309048 conn(0x7f6e6806c3d0 msgr2=0x7f6e6806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.501+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/545309048 shutdown_connections 2023-12-12T09:19:56.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.501+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/545309048 wait complete. 2023-12-12T09:19:56.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.502+0000 7f6e6d2b4640 1 Processor -- start 2023-12-12T09:19:56.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.503+0000 7f6e6d2b4640 1 -- start start 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.503+0000 7f6e6d2b4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e680b24f0 0x7f6e6814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.503+0000 7f6e6d2b4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e68070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.503+0000 7f6e6d2b4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e6815a800 0x7f6e680710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.503+0000 7f6e6d2b4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68153540 con 0x7f6e680b30b0 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.503+0000 7f6e6d2b4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6815ae20 con 0x7f6e680b24f0 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.503+0000 7f6e6d2b4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68153260 con 0x7f6e6815a800 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e68070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e68070b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55438/0 (socket says 172.21.15.84:55438) 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 -- 172.21.15.84:0/2430694296 learned_addr learned my addr 172.21.15.84:0/2430694296 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e66ffd640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e680b24f0 0x7f6e6814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e677fe640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e6815a800 0x7f6e680710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 -- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e6815a800 msgr2=0x7f6e680710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e6815a800 0x7f6e680710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 -- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e680b24f0 msgr2=0x7f6e6814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e680b24f0 0x7f6e6814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 -- 172.21.15.84:0/2430694296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500094d0 con 0x7f6e680b30b0 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e677fe640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e6815a800 0x7f6e680710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e66ffd640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e680b24f0 0x7f6e6814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.504+0000 7f6e5e7fc640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e68070b90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e5002b940 tx=0x7f6e500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.505+0000 7f6e5ffff640 1 -- 172.21.15.84:0/2430694296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5003ad30 con 0x7f6e680b30b0 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.505+0000 7f6e5ffff640 1 -- 172.21.15.84:0/2430694296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e500443f0 con 0x7f6e680b30b0 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.505+0000 7f6e5ffff640 1 -- 172.21.15.84:0/2430694296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500447a0 con 0x7f6e680b30b0 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.505+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6815b0c0 con 0x7f6e680b30b0 2023-12-12T09:19:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.505+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e68152dd0 con 0x7f6e680b30b0 2023-12-12T09:19:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.506+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e68153020 con 0x7f6e680b30b0 2023-12-12T09:19:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.507+0000 7f6e5ffff640 1 -- 172.21.15.84:0/2430694296 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e50044900 con 0x7f6e680b30b0 2023-12-12T09:19:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.508+0000 7f6e5ffff640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e4806ae70 0x7f6e4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.508+0000 7f6e5ffff640 1 -- 172.21.15.84:0/2430694296 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e500abeb0 con 0x7f6e680b30b0 2023-12-12T09:19:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.508+0000 7f6e66ffd640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e4806ae70 0x7f6e4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.509+0000 7f6e66ffd640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e4806ae70 0x7f6e4806d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e58006fd0 tx=0x7f6e58008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:56.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.512+0000 7f6e5ffff640 1 -- 172.21.15.84:0/2430694296 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e68153020 con 0x7f6e680b30b0 2023-12-12T09:19:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.713+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6e6815ac80 con 0x7f6e680b30b0 2023-12-12T09:19:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.714+0000 7f6e5ffff640 1 -- 172.21.15.84:0/2430694296 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6e6815ac80 con 0x7f6e680b30b0 2023-12-12T09:19:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e4806ae70 msgr2=0x7f6e4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e4806ae70 0x7f6e4806d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6e58006fd0 tx=0x7f6e58008040 comp rx=0 tx=0).stop 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 msgr2=0x7f6e68070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e68070b90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e5002b940 tx=0x7f6e500046c0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 shutdown_connections 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e6815a800 0x7f6e680710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e4806ae70 0x7f6e4806d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e680b30b0 0x7f6e68070b90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 --2- 172.21.15.84:0/2430694296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e680b24f0 0x7f6e6814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.716+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 >> 172.21.15.84:0/2430694296 conn(0x7f6e6806c3d0 msgr2=0x7f6e6814d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.717+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 shutdown_connections 2023-12-12T09:19:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:56.717+0000 7f6e6d2b4640 1 -- 172.21.15.84:0/2430694296 wait complete. 2023-12-12T09:19:56.734 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:19:56.734 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:19:56.782 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:19:57.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.039+0000 7f9325890640 1 Processor -- start 2023-12-12T09:19:57.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.039+0000 7f9325890640 1 -- start start 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.041+0000 7f9325890640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f93200b47e0 0x7f9320071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.041+0000 7f9325890640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93200ce550 0x7f93200715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.041+0000 7f9325890640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93200cea30 con 0x7f9320143d20 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.041+0000 7f9325890640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93200702b0 con 0x7f93200ce550 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.041+0000 7f9325890640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9320070590 con 0x7f93200b47e0 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.042+0000 7f931f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93200ce550 0x7f93200715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.042+0000 7f931f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f93200ce550 0x7f93200715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55440/0 (socket says 172.21.15.84:55440) 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.042+0000 7f931f7fe640 1 -- 172.21.15.84:0/158401684 learned_addr learned my addr 172.21.15.84:0/158401684 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:57.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.042+0000 7f93167fc640 1 --2- 172.21.15.84:0/158401684 >> v2:172.21.15.99:3300/0 conn(0x7f93200b47e0 0x7f9320071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.042+0000 7f931f7fe640 1 -- 172.21.15.84:0/158401684 >> v2:172.21.15.99:3300/0 conn(0x7f93200b47e0 msgr2=0x7f9320071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:57.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.042+0000 7f931f7fe640 1 --2- 172.21.15.84:0/158401684 >> v2:172.21.15.99:3300/0 conn(0x7f93200b47e0 0x7f9320071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.042+0000 7f931f7fe640 1 -- 172.21.15.84:0/158401684 >> v1:172.21.15.99:6789/0 conn(0x7f9320143d20 legacy=0x7f93200b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:57.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.042+0000 7f931f7fe640 1 -- 172.21.15.84:0/158401684 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9320070870 con 0x7f93200ce550 2023-12-12T09:19:57.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.043+0000 7f931f7fe640 1 --2- 172.21.15.84:0/158401684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200ce550 0x7f93200715b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f932006be30 tx=0x7f931802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0fe6f5a9cc28c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f931e7fc640 1 -- 172.21.15.84:0/158401684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931802ca80 con 0x7f93200ce550 2023-12-12T09:19:57.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f931e7fc640 1 -- 172.21.15.84:0/158401684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931802cbe0 con 0x7f93200ce550 2023-12-12T09:19:57.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f931e7fc640 1 -- 172.21.15.84:0/158401684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180343f0 con 0x7f93200ce550 2023-12-12T09:19:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f9325890640 1 -- 172.21.15.84:0/158401684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200ce550 msgr2=0x7f93200715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f9325890640 1 --2- 172.21.15.84:0/158401684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200ce550 0x7f93200715b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f932006be30 tx=0x7f931802bee0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f9325890640 1 -- 172.21.15.84:0/158401684 shutdown_connections 2023-12-12T09:19:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f9325890640 1 --2- 172.21.15.84:0/158401684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200ce550 0x7f93200715b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f9325890640 1 --2- 172.21.15.84:0/158401684 >> v2:172.21.15.99:3300/0 conn(0x7f93200b47e0 0x7f9320071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.044+0000 7f9325890640 1 -- 172.21.15.84:0/158401684 >> 172.21.15.84:0/158401684 conn(0x7f932006c3d0 msgr2=0x7f932006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.045+0000 7f9325890640 1 -- 172.21.15.84:0/158401684 shutdown_connections 2023-12-12T09:19:57.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.045+0000 7f9325890640 1 -- 172.21.15.84:0/158401684 wait complete. 2023-12-12T09:19:57.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.046+0000 7f9325890640 1 Processor -- start 2023-12-12T09:19:57.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.046+0000 7f9325890640 1 -- start start 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.047+0000 7f9325890640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200b47e0 0x7f9320137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.047+0000 7f9325890640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93200ce550 0x7f932015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.047+0000 7f9325890640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9320143d20 0x7f932015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.047+0000 7f9325890640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932013b150 con 0x7f93200b47e0 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.047+0000 7f9325890640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9320138900 con 0x7f93200ce550 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.047+0000 7f9325890640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9320138be0 con 0x7f9320143d20 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.047+0000 7f931effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200b47e0 0x7f9320137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200b47e0 0x7f9320137da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55452/0 (socket says 172.21.15.84:55452) 2023-12-12T09:19:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931effd640 1 -- 172.21.15.84:0/2069841809 learned_addr learned my addr 172.21.15.84:0/2069841809 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f93167fc640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93200ce550 0x7f932015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931effd640 1 -- 172.21.15.84:0/2069841809 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9320143d20 msgr2=0x7f932015a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931effd640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9320143d20 0x7f932015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931effd640 1 -- 172.21.15.84:0/2069841809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93200ce550 msgr2=0x7f932015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931effd640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93200ce550 0x7f932015a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931effd640 1 -- 172.21.15.84:0/2069841809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009b30 con 0x7f93200b47e0 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f93167fc640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93200ce550 0x7f932015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931effd640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200b47e0 0x7f9320137da0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f931000b3f0 tx=0x7f931000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931cff9640 1 -- 172.21.15.84:0/2069841809 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011830 con 0x7f93200b47e0 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931cff9640 1 -- 172.21.15.84:0/2069841809 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9310011990 con 0x7f93200b47e0 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.048+0000 7f931cff9640 1 -- 172.21.15.84:0/2069841809 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310011d40 con 0x7f93200b47e0 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.049+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932015c700 con 0x7f93200b47e0 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.049+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932013c370 con 0x7f93200b47e0 2023-12-12T09:19:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.050+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9320138e00 con 0x7f93200b47e0 2023-12-12T09:19:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.051+0000 7f931cff9640 1 -- 172.21.15.84:0/2069841809 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f931001a400 con 0x7f93200b47e0 2023-12-12T09:19:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.051+0000 7f931cff9640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f930006ae40 0x7f930006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.051+0000 7f931cff9640 1 -- 172.21.15.84:0/2069841809 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9310089670 con 0x7f93200b47e0 2023-12-12T09:19:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.052+0000 7f93167fc640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f930006ae40 0x7f930006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.052+0000 7f93167fc640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f930006ae40 0x7f930006d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93200b45e0 tx=0x7f9308008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.056+0000 7f931cff9640 1 -- 172.21.15.84:0/2069841809 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93100544c0 con 0x7f93200b47e0 2023-12-12T09:19:57.185 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:19:57.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:19:57.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.249+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f932015cc20 con 0x7f93200b47e0 2023-12-12T09:19:57.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.250+0000 7f931cff9640 1 -- 172.21.15.84:0/2069841809 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f9310057ae0 con 0x7f93200b47e0 2023-12-12T09:19:57.251 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:19:57.251 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:19:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f930006ae40 msgr2=0x7f930006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f930006ae40 0x7f930006d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f93200b45e0 tx=0x7f9308008040 comp rx=0 tx=0).stop 2023-12-12T09:19:57.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200b47e0 msgr2=0x7f9320137da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200b47e0 0x7f9320137da0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f931000b3f0 tx=0x7f931000b8b0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 shutdown_connections 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9320143d20 0x7f932015a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f93200ce550 0x7f932015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f930006ae40 0x7f930006d300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 --2- 172.21.15.84:0/2069841809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93200b47e0 0x7f9320137da0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 >> 172.21.15.84:0/2069841809 conn(0x7f932006c3d0 msgr2=0x7f9320070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 shutdown_connections 2023-12-12T09:19:57.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.253+0000 7f9325890640 1 -- 172.21.15.84:0/2069841809 wait complete. 2023-12-12T09:19:57.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:19:57.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:19:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.465+0000 7fa8675be640 1 Processor -- start 2023-12-12T09:19:57.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.465+0000 7fa8675be640 1 -- start start 2023-12-12T09:19:57.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.467+0000 7fa8675be640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 0x7fa8600ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.467+0000 7fa8675be640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600ce260 con 0x7fa8600b40d0 2023-12-12T09:19:57.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.467+0000 7fa8675be640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600cd930 con 0x7fa86015be60 2023-12-12T09:19:57.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.467+0000 7fa8675be640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86006e480 con 0x7fa86006dff0 2023-12-12T09:19:57.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.467+0000 7fa86535a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa8600b40d0 0x7fa8600b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39846/0 (socket says 172.21.15.84:39846) 2023-12-12T09:19:57.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.467+0000 7fa86535a640 1 -- 172.21.15.84:0/791338195 learned_addr learned my addr 172.21.15.84:0/791338195 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:57.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.467+0000 7fa864b59640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 0x7fa8600ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.467+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208063778 0 0) 0x7fa8600ce260 con 0x7fa8600b40d0 2023-12-12T09:19:57.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84c003520 con 0x7fa8600b40d0 2023-12-12T09:19:57.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4246069591 0 0) 0x7fa84c003520 con 0x7fa8600b40d0 2023-12-12T09:19:57.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 msgr2=0x7fa8600ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:57.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 0x7fa8600ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 >> v1:172.21.15.99:6789/0 conn(0x7fa86015be60 legacy=0x7fa86013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600cdc10 con 0x7fa8600b40d0 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa85c001670 con 0x7fa8600b40d0 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 >> v1:172.21.15.84:6789/0 conn(0x7fa8600b40d0 legacy=0x7fa8600b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0039a0 0x7fa84c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c0047c0 0x7fa84c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 0x7fa84c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86006e480 con 0x7fa84c0047c0 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c00ba60 con 0x7fa84c0039a0 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c00bc20 con 0x7fa86006dff0 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.468+0000 7fa864b59640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c0047c0 0x7fa84c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa86535a640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0039a0 0x7fa84c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa865b5b640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 0x7fa84c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa864b59640 1 -- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 msgr2=0x7fa84c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:57.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa864b59640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 0x7fa84c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa864b59640 1 -- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0039a0 msgr2=0x7fa84c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:57.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa864b59640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0039a0 0x7fa84c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa864b59640 1 -- 172.21.15.84:0/791338195 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c003520 con 0x7fa84c0047c0 2023-12-12T09:19:57.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa865b5b640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa86006dff0 0x7fa84c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:57.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.469+0000 7fa86535a640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0039a0 0x7fa84c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.470+0000 7fa864b59640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c0047c0 0x7fa84c004c40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa850009a90 tx=0x7fa84c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf9730b5bfbdad3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.470+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85002c660 con 0x7fa84c0047c0 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.470+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85002c7c0 con 0x7fa84c0047c0 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.470+0000 7fa857fff640 1 -- 172.21.15.84:0/791338195 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85002cb50 con 0x7fa84c0047c0 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.471+0000 7fa8675be640 1 -- 172.21.15.84:0/791338195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c0047c0 msgr2=0x7fa84c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.471+0000 7fa8675be640 1 --2- 172.21.15.84:0/791338195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa84c0047c0 0x7fa84c004c40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa850009a90 tx=0x7fa84c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.471+0000 7fa865b5b640 1 -- 172.21.15.84:0/791338195 reap_dead start 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.471+0000 7fa8675be640 1 -- 172.21.15.84:0/791338195 shutdown_connections 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.471+0000 7fa8675be640 1 -- 172.21.15.84:0/791338195 >> 172.21.15.84:0/791338195 conn(0x7fa8600b0ac0 msgr2=0x7fa8600b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.471+0000 7fa8675be640 1 -- 172.21.15.84:0/791338195 shutdown_connections 2023-12-12T09:19:57.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.471+0000 7fa8675be640 1 -- 172.21.15.84:0/791338195 wait complete. 2023-12-12T09:19:57.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.472+0000 7fa8675be640 1 Processor -- start 2023-12-12T09:19:57.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.473+0000 7fa8675be640 1 -- start start 2023-12-12T09:19:57.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa8675be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0047c0 0x7fa8601f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa8675be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8601f3380 0x7fa8601f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa8675be640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8600af990 0x7fa8600afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa8675be640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b0350 con 0x7fa8601f3380 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa8675be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601f4a70 con 0x7fa84c0047c0 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa8675be640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601f3e60 con 0x7fa8600af990 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa864b59640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8601f3380 0x7fa8601f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa864b59640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8601f3380 0x7fa8601f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55462/0 (socket says 172.21.15.84:55462) 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa864b59640 1 -- 172.21.15.84:0/3144197819 learned_addr learned my addr 172.21.15.84:0/3144197819 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa86535a640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0047c0 0x7fa8601f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa865b5b640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8600af990 0x7fa8600afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa864b59640 1 -- 172.21.15.84:0/3144197819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8600af990 msgr2=0x7fa8600afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa864b59640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8600af990 0x7fa8600afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa864b59640 1 -- 172.21.15.84:0/3144197819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0047c0 msgr2=0x7fa8601f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa864b59640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0047c0 0x7fa8601f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.474+0000 7fa864b59640 1 -- 172.21.15.84:0/3144197819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8601f4140 con 0x7fa8601f3380 2023-12-12T09:19:57.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.475+0000 7fa864b59640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8601f3380 0x7fa8601f2190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa85002c200 tx=0x7fa850004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.475+0000 7fa855ffb640 1 -- 172.21.15.84:0/3144197819 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850003810 con 0x7fa8601f3380 2023-12-12T09:19:57.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.475+0000 7fa855ffb640 1 -- 172.21.15.84:0/3144197819 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850003970 con 0x7fa8601f3380 2023-12-12T09:19:57.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.475+0000 7fa855ffb640 1 -- 172.21.15.84:0/3144197819 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850003d00 con 0x7fa8601f3380 2023-12-12T09:19:57.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.475+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8601f4420 con 0x7fa8601f3380 2023-12-12T09:19:57.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.475+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa860141050 con 0x7fa8601f3380 2023-12-12T09:19:57.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.476+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8600cd5a0 con 0x7fa8601f3380 2023-12-12T09:19:57.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.477+0000 7fa855ffb640 1 -- 172.21.15.84:0/3144197819 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa850034440 con 0x7fa8601f3380 2023-12-12T09:19:57.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.478+0000 7fa855ffb640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84406ae40 0x7fa84406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.478+0000 7fa855ffb640 1 -- 172.21.15.84:0/3144197819 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa8500aba20 con 0x7fa8601f3380 2023-12-12T09:19:57.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.478+0000 7fa86535a640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84406ae40 0x7fa84406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.479+0000 7fa86535a640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84406ae40 0x7fa84406d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0017a0 tx=0x7fa85c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.483+0000 7fa855ffb640 1 -- 172.21.15.84:0/3144197819 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8500769b0 con 0x7fa8601f3380 2023-12-12T09:19:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.659+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8600673c0 con 0x7fa8601f3380 2023-12-12T09:19:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.660+0000 7fa855ffb640 1 -- 172.21.15.84:0/3144197819 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa850003e60 con 0x7fa8601f3380 2023-12-12T09:19:57.660 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.662+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84406ae40 msgr2=0x7fa84406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.662+0000 7fa8675be640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84406ae40 0x7fa84406d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0017a0 tx=0x7fa85c009040 comp rx=0 tx=0).stop 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.662+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8601f3380 msgr2=0x7fa8601f2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.662+0000 7fa8675be640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8601f3380 0x7fa8601f2190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa85002c200 tx=0x7fa850004730 comp rx=0 tx=0).stop 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.663+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 shutdown_connections 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.663+0000 7fa8675be640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8600af990 0x7fa8600afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.663+0000 7fa8675be640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84406ae40 0x7fa84406d300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.663+0000 7fa8675be640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8601f3380 0x7fa8601f2190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.663+0000 7fa8675be640 1 --2- 172.21.15.84:0/3144197819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa84c0047c0 0x7fa8601f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.663+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 >> 172.21.15.84:0/3144197819 conn(0x7fa8600b0ac0 msgr2=0x7fa86015adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.663+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 shutdown_connections 2023-12-12T09:19:57.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.663+0000 7fa8675be640 1 -- 172.21.15.84:0/3144197819 wait complete. 2023-12-12T09:19:57.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:19:57.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.894+0000 7fb06759e640 1 Processor -- start 2023-12-12T09:19:57.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.894+0000 7fb06759e640 1 -- start start 2023-12-12T09:19:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.896+0000 7fb06759e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0680d1af0 0x7fb0680cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.896+0000 7fb06759e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b7ac0 0x7fb0680cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.896+0000 7fb06759e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb068160cb0 con 0x7fb0680b88e0 2023-12-12T09:19:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.896+0000 7fb06759e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0680b8cc0 con 0x7fb0680d1af0 2023-12-12T09:19:57.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.896+0000 7fb06759e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680d3c70 con 0x7fb0680b7ac0 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.896+0000 7fb05dd9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb0680d1af0 0x7fb0680cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.896+0000 7fb06659c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb0680b88e0 0x7fb0680d13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39850/0 (socket says 172.21.15.84:39850) 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.896+0000 7fb06659c640 1 -- 172.21.15.84:0/750317039 learned_addr learned my addr 172.21.15.84:0/750317039 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.897+0000 7fb066d9d640 1 --2- 172.21.15.84:0/750317039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b7ac0 0x7fb0680cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.897+0000 7fb05dd9b640 1 -- 172.21.15.84:0/750317039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b7ac0 msgr2=0x7fb0680cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.897+0000 7fb05dd9b640 1 --2- 172.21.15.84:0/750317039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b7ac0 0x7fb0680cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.897+0000 7fb05dd9b640 1 -- 172.21.15.84:0/750317039 >> v1:172.21.15.84:6789/0 conn(0x7fb0680b88e0 legacy=0x7fb0680d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.897+0000 7fb065d9b640 1 -- 172.21.15.84:0/750317039 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877271676 0 0) 0x7fb068160cb0 con 0x7fb0680b88e0 2023-12-12T09:19:57.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.897+0000 7fb05dd9b640 1 -- 172.21.15.84:0/750317039 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0680b5cf0 con 0x7fb0680d1af0 2023-12-12T09:19:57.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.897+0000 7fb066d9d640 1 --2- 172.21.15.84:0/750317039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b7ac0 0x7fb0680cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.898+0000 7fb05dd9b640 1 --2- 172.21.15.84:0/750317039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680d1af0 0x7fb0680cda10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0500097a0 tx=0x7fb05002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb45e70967717288 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.898+0000 7fb065d9b640 1 -- 172.21.15.84:0/750317039 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050030800 con 0x7fb0680d1af0 2023-12-12T09:19:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.898+0000 7fb065d9b640 1 -- 172.21.15.84:0/750317039 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050030960 con 0x7fb0680d1af0 2023-12-12T09:19:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.898+0000 7fb065d9b640 1 -- 172.21.15.84:0/750317039 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050030cf0 con 0x7fb0680d1af0 2023-12-12T09:19:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.899+0000 7fb06759e640 1 -- 172.21.15.84:0/750317039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680d1af0 msgr2=0x7fb0680cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.899+0000 7fb06759e640 1 --2- 172.21.15.84:0/750317039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680d1af0 0x7fb0680cda10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb0500097a0 tx=0x7fb05002b940 comp rx=0 tx=0).stop 2023-12-12T09:19:57.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.899+0000 7fb06759e640 1 -- 172.21.15.84:0/750317039 shutdown_connections 2023-12-12T09:19:57.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.899+0000 7fb06759e640 1 --2- 172.21.15.84:0/750317039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b7ac0 0x7fb0680cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.899+0000 7fb06759e640 1 --2- 172.21.15.84:0/750317039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680d1af0 0x7fb0680cda10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.899+0000 7fb06759e640 1 -- 172.21.15.84:0/750317039 >> 172.21.15.84:0/750317039 conn(0x7fb0680d2e00 msgr2=0x7fb0680d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:57.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.899+0000 7fb06759e640 1 -- 172.21.15.84:0/750317039 shutdown_connections 2023-12-12T09:19:57.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.899+0000 7fb06759e640 1 -- 172.21.15.84:0/750317039 wait complete. 2023-12-12T09:19:57.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.900+0000 7fb06759e640 1 Processor -- start 2023-12-12T09:19:57.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.901+0000 7fb06759e640 1 -- start start 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.901+0000 7fb06759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680b7ac0 0x7fb0680cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.901+0000 7fb06759e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b88e0 0x7fb068154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0680d1af0 0x7fb06806c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06759e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680cbe20 con 0x7fb0680b7ac0 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06759e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c8320 con 0x7fb0680d1af0 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06759e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0680c8600 con 0x7fb0680b88e0 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680b7ac0 0x7fb0680cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680b7ac0 0x7fb0680cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55478/0 (socket says 172.21.15.84:55478) 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06659c640 1 -- 172.21.15.84:0/3420012692 learned_addr learned my addr 172.21.15.84:0/3420012692 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:57.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb05dd9b640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b88e0 0x7fb068154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb066d9d640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0680d1af0 0x7fb06806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06659c640 1 -- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b88e0 msgr2=0x7fb068154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06659c640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b88e0 0x7fb068154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06659c640 1 -- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0680d1af0 msgr2=0x7fb06806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06659c640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0680d1af0 0x7fb06806c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb06659c640 1 -- 172.21.15.84:0/3420012692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050009400 con 0x7fb0680b7ac0 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.902+0000 7fb05dd9b640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b88e0 0x7fb068154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.903+0000 7fb06659c640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680b7ac0 0x7fb0680cb8e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb05800c4d0 tx=0x7fb05800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.903+0000 7fb05f7fe640 1 -- 172.21.15.84:0/3420012692 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0580074e0 con 0x7fb0680b7ac0 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.903+0000 7fb05f7fe640 1 -- 172.21.15.84:0/3420012692 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058007660 con 0x7fb0680b7ac0 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.903+0000 7fb05f7fe640 1 -- 172.21.15.84:0/3420012692 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058004a20 con 0x7fb0680b7ac0 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.903+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0680c88e0 con 0x7fb0680b7ac0 2023-12-12T09:19:57.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.903+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0680cc930 con 0x7fb0680b7ac0 2023-12-12T09:19:57.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.904+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06815ac50 con 0x7fb0680b7ac0 2023-12-12T09:19:57.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.905+0000 7fb05f7fe640 1 -- 172.21.15.84:0/3420012692 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb058004b80 con 0x7fb0680b7ac0 2023-12-12T09:19:57.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.906+0000 7fb05f7fe640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb04806ae40 0x7fb04806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:57.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.906+0000 7fb05f7fe640 1 -- 172.21.15.84:0/3420012692 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb058088a90 con 0x7fb0680b7ac0 2023-12-12T09:19:57.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.906+0000 7fb05dd9b640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb04806ae40 0x7fb04806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:57.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.907+0000 7fb05dd9b640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb04806ae40 0x7fb04806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb050036000 tx=0x7fb05003b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:57.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:57.910+0000 7fb05f7fe640 1 -- 172.21.15.84:0/3420012692 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb058053850 con 0x7fb0680b7ac0 2023-12-12T09:19:58.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.097+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb06804e840 con 0x7fb0680b7ac0 2023-12-12T09:19:58.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.098+0000 7fb05f7fe640 1 -- 172.21.15.84:0/3420012692 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0580180a0 con 0x7fb0680b7ac0 2023-12-12T09:19:58.098 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:19:58.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb04806ae40 msgr2=0x7fb04806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb04806ae40 0x7fb04806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb050036000 tx=0x7fb05003b040 comp rx=0 tx=0).stop 2023-12-12T09:19:58.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680b7ac0 msgr2=0x7fb0680cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680b7ac0 0x7fb0680cb8e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb05800c4d0 tx=0x7fb05800c990 comp rx=0 tx=0).stop 2023-12-12T09:19:58.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 shutdown_connections 2023-12-12T09:19:58.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0680d1af0 0x7fb06806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb0680b88e0 0x7fb068154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb04806ae40 0x7fb04806d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 --2- 172.21.15.84:0/3420012692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0680b7ac0 0x7fb0680cb8e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 >> 172.21.15.84:0/3420012692 conn(0x7fb0680d2e00 msgr2=0x7fb0680d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:58.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 shutdown_connections 2023-12-12T09:19:58.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.101+0000 7fb06759e640 1 -- 172.21.15.84:0/3420012692 wait complete. 2023-12-12T09:19:58.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:19:58.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.321+0000 7f4f2f3ce640 1 Processor -- start 2023-12-12T09:19:58.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.322+0000 7f4f2f3ce640 1 -- start start 2023-12-12T09:19:58.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.323+0000 7f4f2f3ce640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f2815d2e0 0x7f4f280d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.323+0000 7f4f2f3ce640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4f280d16f0 0x7f4f280ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.323+0000 7f4f2f3ce640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f280d1b40 con 0x7f4f280d3300 2023-12-12T09:19:58.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.323+0000 7f4f2f3ce640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280d1d70 con 0x7f4f2815d2e0 2023-12-12T09:19:58.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.323+0000 7f4f2f3ce640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280cde10 con 0x7f4f280d16f0 2023-12-12T09:19:58.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.323+0000 7f4f2d16a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f2815d2e0 0x7f4f280d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.323+0000 7f4f2d16a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f2815d2e0 0x7f4f280d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55494/0 (socket says 172.21.15.84:55494) 2023-12-12T09:19:58.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.324+0000 7f4f2d16a640 1 -- 172.21.15.84:0/346152670 learned_addr learned my addr 172.21.15.84:0/346152670 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.324+0000 7f4f2d96b640 1 --2- 172.21.15.84:0/346152670 >> v2:172.21.15.99:3300/0 conn(0x7f4f280d16f0 0x7f4f280ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.324+0000 7f4f2d16a640 1 -- 172.21.15.84:0/346152670 >> v2:172.21.15.99:3300/0 conn(0x7f4f280d16f0 msgr2=0x7f4f280ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.324+0000 7f4f2d16a640 1 --2- 172.21.15.84:0/346152670 >> v2:172.21.15.99:3300/0 conn(0x7f4f280d16f0 0x7f4f280ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.324+0000 7f4f2d16a640 1 -- 172.21.15.84:0/346152670 >> v1:172.21.15.99:6789/0 conn(0x7f4f280d3300 legacy=0x7f4f280d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:58.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.324+0000 7f4f2d16a640 1 -- 172.21.15.84:0/346152670 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280ce0f0 con 0x7f4f2815d2e0 2023-12-12T09:19:58.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.325+0000 7f4f2d16a640 1 --2- 172.21.15.84:0/346152670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f280d2dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f2808d270 tx=0x7f4f1802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f004da8bdd4098ce server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:58.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.325+0000 7f4f27fff640 1 -- 172.21.15.84:0/346152670 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1802ca80 con 0x7f4f2815d2e0 2023-12-12T09:19:58.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f27fff640 1 -- 172.21.15.84:0/346152670 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1802cbe0 con 0x7f4f2815d2e0 2023-12-12T09:19:58.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f27fff640 1 -- 172.21.15.84:0/346152670 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f180343f0 con 0x7f4f2815d2e0 2023-12-12T09:19:58.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/346152670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 msgr2=0x7f4f280d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/346152670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f280d2dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f2808d270 tx=0x7f4f1802bee0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/346152670 shutdown_connections 2023-12-12T09:19:58.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/346152670 >> v2:172.21.15.99:3300/0 conn(0x7f4f280d16f0 0x7f4f280ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/346152670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f280d2dc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/346152670 >> 172.21.15.84:0/346152670 conn(0x7f4f2808cb10 msgr2=0x7f4f2809c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:58.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/346152670 shutdown_connections 2023-12-12T09:19:58.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.326+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/346152670 wait complete. 2023-12-12T09:19:58.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.328+0000 7f4f2f3ce640 1 Processor -- start 2023-12-12T09:19:58.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.328+0000 7f4f2f3ce640 1 -- start start 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2f3ce640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f280d16f0 0x7f4f280cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2f3ce640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f280d3300 0x7f4f280cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2f3ce640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f281f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2f3ce640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280cafc0 con 0x7f4f2815d2e0 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2f3ce640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280ca3b0 con 0x7f4f280d16f0 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2f3ce640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280ca690 con 0x7f4f280d3300 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2d96b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f281f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2d96b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f281f34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55508/0 (socket says 172.21.15.84:55508) 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.329+0000 7f4f2d96b640 1 -- 172.21.15.84:0/3550245291 learned_addr learned my addr 172.21.15.84:0/3550245291 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2d16a640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f280d16f0 0x7f4f280cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2c969640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f280d3300 0x7f4f280cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2d96b640 1 -- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f280d3300 msgr2=0x7f4f280cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2d96b640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f280d3300 0x7f4f280cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2d96b640 1 -- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f280d16f0 msgr2=0x7f4f280cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2d96b640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f280d16f0 0x7f4f280cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2d96b640 1 -- 172.21.15.84:0/3550245291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18009b30 con 0x7f4f2815d2e0 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2c969640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f280d3300 0x7f4f280cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2d96b640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f281f34d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000d800 tx=0x7f4f2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f25ffb640 1 -- 172.21.15.84:0/3550245291 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000b6c0 con 0x7f4f2815d2e0 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f25ffb640 1 -- 172.21.15.84:0/3550245291 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000b840 con 0x7f4f2815d2e0 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f25ffb640 1 -- 172.21.15.84:0/3550245291 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000bbf0 con 0x7f4f2815d2e0 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.330+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f280ca970 con 0x7f4f2815d2e0 2023-12-12T09:19:58.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.331+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2815fc40 con 0x7f4f2815d2e0 2023-12-12T09:19:58.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.332+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f280d3770 con 0x7f4f2815d2e0 2023-12-12T09:19:58.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.332+0000 7f4f25ffb640 1 -- 172.21.15.84:0/3550245291 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f2000bd50 con 0x7f4f2815d2e0 2023-12-12T09:19:58.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.333+0000 7f4f25ffb640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f1406ae40 0x7f4f1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.333+0000 7f4f25ffb640 1 -- 172.21.15.84:0/3550245291 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f20089ea0 con 0x7f4f2815d2e0 2023-12-12T09:19:58.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.334+0000 7f4f2d16a640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f1406ae40 0x7f4f1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.334+0000 7f4f2d16a640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f1406ae40 0x7f4f1406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f18035000 tx=0x7f4f18030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:58.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.337+0000 7f4f25ffb640 1 -- 172.21.15.84:0/3550245291 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f280d3770 con 0x7f4f2815d2e0 2023-12-12T09:19:58.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.525+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f280d3770 con 0x7f4f2815d2e0 2023-12-12T09:19:58.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.526+0000 7f4f25ffb640 1 -- 172.21.15.84:0/3550245291 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f280d3770 con 0x7f4f2815d2e0 2023-12-12T09:19:58.526 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:19:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f1406ae40 msgr2=0x7f4f1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f1406ae40 0x7f4f1406d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f18035000 tx=0x7f4f18030000 comp rx=0 tx=0).stop 2023-12-12T09:19:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 msgr2=0x7f4f281f34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f281f34d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000d800 tx=0x7f4f2000dcc0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 shutdown_connections 2023-12-12T09:19:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f1406ae40 0x7f4f1406d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f2815d2e0 0x7f4f281f34d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f280d3300 0x7f4f280cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 --2- 172.21.15.84:0/3550245291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f280d16f0 0x7f4f280cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.528+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 >> 172.21.15.84:0/3550245291 conn(0x7f4f2808cb10 msgr2=0x7f4f280d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:58.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.529+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 shutdown_connections 2023-12-12T09:19:58.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.529+0000 7f4f2f3ce640 1 -- 172.21.15.84:0/3550245291 wait complete. 2023-12-12T09:19:58.547 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:19:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.758+0000 7f4856c75640 1 Processor -- start 2023-12-12T09:19:58.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.758+0000 7f4856c75640 1 -- start start 2023-12-12T09:19:58.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.760+0000 7f4856c75640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4850146ac0 0x7f48500b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.760+0000 7f4856c75640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48500b3280 0x7f485015e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.760+0000 7f4856c75640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500b3700 con 0x7f485006beb0 2023-12-12T09:19:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.760+0000 7f4856c75640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485015e670 con 0x7f48500b3280 2023-12-12T09:19:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.760+0000 7f4856c75640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48500b21e0 con 0x7f4850146ac0 2023-12-12T09:19:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.760+0000 7f484ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48500b3280 0x7f485015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.760+0000 7f484ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f48500b3280 0x7f485015e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55514/0 (socket says 172.21.15.84:55514) 2023-12-12T09:19:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.760+0000 7f484ffff640 1 -- 172.21.15.84:0/1020525287 learned_addr learned my addr 172.21.15.84:0/1020525287 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:58.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.761+0000 7f4854a11640 1 --2- 172.21.15.84:0/1020525287 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4850146ac0 0x7f48500b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.761+0000 7f484ffff640 1 -- 172.21.15.84:0/1020525287 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4850146ac0 msgr2=0x7f48500b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:58.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.761+0000 7f484ffff640 1 --2- 172.21.15.84:0/1020525287 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4850146ac0 0x7f48500b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.761+0000 7f484ffff640 1 -- 172.21.15.84:0/1020525287 >> v1:172.21.15.99:6789/0 conn(0x7f485006beb0 legacy=0x7f4850070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:58.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.761+0000 7f484ffff640 1 -- 172.21.15.84:0/1020525287 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500b24c0 con 0x7f48500b3280 2023-12-12T09:19:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.762+0000 7f484ffff640 1 --2- 172.21.15.84:0/1020525287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485015e130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4840009870 tx=0x7f484002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3425e6dc7845add server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.762+0000 7f484f7fe640 1 -- 172.21.15.84:0/1020525287 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840031640 con 0x7f48500b3280 2023-12-12T09:19:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.762+0000 7f484f7fe640 1 -- 172.21.15.84:0/1020525287 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48400317a0 con 0x7f48500b3280 2023-12-12T09:19:58.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f484f7fe640 1 -- 172.21.15.84:0/1020525287 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840031b30 con 0x7f48500b3280 2023-12-12T09:19:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f4856c75640 1 -- 172.21.15.84:0/1020525287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 msgr2=0x7f485015e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f4856c75640 1 --2- 172.21.15.84:0/1020525287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485015e130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4840009870 tx=0x7f484002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f4856c75640 1 -- 172.21.15.84:0/1020525287 shutdown_connections 2023-12-12T09:19:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f4856c75640 1 --2- 172.21.15.84:0/1020525287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485015e130 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f4856c75640 1 --2- 172.21.15.84:0/1020525287 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4850146ac0 0x7f48500b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f4856c75640 1 -- 172.21.15.84:0/1020525287 >> 172.21.15.84:0/1020525287 conn(0x7f48500b0900 msgr2=0x7f48500b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f4856c75640 1 -- 172.21.15.84:0/1020525287 shutdown_connections 2023-12-12T09:19:58.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.763+0000 7f4856c75640 1 -- 172.21.15.84:0/1020525287 wait complete. 2023-12-12T09:19:58.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.765+0000 7f4856c75640 1 Processor -- start 2023-12-12T09:19:58.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.765+0000 7f4856c75640 1 -- start start 2023-12-12T09:19:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f4856c75640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f485006beb0 0x7f485015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f4856c75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485009bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f4856c75640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4850146ac0 0x7f485009c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f4856c75640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485009b290 con 0x7f48500b3280 2023-12-12T09:19:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f4856c75640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485009a400 con 0x7f4850146ac0 2023-12-12T09:19:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f4856c75640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485009a610 con 0x7f485006beb0 2023-12-12T09:19:58.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f484ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485009bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f484ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485009bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55524/0 (socket says 172.21.15.84:55524) 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.766+0000 7f484ffff640 1 -- 172.21.15.84:0/2153016651 learned_addr learned my addr 172.21.15.84:0/2153016651 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.767+0000 7f4854a11640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f485006beb0 0x7f485015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.767+0000 7f4855212640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4850146ac0 0x7f485009c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.767+0000 7f484ffff640 1 -- 172.21.15.84:0/2153016651 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f485006beb0 msgr2=0x7f485015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.767+0000 7f484ffff640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f485006beb0 0x7f485015cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.767+0000 7f484ffff640 1 -- 172.21.15.84:0/2153016651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4850146ac0 msgr2=0x7f485009c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.767+0000 7f484ffff640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4850146ac0 0x7f485009c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.767+0000 7f484ffff640 1 -- 172.21.15.84:0/2153016651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400094d0 con 0x7f48500b3280 2023-12-12T09:19:58.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.767+0000 7f484ffff640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485009bfd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4840009870 tx=0x7f48400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:58.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.768+0000 7f484d7fa640 1 -- 172.21.15.84:0/2153016651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484003a930 con 0x7f48500b3280 2023-12-12T09:19:58.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.768+0000 7f484d7fa640 1 -- 172.21.15.84:0/2153016651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484003aa90 con 0x7f48500b3280 2023-12-12T09:19:58.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.768+0000 7f484d7fa640 1 -- 172.21.15.84:0/2153016651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484003ae40 con 0x7f48500b3280 2023-12-12T09:19:58.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.768+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485009a8f0 con 0x7f48500b3280 2023-12-12T09:19:58.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.768+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485009aeb0 con 0x7f48500b3280 2023-12-12T09:19:58.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.769+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485009b3d0 con 0x7f48500b3280 2023-12-12T09:19:58.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.770+0000 7f484d7fa640 1 -- 172.21.15.84:0/2153016651 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f484002f050 con 0x7f48500b3280 2023-12-12T09:19:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.771+0000 7f484d7fa640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f483c06ae40 0x7f483c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.771+0000 7f484d7fa640 1 -- 172.21.15.84:0/2153016651 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48400ab530 con 0x7f48500b3280 2023-12-12T09:19:58.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.771+0000 7f4854a11640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f483c06ae40 0x7f483c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:58.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.772+0000 7f4854a11640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f483c06ae40 0x7f483c06d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f485009bb10 tx=0x7f4844008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:58.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.775+0000 7f484d7fa640 1 -- 172.21.15.84:0/2153016651 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4840076380 con 0x7f48500b3280 2023-12-12T09:19:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.965+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f48500b3700 con 0x7f48500b3280 2023-12-12T09:19:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.966+0000 7f484d7fa640 1 -- 172.21.15.84:0/2153016651 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f48500b3700 con 0x7f48500b3280 2023-12-12T09:19:58.966 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f483c06ae40 msgr2=0x7f483c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f483c06ae40 0x7f483c06d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f485009bb10 tx=0x7f4844008040 comp rx=0 tx=0).stop 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 msgr2=0x7f485009bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485009bfd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4840009870 tx=0x7f48400046c0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 shutdown_connections 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4850146ac0 0x7f485009c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f483c06ae40 0x7f483c06d300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f48500b3280 0x7f485009bfd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 --2- 172.21.15.84:0/2153016651 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f485006beb0 0x7f485015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.968+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 >> 172.21.15.84:0/2153016651 conn(0x7f48500b0900 msgr2=0x7f48500708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:58.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.969+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 shutdown_connections 2023-12-12T09:19:58.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:58.969+0000 7f4856c75640 1 -- 172.21.15.84:0/2153016651 wait complete. 2023-12-12T09:19:58.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:19:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.200+0000 7ffb38a01640 1 Processor -- start 2023-12-12T09:19:59.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.201+0000 7ffb38a01640 1 -- start start 2023-12-12T09:19:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.202+0000 7ffb38a01640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb3415d130 0x7ffb340d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.202+0000 7ffb38a01640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb340d1470 0x7ffb340cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.202+0000 7ffb38a01640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340b6460 con 0x7ffb340cfdc0 2023-12-12T09:19:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.202+0000 7ffb38a01640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340d0250 con 0x7ffb340d1470 2023-12-12T09:19:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.202+0000 7ffb38a01640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3415d510 con 0x7ffb3415d130 2023-12-12T09:19:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.202+0000 7ffb2bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb340d1470 0x7ffb340cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:59.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.203+0000 7ffb2bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb340d1470 0x7ffb340cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55540/0 (socket says 172.21.15.84:55540) 2023-12-12T09:19:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.203+0000 7ffb2bfff640 1 -- 172.21.15.84:0/3862450607 learned_addr learned my addr 172.21.15.84:0/3862450607 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.203+0000 7ffb32d9d640 1 --2- 172.21.15.84:0/3862450607 >> v2:172.21.15.99:3300/0 conn(0x7ffb3415d130 0x7ffb340d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.203+0000 7ffb2bfff640 1 -- 172.21.15.84:0/3862450607 >> v2:172.21.15.99:3300/0 conn(0x7ffb3415d130 msgr2=0x7ffb340d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.203+0000 7ffb2bfff640 1 --2- 172.21.15.84:0/3862450607 >> v2:172.21.15.99:3300/0 conn(0x7ffb3415d130 0x7ffb340d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.203+0000 7ffb2bfff640 1 -- 172.21.15.84:0/3862450607 >> v1:172.21.15.99:6789/0 conn(0x7ffb340cfdc0 legacy=0x7ffb340cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:19:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.203+0000 7ffb2bfff640 1 -- 172.21.15.84:0/3862450607 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340d1900 con 0x7ffb340d1470 2023-12-12T09:19:59.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.204+0000 7ffb2bfff640 1 --2- 172.21.15.84:0/3862450607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340d1470 0x7ffb340cf880 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffb3408b260 tx=0x7ffb1c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203b06ca858a3a65 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb3259c640 1 -- 172.21.15.84:0/3862450607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c031870 con 0x7ffb340d1470 2023-12-12T09:19:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb3259c640 1 -- 172.21.15.84:0/3862450607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c0319d0 con 0x7ffb340d1470 2023-12-12T09:19:59.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb3259c640 1 -- 172.21.15.84:0/3862450607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c031d60 con 0x7ffb340d1470 2023-12-12T09:19:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb38a01640 1 -- 172.21.15.84:0/3862450607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340d1470 msgr2=0x7ffb340cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb38a01640 1 --2- 172.21.15.84:0/3862450607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340d1470 0x7ffb340cf880 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffb3408b260 tx=0x7ffb1c02b910 comp rx=0 tx=0).stop 2023-12-12T09:19:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb38a01640 1 -- 172.21.15.84:0/3862450607 shutdown_connections 2023-12-12T09:19:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb38a01640 1 --2- 172.21.15.84:0/3862450607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340d1470 0x7ffb340cf880 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb38a01640 1 --2- 172.21.15.84:0/3862450607 >> v2:172.21.15.99:3300/0 conn(0x7ffb3415d130 0x7ffb340d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.205+0000 7ffb38a01640 1 -- 172.21.15.84:0/3862450607 >> 172.21.15.84:0/3862450607 conn(0x7ffb340d2e90 msgr2=0x7ffb340d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.206+0000 7ffb38a01640 1 -- 172.21.15.84:0/3862450607 shutdown_connections 2023-12-12T09:19:59.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.206+0000 7ffb38a01640 1 -- 172.21.15.84:0/3862450607 wait complete. 2023-12-12T09:19:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.207+0000 7ffb38a01640 1 Processor -- start 2023-12-12T09:19:59.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.207+0000 7ffb38a01640 1 -- start start 2023-12-12T09:19:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.208+0000 7ffb38a01640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340cfdc0 0x7ffb340c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.208+0000 7ffb38a01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb340d1470 0x7ffb3409cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.208+0000 7ffb38a01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb3415d130 0x7ffb34153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:59.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.208+0000 7ffb38a01640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3409d110 con 0x7ffb340cfdc0 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.208+0000 7ffb38a01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340c69c0 con 0x7ffb3415d130 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.208+0000 7ffb38a01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3409d340 con 0x7ffb340d1470 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340cfdc0 0x7ffb340c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340cfdc0 0x7ffb340c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55548/0 (socket says 172.21.15.84:55548) 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 -- 172.21.15.84:0/439533518 learned_addr learned my addr 172.21.15.84:0/439533518 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb2bfff640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb340d1470 0x7ffb3409cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb3359e640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb3415d130 0x7ffb34153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 -- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb340d1470 msgr2=0x7ffb3409cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb340d1470 0x7ffb3409cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 -- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb3415d130 msgr2=0x7ffb34153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb3415d130 0x7ffb34153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 -- 172.21.15.84:0/439533518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0094d0 con 0x7ffb340cfdc0 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb3359e640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb3415d130 0x7ffb34153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:59.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb2bfff640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb340d1470 0x7ffb3409cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:19:59.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.209+0000 7ffb32d9d640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340cfdc0 0x7ffb340c9850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400d800 tx=0x7ffb2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:59.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.210+0000 7ffb2b7fe640 1 -- 172.21.15.84:0/439533518 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400b6c0 con 0x7ffb340cfdc0 2023-12-12T09:19:59.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.210+0000 7ffb2b7fe640 1 -- 172.21.15.84:0/439533518 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2400b820 con 0x7ffb340cfdc0 2023-12-12T09:19:59.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.210+0000 7ffb2b7fe640 1 -- 172.21.15.84:0/439533518 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400bbb0 con 0x7ffb340cfdc0 2023-12-12T09:19:59.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.210+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3409d620 con 0x7ffb340cfdc0 2023-12-12T09:19:59.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.210+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3409dbe0 con 0x7ffb340cfdc0 2023-12-12T09:19:59.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.211+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb340673c0 con 0x7ffb340cfdc0 2023-12-12T09:19:59.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.212+0000 7ffb2b7fe640 1 -- 172.21.15.84:0/439533518 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb2400bd10 con 0x7ffb340cfdc0 2023-12-12T09:19:59.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.213+0000 7ffb2b7fe640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb1406ae40 0x7ffb1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:19:59.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.213+0000 7ffb2b7fe640 1 -- 172.21.15.84:0/439533518 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb24089f20 con 0x7ffb340cfdc0 2023-12-12T09:19:59.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.214+0000 7ffb2bfff640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb1406ae40 0x7ffb1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:19:59.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.214+0000 7ffb2bfff640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb1406ae40 0x7ffb1406d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c036000 tx=0x7ffb1c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:19:59.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.218+0000 7ffb2b7fe640 1 -- 172.21.15.84:0/439533518 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffb24054c40 con 0x7ffb340cfdc0 2023-12-12T09:19:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.420+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffb340ca5c0 con 0x7ffb340cfdc0 2023-12-12T09:19:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.421+0000 7ffb2b7fe640 1 -- 172.21.15.84:0/439533518 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffb24058260 con 0x7ffb340cfdc0 2023-12-12T09:19:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:19:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.423+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb1406ae40 msgr2=0x7ffb1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb1406ae40 0x7ffb1406d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c036000 tx=0x7ffb1c03c040 comp rx=0 tx=0).stop 2023-12-12T09:19:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340cfdc0 msgr2=0x7ffb340c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:19:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340cfdc0 0x7ffb340c9850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400d800 tx=0x7ffb2400dcc0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 shutdown_connections 2023-12-12T09:19:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb3415d130 0x7ffb34153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb340d1470 0x7ffb3409cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb1406ae40 0x7ffb1406d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 --2- 172.21.15.84:0/439533518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb340cfdc0 0x7ffb340c9850 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:19:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 >> 172.21.15.84:0/439533518 conn(0x7ffb340d2e90 msgr2=0x7ffb3406c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:19:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 shutdown_connections 2023-12-12T09:19:59.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:19:59.424+0000 7ffb38a01640 1 -- 172.21.15.84:0/439533518 wait complete. 2023-12-12T09:19:59.441 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:19:59.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:19:59.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-12T09:19:59.532 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[94872]: fuse finished with error 0 and tester_r 0 2023-12-12T09:19:59.537 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:20:05.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:20:05.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:05.639 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-12T09:20:05.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.926+0000 7f49f973c640 1 Processor -- start 2023-12-12T09:20:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.927+0000 7f49f973c640 1 -- start start 2023-12-12T09:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.928+0000 7f49f973c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f49f4143d20 0x7f49f40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.928+0000 7f49f973c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49f40ce550 0x7f49f40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.928+0000 7f49f973c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.928+0000 7f49f973c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40cea30 con 0x7f49f40ce550 2023-12-12T09:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.928+0000 7f49f973c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40702b0 con 0x7f49f4143d20 2023-12-12T09:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.928+0000 7f49f973c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4070590 con 0x7f49f41447f0 2023-12-12T09:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49ebfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49f40ce550 0x7f49f40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49ebfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f49f40ce550 0x7f49f40b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34128/0 (socket says 172.21.15.84:34128) 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49ebfff640 1 -- 172.21.15.84:0/1927493115 learned_addr learned my addr 172.21.15.84:0/1927493115 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49f37fe640 1 --2- 172.21.15.84:0/1927493115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49f2ffd640 1 --2- 172.21.15.84:0/1927493115 >> v2:172.21.15.99:3300/0 conn(0x7f49f4143d20 0x7f49f40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49ebfff640 1 -- 172.21.15.84:0/1927493115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 msgr2=0x7f49f415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49ebfff640 1 --2- 172.21.15.84:0/1927493115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49ebfff640 1 -- 172.21.15.84:0/1927493115 >> v2:172.21.15.99:3300/0 conn(0x7f49f4143d20 msgr2=0x7f49f40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49ebfff640 1 --2- 172.21.15.84:0/1927493115 >> v2:172.21.15.99:3300/0 conn(0x7f49f4143d20 0x7f49f40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49ebfff640 1 -- 172.21.15.84:0/1927493115 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4070870 con 0x7f49f40ce550 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49f37fe640 1 --2- 172.21.15.84:0/1927493115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.929+0000 7f49f2ffd640 1 --2- 172.21.15.84:0/1927493115 >> v2:172.21.15.99:3300/0 conn(0x7f49f4143d20 0x7f49f40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.930+0000 7f49ebfff640 1 --2- 172.21.15.84:0/1927493115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f40ce550 0x7f49f40b4610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49f404f7a0 tx=0x7f49dc02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c135a37e4fe88b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f27fc640 1 -- 172.21.15.84:0/1927493115 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc031880 con 0x7f49f40ce550 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f27fc640 1 -- 172.21.15.84:0/1927493115 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0319e0 con 0x7f49f40ce550 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f27fc640 1 -- 172.21.15.84:0/1927493115 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc031d70 con 0x7f49f40ce550 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 -- 172.21.15.84:0/1927493115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f40ce550 msgr2=0x7f49f40b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 --2- 172.21.15.84:0/1927493115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f40ce550 0x7f49f40b4610 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49f404f7a0 tx=0x7f49dc02b920 comp rx=0 tx=0).stop 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 -- 172.21.15.84:0/1927493115 shutdown_connections 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 --2- 172.21.15.84:0/1927493115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f40ce550 0x7f49f40b4610 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 --2- 172.21.15.84:0/1927493115 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 --2- 172.21.15.84:0/1927493115 >> v2:172.21.15.99:3300/0 conn(0x7f49f4143d20 0x7f49f40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 -- 172.21.15.84:0/1927493115 >> 172.21.15.84:0/1927493115 conn(0x7f49f406c3d0 msgr2=0x7f49f406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 -- 172.21.15.84:0/1927493115 shutdown_connections 2023-12-12T09:20:05.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.931+0000 7f49f973c640 1 -- 172.21.15.84:0/1927493115 wait complete. 2023-12-12T09:20:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.933+0000 7f49f973c640 1 Processor -- start 2023-12-12T09:20:05.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.933+0000 7f49f973c640 1 -- start start 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.934+0000 7f49f973c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f40ce550 0x7f49f4159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.934+0000 7f49f973c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f4143d20 0x7f49f415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.934+0000 7f49f973c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f413c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.934+0000 7f49f973c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40b3f30 con 0x7f49f4143d20 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.934+0000 7f49f973c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f415b710 con 0x7f49f40ce550 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.934+0000 7f49f973c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f415b9b0 con 0x7f49f41447f0 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f4143d20 0x7f49f415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f4143d20 0x7f49f415c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34144/0 (socket says 172.21.15.84:34144) 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 -- 172.21.15.84:0/1978835890 learned_addr learned my addr 172.21.15.84:0/1978835890 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49f37fe640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f413c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49f2ffd640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f40ce550 0x7f49f4159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 -- 172.21.15.84:0/1978835890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 msgr2=0x7f49f413c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:05.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f413c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:05.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 -- 172.21.15.84:0/1978835890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f40ce550 msgr2=0x7f49f4159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:05.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f40ce550 0x7f49f4159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:05.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 -- 172.21.15.84:0/1978835890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0094d0 con 0x7f49f4143d20 2023-12-12T09:20:05.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.935+0000 7f49ebfff640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f4143d20 0x7f49f415c490 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0097c0 tx=0x7f49dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:05.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.936+0000 7f49eb7fe640 1 -- 172.21.15.84:0/1978835890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc031830 con 0x7f49f4143d20 2023-12-12T09:20:05.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.936+0000 7f49eb7fe640 1 -- 172.21.15.84:0/1978835890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0443f0 con 0x7f49f4143d20 2023-12-12T09:20:05.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.936+0000 7f49eb7fe640 1 -- 172.21.15.84:0/1978835890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0447a0 con 0x7f49f4143d20 2023-12-12T09:20:05.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.936+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f415bc90 con 0x7f49f4143d20 2023-12-12T09:20:05.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.936+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f415a230 con 0x7f49f4143d20 2023-12-12T09:20:05.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.937+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f415c1b0 con 0x7f49f4143d20 2023-12-12T09:20:05.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.938+0000 7f49eb7fe640 1 -- 172.21.15.84:0/1978835890 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f49dc04d450 con 0x7f49f4143d20 2023-12-12T09:20:05.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.939+0000 7f49eb7fe640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f49d406ae40 0x7f49d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:05.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.939+0000 7f49eb7fe640 1 -- 172.21.15.84:0/1978835890 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f49dc0ac0c0 con 0x7f49f4143d20 2023-12-12T09:20:05.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.939+0000 7f49f2ffd640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f49d406ae40 0x7f49d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:05.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.940+0000 7f49f2ffd640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f49d406ae40 0x7f49d406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49f41f65a0 tx=0x7f49e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:05.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:05.944+0000 7f49eb7fe640 1 -- 172.21.15.84:0/1978835890 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f49f415c1b0 con 0x7f49f4143d20 2023-12-12T09:20:06.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.136+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49f415c1b0 con 0x7f49f4143d20 2023-12-12T09:20:06.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.138+0000 7f49eb7fe640 1 -- 172.21.15.84:0/1978835890 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f49f415c1b0 con 0x7f49f4143d20 2023-12-12T09:20:06.139 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:06.140 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f49d406ae40 msgr2=0x7f49d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f49d406ae40 0x7f49d406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49f41f65a0 tx=0x7f49e4008040 comp rx=0 tx=0).stop 2023-12-12T09:20:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f4143d20 msgr2=0x7f49f415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f4143d20 0x7f49f415c490 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0097c0 tx=0x7f49dc0046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 shutdown_connections 2023-12-12T09:20:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f49f41447f0 0x7f49f413c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f49d406ae40 0x7f49d406d300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49f4143d20 0x7f49f415c490 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 --2- 172.21.15.84:0/1978835890 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f40ce550 0x7f49f4159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.140+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 >> 172.21.15.84:0/1978835890 conn(0x7f49f406c3d0 msgr2=0x7f49f4141310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.141+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 shutdown_connections 2023-12-12T09:20:06.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.141+0000 7f49f973c640 1 -- 172.21.15.84:0/1978835890 wait complete. 2023-12-12T09:20:06.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.373+0000 7f838bebb640 1 Processor -- start 2023-12-12T09:20:06.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.373+0000 7f838bebb640 1 -- start start 2023-12-12T09:20:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.375+0000 7f838bebb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83840ce550 0x7f8384071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.375+0000 7f838bebb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83840cea30 con 0x7f83840b47e0 2023-12-12T09:20:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.375+0000 7f838bebb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83840702b0 con 0x7f8384143d20 2023-12-12T09:20:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.375+0000 7f838bebb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8384070590 con 0x7f83840ce550 2023-12-12T09:20:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.375+0000 7f8389456640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f83840b47e0 0x7f8384071070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50094/0 (socket says 172.21.15.84:50094) 2023-12-12T09:20:06.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.375+0000 7f8389456640 1 -- 172.21.15.84:0/313622629 learned_addr learned my addr 172.21.15.84:0/313622629 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598426714 0 0) 0x7f83840cea30 con 0x7f83840b47e0 2023-12-12T09:20:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f836c003520 con 0x7f83840b47e0 2023-12-12T09:20:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f838a458640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83840ce550 0x7f8384071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2961876164 0 0) 0x7f836c003520 con 0x7f83840b47e0 2023-12-12T09:20:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83840ce550 msgr2=0x7f8384071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:06.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83840ce550 0x7f8384071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 >> v1:172.21.15.99:6789/0 conn(0x7f8384143d20 legacy=0x7f83840b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384070870 con 0x7f83840b47e0 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f8378001670 con 0x7f83840b47e0 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 >> v1:172.21.15.84:6789/0 conn(0x7f83840b47e0 legacy=0x7f8384071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0039a0 0x7f836c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f836c0047c0 0x7f836c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c005180 0x7f836c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8384070590 con 0x7f836c0039a0 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c00c050 con 0x7f836c005180 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c00c210 con 0x7f836c0047c0 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f838a458640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83840ce550 0x7f8384071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.376+0000 7f8389c57640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0039a0 0x7f836c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.377+0000 7f8389456640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f836c0047c0 0x7f836c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.377+0000 7f8389c57640 1 -- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f836c0047c0 msgr2=0x7f836c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.377+0000 7f8389c57640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f836c0047c0 0x7f836c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.377+0000 7f8389c57640 1 -- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c005180 msgr2=0x7f836c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.377+0000 7f8389c57640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c005180 0x7f836c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.377+0000 7f8389c57640 1 -- 172.21.15.84:0/313622629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c003520 con 0x7f836c0039a0 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.378+0000 7f8389c57640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0039a0 0x7f836c003dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8374001750 tx=0x7f836c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1be9dc5ec03c5b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.378+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740052d0 con 0x7f836c0039a0 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.378+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837402e050 con 0x7f836c0039a0 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.378+0000 7f8388c55640 1 -- 172.21.15.84:0/313622629 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740035f0 con 0x7f836c0039a0 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.379+0000 7f838bebb640 1 -- 172.21.15.84:0/313622629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0039a0 msgr2=0x7f836c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.379+0000 7f838bebb640 1 --2- 172.21.15.84:0/313622629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836c0039a0 0x7f836c003dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8374001750 tx=0x7f836c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.379+0000 7f838a458640 1 -- 172.21.15.84:0/313622629 reap_dead start 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.379+0000 7f838bebb640 1 -- 172.21.15.84:0/313622629 shutdown_connections 2023-12-12T09:20:06.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.379+0000 7f838bebb640 1 -- 172.21.15.84:0/313622629 >> 172.21.15.84:0/313622629 conn(0x7f838406c3d0 msgr2=0x7f838406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.379+0000 7f838bebb640 1 -- 172.21.15.84:0/313622629 shutdown_connections 2023-12-12T09:20:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.379+0000 7f838bebb640 1 -- 172.21.15.84:0/313622629 wait complete. 2023-12-12T09:20:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.381+0000 7f838bebb640 1 Processor -- start 2023-12-12T09:20:06.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.381+0000 7f838bebb640 1 -- start start 2023-12-12T09:20:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838bebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c0039a0 0x7f83841e5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838bebb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f838413d5e0 0x7f838414d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838bebb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83841e75b0 0x7f83841e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838bebb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841e7f70 con 0x7f83841e75b0 2023-12-12T09:20:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838bebb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841e5fd0 con 0x7f836c0039a0 2023-12-12T09:20:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838bebb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83841e62b0 con 0x7f838413d5e0 2023-12-12T09:20:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838a458640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83841e75b0 0x7f83841e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838a458640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83841e75b0 0x7f83841e7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34162/0 (socket says 172.21.15.84:34162) 2023-12-12T09:20:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.382+0000 7f838a458640 1 -- 172.21.15.84:0/2101174196 learned_addr learned my addr 172.21.15.84:0/2101174196 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f8389c57640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c0039a0 0x7f83841e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f838a458640 1 -- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f838413d5e0 msgr2=0x7f838414d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f8389456640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f838413d5e0 0x7f838414d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f838a458640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f838413d5e0 0x7f838414d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f838a458640 1 -- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c0039a0 msgr2=0x7f83841e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f838a458640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c0039a0 0x7f83841e5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f838a458640 1 -- 172.21.15.84:0/2101174196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83841e6590 con 0x7f83841e75b0 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f8389c57640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c0039a0 0x7f83841e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f8389456640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f838413d5e0 0x7f838414d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:06.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f838a458640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83841e75b0 0x7f83841e7a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f83840ce930 tx=0x7f837c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f83827fc640 1 -- 172.21.15.84:0/2101174196 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00de90 con 0x7f83841e75b0 2023-12-12T09:20:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f83827fc640 1 -- 172.21.15.84:0/2101174196 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00f040 con 0x7f83841e75b0 2023-12-12T09:20:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f83827fc640 1 -- 172.21.15.84:0/2101174196 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c003bd0 con 0x7f83841e75b0 2023-12-12T09:20:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.383+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83841e6870 con 0x7f83841e75b0 2023-12-12T09:20:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.384+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83841e5cc0 con 0x7f83841e75b0 2023-12-12T09:20:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.385+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8384073200 con 0x7f83841e75b0 2023-12-12T09:20:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.386+0000 7f83827fc640 1 -- 172.21.15.84:0/2101174196 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f837c003d30 con 0x7f83841e75b0 2023-12-12T09:20:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.387+0000 7f83827fc640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f837006ae70 0x7f837006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.387+0000 7f83827fc640 1 -- 172.21.15.84:0/2101174196 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f837c089760 con 0x7f83841e75b0 2023-12-12T09:20:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.387+0000 7f8389c57640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f837006ae70 0x7f837006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.388+0000 7f8389c57640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f837006ae70 0x7f837006d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8374001750 tx=0x7f8374009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.391+0000 7f83827fc640 1 -- 172.21.15.84:0/2101174196 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f837c054520 con 0x7f83841e75b0 2023-12-12T09:20:06.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.581+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83841e6d90 con 0x7f83841e75b0 2023-12-12T09:20:06.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.584+0000 7f83827fc640 1 -- 172.21.15.84:0/2101174196 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f83841e6d90 con 0x7f83841e75b0 2023-12-12T09:20:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:06.586 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f837006ae70 msgr2=0x7f837006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f837006ae70 0x7f837006d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8374001750 tx=0x7f8374009030 comp rx=0 tx=0).stop 2023-12-12T09:20:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83841e75b0 msgr2=0x7f83841e7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83841e75b0 0x7f83841e7a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f83840ce930 tx=0x7f837c00d4a0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 shutdown_connections 2023-12-12T09:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f837006ae70 0x7f837006d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83841e75b0 0x7f83841e7a30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f838413d5e0 0x7f838414d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 --2- 172.21.15.84:0/2101174196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f836c0039a0 0x7f83841e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 >> 172.21.15.84:0/2101174196 conn(0x7f838406c3d0 msgr2=0x7f83840b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 shutdown_connections 2023-12-12T09:20:06.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.587+0000 7f838bebb640 1 -- 172.21.15.84:0/2101174196 wait complete. 2023-12-12T09:20:06.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T09:20:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.822+0000 7fe4820bb640 1 Processor -- start 2023-12-12T09:20:06.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.823+0000 7fe4820bb640 1 -- start start 2023-12-12T09:20:06.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.824+0000 7fe4820bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe47c155690 0x7fe47c06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.824+0000 7fe4820bb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe47c15bc00 0x7fe47c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.824+0000 7fe4820bb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c155a70 con 0x7fe47c0cde40 2023-12-12T09:20:06.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.824+0000 7fe4820bb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c0ce830 con 0x7fe47c155690 2023-12-12T09:20:06.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.824+0000 7fe4820bb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c15c120 con 0x7fe47c15bc00 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe47c155690 0x7fe47c06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe47c155690 0x7fe47c06ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34178/0 (socket says 172.21.15.84:34178) 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47b7fe640 1 -- 172.21.15.84:0/3750189680 learned_addr learned my addr 172.21.15.84:0/3750189680 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe473fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe47c0cde40 0x7fe47c15b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50106/0 (socket says 172.21.15.84:50106) 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47bfff640 1 --2- 172.21.15.84:0/3750189680 >> v2:172.21.15.99:3300/0 conn(0x7fe47c15bc00 0x7fe47c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47b7fe640 1 -- 172.21.15.84:0/3750189680 >> v2:172.21.15.99:3300/0 conn(0x7fe47c15bc00 msgr2=0x7fe47c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47b7fe640 1 --2- 172.21.15.84:0/3750189680 >> v2:172.21.15.99:3300/0 conn(0x7fe47c15bc00 0x7fe47c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47b7fe640 1 -- 172.21.15.84:0/3750189680 >> v1:172.21.15.84:6789/0 conn(0x7fe47c0cde40 legacy=0x7fe47c15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47affd640 1 -- 172.21.15.84:0/3750189680 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299097153 0 0) 0x7fe47c155a70 con 0x7fe47c0cde40 2023-12-12T09:20:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.825+0000 7fe47b7fe640 1 -- 172.21.15.84:0/3750189680 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c15c400 con 0x7fe47c155690 2023-12-12T09:20:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.827+0000 7fe47b7fe640 1 --2- 172.21.15.84:0/3750189680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c155690 0x7fe47c06ce60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe47c159110 tx=0x7fe46c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de706e1f54dd6843 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.827+0000 7fe47affd640 1 -- 172.21.15.84:0/3750189680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c030860 con 0x7fe47c155690 2023-12-12T09:20:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.827+0000 7fe47affd640 1 -- 172.21.15.84:0/3750189680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c0309c0 con 0x7fe47c155690 2023-12-12T09:20:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.827+0000 7fe47affd640 1 -- 172.21.15.84:0/3750189680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c030d50 con 0x7fe47c155690 2023-12-12T09:20:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.828+0000 7fe4820bb640 1 -- 172.21.15.84:0/3750189680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c155690 msgr2=0x7fe47c06ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.828+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3750189680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c155690 0x7fe47c06ce60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe47c159110 tx=0x7fe46c02b9a0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.828+0000 7fe4820bb640 1 -- 172.21.15.84:0/3750189680 shutdown_connections 2023-12-12T09:20:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.828+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3750189680 >> v2:172.21.15.99:3300/0 conn(0x7fe47c15bc00 0x7fe47c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.828+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3750189680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c155690 0x7fe47c06ce60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.828+0000 7fe4820bb640 1 -- 172.21.15.84:0/3750189680 >> 172.21.15.84:0/3750189680 conn(0x7fe47c0b0900 msgr2=0x7fe47c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.828+0000 7fe4820bb640 1 -- 172.21.15.84:0/3750189680 shutdown_connections 2023-12-12T09:20:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.828+0000 7fe4820bb640 1 -- 172.21.15.84:0/3750189680 wait complete. 2023-12-12T09:20:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.830+0000 7fe4820bb640 1 Processor -- start 2023-12-12T09:20:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.830+0000 7fe4820bb640 1 -- start start 2023-12-12T09:20:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.831+0000 7fe4820bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c0cde40 0x7fe47c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.831+0000 7fe4820bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe47c155690 0x7fe47c1f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.831+0000 7fe4820bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe47c15bc00 0x7fe47c140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.831+0000 7fe4820bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c144250 con 0x7fe47c0cde40 2023-12-12T09:20:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.831+0000 7fe4820bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1f5230 con 0x7fe47c15bc00 2023-12-12T09:20:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.831+0000 7fe4820bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c141510 con 0x7fe47c155690 2023-12-12T09:20:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.831+0000 7fe47b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c0cde40 0x7fe47c155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.831+0000 7fe47b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c0cde40 0x7fe47c155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34186/0 (socket says 172.21.15.84:34186) 2023-12-12T09:20:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.832+0000 7fe47b7fe640 1 -- 172.21.15.84:0/3985420968 learned_addr learned my addr 172.21.15.84:0/3985420968 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.832+0000 7fe473fff640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe47c155690 0x7fe47c1f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.832+0000 7fe47b7fe640 1 -- 172.21.15.84:0/3985420968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe47c155690 msgr2=0x7fe47c1f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.832+0000 7fe47b7fe640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe47c155690 0x7fe47c1f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.832+0000 7fe47b7fe640 1 -- 172.21.15.84:0/3985420968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe47c15bc00 msgr2=0x7fe47c140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.832+0000 7fe47b7fe640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe47c15bc00 0x7fe47c140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.832+0000 7fe47b7fe640 1 -- 172.21.15.84:0/3985420968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c0094d0 con 0x7fe47c0cde40 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.832+0000 7fe47b7fe640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c0cde40 0x7fe47c155a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe46c000c00 tx=0x7fe46c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.833+0000 7fe478ff9640 1 -- 172.21.15.84:0/3985420968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c03e040 con 0x7fe47c0cde40 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.833+0000 7fe478ff9640 1 -- 172.21.15.84:0/3985420968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c039c30 con 0x7fe47c0cde40 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.833+0000 7fe478ff9640 1 -- 172.21.15.84:0/3985420968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c004030 con 0x7fe47c0cde40 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.833+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c156050 con 0x7fe47c0cde40 2023-12-12T09:20:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.833+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c143b90 con 0x7fe47c0cde40 2023-12-12T09:20:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.834+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c144390 con 0x7fe47c0cde40 2023-12-12T09:20:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.835+0000 7fe478ff9640 1 -- 172.21.15.84:0/3985420968 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe46c0041b0 con 0x7fe47c0cde40 2023-12-12T09:20:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.836+0000 7fe478ff9640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe45c06ae40 0x7fe45c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.836+0000 7fe478ff9640 1 -- 172.21.15.84:0/3985420968 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe46c0abd00 con 0x7fe47c0cde40 2023-12-12T09:20:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.836+0000 7fe473fff640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe45c06ae40 0x7fe45c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.837+0000 7fe473fff640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe45c06ae40 0x7fe45c06d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe47c09c9d0 tx=0x7fe464007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:06.840+0000 7fe478ff9640 1 -- 172.21.15.84:0/3985420968 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe47c144390 con 0x7fe47c0cde40 2023-12-12T09:20:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.073+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe47c144390 con 0x7fe47c0cde40 2023-12-12T09:20:07.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.148+0000 7fe478ff9640 1 -- 172.21.15.84:0/3985420968 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe47c144390 con 0x7fe47c0cde40 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe45c06ae40 msgr2=0x7fe45c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe45c06ae40 0x7fe45c06d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe47c09c9d0 tx=0x7fe464007b50 comp rx=0 tx=0).stop 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c0cde40 msgr2=0x7fe47c155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c0cde40 0x7fe47c155a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe46c000c00 tx=0x7fe46c004730 comp rx=0 tx=0).stop 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 shutdown_connections 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe47c15bc00 0x7fe47c140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe47c155690 0x7fe47c1f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe45c06ae40 0x7fe45c06d300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 --2- 172.21.15.84:0/3985420968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe47c0cde40 0x7fe47c155a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 >> 172.21.15.84:0/3985420968 conn(0x7fe47c0b0900 msgr2=0x7fe47c0adc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.152+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 shutdown_connections 2023-12-12T09:20:07.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.153+0000 7fe4820bb640 1 -- 172.21.15.84:0/3985420968 wait complete. 2023-12-12T09:20:07.175 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-12T09:20:07.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T09:20:07.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.391+0000 7f056dcca640 1 Processor -- start 2023-12-12T09:20:07.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.391+0000 7f056dcca640 1 -- start start 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f056dcca640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0568157860 0x7f056815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f056dcca640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05680b1a80 0x7f056815e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f056dcca640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056815ddf0 con 0x7f05680cef30 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f056dcca640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056815acb0 con 0x7f05680b1a80 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f056dcca640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056815af90 con 0x7f0568157860 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f0567fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05680b1a80 0x7f056815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f056d4c9640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f05680cef30 0x7f056806d1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50108/0 (socket says 172.21.15.84:50108) 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f056d4c9640 1 -- 172.21.15.84:0/1257881186 learned_addr learned my addr 172.21.15.84:0/1257881186 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.393+0000 7f056ccc8640 1 --2- 172.21.15.84:0/1257881186 >> v2:172.21.15.99:3300/0 conn(0x7f0568157860 0x7f056815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:07.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.394+0000 7f0567fff640 1 -- 172.21.15.84:0/1257881186 >> v2:172.21.15.99:3300/0 conn(0x7f0568157860 msgr2=0x7f056815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:07.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.394+0000 7f0567fff640 1 --2- 172.21.15.84:0/1257881186 >> v2:172.21.15.99:3300/0 conn(0x7f0568157860 0x7f056815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.394+0000 7f0567fff640 1 -- 172.21.15.84:0/1257881186 >> v1:172.21.15.84:6789/0 conn(0x7f05680cef30 legacy=0x7f056806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:07.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.394+0000 7f0567fff640 1 -- 172.21.15.84:0/1257881186 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056815da80 con 0x7f05680b1a80 2023-12-12T09:20:07.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.395+0000 7f0567fff640 1 --2- 172.21.15.84:0/1257881186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680b1a80 0x7f056815e280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f056806c660 tx=0x7f055402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9238ff4970f205 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.395+0000 7f05677fe640 1 -- 172.21.15.84:0/1257881186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554031830 con 0x7f05680b1a80 2023-12-12T09:20:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.395+0000 7f05677fe640 1 -- 172.21.15.84:0/1257881186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554031990 con 0x7f05680b1a80 2023-12-12T09:20:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.395+0000 7f05677fe640 1 -- 172.21.15.84:0/1257881186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554031d20 con 0x7f05680b1a80 2023-12-12T09:20:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.396+0000 7f056dcca640 1 -- 172.21.15.84:0/1257881186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680b1a80 msgr2=0x7f056815e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:07.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.396+0000 7f056dcca640 1 --2- 172.21.15.84:0/1257881186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680b1a80 0x7f056815e280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f056806c660 tx=0x7f055402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.396+0000 7f056dcca640 1 -- 172.21.15.84:0/1257881186 shutdown_connections 2023-12-12T09:20:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.396+0000 7f056dcca640 1 --2- 172.21.15.84:0/1257881186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680b1a80 0x7f056815e280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.396+0000 7f056dcca640 1 --2- 172.21.15.84:0/1257881186 >> v2:172.21.15.99:3300/0 conn(0x7f0568157860 0x7f056815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.396+0000 7f056dcca640 1 -- 172.21.15.84:0/1257881186 >> 172.21.15.84:0/1257881186 conn(0x7f056806a920 msgr2=0x7f056806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.396+0000 7f056dcca640 1 -- 172.21.15.84:0/1257881186 shutdown_connections 2023-12-12T09:20:07.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.396+0000 7f056dcca640 1 -- 172.21.15.84:0/1257881186 wait complete. 2023-12-12T09:20:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.398+0000 7f056dcca640 1 Processor -- start 2023-12-12T09:20:07.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.398+0000 7f056dcca640 1 -- start start 2023-12-12T09:20:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f056dcca640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680b1a80 0x7f0568151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f056dcca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680cef30 0x7f0568071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f056dcca640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0568157860 0x7f05680715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f056dcca640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0568150fe0 con 0x7f05680cef30 2023-12-12T09:20:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f056dcca640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0568150360 con 0x7f05680b1a80 2023-12-12T09:20:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f056dcca640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0568150640 con 0x7f0568157860 2023-12-12T09:20:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f0567fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680cef30 0x7f0568071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:07.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f0567fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680cef30 0x7f0568071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34206/0 (socket says 172.21.15.84:34206) 2023-12-12T09:20:07.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.399+0000 7f0567fff640 1 -- 172.21.15.84:0/3213753716 learned_addr learned my addr 172.21.15.84:0/3213753716 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:07.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f0567fff640 1 -- 172.21.15.84:0/3213753716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0568157860 msgr2=0x7f05680715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:07.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f0567fff640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0568157860 0x7f05680715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f0567fff640 1 -- 172.21.15.84:0/3213753716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680b1a80 msgr2=0x7f0568151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:07.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f0567fff640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680b1a80 0x7f0568151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:07.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f0567fff640 1 -- 172.21.15.84:0/3213753716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554009400 con 0x7f05680cef30 2023-12-12T09:20:07.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f0567fff640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680cef30 0x7f0568071080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0554000c00 tx=0x7f05540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:07.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f05657fa640 1 -- 172.21.15.84:0/3213753716 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055403aa60 con 0x7f05680cef30 2023-12-12T09:20:07.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f05657fa640 1 -- 172.21.15.84:0/3213753716 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055403abe0 con 0x7f05680cef30 2023-12-12T09:20:07.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f05657fa640 1 -- 172.21.15.84:0/3213753716 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540443f0 con 0x7f05680cef30 2023-12-12T09:20:07.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0568150920 con 0x7f05680cef30 2023-12-12T09:20:07.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.400+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0568151d60 con 0x7f05680cef30 2023-12-12T09:20:07.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.402+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056806af30 con 0x7f05680cef30 2023-12-12T09:20:07.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.403+0000 7f05657fa640 1 -- 172.21.15.84:0/3213753716 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f055404d450 con 0x7f05680cef30 2023-12-12T09:20:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.403+0000 7f05657fa640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f054c06ae40 0x7f054c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.404+0000 7f05657fa640 1 -- 172.21.15.84:0/3213753716 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f05540abb30 con 0x7f05680cef30 2023-12-12T09:20:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.404+0000 7f056ccc8640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f054c06ae40 0x7f054c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.404+0000 7f056ccc8640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f054c06ae40 0x7f054c06d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f055c0098f0 tx=0x7f055c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:07.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.408+0000 7f05657fa640 1 -- 172.21.15.84:0/3213753716 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0554076850 con 0x7f05680cef30 2023-12-12T09:20:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:07.635+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f05680673c0 con 0x7f05680cef30 2023-12-12T09:20:08.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.160+0000 7f05657fa640 1 -- 172.21.15.84:0/3213753716 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0554035020 con 0x7f05680cef30 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f054c06ae40 msgr2=0x7f054c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f054c06ae40 0x7f054c06d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f055c0098f0 tx=0x7f055c008040 comp rx=0 tx=0).stop 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680cef30 msgr2=0x7f0568071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680cef30 0x7f0568071080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0554000c00 tx=0x7f05540046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 shutdown_connections 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0568157860 0x7f05680715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f054c06ae40 0x7f054c06d300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05680cef30 0x7f0568071080 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 --2- 172.21.15.84:0/3213753716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680b1a80 0x7f0568151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.163+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 >> 172.21.15.84:0/3213753716 conn(0x7f056806a920 msgr2=0x7f056806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.164+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 shutdown_connections 2023-12-12T09:20:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.164+0000 7f056dcca640 1 -- 172.21.15.84:0/3213753716 wait complete. 2023-12-12T09:20:08.184 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T09:20:08.184 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:20:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.384+0000 7fd3ee1c9640 1 Processor -- start 2023-12-12T09:20:08.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.385+0000 7fd3ee1c9640 1 -- start start 2023-12-12T09:20:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.386+0000 7fd3ee1c9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd3e806de80 0x7fd3e815f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.386+0000 7fd3ee1c9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd3e80705b0 0x7fd3e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.386+0000 7fd3ee1c9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e8144b20 con 0x7fd3e8144740 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.386+0000 7fd3ee1c9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e806e310 con 0x7fd3e80705b0 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.386+0000 7fd3ee1c9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e806d670 con 0x7fd3e806de80 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ed9c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd3e80705b0 0x7fd3e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ed9c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd3e80705b0 0x7fd3e80709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34220/0 (socket says 172.21.15.84:34220) 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ed9c8640 1 -- 172.21.15.84:0/1951071364 learned_addr learned my addr 172.21.15.84:0/1951071364 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ec9c6640 1 --2- 172.21.15.84:0/1951071364 >> v2:172.21.15.99:3300/0 conn(0x7fd3e806de80 0x7fd3e815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ed9c8640 1 -- 172.21.15.84:0/1951071364 >> v2:172.21.15.99:3300/0 conn(0x7fd3e806de80 msgr2=0x7fd3e815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ed9c8640 1 --2- 172.21.15.84:0/1951071364 >> v2:172.21.15.99:3300/0 conn(0x7fd3e806de80 0x7fd3e815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ed9c8640 1 -- 172.21.15.84:0/1951071364 >> v1:172.21.15.84:6789/0 conn(0x7fd3e8144740 legacy=0x7fd3e815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3dffff640 1 -- 172.21.15.84:0/1951071364 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918990437 0 0) 0x7fd3e8144b20 con 0x7fd3e8144740 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ed9c8640 1 -- 172.21.15.84:0/1951071364 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e806cdd0 con 0x7fd3e80705b0 2023-12-12T09:20:08.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.387+0000 7fd3ec9c6640 1 --2- 172.21.15.84:0/1951071364 >> v2:172.21.15.99:3300/0 conn(0x7fd3e806de80 0x7fd3e815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:08.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.388+0000 7fd3ed9c8640 1 --2- 172.21.15.84:0/1951071364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e80705b0 0x7fd3e80709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8071c90 tx=0x7fd3e002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945ac3d55474bcb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3dffff640 1 -- 172.21.15.84:0/1951071364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e002cb20 con 0x7fd3e80705b0 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3dffff640 1 -- 172.21.15.84:0/1951071364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e002cc80 con 0x7fd3e80705b0 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3dffff640 1 -- 172.21.15.84:0/1951071364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00343f0 con 0x7fd3e80705b0 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/1951071364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e80705b0 msgr2=0x7fd3e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/1951071364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e80705b0 0x7fd3e80709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8071c90 tx=0x7fd3e002bf80 comp rx=0 tx=0).stop 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/1951071364 shutdown_connections 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/1951071364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e80705b0 0x7fd3e80709e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/1951071364 >> v2:172.21.15.99:3300/0 conn(0x7fd3e806de80 0x7fd3e815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/1951071364 >> 172.21.15.84:0/1951071364 conn(0x7fd3e80b07f0 msgr2=0x7fd3e80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/1951071364 shutdown_connections 2023-12-12T09:20:08.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.389+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/1951071364 wait complete. 2023-12-12T09:20:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.391+0000 7fd3ee1c9640 1 Processor -- start 2023-12-12T09:20:08.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.391+0000 7fd3ee1c9640 1 -- start start 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.392+0000 7fd3ee1c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e806de80 0x7fd3e81380b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.392+0000 7fd3ee1c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e80705b0 0x7fd3e813cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.392+0000 7fd3ee1c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e8144740 0x7fd3e815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.392+0000 7fd3ee1c9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e81385f0 con 0x7fd3e806de80 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.392+0000 7fd3ee1c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80b1bf0 con 0x7fd3e8144740 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.392+0000 7fd3ee1c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80b2a50 con 0x7fd3e80705b0 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e806de80 0x7fd3e81380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e806de80 0x7fd3e81380b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34232/0 (socket says 172.21.15.84:34232) 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 -- 172.21.15.84:0/90727848 learned_addr learned my addr 172.21.15.84:0/90727848 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ec9c6640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e80705b0 0x7fd3e813cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed9c8640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e8144740 0x7fd3e815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 -- 172.21.15.84:0/90727848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e80705b0 msgr2=0x7fd3e813cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e80705b0 0x7fd3e813cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 -- 172.21.15.84:0/90727848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e8144740 msgr2=0x7fd3e815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e8144740 0x7fd3e815cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 -- 172.21.15.84:0/90727848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0009b30 con 0x7fd3e806de80 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.393+0000 7fd3ed1c7640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e806de80 0x7fd3e81380b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400c440 tx=0x7fd3e400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.394+0000 7fd3ddffb640 1 -- 172.21.15.84:0/90727848 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40035f0 con 0x7fd3e806de80 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.394+0000 7fd3ddffb640 1 -- 172.21.15.84:0/90727848 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4003750 con 0x7fd3e806de80 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.394+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e80b1e40 con 0x7fd3e806de80 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.394+0000 7fd3ddffb640 1 -- 172.21.15.84:0/90727848 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4003b00 con 0x7fd3e806de80 2023-12-12T09:20:08.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.394+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e80b2400 con 0x7fd3e806de80 2023-12-12T09:20:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.395+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e80673c0 con 0x7fd3e806de80 2023-12-12T09:20:08.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.396+0000 7fd3ddffb640 1 -- 172.21.15.84:0/90727848 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3e4003c60 con 0x7fd3e806de80 2023-12-12T09:20:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.396+0000 7fd3ddffb640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd3cc06ae40 0x7fd3cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.397+0000 7fd3ddffb640 1 -- 172.21.15.84:0/90727848 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3e4088ec0 con 0x7fd3e806de80 2023-12-12T09:20:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.397+0000 7fd3ec9c6640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd3cc06ae40 0x7fd3cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.397+0000 7fd3ec9c6640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd3cc06ae40 0x7fd3cc06d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8142f90 tx=0x7fd3d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:08.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.401+0000 7fd3ddffb640 1 -- 172.21.15.84:0/90727848 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3e4053c80 con 0x7fd3e806de80 2023-12-12T09:20:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.628+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3e8071f60 con 0x7fd3e806de80 2023-12-12T09:20:08.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.629+0000 7fd3ddffb640 1 -- 172.21.15.84:0/90727848 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fd3e4017020 con 0x7fd3e806de80 2023-12-12T09:20:08.630 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:08.630 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:20:07.638154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:20:08.631 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-12-12T09:20:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd3cc06ae40 msgr2=0x7fd3cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd3cc06ae40 0x7fd3cc06d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8142f90 tx=0x7fd3d8008040 comp rx=0 tx=0).stop 2023-12-12T09:20:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e806de80 msgr2=0x7fd3e81380b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e806de80 0x7fd3e81380b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd3e400c440 tx=0x7fd3e400c900 comp rx=0 tx=0).stop 2023-12-12T09:20:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 shutdown_connections 2023-12-12T09:20:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3e8144740 0x7fd3e815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd3e80705b0 0x7fd3e813cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd3cc06ae40 0x7fd3cc06d300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 --2- 172.21.15.84:0/90727848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3e806de80 0x7fd3e81380b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.631+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 >> 172.21.15.84:0/90727848 conn(0x7fd3e80b07f0 msgr2=0x7fd3e8142060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.632+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 shutdown_connections 2023-12-12T09:20:08.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.632+0000 7fd3ee1c9640 1 -- 172.21.15.84:0/90727848 wait complete. 2023-12-12T09:20:08.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:08.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.861+0000 7f0b46f0f640 1 Processor -- start 2023-12-12T09:20:08.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.862+0000 7f0b46f0f640 1 -- start start 2023-12-12T09:20:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.863+0000 7f0b46f0f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b4013ff90 0x7f0b40142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.863+0000 7f0b46f0f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b400b4ba0 0x7f0b40142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.863+0000 7f0b46f0f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b400b3b60 con 0x7f0b4015d9a0 2023-12-12T09:20:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.863+0000 7f0b46f0f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4015e6d0 con 0x7f0b4013ff90 2023-12-12T09:20:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.863+0000 7f0b46f0f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400b3de0 con 0x7f0b400b4ba0 2023-12-12T09:20:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b454ac640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0b4015d9a0 0x7f0b4015de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50120/0 (socket says 172.21.15.84:50120) 2023-12-12T09:20:08.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b454ac640 1 -- 172.21.15.84:0/3085830871 learned_addr learned my addr 172.21.15.84:0/3085830871 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b44cab640 1 --2- 172.21.15.84:0/3085830871 >> v2:172.21.15.99:3300/0 conn(0x7f0b4013ff90 0x7f0b40142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3ffff640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b400b4ba0 0x7f0b40142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752630918 0 0) 0x7f0b400b3b60 con 0x7f0b4015d9a0 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b30003520 con 0x7f0b4015d9a0 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1066006615 0 0) 0x7f0b30003520 con 0x7f0b4015d9a0 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b400b4ba0 msgr2=0x7f0b40142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b400b4ba0 0x7f0b40142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 >> v2:172.21.15.99:3300/0 conn(0x7f0b4013ff90 msgr2=0x7f0b40142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 --2- 172.21.15.84:0/3085830871 >> v2:172.21.15.99:3300/0 conn(0x7f0b4013ff90 0x7f0b40142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b400b40c0 con 0x7f0b4015d9a0 2023-12-12T09:20:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f0b380019f0 con 0x7f0b4015d9a0 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 >> v1:172.21.15.84:6789/0 conn(0x7f0b4015d9a0 legacy=0x7f0b4015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b30003970 0x7f0b30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.864+0000 7f0b3f7fe640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b300047c0 0x7f0b30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b3f7fe640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b400b4ba0 0x7f0b30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4015e6d0 con 0x7f0b30003970 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400b3de0 con 0x7f0b300047c0 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3000b980 con 0x7f0b400b4ba0 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b44cab640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b30003970 0x7f0b30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b3ffff640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b300047c0 0x7f0b30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b44cab640 1 -- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b400b4ba0 msgr2=0x7f0b30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b44cab640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b400b4ba0 0x7f0b30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b44cab640 1 -- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b300047c0 msgr2=0x7f0b30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b44cab640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b300047c0 0x7f0b30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b44cab640 1 -- 172.21.15.84:0/3085830871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30003520 con 0x7f0b30003970 2023-12-12T09:20:08.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.865+0000 7f0b3ffff640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b300047c0 0x7f0b30004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:08.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.866+0000 7f0b44cab640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b30003970 0x7f0b30003d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009ac0 tx=0x7f0b300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be25b3c7c1e8200c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3402c710 con 0x7f0b30003970 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3402c870 con 0x7f0b30003970 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b3f7fe640 1 -- 172.21.15.84:0/3085830871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3402cc00 con 0x7f0b30003970 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b46f0f640 1 -- 172.21.15.84:0/3085830871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b30003970 msgr2=0x7f0b30003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b46f0f640 1 --2- 172.21.15.84:0/3085830871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b30003970 0x7f0b30003d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009ac0 tx=0x7f0b300057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b454ac640 1 -- 172.21.15.84:0/3085830871 reap_dead start 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b46f0f640 1 -- 172.21.15.84:0/3085830871 shutdown_connections 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b46f0f640 1 -- 172.21.15.84:0/3085830871 >> 172.21.15.84:0/3085830871 conn(0x7f0b4006c3d0 msgr2=0x7f0b4006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b46f0f640 1 -- 172.21.15.84:0/3085830871 shutdown_connections 2023-12-12T09:20:08.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.867+0000 7f0b46f0f640 1 -- 172.21.15.84:0/3085830871 wait complete. 2023-12-12T09:20:08.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.869+0000 7f0b46f0f640 1 Processor -- start 2023-12-12T09:20:08.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.869+0000 7f0b46f0f640 1 -- start start 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.870+0000 7f0b46f0f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b30003970 0x7f0b400b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.870+0000 7f0b46f0f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b40154060 0x7f0b401416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.870+0000 7f0b46f0f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b40141c30 0x7f0b400ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.870+0000 7f0b46f0f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401420b0 con 0x7f0b40141c30 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.870+0000 7f0b46f0f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4013d700 con 0x7f0b30003970 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.870+0000 7f0b46f0f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400af3f0 con 0x7f0b40154060 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b40141c30 0x7f0b400ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b40141c30 0x7f0b400ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34256/0 (socket says 172.21.15.84:34256) 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 -- 172.21.15.84:0/1805668638 learned_addr learned my addr 172.21.15.84:0/1805668638 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b44cab640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b30003970 0x7f0b400b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b3ffff640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b40154060 0x7f0b401416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 -- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b40154060 msgr2=0x7f0b401416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b40154060 0x7f0b401416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 -- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b30003970 msgr2=0x7f0b400b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b30003970 0x7f0b400b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 -- 172.21.15.84:0/1805668638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b400af6d0 con 0x7f0b40141c30 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b3ffff640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b40154060 0x7f0b401416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b454ac640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b40141c30 0x7f0b400ae810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b4015dd80 tx=0x7f0b3800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.871+0000 7f0b3d7fa640 1 -- 172.21.15.84:0/1805668638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800a610 con 0x7f0b40141c30 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.872+0000 7f0b3d7fa640 1 -- 172.21.15.84:0/1805668638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800a790 con 0x7f0b40141c30 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.872+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b400af9b0 con 0x7f0b40141c30 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.872+0000 7f0b3d7fa640 1 -- 172.21.15.84:0/1805668638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800ab40 con 0x7f0b40141c30 2023-12-12T09:20:08.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.872+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b400aff70 con 0x7f0b40141c30 2023-12-12T09:20:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.873+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b400673c0 con 0x7f0b40141c30 2023-12-12T09:20:08.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.874+0000 7f0b3d7fa640 1 -- 172.21.15.84:0/1805668638 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b3800aca0 con 0x7f0b40141c30 2023-12-12T09:20:08.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.875+0000 7f0b3d7fa640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b2406ae40 0x7f0b2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:08.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.875+0000 7f0b3d7fa640 1 -- 172.21.15.84:0/1805668638 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b38088f40 con 0x7f0b40141c30 2023-12-12T09:20:08.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.875+0000 7f0b44cab640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b2406ae40 0x7f0b2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:08.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.876+0000 7f0b44cab640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b2406ae40 0x7f0b2406d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b34036000 tx=0x7f0b34030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:08.879+0000 7f0b3d7fa640 1 -- 172.21.15.84:0/1805668638 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b38053bd0 con 0x7f0b40141c30 2023-12-12T09:20:09.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.070+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b400724f0 con 0x7f0b40141c30 2023-12-12T09:20:09.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.072+0000 7f0b3d7fa640 1 -- 172.21.15.84:0/1805668638 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f0b380571f0 con 0x7f0b40141c30 2023-12-12T09:20:09.074 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:09.074 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b2406ae40 msgr2=0x7f0b2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b2406ae40 0x7f0b2406d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b34036000 tx=0x7f0b34030000 comp rx=0 tx=0).stop 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b40141c30 msgr2=0x7f0b400ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b40141c30 0x7f0b400ae810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b4015dd80 tx=0x7f0b3800ccd0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 shutdown_connections 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0b2406ae40 0x7f0b2406d300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b40141c30 0x7f0b400ae810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0b40154060 0x7f0b401416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 --2- 172.21.15.84:0/1805668638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b30003970 0x7f0b400b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 >> 172.21.15.84:0/1805668638 conn(0x7f0b4006c3d0 msgr2=0x7f0b4015faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 shutdown_connections 2023-12-12T09:20:09.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.075+0000 7f0b46f0f640 1 -- 172.21.15.84:0/1805668638 wait complete. 2023-12-12T09:20:09.095 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:20:09.095 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:20:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.298+0000 7f1d17339640 1 Processor -- start 2023-12-12T09:20:09.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.298+0000 7f1d17339640 1 -- start start 2023-12-12T09:20:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.300+0000 7f1d17339640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1d1006ade0 0x7f1d101614f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.300+0000 7f1d17339640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1006b2d0 con 0x7f1d10146500 2023-12-12T09:20:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.300+0000 7f1d17339640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1006b5b0 con 0x7f1d1006aa00 2023-12-12T09:20:09.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.300+0000 7f1d17339640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d10140840 con 0x7f1d1006ade0 2023-12-12T09:20:09.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d158d6640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1d10146500 0x7f1d1006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50124/0 (socket says 172.21.15.84:50124) 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d158d6640 1 -- 172.21.15.84:0/1416570674 learned_addr learned my addr 172.21.15.84:0/1416570674 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d148d4640 1 --2- 172.21.15.84:0/1416570674 >> v2:172.21.15.99:3300/0 conn(0x7f1d1006ade0 0x7f1d101614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492397914 0 0) 0x7f1d1006b2d0 con 0x7f1d10146500 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf8003520 con 0x7f1d10146500 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4081095424 0 0) 0x7f1cf8003520 con 0x7f1d10146500 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 >> v2:172.21.15.99:3300/0 conn(0x7f1d1006ade0 msgr2=0x7f1d101614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d0ffff640 1 --2- 172.21.15.84:0/1416570674 >> v2:172.21.15.99:3300/0 conn(0x7f1d1006ade0 0x7f1d101614f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 >> v1:172.21.15.99:6789/0 conn(0x7f1d1006aa00 legacy=0x7f1d10160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.301+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1006b890 con 0x7f1d10146500 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f1d08001670 con 0x7f1d10146500 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 >> v1:172.21.15.84:6789/0 conn(0x7f1d10146500 legacy=0x7f1d1006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d0ffff640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf8003970 0x7f1cf8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d0ffff640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf80047c0 0x7f1cf8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d0ffff640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8005180 0x7f1cf800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d10140840 con 0x7f1cf8003970 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf800c020 con 0x7f1cf8005180 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf800c1e0 con 0x7f1cf80047c0 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d150d5640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf8003970 0x7f1cf8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d158d6640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8005180 0x7f1cf800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.302+0000 7f1d148d4640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf80047c0 0x7f1cf8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.303+0000 7f1d150d5640 1 -- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf80047c0 msgr2=0x7f1cf8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.303+0000 7f1d150d5640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf80047c0 0x7f1cf8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.303+0000 7f1d150d5640 1 -- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8005180 msgr2=0x7f1cf800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.303+0000 7f1d150d5640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1cf8005180 0x7f1cf800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.303+0000 7f1d150d5640 1 -- 172.21.15.84:0/1416570674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8003520 con 0x7f1cf8003970 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.303+0000 7f1d158d6640 1 -- 172.21.15.84:0/1416570674 reap_dead start 2023-12-12T09:20:09.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.303+0000 7f1d148d4640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf80047c0 0x7f1cf8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.304+0000 7f1d150d5640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf8003970 0x7f1cf8003d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d00001e50 tx=0x7f1cf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1a23ef9ff4af74 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.304+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00003b70 con 0x7f1cf8003970 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.304+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d00003cd0 con 0x7f1cf8003970 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.304+0000 7f1d0ffff640 1 -- 172.21.15.84:0/1416570674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00005310 con 0x7f1cf8003970 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.305+0000 7f1d17339640 1 -- 172.21.15.84:0/1416570674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf8003970 msgr2=0x7f1cf8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.305+0000 7f1d17339640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf8003970 0x7f1cf8003d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d00001e50 tx=0x7f1cf80057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.305+0000 7f1d17339640 1 -- 172.21.15.84:0/1416570674 shutdown_connections 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.305+0000 7f1d17339640 1 --2- 172.21.15.84:0/1416570674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf8003970 0x7f1cf8003d90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.305+0000 7f1d17339640 1 -- 172.21.15.84:0/1416570674 >> 172.21.15.84:0/1416570674 conn(0x7f1d100cf660 msgr2=0x7f1d100cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.305+0000 7f1d17339640 1 -- 172.21.15.84:0/1416570674 shutdown_connections 2023-12-12T09:20:09.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.305+0000 7f1d17339640 1 -- 172.21.15.84:0/1416570674 wait complete. 2023-12-12T09:20:09.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.307+0000 7f1d17339640 1 Processor -- start 2023-12-12T09:20:09.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.307+0000 7f1d17339640 1 -- start start 2023-12-12T09:20:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d17339640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003970 0x7f1d100cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d17339640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d1015c650 0x7f1d100b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d17339640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d100cd780 0x7f1d100cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d17339640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1015cad0 con 0x7f1d100cd780 2023-12-12T09:20:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d17339640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100cd2f0 con 0x7f1d1015c650 2023-12-12T09:20:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d17339640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100cc6e0 con 0x7f1cf8003970 2023-12-12T09:20:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d158d6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d100cd780 0x7f1d100cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d158d6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d100cd780 0x7f1d100cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34288/0 (socket says 172.21.15.84:34288) 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.308+0000 7f1d158d6640 1 -- 172.21.15.84:0/2637425256 learned_addr learned my addr 172.21.15.84:0/2637425256 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d150d5640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003970 0x7f1d100cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d148d4640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d1015c650 0x7f1d100b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d158d6640 1 -- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003970 msgr2=0x7f1d100cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d158d6640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003970 0x7f1d100cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d158d6640 1 -- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d1015c650 msgr2=0x7f1d100b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d158d6640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d1015c650 0x7f1d100b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d158d6640 1 -- 172.21.15.84:0/2637425256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d100cc9c0 con 0x7f1d100cd780 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d150d5640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003970 0x7f1d100cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d148d4640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d1015c650 0x7f1d100b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d158d6640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d100cd780 0x7f1d100cdc00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1d10072270 tx=0x7f1d0800e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d0dffb640 1 -- 172.21.15.84:0/2637425256 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08010510 con 0x7f1d100cd780 2023-12-12T09:20:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d0dffb640 1 -- 172.21.15.84:0/2637425256 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d08010670 con 0x7f1d100cd780 2023-12-12T09:20:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d100ccca0 con 0x7f1d100cd780 2023-12-12T09:20:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d0dffb640 1 -- 172.21.15.84:0/2637425256 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080109e0 con 0x7f1d100cd780 2023-12-12T09:20:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.309+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1013db60 con 0x7f1d100cd780 2023-12-12T09:20:09.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.311+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d100673c0 con 0x7f1d100cd780 2023-12-12T09:20:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.312+0000 7f1d0dffb640 1 -- 172.21.15.84:0/2637425256 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d08010b40 con 0x7f1d100cd780 2023-12-12T09:20:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.312+0000 7f1d0dffb640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1cfc06ae40 0x7f1cfc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.313+0000 7f1d0dffb640 1 -- 172.21.15.84:0/2637425256 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d08088f60 con 0x7f1d100cd780 2023-12-12T09:20:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.313+0000 7f1d150d5640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1cfc06ae40 0x7f1cfc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.313+0000 7f1d150d5640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1cfc06ae40 0x7f1cfc06d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d00034000 tx=0x7f1d00009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:09.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.317+0000 7f1d0dffb640 1 -- 172.21.15.84:0/2637425256 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d08053c80 con 0x7f1d100cd780 2023-12-12T09:20:09.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.502+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d1006be50 con 0x7f1cfc06ae40 2023-12-12T09:20:09.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.534+0000 7f1d0dffb640 1 -- 172.21.15.84:0/2637425256 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345082 (secure 0 0 0) 0x7f1d00007db0 con 0x7f1cfc06ae40 2023-12-12T09:20:09.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:20:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1cfc06ae40 msgr2=0x7f1cfc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1cfc06ae40 0x7f1cfc06d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d00034000 tx=0x7f1d00009030 comp rx=0 tx=0).stop 2023-12-12T09:20:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d100cd780 msgr2=0x7f1d100cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d100cd780 0x7f1d100cdc00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1d10072270 tx=0x7f1d0800e8b0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 shutdown_connections 2023-12-12T09:20:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1cfc06ae40 0x7f1cfc06d300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1d100cd780 0x7f1d100cdc00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d1015c650 0x7f1d100b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 --2- 172.21.15.84:0/2637425256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1cf8003970 0x7f1d100cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 >> 172.21.15.84:0/2637425256 conn(0x7f1d100cf660 msgr2=0x7f1d100b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 shutdown_connections 2023-12-12T09:20:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.540+0000 7f1d17339640 1 -- 172.21.15.84:0/2637425256 wait complete. 2023-12-12T09:20:09.561 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-12-12T09:20:09.082072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219544,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":3448832,"data_stored":2071226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004472"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951816+0000","last_change":"2023-12-12T09:19:41.122279+0000","last_active":"2023-12-12T09:19:47.951816+0000","last_peered":"2023-12-12T09:19:47.951816+0000","last_clean":"2023-12-12T09:19:47.951816+0000","last_became_active":"2023-12-12T09:19:41.122032+0000","last_became_peered":"2023-12-12T09:19:41.122032+0000","last_unstale":"2023-12-12T09:19:47.951816+0000","last_undegraded":"2023-12-12T09:19:47.951816+0000","last_fullsized":"2023-12-12T09:19:47.951816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957378+0000","last_change":"2023-12-12T09:19:41.863190+0000","last_active":"2023-12-12T09:19:47.957378+0000","last_peered":"2023-12-12T09:19:47.957378+0000","last_clean":"2023-12-12T09:19:47.957378+0000","last_became_active":"2023-12-12T09:19:41.862923+0000","last_became_peered":"2023-12-12T09:19:41.862923+0000","last_unstale":"2023-12-12T09:19:47.957378+0000","last_undegraded":"2023-12-12T09:19:47.957378+0000","last_fullsized":"2023-12-12T09:19:47.957378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:12.357618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127983+0000","last_change":"2023-12-12T09:19:46.953136+0000","last_active":"2023-12-12T09:19:48.127983+0000","last_peered":"2023-12-12T09:19:48.127983+0000","last_clean":"2023-12-12T09:19:48.127983+0000","last_became_active":"2023-12-12T09:19:46.951967+0000","last_became_peered":"2023-12-12T09:19:46.951967+0000","last_unstale":"2023-12-12T09:19:48.127983+0000","last_undegraded":"2023-12-12T09:19:48.127983+0000","last_fullsized":"2023-12-12T09:19:48.127983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:57:42.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957667+0000","last_change":"2023-12-12T09:19:41.121042+0000","last_active":"2023-12-12T09:19:47.957667+0000","last_peered":"2023-12-12T09:19:47.957667+0000","last_clean":"2023-12-12T09:19:47.957667+0000","last_became_active":"2023-12-12T09:19:41.120807+0000","last_became_peered":"2023-12-12T09:19:41.120807+0000","last_unstale":"2023-12-12T09:19:47.957667+0000","last_undegraded":"2023-12-12T09:19:47.957667+0000","last_fullsized":"2023-12-12T09:19:47.957667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:13:12.317036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951513+0000","last_change":"2023-12-12T09:19:41.878335+0000","last_active":"2023-12-12T09:19:47.951513+0000","last_peered":"2023-12-12T09:19:47.951513+0000","last_clean":"2023-12-12T09:19:47.951513+0000","last_became_active":"2023-12-12T09:19:41.878074+0000","last_became_peered":"2023-12-12T09:19:41.878074+0000","last_unstale":"2023-12-12T09:19:47.951513+0000","last_undegraded":"2023-12-12T09:19:47.951513+0000","last_fullsized":"2023-12-12T09:19:47.951513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130375+0000","last_change":"2023-12-12T09:19:46.188502+0000","last_active":"2023-12-12T09:19:48.130375+0000","last_peered":"2023-12-12T09:19:48.130375+0000","last_clean":"2023-12-12T09:19:48.130375+0000","last_became_active":"2023-12-12T09:19:46.187905+0000","last_became_peered":"2023-12-12T09:19:46.187905+0000","last_unstale":"2023-12-12T09:19:48.130375+0000","last_undegraded":"2023-12-12T09:19:48.130375+0000","last_fullsized":"2023-12-12T09:19:48.130375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:47:39.097135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303686+0000","last_change":"2023-12-12T09:19:41.138949+0000","last_active":"2023-12-12T09:19:47.303686+0000","last_peered":"2023-12-12T09:19:47.303686+0000","last_clean":"2023-12-12T09:19:47.303686+0000","last_became_active":"2023-12-12T09:19:41.138599+0000","last_became_peered":"2023-12-12T09:19:41.138599+0000","last_unstale":"2023-12-12T09:19:47.303686+0000","last_undegraded":"2023-12-12T09:19:47.303686+0000","last_fullsized":"2023-12-12T09:19:47.303686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127902+0000","last_change":"2023-12-12T09:19:41.871082+0000","last_active":"2023-12-12T09:19:47.127902+0000","last_peered":"2023-12-12T09:19:47.127902+0000","last_clean":"2023-12-12T09:19:47.127902+0000","last_became_active":"2023-12-12T09:19:41.870566+0000","last_became_peered":"2023-12-12T09:19:41.870566+0000","last_unstale":"2023-12-12T09:19:47.127902+0000","last_undegraded":"2023-12-12T09:19:47.127902+0000","last_fullsized":"2023-12-12T09:19:47.127902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:25.789938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131233+0000","last_change":"2023-12-12T09:19:46.189328+0000","last_active":"2023-12-12T09:19:48.131233+0000","last_peered":"2023-12-12T09:19:48.131233+0000","last_clean":"2023-12-12T09:19:48.131233+0000","last_became_active":"2023-12-12T09:19:46.187611+0000","last_became_peered":"2023-12-12T09:19:46.187611+0000","last_unstale":"2023-12-12T09:19:48.131233+0000","last_undegraded":"2023-12-12T09:19:48.131233+0000","last_fullsized":"2023-12-12T09:19:48.131233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303363+0000","last_change":"2023-12-12T09:19:41.137054+0000","last_active":"2023-12-12T09:19:47.303363+0000","last_peered":"2023-12-12T09:19:47.303363+0000","last_clean":"2023-12-12T09:19:47.303363+0000","last_became_active":"2023-12-12T09:19:41.136605+0000","last_became_peered":"2023-12-12T09:19:41.136605+0000","last_unstale":"2023-12-12T09:19:47.303363+0000","last_undegraded":"2023-12-12T09:19:47.303363+0000","last_fullsized":"2023-12-12T09:19:47.303363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127898+0000","last_change":"2023-12-12T09:19:41.874505+0000","last_active":"2023-12-12T09:19:47.127898+0000","last_peered":"2023-12-12T09:19:47.127898+0000","last_clean":"2023-12-12T09:19:47.127898+0000","last_became_active":"2023-12-12T09:19:41.867235+0000","last_became_peered":"2023-12-12T09:19:41.867235+0000","last_unstale":"2023-12-12T09:19:47.127898+0000","last_undegraded":"2023-12-12T09:19:47.127898+0000","last_fullsized":"2023-12-12T09:19:47.127898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:24.432590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130292+0000","last_change":"2023-12-12T09:19:46.181752+0000","last_active":"2023-12-12T09:19:48.130292+0000","last_peered":"2023-12-12T09:19:48.130292+0000","last_clean":"2023-12-12T09:19:48.130292+0000","last_became_active":"2023-12-12T09:19:46.181333+0000","last_became_peered":"2023-12-12T09:19:46.181333+0000","last_unstale":"2023-12-12T09:19:48.130292+0000","last_undegraded":"2023-12-12T09:19:48.130292+0000","last_fullsized":"2023-12-12T09:19:48.130292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:24.767108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019710+0000","last_change":"2023-12-12T09:19:41.875596+0000","last_active":"2023-12-12T09:19:48.019710+0000","last_peered":"2023-12-12T09:19:48.019710+0000","last_clean":"2023-12-12T09:19:48.019710+0000","last_became_active":"2023-12-12T09:19:41.874550+0000","last_became_peered":"2023-12-12T09:19:41.874550+0000","last_unstale":"2023-12-12T09:19:48.019710+0000","last_undegraded":"2023-12-12T09:19:48.019710+0000","last_fullsized":"2023-12-12T09:19:48.019710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303839+0000","last_change":"2023-12-12T09:19:41.134017+0000","last_active":"2023-12-12T09:19:47.303839+0000","last_peered":"2023-12-12T09:19:47.303839+0000","last_clean":"2023-12-12T09:19:47.303839+0000","last_became_active":"2023-12-12T09:19:41.133112+0000","last_became_peered":"2023-12-12T09:19:41.133112+0000","last_unstale":"2023-12-12T09:19:47.303839+0000","last_undegraded":"2023-12-12T09:19:47.303839+0000","last_fullsized":"2023-12-12T09:19:47.303839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:30.833996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132530+0000","last_change":"2023-12-12T09:19:46.183576+0000","last_active":"2023-12-12T09:19:48.132530+0000","last_peered":"2023-12-12T09:19:48.132530+0000","last_clean":"2023-12-12T09:19:48.132530+0000","last_became_active":"2023-12-12T09:19:46.182655+0000","last_became_peered":"2023-12-12T09:19:46.182655+0000","last_unstale":"2023-12-12T09:19:48.132530+0000","last_undegraded":"2023-12-12T09:19:48.132530+0000","last_fullsized":"2023-12-12T09:19:48.132530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:46.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956362+0000","last_change":"2023-12-12T09:19:41.862462+0000","last_active":"2023-12-12T09:19:47.956362+0000","last_peered":"2023-12-12T09:19:47.956362+0000","last_clean":"2023-12-12T09:19:47.956362+0000","last_became_active":"2023-12-12T09:19:41.860988+0000","last_became_peered":"2023-12-12T09:19:41.860988+0000","last_unstale":"2023-12-12T09:19:47.956362+0000","last_undegraded":"2023-12-12T09:19:47.956362+0000","last_fullsized":"2023-12-12T09:19:47.956362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:26.864874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444995+0000","last_change":"2023-12-12T09:19:41.124071+0000","last_active":"2023-12-12T09:19:47.444995+0000","last_peered":"2023-12-12T09:19:47.444995+0000","last_clean":"2023-12-12T09:19:47.444995+0000","last_became_active":"2023-12-12T09:19:41.123806+0000","last_became_peered":"2023-12-12T09:19:41.123806+0000","last_unstale":"2023-12-12T09:19:47.444995+0000","last_undegraded":"2023-12-12T09:19:47.444995+0000","last_fullsized":"2023-12-12T09:19:47.444995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131780+0000","last_change":"2023-12-12T09:19:46.188994+0000","last_active":"2023-12-12T09:19:48.131780+0000","last_peered":"2023-12-12T09:19:48.131780+0000","last_clean":"2023-12-12T09:19:48.131780+0000","last_became_active":"2023-12-12T09:19:46.188551+0000","last_became_peered":"2023-12-12T09:19:46.188551+0000","last_unstale":"2023-12-12T09:19:48.131780+0000","last_undegraded":"2023-12-12T09:19:48.131780+0000","last_fullsized":"2023-12-12T09:19:48.131780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956335+0000","last_change":"2023-12-12T09:19:41.857578+0000","last_active":"2023-12-12T09:19:47.956335+0000","last_peered":"2023-12-12T09:19:47.956335+0000","last_clean":"2023-12-12T09:19:47.956335+0000","last_became_active":"2023-12-12T09:19:41.857262+0000","last_became_peered":"2023-12-12T09:19:41.857262+0000","last_unstale":"2023-12-12T09:19:47.956335+0000","last_undegraded":"2023-12-12T09:19:47.956335+0000","last_fullsized":"2023-12-12T09:19:47.956335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:23:10.886043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444759+0000","last_change":"2023-12-12T09:19:41.124140+0000","last_active":"2023-12-12T09:19:47.444759+0000","last_peered":"2023-12-12T09:19:47.444759+0000","last_clean":"2023-12-12T09:19:47.444759+0000","last_became_active":"2023-12-12T09:19:41.123866+0000","last_became_peered":"2023-12-12T09:19:41.123866+0000","last_unstale":"2023-12-12T09:19:47.444759+0000","last_undegraded":"2023-12-12T09:19:47.444759+0000","last_fullsized":"2023-12-12T09:19:47.444759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:30.833996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169980+0000","last_change":"2023-12-12T09:19:46.944967+0000","last_active":"2023-12-12T09:19:48.169980+0000","last_peered":"2023-12-12T09:19:48.169980+0000","last_clean":"2023-12-12T09:19:48.169980+0000","last_became_active":"2023-12-12T09:19:46.942177+0000","last_became_peered":"2023-12-12T09:19:46.942177+0000","last_unstale":"2023-12-12T09:19:48.169980+0000","last_undegraded":"2023-12-12T09:19:48.169980+0000","last_fullsized":"2023-12-12T09:19:48.169980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129676+0000","last_change":"2023-12-12T09:19:41.861866+0000","last_active":"2023-12-12T09:19:47.129676+0000","last_peered":"2023-12-12T09:19:47.129676+0000","last_clean":"2023-12-12T09:19:47.129676+0000","last_became_active":"2023-12-12T09:19:41.861471+0000","last_became_peered":"2023-12-12T09:19:41.861471+0000","last_unstale":"2023-12-12T09:19:47.129676+0000","last_undegraded":"2023-12-12T09:19:47.129676+0000","last_fullsized":"2023-12-12T09:19:47.129676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:19.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302819+0000","last_change":"2023-12-12T09:19:41.132420+0000","last_active":"2023-12-12T09:19:47.302819+0000","last_peered":"2023-12-12T09:19:47.302819+0000","last_clean":"2023-12-12T09:19:47.302819+0000","last_became_active":"2023-12-12T09:19:41.130901+0000","last_became_peered":"2023-12-12T09:19:41.130901+0000","last_unstale":"2023-12-12T09:19:47.302819+0000","last_undegraded":"2023-12-12T09:19:47.302819+0000","last_fullsized":"2023-12-12T09:19:47.302819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:38.516239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132323+0000","last_change":"2023-12-12T09:19:46.190546+0000","last_active":"2023-12-12T09:19:48.132323+0000","last_peered":"2023-12-12T09:19:48.132323+0000","last_clean":"2023-12-12T09:19:48.132323+0000","last_became_active":"2023-12-12T09:19:46.190080+0000","last_became_peered":"2023-12-12T09:19:46.190080+0000","last_unstale":"2023-12-12T09:19:48.132323+0000","last_undegraded":"2023-12-12T09:19:48.132323+0000","last_fullsized":"2023-12-12T09:19:48.132323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951268+0000","last_change":"2023-12-12T09:19:41.858094+0000","last_active":"2023-12-12T09:19:47.951268+0000","last_peered":"2023-12-12T09:19:47.951268+0000","last_clean":"2023-12-12T09:19:47.951268+0000","last_became_active":"2023-12-12T09:19:41.857826+0000","last_became_peered":"2023-12-12T09:19:41.857826+0000","last_unstale":"2023-12-12T09:19:47.951268+0000","last_undegraded":"2023-12-12T09:19:47.951268+0000","last_fullsized":"2023-12-12T09:19:47.951268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021166+0000","last_change":"2023-12-12T09:19:41.135301+0000","last_active":"2023-12-12T09:19:48.021166+0000","last_peered":"2023-12-12T09:19:48.021166+0000","last_clean":"2023-12-12T09:19:48.021166+0000","last_became_active":"2023-12-12T09:19:41.134467+0000","last_became_peered":"2023-12-12T09:19:41.134467+0000","last_unstale":"2023-12-12T09:19:48.021166+0000","last_undegraded":"2023-12-12T09:19:48.021166+0000","last_fullsized":"2023-12-12T09:19:48.021166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132355+0000","last_change":"2023-12-12T09:19:46.943689+0000","last_active":"2023-12-12T09:19:48.132355+0000","last_peered":"2023-12-12T09:19:48.132355+0000","last_clean":"2023-12-12T09:19:48.132355+0000","last_became_active":"2023-12-12T09:19:46.942093+0000","last_became_peered":"2023-12-12T09:19:46.942093+0000","last_unstale":"2023-12-12T09:19:48.132355+0000","last_undegraded":"2023-12-12T09:19:48.132355+0000","last_fullsized":"2023-12-12T09:19:48.132355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:00.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957608+0000","last_change":"2023-12-12T09:19:41.861945+0000","last_active":"2023-12-12T09:19:47.957608+0000","last_peered":"2023-12-12T09:19:47.957608+0000","last_clean":"2023-12-12T09:19:47.957608+0000","last_became_active":"2023-12-12T09:19:41.861570+0000","last_became_peered":"2023-12-12T09:19:41.861570+0000","last_unstale":"2023-12-12T09:19:47.957608+0000","last_undegraded":"2023-12-12T09:19:47.957608+0000","last_fullsized":"2023-12-12T09:19:47.957608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:49.539855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445666+0000","last_change":"2023-12-12T09:19:41.131818+0000","last_active":"2023-12-12T09:19:47.445666+0000","last_peered":"2023-12-12T09:19:47.445666+0000","last_clean":"2023-12-12T09:19:47.445666+0000","last_became_active":"2023-12-12T09:19:41.131557+0000","last_became_peered":"2023-12-12T09:19:41.131557+0000","last_unstale":"2023-12-12T09:19:47.445666+0000","last_undegraded":"2023-12-12T09:19:47.445666+0000","last_fullsized":"2023-12-12T09:19:47.445666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:18.435713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127909+0000","last_change":"2023-12-12T09:19:46.955434+0000","last_active":"2023-12-12T09:19:48.127909+0000","last_peered":"2023-12-12T09:19:48.127909+0000","last_clean":"2023-12-12T09:19:48.127909+0000","last_became_active":"2023-12-12T09:19:46.949579+0000","last_became_peered":"2023-12-12T09:19:46.949579+0000","last_unstale":"2023-12-12T09:19:48.127909+0000","last_undegraded":"2023-12-12T09:19:48.127909+0000","last_fullsized":"2023-12-12T09:19:48.127909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:30:22.426722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445297+0000","last_change":"2023-12-12T09:19:41.864811+0000","last_active":"2023-12-12T09:19:47.445297+0000","last_peered":"2023-12-12T09:19:47.445297+0000","last_clean":"2023-12-12T09:19:47.445297+0000","last_became_active":"2023-12-12T09:19:41.863476+0000","last_became_peered":"2023-12-12T09:19:41.863476+0000","last_unstale":"2023-12-12T09:19:47.445297+0000","last_undegraded":"2023-12-12T09:19:47.445297+0000","last_fullsized":"2023-12-12T09:19:47.445297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303909+0000","last_change":"2023-12-12T09:19:41.134083+0000","last_active":"2023-12-12T09:19:47.303909+0000","last_peered":"2023-12-12T09:19:47.303909+0000","last_clean":"2023-12-12T09:19:47.303909+0000","last_became_active":"2023-12-12T09:19:41.133702+0000","last_became_peered":"2023-12-12T09:19:41.133702+0000","last_unstale":"2023-12-12T09:19:47.303909+0000","last_undegraded":"2023-12-12T09:19:47.303909+0000","last_fullsized":"2023-12-12T09:19:47.303909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:55.931283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170416+0000","last_change":"2023-12-12T09:19:46.943046+0000","last_active":"2023-12-12T09:19:48.170416+0000","last_peered":"2023-12-12T09:19:48.170416+0000","last_clean":"2023-12-12T09:19:48.170416+0000","last_became_active":"2023-12-12T09:19:46.941680+0000","last_became_peered":"2023-12-12T09:19:46.941680+0000","last_unstale":"2023-12-12T09:19:48.170416+0000","last_undegraded":"2023-12-12T09:19:48.170416+0000","last_fullsized":"2023-12-12T09:19:48.170416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128054+0000","last_change":"2023-12-12T09:19:41.865106+0000","last_active":"2023-12-12T09:19:47.128054+0000","last_peered":"2023-12-12T09:19:47.128054+0000","last_clean":"2023-12-12T09:19:47.128054+0000","last_became_active":"2023-12-12T09:19:41.864807+0000","last_became_peered":"2023-12-12T09:19:41.864807+0000","last_unstale":"2023-12-12T09:19:47.128054+0000","last_undegraded":"2023-12-12T09:19:47.128054+0000","last_fullsized":"2023-12-12T09:19:47.128054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:32.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445367+0000","last_change":"2023-12-12T09:19:41.116293+0000","last_active":"2023-12-12T09:19:47.445367+0000","last_peered":"2023-12-12T09:19:47.445367+0000","last_clean":"2023-12-12T09:19:47.445367+0000","last_became_active":"2023-12-12T09:19:41.115995+0000","last_became_peered":"2023-12-12T09:19:41.115995+0000","last_unstale":"2023-12-12T09:19:47.445367+0000","last_undegraded":"2023-12-12T09:19:47.445367+0000","last_fullsized":"2023-12-12T09:19:47.445367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:02.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.168829+0000","last_change":"2023-12-12T09:19:46.184450+0000","last_active":"2023-12-12T09:19:48.168829+0000","last_peered":"2023-12-12T09:19:48.168829+0000","last_clean":"2023-12-12T09:19:48.168829+0000","last_became_active":"2023-12-12T09:19:46.183856+0000","last_became_peered":"2023-12-12T09:19:46.183856+0000","last_unstale":"2023-12-12T09:19:48.168829+0000","last_undegraded":"2023-12-12T09:19:48.168829+0000","last_fullsized":"2023-12-12T09:19:48.168829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.131191+0000","last_change":"2023-12-12T09:19:41.859699+0000","last_active":"2023-12-12T09:19:47.131191+0000","last_peered":"2023-12-12T09:19:47.131191+0000","last_clean":"2023-12-12T09:19:47.131191+0000","last_became_active":"2023-12-12T09:19:41.859271+0000","last_became_peered":"2023-12-12T09:19:41.859271+0000","last_unstale":"2023-12-12T09:19:47.131191+0000","last_undegraded":"2023-12-12T09:19:47.131191+0000","last_fullsized":"2023-12-12T09:19:47.131191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:23:52.795227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128310+0000","last_change":"2023-12-12T09:19:41.127974+0000","last_active":"2023-12-12T09:19:47.128310+0000","last_peered":"2023-12-12T09:19:47.128310+0000","last_clean":"2023-12-12T09:19:47.128310+0000","last_became_active":"2023-12-12T09:19:41.127284+0000","last_became_peered":"2023-12-12T09:19:41.127284+0000","last_unstale":"2023-12-12T09:19:47.128310+0000","last_undegraded":"2023-12-12T09:19:47.128310+0000","last_fullsized":"2023-12-12T09:19:47.128310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:27.876703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169383+0000","last_change":"2023-12-12T09:19:46.187283+0000","last_active":"2023-12-12T09:19:48.169383+0000","last_peered":"2023-12-12T09:19:48.169383+0000","last_clean":"2023-12-12T09:19:48.169383+0000","last_became_active":"2023-12-12T09:19:46.184094+0000","last_became_peered":"2023-12-12T09:19:46.184094+0000","last_unstale":"2023-12-12T09:19:48.169383+0000","last_undegraded":"2023-12-12T09:19:48.169383+0000","last_fullsized":"2023-12-12T09:19:48.169383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444747+0000","last_change":"2023-12-12T09:19:41.860571+0000","last_active":"2023-12-12T09:19:47.444747+0000","last_peered":"2023-12-12T09:19:47.444747+0000","last_clean":"2023-12-12T09:19:47.444747+0000","last_became_active":"2023-12-12T09:19:41.860299+0000","last_became_peered":"2023-12-12T09:19:41.860299+0000","last_unstale":"2023-12-12T09:19:47.444747+0000","last_undegraded":"2023-12-12T09:19:47.444747+0000","last_fullsized":"2023-12-12T09:19:47.444747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126141+0000","last_change":"2023-12-12T09:19:41.117790+0000","last_active":"2023-12-12T09:19:47.126141+0000","last_peered":"2023-12-12T09:19:47.126141+0000","last_clean":"2023-12-12T09:19:47.126141+0000","last_became_active":"2023-12-12T09:19:41.117558+0000","last_became_peered":"2023-12-12T09:19:41.117558+0000","last_unstale":"2023-12-12T09:19:47.126141+0000","last_undegraded":"2023-12-12T09:19:47.126141+0000","last_fullsized":"2023-12-12T09:19:47.126141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:34:48.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170143+0000","last_change":"2023-12-12T09:19:46.182717+0000","last_active":"2023-12-12T09:19:48.170143+0000","last_peered":"2023-12-12T09:19:48.170143+0000","last_clean":"2023-12-12T09:19:48.170143+0000","last_became_active":"2023-12-12T09:19:46.179138+0000","last_became_peered":"2023-12-12T09:19:46.179138+0000","last_unstale":"2023-12-12T09:19:48.170143+0000","last_undegraded":"2023-12-12T09:19:48.170143+0000","last_fullsized":"2023-12-12T09:19:48.170143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950048+0000","last_change":"2023-12-12T09:19:41.850752+0000","last_active":"2023-12-12T09:19:47.950048+0000","last_peered":"2023-12-12T09:19:47.950048+0000","last_clean":"2023-12-12T09:19:47.950048+0000","last_became_active":"2023-12-12T09:19:41.849147+0000","last_became_peered":"2023-12-12T09:19:41.849147+0000","last_unstale":"2023-12-12T09:19:47.950048+0000","last_undegraded":"2023-12-12T09:19:47.950048+0000","last_fullsized":"2023-12-12T09:19:47.950048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:03.309104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302812+0000","last_change":"2023-12-12T09:19:41.134276+0000","last_active":"2023-12-12T09:19:47.302812+0000","last_peered":"2023-12-12T09:19:47.302812+0000","last_clean":"2023-12-12T09:19:47.302812+0000","last_became_active":"2023-12-12T09:19:41.133924+0000","last_became_peered":"2023-12-12T09:19:41.133924+0000","last_unstale":"2023-12-12T09:19:47.302812+0000","last_undegraded":"2023-12-12T09:19:47.302812+0000","last_fullsized":"2023-12-12T09:19:47.302812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171202+0000","last_change":"2023-12-12T09:19:46.947025+0000","last_active":"2023-12-12T09:19:48.171202+0000","last_peered":"2023-12-12T09:19:48.171202+0000","last_clean":"2023-12-12T09:19:48.171202+0000","last_became_active":"2023-12-12T09:19:46.945211+0000","last_became_peered":"2023-12-12T09:19:46.945211+0000","last_unstale":"2023-12-12T09:19:48.171202+0000","last_undegraded":"2023-12-12T09:19:48.171202+0000","last_fullsized":"2023-12-12T09:19:48.171202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.955803+0000","last_change":"2023-12-12T09:19:41.877643+0000","last_active":"2023-12-12T09:19:47.955803+0000","last_peered":"2023-12-12T09:19:47.955803+0000","last_clean":"2023-12-12T09:19:47.955803+0000","last_became_active":"2023-12-12T09:19:41.877316+0000","last_became_peered":"2023-12-12T09:19:41.877316+0000","last_unstale":"2023-12-12T09:19:47.955803+0000","last_undegraded":"2023-12-12T09:19:47.955803+0000","last_fullsized":"2023-12-12T09:19:47.955803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:14:08.288770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127400+0000","last_change":"2023-12-12T09:19:41.113788+0000","last_active":"2023-12-12T09:19:47.127400+0000","last_peered":"2023-12-12T09:19:47.127400+0000","last_clean":"2023-12-12T09:19:47.127400+0000","last_became_active":"2023-12-12T09:19:41.112577+0000","last_became_peered":"2023-12-12T09:19:41.112577+0000","last_unstale":"2023-12-12T09:19:47.127400+0000","last_undegraded":"2023-12-12T09:19:47.127400+0000","last_fullsized":"2023-12-12T09:19:47.127400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:42.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303078+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:19:47.303078+0000","last_peered":"2023-12-12T09:19:47.303078+0000","last_clean":"2023-12-12T09:19:47.303078+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:19:47.303078+0000","last_undegraded":"2023-12-12T09:19:47.303078+0000","last_fullsized":"2023-12-12T09:19:47.303078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.172709+0000","last_change":"2023-12-12T09:19:46.944981+0000","last_active":"2023-12-12T09:19:48.172709+0000","last_peered":"2023-12-12T09:19:48.172709+0000","last_clean":"2023-12-12T09:19:48.172709+0000","last_became_active":"2023-12-12T09:19:46.943825+0000","last_became_peered":"2023-12-12T09:19:46.943825+0000","last_unstale":"2023-12-12T09:19:48.172709+0000","last_undegraded":"2023-12-12T09:19:48.172709+0000","last_fullsized":"2023-12-12T09:19:48.172709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:33.622944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303399+0000","last_change":"2023-12-12T09:19:41.883110+0000","last_active":"2023-12-12T09:19:47.303399+0000","last_peered":"2023-12-12T09:19:47.303399+0000","last_clean":"2023-12-12T09:19:47.303399+0000","last_became_active":"2023-12-12T09:19:41.882836+0000","last_became_peered":"2023-12-12T09:19:41.882836+0000","last_unstale":"2023-12-12T09:19:47.303399+0000","last_undegraded":"2023-12-12T09:19:47.303399+0000","last_fullsized":"2023-12-12T09:19:47.303399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:53.429076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127491+0000","last_change":"2023-12-12T09:19:41.128783+0000","last_active":"2023-12-12T09:19:47.127491+0000","last_peered":"2023-12-12T09:19:47.127491+0000","last_clean":"2023-12-12T09:19:47.127491+0000","last_became_active":"2023-12-12T09:19:41.128390+0000","last_became_peered":"2023-12-12T09:19:41.128390+0000","last_unstale":"2023-12-12T09:19:47.127491+0000","last_undegraded":"2023-12-12T09:19:47.127491+0000","last_fullsized":"2023-12-12T09:19:47.127491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:38.516239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170902+0000","last_change":"2023-12-12T09:19:46.945892+0000","last_active":"2023-12-12T09:19:48.170902+0000","last_peered":"2023-12-12T09:19:48.170902+0000","last_clean":"2023-12-12T09:19:48.170902+0000","last_became_active":"2023-12-12T09:19:46.944874+0000","last_became_peered":"2023-12-12T09:19:46.944874+0000","last_unstale":"2023-12-12T09:19:48.170902+0000","last_undegraded":"2023-12-12T09:19:48.170902+0000","last_fullsized":"2023-12-12T09:19:48.170902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:36.314213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127967+0000","last_change":"2023-12-12T09:19:41.861777+0000","last_active":"2023-12-12T09:19:47.127967+0000","last_peered":"2023-12-12T09:19:47.127967+0000","last_clean":"2023-12-12T09:19:47.127967+0000","last_became_active":"2023-12-12T09:19:41.861449+0000","last_became_peered":"2023-12-12T09:19:41.861449+0000","last_unstale":"2023-12-12T09:19:47.127967+0000","last_undegraded":"2023-12-12T09:19:47.127967+0000","last_fullsized":"2023-12-12T09:19:47.127967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:29.573933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445429+0000","last_change":"2023-12-12T09:19:41.119895+0000","last_active":"2023-12-12T09:19:47.445429+0000","last_peered":"2023-12-12T09:19:47.445429+0000","last_clean":"2023-12-12T09:19:47.445429+0000","last_became_active":"2023-12-12T09:19:41.119579+0000","last_became_peered":"2023-12-12T09:19:41.119579+0000","last_unstale":"2023-12-12T09:19:47.445429+0000","last_undegraded":"2023-12-12T09:19:47.445429+0000","last_fullsized":"2023-12-12T09:19:47.445429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170457+0000","last_change":"2023-12-12T09:19:46.184299+0000","last_active":"2023-12-12T09:19:48.170457+0000","last_peered":"2023-12-12T09:19:48.170457+0000","last_clean":"2023-12-12T09:19:48.170457+0000","last_became_active":"2023-12-12T09:19:46.182654+0000","last_became_peered":"2023-12-12T09:19:46.182654+0000","last_unstale":"2023-12-12T09:19:48.170457+0000","last_undegraded":"2023-12-12T09:19:48.170457+0000","last_fullsized":"2023-12-12T09:19:48.170457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304529+0000","last_change":"2023-12-12T09:19:41.881513+0000","last_active":"2023-12-12T09:19:47.304529+0000","last_peered":"2023-12-12T09:19:47.304529+0000","last_clean":"2023-12-12T09:19:47.304529+0000","last_became_active":"2023-12-12T09:19:41.881128+0000","last_became_peered":"2023-12-12T09:19:41.881128+0000","last_unstale":"2023-12-12T09:19:47.304529+0000","last_undegraded":"2023-12-12T09:19:47.304529+0000","last_fullsized":"2023-12-12T09:19:47.304529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:47:35.048125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126858+0000","last_change":"2023-12-12T09:19:41.116076+0000","last_active":"2023-12-12T09:19:47.126858+0000","last_peered":"2023-12-12T09:19:47.126858+0000","last_clean":"2023-12-12T09:19:47.126858+0000","last_became_active":"2023-12-12T09:19:41.115133+0000","last_became_peered":"2023-12-12T09:19:41.115133+0000","last_unstale":"2023-12-12T09:19:47.126858+0000","last_undegraded":"2023-12-12T09:19:47.126858+0000","last_fullsized":"2023-12-12T09:19:47.126858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.129238+0000","last_change":"2023-12-12T09:19:46.944320+0000","last_active":"2023-12-12T09:19:48.129238+0000","last_peered":"2023-12-12T09:19:48.129238+0000","last_clean":"2023-12-12T09:19:48.129238+0000","last_became_active":"2023-12-12T09:19:46.941541+0000","last_became_peered":"2023-12-12T09:19:46.941541+0000","last_unstale":"2023-12-12T09:19:48.129238+0000","last_undegraded":"2023-12-12T09:19:48.129238+0000","last_fullsized":"2023-12-12T09:19:48.129238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304268+0000","last_change":"2023-12-12T09:19:41.877256+0000","last_active":"2023-12-12T09:19:47.304268+0000","last_peered":"2023-12-12T09:19:47.304268+0000","last_clean":"2023-12-12T09:19:47.304268+0000","last_became_active":"2023-12-12T09:19:41.875186+0000","last_became_peered":"2023-12-12T09:19:41.875186+0000","last_unstale":"2023-12-12T09:19:47.304268+0000","last_undegraded":"2023-12-12T09:19:47.304268+0000","last_fullsized":"2023-12-12T09:19:47.304268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:32.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.131383+0000","last_change":"2023-12-12T09:19:41.119283+0000","last_active":"2023-12-12T09:19:47.131383+0000","last_peered":"2023-12-12T09:19:47.131383+0000","last_clean":"2023-12-12T09:19:47.131383+0000","last_became_active":"2023-12-12T09:19:41.118924+0000","last_became_peered":"2023-12-12T09:19:41.118924+0000","last_unstale":"2023-12-12T09:19:47.131383+0000","last_undegraded":"2023-12-12T09:19:47.131383+0000","last_fullsized":"2023-12-12T09:19:47.131383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:34:48.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131732+0000","last_change":"2023-12-12T09:19:46.186473+0000","last_active":"2023-12-12T09:19:48.131732+0000","last_peered":"2023-12-12T09:19:48.131732+0000","last_clean":"2023-12-12T09:19:48.131732+0000","last_became_active":"2023-12-12T09:19:46.185905+0000","last_became_peered":"2023-12-12T09:19:46.185905+0000","last_unstale":"2023-12-12T09:19:48.131732+0000","last_undegraded":"2023-12-12T09:19:48.131732+0000","last_fullsized":"2023-12-12T09:19:48.131732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303587+0000","last_change":"2023-12-12T09:19:41.877853+0000","last_active":"2023-12-12T09:19:47.303587+0000","last_peered":"2023-12-12T09:19:47.303587+0000","last_clean":"2023-12-12T09:19:47.303587+0000","last_became_active":"2023-12-12T09:19:41.875044+0000","last_became_peered":"2023-12-12T09:19:41.875044+0000","last_unstale":"2023-12-12T09:19:47.303587+0000","last_undegraded":"2023-12-12T09:19:47.303587+0000","last_fullsized":"2023-12-12T09:19:47.303587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:14.546295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.125556+0000","last_change":"2023-12-12T09:19:41.120939+0000","last_active":"2023-12-12T09:19:47.125556+0000","last_peered":"2023-12-12T09:19:47.125556+0000","last_clean":"2023-12-12T09:19:47.125556+0000","last_became_active":"2023-12-12T09:19:41.120648+0000","last_became_peered":"2023-12-12T09:19:41.120648+0000","last_unstale":"2023-12-12T09:19:47.125556+0000","last_undegraded":"2023-12-12T09:19:47.125556+0000","last_fullsized":"2023-12-12T09:19:47.125556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:50:22.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171167+0000","last_change":"2023-12-12T09:19:46.189274+0000","last_active":"2023-12-12T09:19:48.171167+0000","last_peered":"2023-12-12T09:19:48.171167+0000","last_clean":"2023-12-12T09:19:48.171167+0000","last_became_active":"2023-12-12T09:19:46.188822+0000","last_became_peered":"2023-12-12T09:19:46.188822+0000","last_unstale":"2023-12-12T09:19:48.171167+0000","last_undegraded":"2023-12-12T09:19:48.171167+0000","last_fullsized":"2023-12-12T09:19:48.171167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019851+0000","last_change":"2023-12-12T09:19:41.864891+0000","last_active":"2023-12-12T09:19:48.019851+0000","last_peered":"2023-12-12T09:19:48.019851+0000","last_clean":"2023-12-12T09:19:48.019851+0000","last_became_active":"2023-12-12T09:19:41.864627+0000","last_became_peered":"2023-12-12T09:19:41.864627+0000","last_unstale":"2023-12-12T09:19:48.019851+0000","last_undegraded":"2023-12-12T09:19:48.019851+0000","last_fullsized":"2023-12-12T09:19:48.019851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020105+0000","last_change":"2023-12-12T09:19:41.133652+0000","last_active":"2023-12-12T09:19:48.020105+0000","last_peered":"2023-12-12T09:19:48.020105+0000","last_clean":"2023-12-12T09:19:48.020105+0000","last_became_active":"2023-12-12T09:19:41.133408+0000","last_became_peered":"2023-12-12T09:19:41.133408+0000","last_unstale":"2023-12-12T09:19:48.020105+0000","last_undegraded":"2023-12-12T09:19:48.020105+0000","last_fullsized":"2023-12-12T09:19:48.020105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:08.194468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128487+0000","last_change":"2023-12-12T09:19:46.948569+0000","last_active":"2023-12-12T09:19:48.128487+0000","last_peered":"2023-12-12T09:19:48.128487+0000","last_clean":"2023-12-12T09:19:48.128487+0000","last_became_active":"2023-12-12T09:19:46.947137+0000","last_became_peered":"2023-12-12T09:19:46.947137+0000","last_unstale":"2023-12-12T09:19:48.128487+0000","last_undegraded":"2023-12-12T09:19:48.128487+0000","last_fullsized":"2023-12-12T09:19:48.128487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:05:18.225548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303688+0000","last_change":"2023-12-12T09:19:41.877782+0000","last_active":"2023-12-12T09:19:47.303688+0000","last_peered":"2023-12-12T09:19:47.303688+0000","last_clean":"2023-12-12T09:19:47.303688+0000","last_became_active":"2023-12-12T09:19:41.877386+0000","last_became_peered":"2023-12-12T09:19:41.877386+0000","last_unstale":"2023-12-12T09:19:47.303688+0000","last_undegraded":"2023-12-12T09:19:47.303688+0000","last_fullsized":"2023-12-12T09:19:47.303688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:24.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128131+0000","last_change":"2023-12-12T09:19:41.132860+0000","last_active":"2023-12-12T09:19:47.128131+0000","last_peered":"2023-12-12T09:19:47.128131+0000","last_clean":"2023-12-12T09:19:47.128131+0000","last_became_active":"2023-12-12T09:19:41.132569+0000","last_became_peered":"2023-12-12T09:19:41.132569+0000","last_unstale":"2023-12-12T09:19:47.128131+0000","last_undegraded":"2023-12-12T09:19:47.128131+0000","last_fullsized":"2023-12-12T09:19:47.128131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:18.435713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128599+0000","last_change":"2023-12-12T09:19:46.950471+0000","last_active":"2023-12-12T09:19:48.128599+0000","last_peered":"2023-12-12T09:19:48.128599+0000","last_clean":"2023-12-12T09:19:48.128599+0000","last_became_active":"2023-12-12T09:19:46.949395+0000","last_became_peered":"2023-12-12T09:19:46.949395+0000","last_unstale":"2023-12-12T09:19:48.128599+0000","last_undegraded":"2023-12-12T09:19:48.128599+0000","last_fullsized":"2023-12-12T09:19:48.128599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:23:10.613536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950800+0000","last_change":"2023-12-12T09:19:41.869585+0000","last_active":"2023-12-12T09:19:47.950800+0000","last_peered":"2023-12-12T09:19:47.950800+0000","last_clean":"2023-12-12T09:19:47.950800+0000","last_became_active":"2023-12-12T09:19:41.869388+0000","last_became_peered":"2023-12-12T09:19:41.869388+0000","last_unstale":"2023-12-12T09:19:47.950800+0000","last_undegraded":"2023-12-12T09:19:47.950800+0000","last_fullsized":"2023-12-12T09:19:47.950800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951035+0000","last_change":"2023-12-12T09:19:41.123186+0000","last_active":"2023-12-12T09:19:47.951035+0000","last_peered":"2023-12-12T09:19:47.951035+0000","last_clean":"2023-12-12T09:19:47.951035+0000","last_became_active":"2023-12-12T09:19:41.122891+0000","last_became_peered":"2023-12-12T09:19:41.122891+0000","last_unstale":"2023-12-12T09:19:47.951035+0000","last_undegraded":"2023-12-12T09:19:47.951035+0000","last_fullsized":"2023-12-12T09:19:47.951035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:23:51.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130720+0000","last_change":"2023-12-12T09:19:46.943661+0000","last_active":"2023-12-12T09:19:48.130720+0000","last_peered":"2023-12-12T09:19:48.130720+0000","last_clean":"2023-12-12T09:19:48.130720+0000","last_became_active":"2023-12-12T09:19:46.942612+0000","last_became_peered":"2023-12-12T09:19:46.942612+0000","last_unstale":"2023-12-12T09:19:48.130720+0000","last_undegraded":"2023-12-12T09:19:48.130720+0000","last_fullsized":"2023-12-12T09:19:48.130720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:00.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303253+0000","last_change":"2023-12-12T09:19:41.879007+0000","last_active":"2023-12-12T09:19:47.303253+0000","last_peered":"2023-12-12T09:19:47.303253+0000","last_clean":"2023-12-12T09:19:47.303253+0000","last_became_active":"2023-12-12T09:19:41.878653+0000","last_became_peered":"2023-12-12T09:19:41.878653+0000","last_unstale":"2023-12-12T09:19:47.303253+0000","last_undegraded":"2023-12-12T09:19:47.303253+0000","last_fullsized":"2023-12-12T09:19:47.303253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:24.432590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:59.537079+0000","last_change":"2023-12-12T09:19:41.130448+0000","last_active":"2023-12-12T09:19:59.537079+0000","last_peered":"2023-12-12T09:19:59.537079+0000","last_clean":"2023-12-12T09:19:59.537079+0000","last_became_active":"2023-12-12T09:19:41.129913+0000","last_became_peered":"2023-12-12T09:19:41.129913+0000","last_unstale":"2023-12-12T09:19:59.537079+0000","last_undegraded":"2023-12-12T09:19:59.537079+0000","last_fullsized":"2023-12-12T09:19:59.537079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169031+0000","last_change":"2023-12-12T09:19:46.193832+0000","last_active":"2023-12-12T09:19:48.169031+0000","last_peered":"2023-12-12T09:19:48.169031+0000","last_clean":"2023-12-12T09:19:48.169031+0000","last_became_active":"2023-12-12T09:19:46.193427+0000","last_became_peered":"2023-12-12T09:19:46.193427+0000","last_unstale":"2023-12-12T09:19:48.169031+0000","last_undegraded":"2023-12-12T09:19:48.169031+0000","last_fullsized":"2023-12-12T09:19:48.169031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130880+0000","last_change":"2023-12-12T09:19:41.866473+0000","last_active":"2023-12-12T09:19:47.130880+0000","last_peered":"2023-12-12T09:19:47.130880+0000","last_clean":"2023-12-12T09:19:47.130880+0000","last_became_active":"2023-12-12T09:19:41.865426+0000","last_became_peered":"2023-12-12T09:19:41.865426+0000","last_unstale":"2023-12-12T09:19:47.130880+0000","last_undegraded":"2023-12-12T09:19:47.130880+0000","last_fullsized":"2023-12-12T09:19:47.130880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:32.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445355+0000","last_change":"2023-12-12T09:19:41.128579+0000","last_active":"2023-12-12T09:19:47.445355+0000","last_peered":"2023-12-12T09:19:47.445355+0000","last_clean":"2023-12-12T09:19:47.445355+0000","last_became_active":"2023-12-12T09:19:41.127500+0000","last_became_peered":"2023-12-12T09:19:41.127500+0000","last_unstale":"2023-12-12T09:19:47.445355+0000","last_undegraded":"2023-12-12T09:19:47.445355+0000","last_fullsized":"2023-12-12T09:19:47.445355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:08:51.795865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131533+0000","last_change":"2023-12-12T09:19:46.192023+0000","last_active":"2023-12-12T09:19:48.131533+0000","last_peered":"2023-12-12T09:19:48.131533+0000","last_clean":"2023-12-12T09:19:48.131533+0000","last_became_active":"2023-12-12T09:19:46.190736+0000","last_became_peered":"2023-12-12T09:19:46.190736+0000","last_unstale":"2023-12-12T09:19:48.131533+0000","last_undegraded":"2023-12-12T09:19:48.131533+0000","last_fullsized":"2023-12-12T09:19:48.131533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951755+0000","last_change":"2023-12-12T09:19:41.878135+0000","last_active":"2023-12-12T09:19:47.951755+0000","last_peered":"2023-12-12T09:19:47.951755+0000","last_clean":"2023-12-12T09:19:47.951755+0000","last_became_active":"2023-12-12T09:19:41.877619+0000","last_became_peered":"2023-12-12T09:19:41.877619+0000","last_unstale":"2023-12-12T09:19:47.951755+0000","last_undegraded":"2023-12-12T09:19:47.951755+0000","last_fullsized":"2023-12-12T09:19:47.951755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129007+0000","last_change":"2023-12-12T09:19:41.133535+0000","last_active":"2023-12-12T09:19:47.129007+0000","last_peered":"2023-12-12T09:19:47.129007+0000","last_clean":"2023-12-12T09:19:47.129007+0000","last_became_active":"2023-12-12T09:19:41.133248+0000","last_became_peered":"2023-12-12T09:19:41.133248+0000","last_unstale":"2023-12-12T09:19:47.129007+0000","last_undegraded":"2023-12-12T09:19:47.129007+0000","last_fullsized":"2023-12-12T09:19:47.129007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:35.003697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128002+0000","last_change":"2023-12-12T09:19:46.187952+0000","last_active":"2023-12-12T09:19:48.128002+0000","last_peered":"2023-12-12T09:19:48.128002+0000","last_clean":"2023-12-12T09:19:48.128002+0000","last_became_active":"2023-12-12T09:19:46.187441+0000","last_became_peered":"2023-12-12T09:19:46.187441+0000","last_unstale":"2023-12-12T09:19:48.128002+0000","last_undegraded":"2023-12-12T09:19:48.128002+0000","last_fullsized":"2023-12-12T09:19:48.128002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:46:54.723850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128820+0000","last_change":"2023-12-12T09:19:41.874029+0000","last_active":"2023-12-12T09:19:47.128820+0000","last_peered":"2023-12-12T09:19:47.128820+0000","last_clean":"2023-12-12T09:19:47.128820+0000","last_became_active":"2023-12-12T09:19:41.873678+0000","last_became_peered":"2023-12-12T09:19:41.873678+0000","last_unstale":"2023-12-12T09:19:47.128820+0000","last_undegraded":"2023-12-12T09:19:47.128820+0000","last_fullsized":"2023-12-12T09:19:47.128820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:53.429076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020897+0000","last_change":"2023-12-12T09:19:41.136636+0000","last_active":"2023-12-12T09:19:48.020897+0000","last_peered":"2023-12-12T09:19:48.020897+0000","last_clean":"2023-12-12T09:19:48.020897+0000","last_became_active":"2023-12-12T09:19:41.136314+0000","last_became_peered":"2023-12-12T09:19:41.136314+0000","last_unstale":"2023-12-12T09:19:48.020897+0000","last_undegraded":"2023-12-12T09:19:48.020897+0000","last_fullsized":"2023-12-12T09:19:48.020897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:35.268242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127896+0000","last_change":"2023-12-12T09:19:46.955741+0000","last_active":"2023-12-12T09:19:48.127896+0000","last_peered":"2023-12-12T09:19:48.127896+0000","last_clean":"2023-12-12T09:19:48.127896+0000","last_became_active":"2023-12-12T09:19:46.950425+0000","last_became_peered":"2023-12-12T09:19:46.950425+0000","last_unstale":"2023-12-12T09:19:48.127896+0000","last_undegraded":"2023-12-12T09:19:48.127896+0000","last_fullsized":"2023-12-12T09:19:48.127896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:56:11.700203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171062+0000","last_change":"2023-12-12T09:19:46.943384+0000","last_active":"2023-12-12T09:19:48.171062+0000","last_peered":"2023-12-12T09:19:48.171062+0000","last_clean":"2023-12-12T09:19:48.171062+0000","last_became_active":"2023-12-12T09:19:46.942319+0000","last_became_peered":"2023-12-12T09:19:46.942319+0000","last_unstale":"2023-12-12T09:19:48.171062+0000","last_undegraded":"2023-12-12T09:19:48.171062+0000","last_fullsized":"2023-12-12T09:19:48.171062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444647+0000","last_change":"2023-12-12T09:19:41.871355+0000","last_active":"2023-12-12T09:19:47.444647+0000","last_peered":"2023-12-12T09:19:47.444647+0000","last_clean":"2023-12-12T09:19:47.444647+0000","last_became_active":"2023-12-12T09:19:41.871096+0000","last_became_peered":"2023-12-12T09:19:41.871096+0000","last_unstale":"2023-12-12T09:19:47.444647+0000","last_undegraded":"2023-12-12T09:19:47.444647+0000","last_fullsized":"2023-12-12T09:19:47.444647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130761+0000","last_change":"2023-12-12T09:19:41.123288+0000","last_active":"2023-12-12T09:19:47.130761+0000","last_peered":"2023-12-12T09:19:47.130761+0000","last_clean":"2023-12-12T09:19:47.130761+0000","last_became_active":"2023-12-12T09:19:41.122752+0000","last_became_peered":"2023-12-12T09:19:41.122752+0000","last_unstale":"2023-12-12T09:19:47.130761+0000","last_undegraded":"2023-12-12T09:19:47.130761+0000","last_fullsized":"2023-12-12T09:19:47.130761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:55.931283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.173331+0000","last_change":"2023-12-12T09:19:46.195051+0000","last_active":"2023-12-12T09:19:48.173331+0000","last_peered":"2023-12-12T09:19:48.173331+0000","last_clean":"2023-12-12T09:19:48.173331+0000","last_became_active":"2023-12-12T09:19:46.194655+0000","last_became_peered":"2023-12-12T09:19:46.194655+0000","last_unstale":"2023-12-12T09:19:48.173331+0000","last_undegraded":"2023-12-12T09:19:48.173331+0000","last_fullsized":"2023-12-12T09:19:48.173331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:24.767108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956243+0000","last_change":"2023-12-12T09:19:41.861972+0000","last_active":"2023-12-12T09:19:47.956243+0000","last_peered":"2023-12-12T09:19:47.956243+0000","last_clean":"2023-12-12T09:19:47.956243+0000","last_became_active":"2023-12-12T09:19:41.861683+0000","last_became_peered":"2023-12-12T09:19:41.861683+0000","last_unstale":"2023-12-12T09:19:47.956243+0000","last_undegraded":"2023-12-12T09:19:47.956243+0000","last_fullsized":"2023-12-12T09:19:47.956243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:45:09.496901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956289+0000","last_change":"2023-12-12T09:19:41.130199+0000","last_active":"2023-12-12T09:19:47.956289+0000","last_peered":"2023-12-12T09:19:47.956289+0000","last_clean":"2023-12-12T09:19:47.956289+0000","last_became_active":"2023-12-12T09:19:41.129901+0000","last_became_peered":"2023-12-12T09:19:41.129901+0000","last_unstale":"2023-12-12T09:19:47.956289+0000","last_undegraded":"2023-12-12T09:19:47.956289+0000","last_fullsized":"2023-12-12T09:19:47.956289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:20:13.334305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020336+0000","last_change":"2023-12-12T09:19:41.135226+0000","last_active":"2023-12-12T09:19:48.020336+0000","last_peered":"2023-12-12T09:19:48.020336+0000","last_clean":"2023-12-12T09:19:48.020336+0000","last_became_active":"2023-12-12T09:19:41.134249+0000","last_became_peered":"2023-12-12T09:19:41.134249+0000","last_unstale":"2023-12-12T09:19:48.020336+0000","last_undegraded":"2023-12-12T09:19:48.020336+0000","last_fullsized":"2023-12-12T09:19:48.020336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:02.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951009+0000","last_change":"2023-12-12T09:19:41.853034+0000","last_active":"2023-12-12T09:19:47.951009+0000","last_peered":"2023-12-12T09:19:47.951009+0000","last_clean":"2023-12-12T09:19:47.951009+0000","last_became_active":"2023-12-12T09:19:41.852723+0000","last_became_peered":"2023-12-12T09:19:41.852723+0000","last_unstale":"2023-12-12T09:19:47.951009+0000","last_undegraded":"2023-12-12T09:19:47.951009+0000","last_fullsized":"2023-12-12T09:19:47.951009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.167998+0000","last_change":"2023-12-12T09:19:46.187764+0000","last_active":"2023-12-12T09:19:48.167998+0000","last_peered":"2023-12-12T09:19:48.167998+0000","last_clean":"2023-12-12T09:19:48.167998+0000","last_became_active":"2023-12-12T09:19:46.186203+0000","last_became_peered":"2023-12-12T09:19:46.186203+0000","last_unstale":"2023-12-12T09:19:48.167998+0000","last_undegraded":"2023-12-12T09:19:48.167998+0000","last_fullsized":"2023-12-12T09:19:48.167998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:23.753673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956499+0000","last_change":"2023-12-12T09:19:41.128685+0000","last_active":"2023-12-12T09:19:47.956499+0000","last_peered":"2023-12-12T09:19:47.956499+0000","last_clean":"2023-12-12T09:19:47.956499+0000","last_became_active":"2023-12-12T09:19:41.127743+0000","last_became_peered":"2023-12-12T09:19:41.127743+0000","last_unstale":"2023-12-12T09:19:47.956499+0000","last_undegraded":"2023-12-12T09:19:47.956499+0000","last_fullsized":"2023-12-12T09:19:47.956499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:32:47.519167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130033+0000","last_change":"2023-12-12T09:19:41.860010+0000","last_active":"2023-12-12T09:19:47.130033+0000","last_peered":"2023-12-12T09:19:47.130033+0000","last_clean":"2023-12-12T09:19:47.130033+0000","last_became_active":"2023-12-12T09:19:41.859472+0000","last_became_peered":"2023-12-12T09:19:41.859472+0000","last_unstale":"2023-12-12T09:19:47.130033+0000","last_undegraded":"2023-12-12T09:19:47.130033+0000","last_fullsized":"2023-12-12T09:19:47.130033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:36.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128477+0000","last_change":"2023-12-12T09:19:46.184369+0000","last_active":"2023-12-12T09:19:48.128477+0000","last_peered":"2023-12-12T09:19:48.128477+0000","last_clean":"2023-12-12T09:19:48.128477+0000","last_became_active":"2023-12-12T09:19:46.180831+0000","last_became_peered":"2023-12-12T09:19:46.180831+0000","last_unstale":"2023-12-12T09:19:48.128477+0000","last_undegraded":"2023-12-12T09:19:48.128477+0000","last_fullsized":"2023-12-12T09:19:48.128477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:44.706388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019602+0000","last_change":"2023-12-12T09:19:41.866259+0000","last_active":"2023-12-12T09:19:48.019602+0000","last_peered":"2023-12-12T09:19:48.019602+0000","last_clean":"2023-12-12T09:19:48.019602+0000","last_became_active":"2023-12-12T09:19:41.865940+0000","last_became_peered":"2023-12-12T09:19:41.865940+0000","last_unstale":"2023-12-12T09:19:48.019602+0000","last_undegraded":"2023-12-12T09:19:48.019602+0000","last_fullsized":"2023-12-12T09:19:48.019602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:19.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.125929+0000","last_change":"2023-12-12T09:19:41.867023+0000","last_active":"2023-12-12T09:19:47.125929+0000","last_peered":"2023-12-12T09:19:47.125929+0000","last_clean":"2023-12-12T09:19:47.125929+0000","last_became_active":"2023-12-12T09:19:41.866764+0000","last_became_peered":"2023-12-12T09:19:41.866764+0000","last_unstale":"2023-12-12T09:19:47.125929+0000","last_undegraded":"2023-12-12T09:19:47.125929+0000","last_fullsized":"2023-12-12T09:19:47.125929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:32.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127901+0000","last_change":"2023-12-12T09:19:41.867979+0000","last_active":"2023-12-12T09:19:47.127901+0000","last_peered":"2023-12-12T09:19:47.127901+0000","last_clean":"2023-12-12T09:19:47.127901+0000","last_became_active":"2023-12-12T09:19:41.867701+0000","last_became_peered":"2023-12-12T09:19:41.867701+0000","last_unstale":"2023-12-12T09:19:47.127901+0000","last_undegraded":"2023-12-12T09:19:47.127901+0000","last_fullsized":"2023-12-12T09:19:47.127901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:14.546295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950773+0000","last_change":"2023-12-12T09:19:41.866057+0000","last_active":"2023-12-12T09:19:47.950773+0000","last_peered":"2023-12-12T09:19:47.950773+0000","last_clean":"2023-12-12T09:19:47.950773+0000","last_became_active":"2023-12-12T09:19:41.865684+0000","last_became_peered":"2023-12-12T09:19:41.865684+0000","last_unstale":"2023-12-12T09:19:47.950773+0000","last_undegraded":"2023-12-12T09:19:47.950773+0000","last_fullsized":"2023-12-12T09:19:47.950773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:19.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956904+0000","last_change":"2023-12-12T09:19:41.870549+0000","last_active":"2023-12-12T09:19:47.956904+0000","last_peered":"2023-12-12T09:19:47.956904+0000","last_clean":"2023-12-12T09:19:47.956904+0000","last_became_active":"2023-12-12T09:19:41.870253+0000","last_became_peered":"2023-12-12T09:19:41.870253+0000","last_unstale":"2023-12-12T09:19:47.956904+0000","last_undegraded":"2023-12-12T09:19:47.956904+0000","last_fullsized":"2023-12-12T09:19:47.956904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:28:38.925176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445258+0000","last_change":"2023-12-12T09:19:41.868298+0000","last_active":"2023-12-12T09:19:47.445258+0000","last_peered":"2023-12-12T09:19:47.445258+0000","last_clean":"2023-12-12T09:19:47.445258+0000","last_became_active":"2023-12-12T09:19:41.866056+0000","last_became_peered":"2023-12-12T09:19:41.866056+0000","last_unstale":"2023-12-12T09:19:47.445258+0000","last_undegraded":"2023-12-12T09:19:47.445258+0000","last_fullsized":"2023-12-12T09:19:47.445258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021114+0000","last_change":"2023-12-12T09:19:41.870795+0000","last_active":"2023-12-12T09:19:48.021114+0000","last_peered":"2023-12-12T09:19:48.021114+0000","last_clean":"2023-12-12T09:19:48.021114+0000","last_became_active":"2023-12-12T09:19:41.869377+0000","last_became_peered":"2023-12-12T09:19:41.869377+0000","last_unstale":"2023-12-12T09:19:48.021114+0000","last_undegraded":"2023-12-12T09:19:48.021114+0000","last_fullsized":"2023-12-12T09:19:48.021114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957512+0000","last_change":"2023-12-12T09:19:41.871326+0000","last_active":"2023-12-12T09:19:47.957512+0000","last_peered":"2023-12-12T09:19:47.957512+0000","last_clean":"2023-12-12T09:19:47.957512+0000","last_became_active":"2023-12-12T09:19:41.870253+0000","last_became_peered":"2023-12-12T09:19:41.870253+0000","last_unstale":"2023-12-12T09:19:47.957512+0000","last_undegraded":"2023-12-12T09:19:47.957512+0000","last_fullsized":"2023-12-12T09:19:47.957512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:15:05.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130531+0000","last_change":"2023-12-12T09:19:41.866400+0000","last_active":"2023-12-12T09:19:47.130531+0000","last_peered":"2023-12-12T09:19:47.130531+0000","last_clean":"2023-12-12T09:19:47.130531+0000","last_became_active":"2023-12-12T09:19:41.866125+0000","last_became_peered":"2023-12-12T09:19:41.866125+0000","last_unstale":"2023-12-12T09:19:47.130531+0000","last_undegraded":"2023-12-12T09:19:47.130531+0000","last_fullsized":"2023-12-12T09:19:47.130531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956057+0000","last_change":"2023-12-12T09:19:41.871487+0000","last_active":"2023-12-12T09:19:47.956057+0000","last_peered":"2023-12-12T09:19:47.956057+0000","last_clean":"2023-12-12T09:19:47.956057+0000","last_became_active":"2023-12-12T09:19:41.871121+0000","last_became_peered":"2023-12-12T09:19:41.871121+0000","last_unstale":"2023-12-12T09:19:47.956057+0000","last_undegraded":"2023-12-12T09:19:47.956057+0000","last_fullsized":"2023-12-12T09:19:47.956057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:04.587709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127718+0000","last_change":"2023-12-12T09:19:41.877637+0000","last_active":"2023-12-12T09:19:47.127718+0000","last_peered":"2023-12-12T09:19:47.127718+0000","last_clean":"2023-12-12T09:19:47.127718+0000","last_became_active":"2023-12-12T09:19:41.877279+0000","last_became_peered":"2023-12-12T09:19:41.877279+0000","last_unstale":"2023-12-12T09:19:47.127718+0000","last_undegraded":"2023-12-12T09:19:47.127718+0000","last_fullsized":"2023-12-12T09:19:47.127718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:40.867544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950503+0000","last_change":"2023-12-12T09:19:41.858678+0000","last_active":"2023-12-12T09:19:47.950503+0000","last_peered":"2023-12-12T09:19:47.950503+0000","last_clean":"2023-12-12T09:19:47.950503+0000","last_became_active":"2023-12-12T09:19:41.858368+0000","last_became_peered":"2023-12-12T09:19:41.858368+0000","last_unstale":"2023-12-12T09:19:47.950503+0000","last_undegraded":"2023-12-12T09:19:47.950503+0000","last_fullsized":"2023-12-12T09:19:47.950503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:08:53.064814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020884+0000","last_change":"2023-12-12T09:19:41.874119+0000","last_active":"2023-12-12T09:19:48.020884+0000","last_peered":"2023-12-12T09:19:48.020884+0000","last_clean":"2023-12-12T09:19:48.020884+0000","last_became_active":"2023-12-12T09:19:41.873475+0000","last_became_peered":"2023-12-12T09:19:41.873475+0000","last_unstale":"2023-12-12T09:19:48.020884+0000","last_undegraded":"2023-12-12T09:19:48.020884+0000","last_fullsized":"2023-12-12T09:19:48.020884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303796+0000","last_change":"2023-12-12T09:19:41.880927+0000","last_active":"2023-12-12T09:19:47.303796+0000","last_peered":"2023-12-12T09:19:47.303796+0000","last_clean":"2023-12-12T09:19:47.303796+0000","last_became_active":"2023-12-12T09:19:41.880553+0000","last_became_peered":"2023-12-12T09:19:41.880553+0000","last_unstale":"2023-12-12T09:19:47.303796+0000","last_undegraded":"2023-12-12T09:19:47.303796+0000","last_fullsized":"2023-12-12T09:19:47.303796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:29.573933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126787+0000","last_change":"2023-12-12T09:19:41.865313+0000","last_active":"2023-12-12T09:19:47.126787+0000","last_peered":"2023-12-12T09:19:47.126787+0000","last_clean":"2023-12-12T09:19:47.126787+0000","last_became_active":"2023-12-12T09:19:41.864264+0000","last_became_peered":"2023-12-12T09:19:41.864264+0000","last_unstale":"2023-12-12T09:19:47.126787+0000","last_undegraded":"2023-12-12T09:19:47.126787+0000","last_fullsized":"2023-12-12T09:19:47.126787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:09.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129613+0000","last_change":"2023-12-12T09:19:41.873905+0000","last_active":"2023-12-12T09:19:47.129613+0000","last_peered":"2023-12-12T09:19:47.129613+0000","last_clean":"2023-12-12T09:19:47.129613+0000","last_became_active":"2023-12-12T09:19:41.873699+0000","last_became_peered":"2023-12-12T09:19:41.873699+0000","last_unstale":"2023-12-12T09:19:47.129613+0000","last_undegraded":"2023-12-12T09:19:47.129613+0000","last_fullsized":"2023-12-12T09:19:47.129613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:20.718098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130289+0000","last_change":"2023-12-12T09:19:41.869722+0000","last_active":"2023-12-12T09:19:47.130289+0000","last_peered":"2023-12-12T09:19:47.130289+0000","last_clean":"2023-12-12T09:19:47.130289+0000","last_became_active":"2023-12-12T09:19:41.867498+0000","last_became_peered":"2023-12-12T09:19:41.867498+0000","last_unstale":"2023-12-12T09:19:47.130289+0000","last_undegraded":"2023-12-12T09:19:47.130289+0000","last_fullsized":"2023-12-12T09:19:47.130289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:37.971340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444692+0000","last_change":"2023-12-12T09:19:41.866112+0000","last_active":"2023-12-12T09:19:47.444692+0000","last_peered":"2023-12-12T09:19:47.444692+0000","last_clean":"2023-12-12T09:19:47.444692+0000","last_became_active":"2023-12-12T09:19:41.865801+0000","last_became_peered":"2023-12-12T09:19:41.865801+0000","last_unstale":"2023-12-12T09:19:47.444692+0000","last_undegraded":"2023-12-12T09:19:47.444692+0000","last_fullsized":"2023-12-12T09:19:47.444692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950664+0000","last_change":"2023-12-12T09:19:41.856237+0000","last_active":"2023-12-12T09:19:47.950664+0000","last_peered":"2023-12-12T09:19:47.950664+0000","last_clean":"2023-12-12T09:19:47.950664+0000","last_became_active":"2023-12-12T09:19:41.854807+0000","last_became_peered":"2023-12-12T09:19:41.854807+0000","last_unstale":"2023-12-12T09:19:47.950664+0000","last_undegraded":"2023-12-12T09:19:47.950664+0000","last_fullsized":"2023-12-12T09:19:47.950664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956161+0000","last_change":"2023-12-12T09:19:41.864225+0000","last_active":"2023-12-12T09:19:47.956161+0000","last_peered":"2023-12-12T09:19:47.956161+0000","last_clean":"2023-12-12T09:19:47.956161+0000","last_became_active":"2023-12-12T09:19:41.863889+0000","last_became_peered":"2023-12-12T09:19:41.863889+0000","last_unstale":"2023-12-12T09:19:47.956161+0000","last_undegraded":"2023-12-12T09:19:47.956161+0000","last_fullsized":"2023-12-12T09:19:47.956161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:28.079653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130755+0000","last_change":"2023-12-12T09:19:41.864900+0000","last_active":"2023-12-12T09:19:47.130755+0000","last_peered":"2023-12-12T09:19:47.130755+0000","last_clean":"2023-12-12T09:19:47.130755+0000","last_became_active":"2023-12-12T09:19:41.864317+0000","last_became_peered":"2023-12-12T09:19:41.864317+0000","last_unstale":"2023-12-12T09:19:47.130755+0000","last_undegraded":"2023-12-12T09:19:47.130755+0000","last_fullsized":"2023-12-12T09:19:47.130755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:09.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020367+0000","last_change":"2023-12-12T09:19:41.878679+0000","last_active":"2023-12-12T09:19:48.020367+0000","last_peered":"2023-12-12T09:19:48.020367+0000","last_clean":"2023-12-12T09:19:48.020367+0000","last_became_active":"2023-12-12T09:19:41.878386+0000","last_became_peered":"2023-12-12T09:19:41.878386+0000","last_unstale":"2023-12-12T09:19:48.020367+0000","last_undegraded":"2023-12-12T09:19:48.020367+0000","last_fullsized":"2023-12-12T09:19:48.020367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021119+0000","last_change":"2023-12-12T09:19:41.876850+0000","last_active":"2023-12-12T09:19:48.021119+0000","last_peered":"2023-12-12T09:19:48.021119+0000","last_clean":"2023-12-12T09:19:48.021119+0000","last_became_active":"2023-12-12T09:19:41.876562+0000","last_became_peered":"2023-12-12T09:19:41.876562+0000","last_unstale":"2023-12-12T09:19:48.021119+0000","last_undegraded":"2023-12-12T09:19:48.021119+0000","last_fullsized":"2023-12-12T09:19:48.021119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304376+0000","last_change":"2023-12-12T09:19:41.883253+0000","last_active":"2023-12-12T09:19:47.304376+0000","last_peered":"2023-12-12T09:19:47.304376+0000","last_clean":"2023-12-12T09:19:47.304376+0000","last_became_active":"2023-12-12T09:19:41.882726+0000","last_became_peered":"2023-12-12T09:19:41.882726+0000","last_unstale":"2023-12-12T09:19:47.304376+0000","last_undegraded":"2023-12-12T09:19:47.304376+0000","last_fullsized":"2023-12-12T09:19:47.304376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:31.700244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.955946+0000","last_change":"2023-12-12T09:19:41.877684+0000","last_active":"2023-12-12T09:19:47.955946+0000","last_peered":"2023-12-12T09:19:47.955946+0000","last_clean":"2023-12-12T09:19:47.955946+0000","last_became_active":"2023-12-12T09:19:41.877339+0000","last_became_peered":"2023-12-12T09:19:41.877339+0000","last_unstale":"2023-12-12T09:19:47.955946+0000","last_undegraded":"2023-12-12T09:19:47.955946+0000","last_fullsized":"2023-12-12T09:19:47.955946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:03.365677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302878+0000","last_change":"2023-12-12T09:19:41.868128+0000","last_active":"2023-12-12T09:19:47.302878+0000","last_peered":"2023-12-12T09:19:47.302878+0000","last_clean":"2023-12-12T09:19:47.302878+0000","last_became_active":"2023-12-12T09:19:41.867856+0000","last_became_peered":"2023-12-12T09:19:41.867856+0000","last_unstale":"2023-12-12T09:19:47.302878+0000","last_undegraded":"2023-12-12T09:19:47.302878+0000","last_fullsized":"2023-12-12T09:19:47.302878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:37.971340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127464+0000","last_change":"2023-12-12T09:19:41.869966+0000","last_active":"2023-12-12T09:19:47.127464+0000","last_peered":"2023-12-12T09:19:47.127464+0000","last_clean":"2023-12-12T09:19:47.127464+0000","last_became_active":"2023-12-12T09:19:41.868229+0000","last_became_peered":"2023-12-12T09:19:41.868229+0000","last_unstale":"2023-12-12T09:19:47.127464+0000","last_undegraded":"2023-12-12T09:19:47.127464+0000","last_fullsized":"2023-12-12T09:19:47.127464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303428+0000","last_change":"2023-12-12T09:19:41.871972+0000","last_active":"2023-12-12T09:19:47.303428+0000","last_peered":"2023-12-12T09:19:47.303428+0000","last_clean":"2023-12-12T09:19:47.303428+0000","last_became_active":"2023-12-12T09:19:41.871670+0000","last_became_peered":"2023-12-12T09:19:41.871670+0000","last_unstale":"2023-12-12T09:19:47.303428+0000","last_undegraded":"2023-12-12T09:19:47.303428+0000","last_fullsized":"2023-12-12T09:19:47.303428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:25.789938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127735+0000","last_change":"2023-12-12T09:19:41.870884+0000","last_active":"2023-12-12T09:19:47.127735+0000","last_peered":"2023-12-12T09:19:47.127735+0000","last_clean":"2023-12-12T09:19:47.127735+0000","last_became_active":"2023-12-12T09:19:41.868918+0000","last_became_peered":"2023-12-12T09:19:41.868918+0000","last_unstale":"2023-12-12T09:19:47.127735+0000","last_undegraded":"2023-12-12T09:19:47.127735+0000","last_fullsized":"2023-12-12T09:19:47.127735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:24.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950799+0000","last_change":"2023-12-12T09:19:41.852563+0000","last_active":"2023-12-12T09:19:47.950799+0000","last_peered":"2023-12-12T09:19:47.950799+0000","last_clean":"2023-12-12T09:19:47.950799+0000","last_became_active":"2023-12-12T09:19:41.851419+0000","last_became_peered":"2023-12-12T09:19:41.851419+0000","last_unstale":"2023-12-12T09:19:47.950799+0000","last_undegraded":"2023-12-12T09:19:47.950799+0000","last_fullsized":"2023-12-12T09:19:47.950799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:10.837542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445576+0000","last_change":"2023-12-12T09:19:41.865052+0000","last_active":"2023-12-12T09:19:47.445576+0000","last_peered":"2023-12-12T09:19:47.445576+0000","last_clean":"2023-12-12T09:19:47.445576+0000","last_became_active":"2023-12-12T09:19:41.864707+0000","last_became_peered":"2023-12-12T09:19:41.864707+0000","last_unstale":"2023-12-12T09:19:47.445576+0000","last_undegraded":"2023-12-12T09:19:47.445576+0000","last_fullsized":"2023-12-12T09:19:47.445576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304266+0000","last_change":"2023-12-12T09:19:41.881336+0000","last_active":"2023-12-12T09:19:47.304266+0000","last_peered":"2023-12-12T09:19:47.304266+0000","last_clean":"2023-12-12T09:19:47.304266+0000","last_became_active":"2023-12-12T09:19:41.880783+0000","last_became_peered":"2023-12-12T09:19:41.880783+0000","last_unstale":"2023-12-12T09:19:47.304266+0000","last_undegraded":"2023-12-12T09:19:47.304266+0000","last_fullsized":"2023-12-12T09:19:47.304266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:20.718098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":701102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":110242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8089999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:20:09.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:20:09.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.819+0000 7fcefde17640 1 Processor -- start 2023-12-12T09:20:09.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.819+0000 7fcefde17640 1 -- start start 2023-12-12T09:20:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.820+0000 7fcefde17640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcef80ce550 0x7fcef8071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.820+0000 7fcefde17640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80cea30 con 0x7fcef8143d20 2023-12-12T09:20:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.820+0000 7fcefde17640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80702b0 con 0x7fcef80b47e0 2023-12-12T09:20:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.820+0000 7fcefde17640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef8070590 con 0x7fcef80ce550 2023-12-12T09:20:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.821+0000 7fcef7fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcef80ce550 0x7fcef8071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.821+0000 7fcef77fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcef8143d20 0x7fcef80b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50132/0 (socket says 172.21.15.84:50132) 2023-12-12T09:20:09.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.821+0000 7fcef77fe640 1 -- 172.21.15.84:0/1266908602 learned_addr learned my addr 172.21.15.84:0/1266908602 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.821+0000 7fcef7fff640 1 -- 172.21.15.84:0/1266908602 >> v1:172.21.15.99:6789/0 conn(0x7fcef80b47e0 legacy=0x7fcef8071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.821+0000 7fcef7fff640 1 -- 172.21.15.84:0/1266908602 >> v1:172.21.15.84:6789/0 conn(0x7fcef8143d20 legacy=0x7fcef80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.821+0000 7fcef7fff640 1 -- 172.21.15.84:0/1266908602 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8070870 con 0x7fcef80ce550 2023-12-12T09:20:09.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.822+0000 7fcef7fff640 1 --2- 172.21.15.84:0/1266908602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef8071780 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009d90 tx=0x7fcef002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bb5d5c34f2cc53 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.822+0000 7fcef6ffd640 1 -- 172.21.15.84:0/1266908602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef002cc60 con 0x7fcef80ce550 2023-12-12T09:20:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcef6ffd640 1 -- 172.21.15.84:0/1266908602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef002cdc0 con 0x7fcef80ce550 2023-12-12T09:20:09.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcef6ffd640 1 -- 172.21.15.84:0/1266908602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0034660 con 0x7fcef80ce550 2023-12-12T09:20:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcefde17640 1 -- 172.21.15.84:0/1266908602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 msgr2=0x7fcef8071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcefde17640 1 --2- 172.21.15.84:0/1266908602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef8071780 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009d90 tx=0x7fcef002beb0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcefde17640 1 -- 172.21.15.84:0/1266908602 shutdown_connections 2023-12-12T09:20:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcefde17640 1 --2- 172.21.15.84:0/1266908602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef8071780 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcefde17640 1 -- 172.21.15.84:0/1266908602 >> 172.21.15.84:0/1266908602 conn(0x7fcef806c3d0 msgr2=0x7fcef806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcefde17640 1 -- 172.21.15.84:0/1266908602 shutdown_connections 2023-12-12T09:20:09.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.823+0000 7fcefde17640 1 -- 172.21.15.84:0/1266908602 wait complete. 2023-12-12T09:20:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.825+0000 7fcefde17640 1 Processor -- start 2023-12-12T09:20:09.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.825+0000 7fcefde17640 1 -- start start 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fcefde17640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b47e0 0x7fcef8138560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fcefde17640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef81f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fcefde17640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcef8143d20 0x7fcef81f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fcefde17640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef81f3300 con 0x7fcef80ce550 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fcefde17640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef81e6500 con 0x7fcef80b47e0 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fcefde17640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef81f2430 con 0x7fcef8143d20 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fceeffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef81f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fceeffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef81f3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34306/0 (socket says 172.21.15.84:34306) 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.826+0000 7fceeffff640 1 -- 172.21.15.84:0/298614380 learned_addr learned my addr 172.21.15.84:0/298614380 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fcef77fe640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b47e0 0x7fcef8138560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fcef7fff640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcef8143d20 0x7fcef81f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fceeffff640 1 -- 172.21.15.84:0/298614380 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcef8143d20 msgr2=0x7fcef81f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fceeffff640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcef8143d20 0x7fcef81f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fceeffff640 1 -- 172.21.15.84:0/298614380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b47e0 msgr2=0x7fcef8138560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:09.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fceeffff640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b47e0 0x7fcef8138560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:09.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fceeffff640 1 -- 172.21.15.84:0/298614380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009a70 con 0x7fcef80ce550 2023-12-12T09:20:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fceeffff640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef81f3720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcee000c460 tx=0x7fcee000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fcef4ff9640 1 -- 172.21.15.84:0/298614380 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0012830 con 0x7fcef80ce550 2023-12-12T09:20:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fcef4ff9640 1 -- 172.21.15.84:0/298614380 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee00129d0 con 0x7fcef80ce550 2023-12-12T09:20:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef81f2680 con 0x7fcef80ce550 2023-12-12T09:20:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fcef4ff9640 1 -- 172.21.15.84:0/298614380 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0012d80 con 0x7fcef80ce550 2023-12-12T09:20:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.827+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef81f2c40 con 0x7fcef80ce550 2023-12-12T09:20:09.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.829+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef80673c0 con 0x7fcef80ce550 2023-12-12T09:20:09.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.830+0000 7fcef4ff9640 1 -- 172.21.15.84:0/298614380 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcee001b400 con 0x7fcef80ce550 2023-12-12T09:20:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.831+0000 7fcef4ff9640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fced806ae40 0x7fced806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.831+0000 7fcef4ff9640 1 -- 172.21.15.84:0/298614380 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcee0089950 con 0x7fcef80ce550 2023-12-12T09:20:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.831+0000 7fcef77fe640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fced806ae40 0x7fced806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:09.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.831+0000 7fcef77fe640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fced806ae40 0x7fced806d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcee8005880 tx=0x7fcee8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:09.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:09.835+0000 7fcef4ff9640 1 -- 172.21.15.84:0/298614380 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcee0054680 con 0x7fcef80ce550 2023-12-12T09:20:10.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.021+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcef806e3b0 con 0x7fced806ae40 2023-12-12T09:20:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.046+0000 7fcef4ff9640 1 -- 172.21.15.84:0/298614380 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345082 (secure 0 0 0) 0x7fcef806e3b0 con 0x7fced806ae40 2023-12-12T09:20:10.052 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:10.054 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.052+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fced806ae40 msgr2=0x7fced806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.052+0000 7fcefde17640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fced806ae40 0x7fced806d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcee8005880 tx=0x7fcee8009040 comp rx=0 tx=0).stop 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.052+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 msgr2=0x7fcef81f3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.052+0000 7fcefde17640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef81f3720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcee000c460 tx=0x7fcee000c920 comp rx=0 tx=0).stop 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.053+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 shutdown_connections 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.053+0000 7fcefde17640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcef8143d20 0x7fcef81f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.053+0000 7fcefde17640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fced806ae40 0x7fced806d300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.053+0000 7fcefde17640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef80ce550 0x7fcef81f3720 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.053+0000 7fcefde17640 1 --2- 172.21.15.84:0/298614380 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcef80b47e0 0x7fcef8138560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.053+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 >> 172.21.15.84:0/298614380 conn(0x7fcef806c3d0 msgr2=0x7fcef80aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.053+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 shutdown_connections 2023-12-12T09:20:10.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.053+0000 7fcefde17640 1 -- 172.21.15.84:0/298614380 wait complete. 2023-12-12T09:20:10.075 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-12-12T09:20:09.082072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219544,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":3448832,"data_stored":2071226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004472"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951816+0000","last_change":"2023-12-12T09:19:41.122279+0000","last_active":"2023-12-12T09:19:47.951816+0000","last_peered":"2023-12-12T09:19:47.951816+0000","last_clean":"2023-12-12T09:19:47.951816+0000","last_became_active":"2023-12-12T09:19:41.122032+0000","last_became_peered":"2023-12-12T09:19:41.122032+0000","last_unstale":"2023-12-12T09:19:47.951816+0000","last_undegraded":"2023-12-12T09:19:47.951816+0000","last_fullsized":"2023-12-12T09:19:47.951816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957378+0000","last_change":"2023-12-12T09:19:41.863190+0000","last_active":"2023-12-12T09:19:47.957378+0000","last_peered":"2023-12-12T09:19:47.957378+0000","last_clean":"2023-12-12T09:19:47.957378+0000","last_became_active":"2023-12-12T09:19:41.862923+0000","last_became_peered":"2023-12-12T09:19:41.862923+0000","last_unstale":"2023-12-12T09:19:47.957378+0000","last_undegraded":"2023-12-12T09:19:47.957378+0000","last_fullsized":"2023-12-12T09:19:47.957378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:12.357618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127983+0000","last_change":"2023-12-12T09:19:46.953136+0000","last_active":"2023-12-12T09:19:48.127983+0000","last_peered":"2023-12-12T09:19:48.127983+0000","last_clean":"2023-12-12T09:19:48.127983+0000","last_became_active":"2023-12-12T09:19:46.951967+0000","last_became_peered":"2023-12-12T09:19:46.951967+0000","last_unstale":"2023-12-12T09:19:48.127983+0000","last_undegraded":"2023-12-12T09:19:48.127983+0000","last_fullsized":"2023-12-12T09:19:48.127983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:57:42.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957667+0000","last_change":"2023-12-12T09:19:41.121042+0000","last_active":"2023-12-12T09:19:47.957667+0000","last_peered":"2023-12-12T09:19:47.957667+0000","last_clean":"2023-12-12T09:19:47.957667+0000","last_became_active":"2023-12-12T09:19:41.120807+0000","last_became_peered":"2023-12-12T09:19:41.120807+0000","last_unstale":"2023-12-12T09:19:47.957667+0000","last_undegraded":"2023-12-12T09:19:47.957667+0000","last_fullsized":"2023-12-12T09:19:47.957667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:13:12.317036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951513+0000","last_change":"2023-12-12T09:19:41.878335+0000","last_active":"2023-12-12T09:19:47.951513+0000","last_peered":"2023-12-12T09:19:47.951513+0000","last_clean":"2023-12-12T09:19:47.951513+0000","last_became_active":"2023-12-12T09:19:41.878074+0000","last_became_peered":"2023-12-12T09:19:41.878074+0000","last_unstale":"2023-12-12T09:19:47.951513+0000","last_undegraded":"2023-12-12T09:19:47.951513+0000","last_fullsized":"2023-12-12T09:19:47.951513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130375+0000","last_change":"2023-12-12T09:19:46.188502+0000","last_active":"2023-12-12T09:19:48.130375+0000","last_peered":"2023-12-12T09:19:48.130375+0000","last_clean":"2023-12-12T09:19:48.130375+0000","last_became_active":"2023-12-12T09:19:46.187905+0000","last_became_peered":"2023-12-12T09:19:46.187905+0000","last_unstale":"2023-12-12T09:19:48.130375+0000","last_undegraded":"2023-12-12T09:19:48.130375+0000","last_fullsized":"2023-12-12T09:19:48.130375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:47:39.097135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303686+0000","last_change":"2023-12-12T09:19:41.138949+0000","last_active":"2023-12-12T09:19:47.303686+0000","last_peered":"2023-12-12T09:19:47.303686+0000","last_clean":"2023-12-12T09:19:47.303686+0000","last_became_active":"2023-12-12T09:19:41.138599+0000","last_became_peered":"2023-12-12T09:19:41.138599+0000","last_unstale":"2023-12-12T09:19:47.303686+0000","last_undegraded":"2023-12-12T09:19:47.303686+0000","last_fullsized":"2023-12-12T09:19:47.303686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127902+0000","last_change":"2023-12-12T09:19:41.871082+0000","last_active":"2023-12-12T09:19:47.127902+0000","last_peered":"2023-12-12T09:19:47.127902+0000","last_clean":"2023-12-12T09:19:47.127902+0000","last_became_active":"2023-12-12T09:19:41.870566+0000","last_became_peered":"2023-12-12T09:19:41.870566+0000","last_unstale":"2023-12-12T09:19:47.127902+0000","last_undegraded":"2023-12-12T09:19:47.127902+0000","last_fullsized":"2023-12-12T09:19:47.127902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:25.789938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131233+0000","last_change":"2023-12-12T09:19:46.189328+0000","last_active":"2023-12-12T09:19:48.131233+0000","last_peered":"2023-12-12T09:19:48.131233+0000","last_clean":"2023-12-12T09:19:48.131233+0000","last_became_active":"2023-12-12T09:19:46.187611+0000","last_became_peered":"2023-12-12T09:19:46.187611+0000","last_unstale":"2023-12-12T09:19:48.131233+0000","last_undegraded":"2023-12-12T09:19:48.131233+0000","last_fullsized":"2023-12-12T09:19:48.131233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303363+0000","last_change":"2023-12-12T09:19:41.137054+0000","last_active":"2023-12-12T09:19:47.303363+0000","last_peered":"2023-12-12T09:19:47.303363+0000","last_clean":"2023-12-12T09:19:47.303363+0000","last_became_active":"2023-12-12T09:19:41.136605+0000","last_became_peered":"2023-12-12T09:19:41.136605+0000","last_unstale":"2023-12-12T09:19:47.303363+0000","last_undegraded":"2023-12-12T09:19:47.303363+0000","last_fullsized":"2023-12-12T09:19:47.303363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127898+0000","last_change":"2023-12-12T09:19:41.874505+0000","last_active":"2023-12-12T09:19:47.127898+0000","last_peered":"2023-12-12T09:19:47.127898+0000","last_clean":"2023-12-12T09:19:47.127898+0000","last_became_active":"2023-12-12T09:19:41.867235+0000","last_became_peered":"2023-12-12T09:19:41.867235+0000","last_unstale":"2023-12-12T09:19:47.127898+0000","last_undegraded":"2023-12-12T09:19:47.127898+0000","last_fullsized":"2023-12-12T09:19:47.127898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:24.432590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130292+0000","last_change":"2023-12-12T09:19:46.181752+0000","last_active":"2023-12-12T09:19:48.130292+0000","last_peered":"2023-12-12T09:19:48.130292+0000","last_clean":"2023-12-12T09:19:48.130292+0000","last_became_active":"2023-12-12T09:19:46.181333+0000","last_became_peered":"2023-12-12T09:19:46.181333+0000","last_unstale":"2023-12-12T09:19:48.130292+0000","last_undegraded":"2023-12-12T09:19:48.130292+0000","last_fullsized":"2023-12-12T09:19:48.130292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:24.767108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019710+0000","last_change":"2023-12-12T09:19:41.875596+0000","last_active":"2023-12-12T09:19:48.019710+0000","last_peered":"2023-12-12T09:19:48.019710+0000","last_clean":"2023-12-12T09:19:48.019710+0000","last_became_active":"2023-12-12T09:19:41.874550+0000","last_became_peered":"2023-12-12T09:19:41.874550+0000","last_unstale":"2023-12-12T09:19:48.019710+0000","last_undegraded":"2023-12-12T09:19:48.019710+0000","last_fullsized":"2023-12-12T09:19:48.019710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303839+0000","last_change":"2023-12-12T09:19:41.134017+0000","last_active":"2023-12-12T09:19:47.303839+0000","last_peered":"2023-12-12T09:19:47.303839+0000","last_clean":"2023-12-12T09:19:47.303839+0000","last_became_active":"2023-12-12T09:19:41.133112+0000","last_became_peered":"2023-12-12T09:19:41.133112+0000","last_unstale":"2023-12-12T09:19:47.303839+0000","last_undegraded":"2023-12-12T09:19:47.303839+0000","last_fullsized":"2023-12-12T09:19:47.303839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:30.833996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132530+0000","last_change":"2023-12-12T09:19:46.183576+0000","last_active":"2023-12-12T09:19:48.132530+0000","last_peered":"2023-12-12T09:19:48.132530+0000","last_clean":"2023-12-12T09:19:48.132530+0000","last_became_active":"2023-12-12T09:19:46.182655+0000","last_became_peered":"2023-12-12T09:19:46.182655+0000","last_unstale":"2023-12-12T09:19:48.132530+0000","last_undegraded":"2023-12-12T09:19:48.132530+0000","last_fullsized":"2023-12-12T09:19:48.132530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:46.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956362+0000","last_change":"2023-12-12T09:19:41.862462+0000","last_active":"2023-12-12T09:19:47.956362+0000","last_peered":"2023-12-12T09:19:47.956362+0000","last_clean":"2023-12-12T09:19:47.956362+0000","last_became_active":"2023-12-12T09:19:41.860988+0000","last_became_peered":"2023-12-12T09:19:41.860988+0000","last_unstale":"2023-12-12T09:19:47.956362+0000","last_undegraded":"2023-12-12T09:19:47.956362+0000","last_fullsized":"2023-12-12T09:19:47.956362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:26.864874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444995+0000","last_change":"2023-12-12T09:19:41.124071+0000","last_active":"2023-12-12T09:19:47.444995+0000","last_peered":"2023-12-12T09:19:47.444995+0000","last_clean":"2023-12-12T09:19:47.444995+0000","last_became_active":"2023-12-12T09:19:41.123806+0000","last_became_peered":"2023-12-12T09:19:41.123806+0000","last_unstale":"2023-12-12T09:19:47.444995+0000","last_undegraded":"2023-12-12T09:19:47.444995+0000","last_fullsized":"2023-12-12T09:19:47.444995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131780+0000","last_change":"2023-12-12T09:19:46.188994+0000","last_active":"2023-12-12T09:19:48.131780+0000","last_peered":"2023-12-12T09:19:48.131780+0000","last_clean":"2023-12-12T09:19:48.131780+0000","last_became_active":"2023-12-12T09:19:46.188551+0000","last_became_peered":"2023-12-12T09:19:46.188551+0000","last_unstale":"2023-12-12T09:19:48.131780+0000","last_undegraded":"2023-12-12T09:19:48.131780+0000","last_fullsized":"2023-12-12T09:19:48.131780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956335+0000","last_change":"2023-12-12T09:19:41.857578+0000","last_active":"2023-12-12T09:19:47.956335+0000","last_peered":"2023-12-12T09:19:47.956335+0000","last_clean":"2023-12-12T09:19:47.956335+0000","last_became_active":"2023-12-12T09:19:41.857262+0000","last_became_peered":"2023-12-12T09:19:41.857262+0000","last_unstale":"2023-12-12T09:19:47.956335+0000","last_undegraded":"2023-12-12T09:19:47.956335+0000","last_fullsized":"2023-12-12T09:19:47.956335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:23:10.886043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444759+0000","last_change":"2023-12-12T09:19:41.124140+0000","last_active":"2023-12-12T09:19:47.444759+0000","last_peered":"2023-12-12T09:19:47.444759+0000","last_clean":"2023-12-12T09:19:47.444759+0000","last_became_active":"2023-12-12T09:19:41.123866+0000","last_became_peered":"2023-12-12T09:19:41.123866+0000","last_unstale":"2023-12-12T09:19:47.444759+0000","last_undegraded":"2023-12-12T09:19:47.444759+0000","last_fullsized":"2023-12-12T09:19:47.444759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:30.833996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169980+0000","last_change":"2023-12-12T09:19:46.944967+0000","last_active":"2023-12-12T09:19:48.169980+0000","last_peered":"2023-12-12T09:19:48.169980+0000","last_clean":"2023-12-12T09:19:48.169980+0000","last_became_active":"2023-12-12T09:19:46.942177+0000","last_became_peered":"2023-12-12T09:19:46.942177+0000","last_unstale":"2023-12-12T09:19:48.169980+0000","last_undegraded":"2023-12-12T09:19:48.169980+0000","last_fullsized":"2023-12-12T09:19:48.169980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129676+0000","last_change":"2023-12-12T09:19:41.861866+0000","last_active":"2023-12-12T09:19:47.129676+0000","last_peered":"2023-12-12T09:19:47.129676+0000","last_clean":"2023-12-12T09:19:47.129676+0000","last_became_active":"2023-12-12T09:19:41.861471+0000","last_became_peered":"2023-12-12T09:19:41.861471+0000","last_unstale":"2023-12-12T09:19:47.129676+0000","last_undegraded":"2023-12-12T09:19:47.129676+0000","last_fullsized":"2023-12-12T09:19:47.129676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:19.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302819+0000","last_change":"2023-12-12T09:19:41.132420+0000","last_active":"2023-12-12T09:19:47.302819+0000","last_peered":"2023-12-12T09:19:47.302819+0000","last_clean":"2023-12-12T09:19:47.302819+0000","last_became_active":"2023-12-12T09:19:41.130901+0000","last_became_peered":"2023-12-12T09:19:41.130901+0000","last_unstale":"2023-12-12T09:19:47.302819+0000","last_undegraded":"2023-12-12T09:19:47.302819+0000","last_fullsized":"2023-12-12T09:19:47.302819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:38.516239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132323+0000","last_change":"2023-12-12T09:19:46.190546+0000","last_active":"2023-12-12T09:19:48.132323+0000","last_peered":"2023-12-12T09:19:48.132323+0000","last_clean":"2023-12-12T09:19:48.132323+0000","last_became_active":"2023-12-12T09:19:46.190080+0000","last_became_peered":"2023-12-12T09:19:46.190080+0000","last_unstale":"2023-12-12T09:19:48.132323+0000","last_undegraded":"2023-12-12T09:19:48.132323+0000","last_fullsized":"2023-12-12T09:19:48.132323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951268+0000","last_change":"2023-12-12T09:19:41.858094+0000","last_active":"2023-12-12T09:19:47.951268+0000","last_peered":"2023-12-12T09:19:47.951268+0000","last_clean":"2023-12-12T09:19:47.951268+0000","last_became_active":"2023-12-12T09:19:41.857826+0000","last_became_peered":"2023-12-12T09:19:41.857826+0000","last_unstale":"2023-12-12T09:19:47.951268+0000","last_undegraded":"2023-12-12T09:19:47.951268+0000","last_fullsized":"2023-12-12T09:19:47.951268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021166+0000","last_change":"2023-12-12T09:19:41.135301+0000","last_active":"2023-12-12T09:19:48.021166+0000","last_peered":"2023-12-12T09:19:48.021166+0000","last_clean":"2023-12-12T09:19:48.021166+0000","last_became_active":"2023-12-12T09:19:41.134467+0000","last_became_peered":"2023-12-12T09:19:41.134467+0000","last_unstale":"2023-12-12T09:19:48.021166+0000","last_undegraded":"2023-12-12T09:19:48.021166+0000","last_fullsized":"2023-12-12T09:19:48.021166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132355+0000","last_change":"2023-12-12T09:19:46.943689+0000","last_active":"2023-12-12T09:19:48.132355+0000","last_peered":"2023-12-12T09:19:48.132355+0000","last_clean":"2023-12-12T09:19:48.132355+0000","last_became_active":"2023-12-12T09:19:46.942093+0000","last_became_peered":"2023-12-12T09:19:46.942093+0000","last_unstale":"2023-12-12T09:19:48.132355+0000","last_undegraded":"2023-12-12T09:19:48.132355+0000","last_fullsized":"2023-12-12T09:19:48.132355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:00.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957608+0000","last_change":"2023-12-12T09:19:41.861945+0000","last_active":"2023-12-12T09:19:47.957608+0000","last_peered":"2023-12-12T09:19:47.957608+0000","last_clean":"2023-12-12T09:19:47.957608+0000","last_became_active":"2023-12-12T09:19:41.861570+0000","last_became_peered":"2023-12-12T09:19:41.861570+0000","last_unstale":"2023-12-12T09:19:47.957608+0000","last_undegraded":"2023-12-12T09:19:47.957608+0000","last_fullsized":"2023-12-12T09:19:47.957608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:49.539855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445666+0000","last_change":"2023-12-12T09:19:41.131818+0000","last_active":"2023-12-12T09:19:47.445666+0000","last_peered":"2023-12-12T09:19:47.445666+0000","last_clean":"2023-12-12T09:19:47.445666+0000","last_became_active":"2023-12-12T09:19:41.131557+0000","last_became_peered":"2023-12-12T09:19:41.131557+0000","last_unstale":"2023-12-12T09:19:47.445666+0000","last_undegraded":"2023-12-12T09:19:47.445666+0000","last_fullsized":"2023-12-12T09:19:47.445666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:18.435713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127909+0000","last_change":"2023-12-12T09:19:46.955434+0000","last_active":"2023-12-12T09:19:48.127909+0000","last_peered":"2023-12-12T09:19:48.127909+0000","last_clean":"2023-12-12T09:19:48.127909+0000","last_became_active":"2023-12-12T09:19:46.949579+0000","last_became_peered":"2023-12-12T09:19:46.949579+0000","last_unstale":"2023-12-12T09:19:48.127909+0000","last_undegraded":"2023-12-12T09:19:48.127909+0000","last_fullsized":"2023-12-12T09:19:48.127909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:30:22.426722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445297+0000","last_change":"2023-12-12T09:19:41.864811+0000","last_active":"2023-12-12T09:19:47.445297+0000","last_peered":"2023-12-12T09:19:47.445297+0000","last_clean":"2023-12-12T09:19:47.445297+0000","last_became_active":"2023-12-12T09:19:41.863476+0000","last_became_peered":"2023-12-12T09:19:41.863476+0000","last_unstale":"2023-12-12T09:19:47.445297+0000","last_undegraded":"2023-12-12T09:19:47.445297+0000","last_fullsized":"2023-12-12T09:19:47.445297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303909+0000","last_change":"2023-12-12T09:19:41.134083+0000","last_active":"2023-12-12T09:19:47.303909+0000","last_peered":"2023-12-12T09:19:47.303909+0000","last_clean":"2023-12-12T09:19:47.303909+0000","last_became_active":"2023-12-12T09:19:41.133702+0000","last_became_peered":"2023-12-12T09:19:41.133702+0000","last_unstale":"2023-12-12T09:19:47.303909+0000","last_undegraded":"2023-12-12T09:19:47.303909+0000","last_fullsized":"2023-12-12T09:19:47.303909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:55.931283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170416+0000","last_change":"2023-12-12T09:19:46.943046+0000","last_active":"2023-12-12T09:19:48.170416+0000","last_peered":"2023-12-12T09:19:48.170416+0000","last_clean":"2023-12-12T09:19:48.170416+0000","last_became_active":"2023-12-12T09:19:46.941680+0000","last_became_peered":"2023-12-12T09:19:46.941680+0000","last_unstale":"2023-12-12T09:19:48.170416+0000","last_undegraded":"2023-12-12T09:19:48.170416+0000","last_fullsized":"2023-12-12T09:19:48.170416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128054+0000","last_change":"2023-12-12T09:19:41.865106+0000","last_active":"2023-12-12T09:19:47.128054+0000","last_peered":"2023-12-12T09:19:47.128054+0000","last_clean":"2023-12-12T09:19:47.128054+0000","last_became_active":"2023-12-12T09:19:41.864807+0000","last_became_peered":"2023-12-12T09:19:41.864807+0000","last_unstale":"2023-12-12T09:19:47.128054+0000","last_undegraded":"2023-12-12T09:19:47.128054+0000","last_fullsized":"2023-12-12T09:19:47.128054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:32.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445367+0000","last_change":"2023-12-12T09:19:41.116293+0000","last_active":"2023-12-12T09:19:47.445367+0000","last_peered":"2023-12-12T09:19:47.445367+0000","last_clean":"2023-12-12T09:19:47.445367+0000","last_became_active":"2023-12-12T09:19:41.115995+0000","last_became_peered":"2023-12-12T09:19:41.115995+0000","last_unstale":"2023-12-12T09:19:47.445367+0000","last_undegraded":"2023-12-12T09:19:47.445367+0000","last_fullsized":"2023-12-12T09:19:47.445367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:02.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.168829+0000","last_change":"2023-12-12T09:19:46.184450+0000","last_active":"2023-12-12T09:19:48.168829+0000","last_peered":"2023-12-12T09:19:48.168829+0000","last_clean":"2023-12-12T09:19:48.168829+0000","last_became_active":"2023-12-12T09:19:46.183856+0000","last_became_peered":"2023-12-12T09:19:46.183856+0000","last_unstale":"2023-12-12T09:19:48.168829+0000","last_undegraded":"2023-12-12T09:19:48.168829+0000","last_fullsized":"2023-12-12T09:19:48.168829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.131191+0000","last_change":"2023-12-12T09:19:41.859699+0000","last_active":"2023-12-12T09:19:47.131191+0000","last_peered":"2023-12-12T09:19:47.131191+0000","last_clean":"2023-12-12T09:19:47.131191+0000","last_became_active":"2023-12-12T09:19:41.859271+0000","last_became_peered":"2023-12-12T09:19:41.859271+0000","last_unstale":"2023-12-12T09:19:47.131191+0000","last_undegraded":"2023-12-12T09:19:47.131191+0000","last_fullsized":"2023-12-12T09:19:47.131191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:23:52.795227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128310+0000","last_change":"2023-12-12T09:19:41.127974+0000","last_active":"2023-12-12T09:19:47.128310+0000","last_peered":"2023-12-12T09:19:47.128310+0000","last_clean":"2023-12-12T09:19:47.128310+0000","last_became_active":"2023-12-12T09:19:41.127284+0000","last_became_peered":"2023-12-12T09:19:41.127284+0000","last_unstale":"2023-12-12T09:19:47.128310+0000","last_undegraded":"2023-12-12T09:19:47.128310+0000","last_fullsized":"2023-12-12T09:19:47.128310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:27.876703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169383+0000","last_change":"2023-12-12T09:19:46.187283+0000","last_active":"2023-12-12T09:19:48.169383+0000","last_peered":"2023-12-12T09:19:48.169383+0000","last_clean":"2023-12-12T09:19:48.169383+0000","last_became_active":"2023-12-12T09:19:46.184094+0000","last_became_peered":"2023-12-12T09:19:46.184094+0000","last_unstale":"2023-12-12T09:19:48.169383+0000","last_undegraded":"2023-12-12T09:19:48.169383+0000","last_fullsized":"2023-12-12T09:19:48.169383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444747+0000","last_change":"2023-12-12T09:19:41.860571+0000","last_active":"2023-12-12T09:19:47.444747+0000","last_peered":"2023-12-12T09:19:47.444747+0000","last_clean":"2023-12-12T09:19:47.444747+0000","last_became_active":"2023-12-12T09:19:41.860299+0000","last_became_peered":"2023-12-12T09:19:41.860299+0000","last_unstale":"2023-12-12T09:19:47.444747+0000","last_undegraded":"2023-12-12T09:19:47.444747+0000","last_fullsized":"2023-12-12T09:19:47.444747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126141+0000","last_change":"2023-12-12T09:19:41.117790+0000","last_active":"2023-12-12T09:19:47.126141+0000","last_peered":"2023-12-12T09:19:47.126141+0000","last_clean":"2023-12-12T09:19:47.126141+0000","last_became_active":"2023-12-12T09:19:41.117558+0000","last_became_peered":"2023-12-12T09:19:41.117558+0000","last_unstale":"2023-12-12T09:19:47.126141+0000","last_undegraded":"2023-12-12T09:19:47.126141+0000","last_fullsized":"2023-12-12T09:19:47.126141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:34:48.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170143+0000","last_change":"2023-12-12T09:19:46.182717+0000","last_active":"2023-12-12T09:19:48.170143+0000","last_peered":"2023-12-12T09:19:48.170143+0000","last_clean":"2023-12-12T09:19:48.170143+0000","last_became_active":"2023-12-12T09:19:46.179138+0000","last_became_peered":"2023-12-12T09:19:46.179138+0000","last_unstale":"2023-12-12T09:19:48.170143+0000","last_undegraded":"2023-12-12T09:19:48.170143+0000","last_fullsized":"2023-12-12T09:19:48.170143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950048+0000","last_change":"2023-12-12T09:19:41.850752+0000","last_active":"2023-12-12T09:19:47.950048+0000","last_peered":"2023-12-12T09:19:47.950048+0000","last_clean":"2023-12-12T09:19:47.950048+0000","last_became_active":"2023-12-12T09:19:41.849147+0000","last_became_peered":"2023-12-12T09:19:41.849147+0000","last_unstale":"2023-12-12T09:19:47.950048+0000","last_undegraded":"2023-12-12T09:19:47.950048+0000","last_fullsized":"2023-12-12T09:19:47.950048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:03.309104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302812+0000","last_change":"2023-12-12T09:19:41.134276+0000","last_active":"2023-12-12T09:19:47.302812+0000","last_peered":"2023-12-12T09:19:47.302812+0000","last_clean":"2023-12-12T09:19:47.302812+0000","last_became_active":"2023-12-12T09:19:41.133924+0000","last_became_peered":"2023-12-12T09:19:41.133924+0000","last_unstale":"2023-12-12T09:19:47.302812+0000","last_undegraded":"2023-12-12T09:19:47.302812+0000","last_fullsized":"2023-12-12T09:19:47.302812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171202+0000","last_change":"2023-12-12T09:19:46.947025+0000","last_active":"2023-12-12T09:19:48.171202+0000","last_peered":"2023-12-12T09:19:48.171202+0000","last_clean":"2023-12-12T09:19:48.171202+0000","last_became_active":"2023-12-12T09:19:46.945211+0000","last_became_peered":"2023-12-12T09:19:46.945211+0000","last_unstale":"2023-12-12T09:19:48.171202+0000","last_undegraded":"2023-12-12T09:19:48.171202+0000","last_fullsized":"2023-12-12T09:19:48.171202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.955803+0000","last_change":"2023-12-12T09:19:41.877643+0000","last_active":"2023-12-12T09:19:47.955803+0000","last_peered":"2023-12-12T09:19:47.955803+0000","last_clean":"2023-12-12T09:19:47.955803+0000","last_became_active":"2023-12-12T09:19:41.877316+0000","last_became_peered":"2023-12-12T09:19:41.877316+0000","last_unstale":"2023-12-12T09:19:47.955803+0000","last_undegraded":"2023-12-12T09:19:47.955803+0000","last_fullsized":"2023-12-12T09:19:47.955803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:14:08.288770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127400+0000","last_change":"2023-12-12T09:19:41.113788+0000","last_active":"2023-12-12T09:19:47.127400+0000","last_peered":"2023-12-12T09:19:47.127400+0000","last_clean":"2023-12-12T09:19:47.127400+0000","last_became_active":"2023-12-12T09:19:41.112577+0000","last_became_peered":"2023-12-12T09:19:41.112577+0000","last_unstale":"2023-12-12T09:19:47.127400+0000","last_undegraded":"2023-12-12T09:19:47.127400+0000","last_fullsized":"2023-12-12T09:19:47.127400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:42.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303078+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:19:47.303078+0000","last_peered":"2023-12-12T09:19:47.303078+0000","last_clean":"2023-12-12T09:19:47.303078+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:19:47.303078+0000","last_undegraded":"2023-12-12T09:19:47.303078+0000","last_fullsized":"2023-12-12T09:19:47.303078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.172709+0000","last_change":"2023-12-12T09:19:46.944981+0000","last_active":"2023-12-12T09:19:48.172709+0000","last_peered":"2023-12-12T09:19:48.172709+0000","last_clean":"2023-12-12T09:19:48.172709+0000","last_became_active":"2023-12-12T09:19:46.943825+0000","last_became_peered":"2023-12-12T09:19:46.943825+0000","last_unstale":"2023-12-12T09:19:48.172709+0000","last_undegraded":"2023-12-12T09:19:48.172709+0000","last_fullsized":"2023-12-12T09:19:48.172709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:33.622944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303399+0000","last_change":"2023-12-12T09:19:41.883110+0000","last_active":"2023-12-12T09:19:47.303399+0000","last_peered":"2023-12-12T09:19:47.303399+0000","last_clean":"2023-12-12T09:19:47.303399+0000","last_became_active":"2023-12-12T09:19:41.882836+0000","last_became_peered":"2023-12-12T09:19:41.882836+0000","last_unstale":"2023-12-12T09:19:47.303399+0000","last_undegraded":"2023-12-12T09:19:47.303399+0000","last_fullsized":"2023-12-12T09:19:47.303399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:53.429076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127491+0000","last_change":"2023-12-12T09:19:41.128783+0000","last_active":"2023-12-12T09:19:47.127491+0000","last_peered":"2023-12-12T09:19:47.127491+0000","last_clean":"2023-12-12T09:19:47.127491+0000","last_became_active":"2023-12-12T09:19:41.128390+0000","last_became_peered":"2023-12-12T09:19:41.128390+0000","last_unstale":"2023-12-12T09:19:47.127491+0000","last_undegraded":"2023-12-12T09:19:47.127491+0000","last_fullsized":"2023-12-12T09:19:47.127491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:38.516239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170902+0000","last_change":"2023-12-12T09:19:46.945892+0000","last_active":"2023-12-12T09:19:48.170902+0000","last_peered":"2023-12-12T09:19:48.170902+0000","last_clean":"2023-12-12T09:19:48.170902+0000","last_became_active":"2023-12-12T09:19:46.944874+0000","last_became_peered":"2023-12-12T09:19:46.944874+0000","last_unstale":"2023-12-12T09:19:48.170902+0000","last_undegraded":"2023-12-12T09:19:48.170902+0000","last_fullsized":"2023-12-12T09:19:48.170902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:36.314213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127967+0000","last_change":"2023-12-12T09:19:41.861777+0000","last_active":"2023-12-12T09:19:47.127967+0000","last_peered":"2023-12-12T09:19:47.127967+0000","last_clean":"2023-12-12T09:19:47.127967+0000","last_became_active":"2023-12-12T09:19:41.861449+0000","last_became_peered":"2023-12-12T09:19:41.861449+0000","last_unstale":"2023-12-12T09:19:47.127967+0000","last_undegraded":"2023-12-12T09:19:47.127967+0000","last_fullsized":"2023-12-12T09:19:47.127967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:29.573933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445429+0000","last_change":"2023-12-12T09:19:41.119895+0000","last_active":"2023-12-12T09:19:47.445429+0000","last_peered":"2023-12-12T09:19:47.445429+0000","last_clean":"2023-12-12T09:19:47.445429+0000","last_became_active":"2023-12-12T09:19:41.119579+0000","last_became_peered":"2023-12-12T09:19:41.119579+0000","last_unstale":"2023-12-12T09:19:47.445429+0000","last_undegraded":"2023-12-12T09:19:47.445429+0000","last_fullsized":"2023-12-12T09:19:47.445429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170457+0000","last_change":"2023-12-12T09:19:46.184299+0000","last_active":"2023-12-12T09:19:48.170457+0000","last_peered":"2023-12-12T09:19:48.170457+0000","last_clean":"2023-12-12T09:19:48.170457+0000","last_became_active":"2023-12-12T09:19:46.182654+0000","last_became_peered":"2023-12-12T09:19:46.182654+0000","last_unstale":"2023-12-12T09:19:48.170457+0000","last_undegraded":"2023-12-12T09:19:48.170457+0000","last_fullsized":"2023-12-12T09:19:48.170457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304529+0000","last_change":"2023-12-12T09:19:41.881513+0000","last_active":"2023-12-12T09:19:47.304529+0000","last_peered":"2023-12-12T09:19:47.304529+0000","last_clean":"2023-12-12T09:19:47.304529+0000","last_became_active":"2023-12-12T09:19:41.881128+0000","last_became_peered":"2023-12-12T09:19:41.881128+0000","last_unstale":"2023-12-12T09:19:47.304529+0000","last_undegraded":"2023-12-12T09:19:47.304529+0000","last_fullsized":"2023-12-12T09:19:47.304529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:47:35.048125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126858+0000","last_change":"2023-12-12T09:19:41.116076+0000","last_active":"2023-12-12T09:19:47.126858+0000","last_peered":"2023-12-12T09:19:47.126858+0000","last_clean":"2023-12-12T09:19:47.126858+0000","last_became_active":"2023-12-12T09:19:41.115133+0000","last_became_peered":"2023-12-12T09:19:41.115133+0000","last_unstale":"2023-12-12T09:19:47.126858+0000","last_undegraded":"2023-12-12T09:19:47.126858+0000","last_fullsized":"2023-12-12T09:19:47.126858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.129238+0000","last_change":"2023-12-12T09:19:46.944320+0000","last_active":"2023-12-12T09:19:48.129238+0000","last_peered":"2023-12-12T09:19:48.129238+0000","last_clean":"2023-12-12T09:19:48.129238+0000","last_became_active":"2023-12-12T09:19:46.941541+0000","last_became_peered":"2023-12-12T09:19:46.941541+0000","last_unstale":"2023-12-12T09:19:48.129238+0000","last_undegraded":"2023-12-12T09:19:48.129238+0000","last_fullsized":"2023-12-12T09:19:48.129238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304268+0000","last_change":"2023-12-12T09:19:41.877256+0000","last_active":"2023-12-12T09:19:47.304268+0000","last_peered":"2023-12-12T09:19:47.304268+0000","last_clean":"2023-12-12T09:19:47.304268+0000","last_became_active":"2023-12-12T09:19:41.875186+0000","last_became_peered":"2023-12-12T09:19:41.875186+0000","last_unstale":"2023-12-12T09:19:47.304268+0000","last_undegraded":"2023-12-12T09:19:47.304268+0000","last_fullsized":"2023-12-12T09:19:47.304268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:32.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.131383+0000","last_change":"2023-12-12T09:19:41.119283+0000","last_active":"2023-12-12T09:19:47.131383+0000","last_peered":"2023-12-12T09:19:47.131383+0000","last_clean":"2023-12-12T09:19:47.131383+0000","last_became_active":"2023-12-12T09:19:41.118924+0000","last_became_peered":"2023-12-12T09:19:41.118924+0000","last_unstale":"2023-12-12T09:19:47.131383+0000","last_undegraded":"2023-12-12T09:19:47.131383+0000","last_fullsized":"2023-12-12T09:19:47.131383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:34:48.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131732+0000","last_change":"2023-12-12T09:19:46.186473+0000","last_active":"2023-12-12T09:19:48.131732+0000","last_peered":"2023-12-12T09:19:48.131732+0000","last_clean":"2023-12-12T09:19:48.131732+0000","last_became_active":"2023-12-12T09:19:46.185905+0000","last_became_peered":"2023-12-12T09:19:46.185905+0000","last_unstale":"2023-12-12T09:19:48.131732+0000","last_undegraded":"2023-12-12T09:19:48.131732+0000","last_fullsized":"2023-12-12T09:19:48.131732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303587+0000","last_change":"2023-12-12T09:19:41.877853+0000","last_active":"2023-12-12T09:19:47.303587+0000","last_peered":"2023-12-12T09:19:47.303587+0000","last_clean":"2023-12-12T09:19:47.303587+0000","last_became_active":"2023-12-12T09:19:41.875044+0000","last_became_peered":"2023-12-12T09:19:41.875044+0000","last_unstale":"2023-12-12T09:19:47.303587+0000","last_undegraded":"2023-12-12T09:19:47.303587+0000","last_fullsized":"2023-12-12T09:19:47.303587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:14.546295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.125556+0000","last_change":"2023-12-12T09:19:41.120939+0000","last_active":"2023-12-12T09:19:47.125556+0000","last_peered":"2023-12-12T09:19:47.125556+0000","last_clean":"2023-12-12T09:19:47.125556+0000","last_became_active":"2023-12-12T09:19:41.120648+0000","last_became_peered":"2023-12-12T09:19:41.120648+0000","last_unstale":"2023-12-12T09:19:47.125556+0000","last_undegraded":"2023-12-12T09:19:47.125556+0000","last_fullsized":"2023-12-12T09:19:47.125556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:50:22.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171167+0000","last_change":"2023-12-12T09:19:46.189274+0000","last_active":"2023-12-12T09:19:48.171167+0000","last_peered":"2023-12-12T09:19:48.171167+0000","last_clean":"2023-12-12T09:19:48.171167+0000","last_became_active":"2023-12-12T09:19:46.188822+0000","last_became_peered":"2023-12-12T09:19:46.188822+0000","last_unstale":"2023-12-12T09:19:48.171167+0000","last_undegraded":"2023-12-12T09:19:48.171167+0000","last_fullsized":"2023-12-12T09:19:48.171167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019851+0000","last_change":"2023-12-12T09:19:41.864891+0000","last_active":"2023-12-12T09:19:48.019851+0000","last_peered":"2023-12-12T09:19:48.019851+0000","last_clean":"2023-12-12T09:19:48.019851+0000","last_became_active":"2023-12-12T09:19:41.864627+0000","last_became_peered":"2023-12-12T09:19:41.864627+0000","last_unstale":"2023-12-12T09:19:48.019851+0000","last_undegraded":"2023-12-12T09:19:48.019851+0000","last_fullsized":"2023-12-12T09:19:48.019851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020105+0000","last_change":"2023-12-12T09:19:41.133652+0000","last_active":"2023-12-12T09:19:48.020105+0000","last_peered":"2023-12-12T09:19:48.020105+0000","last_clean":"2023-12-12T09:19:48.020105+0000","last_became_active":"2023-12-12T09:19:41.133408+0000","last_became_peered":"2023-12-12T09:19:41.133408+0000","last_unstale":"2023-12-12T09:19:48.020105+0000","last_undegraded":"2023-12-12T09:19:48.020105+0000","last_fullsized":"2023-12-12T09:19:48.020105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:08.194468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128487+0000","last_change":"2023-12-12T09:19:46.948569+0000","last_active":"2023-12-12T09:19:48.128487+0000","last_peered":"2023-12-12T09:19:48.128487+0000","last_clean":"2023-12-12T09:19:48.128487+0000","last_became_active":"2023-12-12T09:19:46.947137+0000","last_became_peered":"2023-12-12T09:19:46.947137+0000","last_unstale":"2023-12-12T09:19:48.128487+0000","last_undegraded":"2023-12-12T09:19:48.128487+0000","last_fullsized":"2023-12-12T09:19:48.128487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:05:18.225548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303688+0000","last_change":"2023-12-12T09:19:41.877782+0000","last_active":"2023-12-12T09:19:47.303688+0000","last_peered":"2023-12-12T09:19:47.303688+0000","last_clean":"2023-12-12T09:19:47.303688+0000","last_became_active":"2023-12-12T09:19:41.877386+0000","last_became_peered":"2023-12-12T09:19:41.877386+0000","last_unstale":"2023-12-12T09:19:47.303688+0000","last_undegraded":"2023-12-12T09:19:47.303688+0000","last_fullsized":"2023-12-12T09:19:47.303688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:24.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128131+0000","last_change":"2023-12-12T09:19:41.132860+0000","last_active":"2023-12-12T09:19:47.128131+0000","last_peered":"2023-12-12T09:19:47.128131+0000","last_clean":"2023-12-12T09:19:47.128131+0000","last_became_active":"2023-12-12T09:19:41.132569+0000","last_became_peered":"2023-12-12T09:19:41.132569+0000","last_unstale":"2023-12-12T09:19:47.128131+0000","last_undegraded":"2023-12-12T09:19:47.128131+0000","last_fullsized":"2023-12-12T09:19:47.128131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:18.435713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128599+0000","last_change":"2023-12-12T09:19:46.950471+0000","last_active":"2023-12-12T09:19:48.128599+0000","last_peered":"2023-12-12T09:19:48.128599+0000","last_clean":"2023-12-12T09:19:48.128599+0000","last_became_active":"2023-12-12T09:19:46.949395+0000","last_became_peered":"2023-12-12T09:19:46.949395+0000","last_unstale":"2023-12-12T09:19:48.128599+0000","last_undegraded":"2023-12-12T09:19:48.128599+0000","last_fullsized":"2023-12-12T09:19:48.128599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:23:10.613536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950800+0000","last_change":"2023-12-12T09:19:41.869585+0000","last_active":"2023-12-12T09:19:47.950800+0000","last_peered":"2023-12-12T09:19:47.950800+0000","last_clean":"2023-12-12T09:19:47.950800+0000","last_became_active":"2023-12-12T09:19:41.869388+0000","last_became_peered":"2023-12-12T09:19:41.869388+0000","last_unstale":"2023-12-12T09:19:47.950800+0000","last_undegraded":"2023-12-12T09:19:47.950800+0000","last_fullsized":"2023-12-12T09:19:47.950800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951035+0000","last_change":"2023-12-12T09:19:41.123186+0000","last_active":"2023-12-12T09:19:47.951035+0000","last_peered":"2023-12-12T09:19:47.951035+0000","last_clean":"2023-12-12T09:19:47.951035+0000","last_became_active":"2023-12-12T09:19:41.122891+0000","last_became_peered":"2023-12-12T09:19:41.122891+0000","last_unstale":"2023-12-12T09:19:47.951035+0000","last_undegraded":"2023-12-12T09:19:47.951035+0000","last_fullsized":"2023-12-12T09:19:47.951035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:23:51.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130720+0000","last_change":"2023-12-12T09:19:46.943661+0000","last_active":"2023-12-12T09:19:48.130720+0000","last_peered":"2023-12-12T09:19:48.130720+0000","last_clean":"2023-12-12T09:19:48.130720+0000","last_became_active":"2023-12-12T09:19:46.942612+0000","last_became_peered":"2023-12-12T09:19:46.942612+0000","last_unstale":"2023-12-12T09:19:48.130720+0000","last_undegraded":"2023-12-12T09:19:48.130720+0000","last_fullsized":"2023-12-12T09:19:48.130720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:00.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303253+0000","last_change":"2023-12-12T09:19:41.879007+0000","last_active":"2023-12-12T09:19:47.303253+0000","last_peered":"2023-12-12T09:19:47.303253+0000","last_clean":"2023-12-12T09:19:47.303253+0000","last_became_active":"2023-12-12T09:19:41.878653+0000","last_became_peered":"2023-12-12T09:19:41.878653+0000","last_unstale":"2023-12-12T09:19:47.303253+0000","last_undegraded":"2023-12-12T09:19:47.303253+0000","last_fullsized":"2023-12-12T09:19:47.303253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:24.432590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:59.537079+0000","last_change":"2023-12-12T09:19:41.130448+0000","last_active":"2023-12-12T09:19:59.537079+0000","last_peered":"2023-12-12T09:19:59.537079+0000","last_clean":"2023-12-12T09:19:59.537079+0000","last_became_active":"2023-12-12T09:19:41.129913+0000","last_became_peered":"2023-12-12T09:19:41.129913+0000","last_unstale":"2023-12-12T09:19:59.537079+0000","last_undegraded":"2023-12-12T09:19:59.537079+0000","last_fullsized":"2023-12-12T09:19:59.537079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169031+0000","last_change":"2023-12-12T09:19:46.193832+0000","last_active":"2023-12-12T09:19:48.169031+0000","last_peered":"2023-12-12T09:19:48.169031+0000","last_clean":"2023-12-12T09:19:48.169031+0000","last_became_active":"2023-12-12T09:19:46.193427+0000","last_became_peered":"2023-12-12T09:19:46.193427+0000","last_unstale":"2023-12-12T09:19:48.169031+0000","last_undegraded":"2023-12-12T09:19:48.169031+0000","last_fullsized":"2023-12-12T09:19:48.169031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130880+0000","last_change":"2023-12-12T09:19:41.866473+0000","last_active":"2023-12-12T09:19:47.130880+0000","last_peered":"2023-12-12T09:19:47.130880+0000","last_clean":"2023-12-12T09:19:47.130880+0000","last_became_active":"2023-12-12T09:19:41.865426+0000","last_became_peered":"2023-12-12T09:19:41.865426+0000","last_unstale":"2023-12-12T09:19:47.130880+0000","last_undegraded":"2023-12-12T09:19:47.130880+0000","last_fullsized":"2023-12-12T09:19:47.130880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:32.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445355+0000","last_change":"2023-12-12T09:19:41.128579+0000","last_active":"2023-12-12T09:19:47.445355+0000","last_peered":"2023-12-12T09:19:47.445355+0000","last_clean":"2023-12-12T09:19:47.445355+0000","last_became_active":"2023-12-12T09:19:41.127500+0000","last_became_peered":"2023-12-12T09:19:41.127500+0000","last_unstale":"2023-12-12T09:19:47.445355+0000","last_undegraded":"2023-12-12T09:19:47.445355+0000","last_fullsized":"2023-12-12T09:19:47.445355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:08:51.795865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131533+0000","last_change":"2023-12-12T09:19:46.192023+0000","last_active":"2023-12-12T09:19:48.131533+0000","last_peered":"2023-12-12T09:19:48.131533+0000","last_clean":"2023-12-12T09:19:48.131533+0000","last_became_active":"2023-12-12T09:19:46.190736+0000","last_became_peered":"2023-12-12T09:19:46.190736+0000","last_unstale":"2023-12-12T09:19:48.131533+0000","last_undegraded":"2023-12-12T09:19:48.131533+0000","last_fullsized":"2023-12-12T09:19:48.131533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951755+0000","last_change":"2023-12-12T09:19:41.878135+0000","last_active":"2023-12-12T09:19:47.951755+0000","last_peered":"2023-12-12T09:19:47.951755+0000","last_clean":"2023-12-12T09:19:47.951755+0000","last_became_active":"2023-12-12T09:19:41.877619+0000","last_became_peered":"2023-12-12T09:19:41.877619+0000","last_unstale":"2023-12-12T09:19:47.951755+0000","last_undegraded":"2023-12-12T09:19:47.951755+0000","last_fullsized":"2023-12-12T09:19:47.951755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129007+0000","last_change":"2023-12-12T09:19:41.133535+0000","last_active":"2023-12-12T09:19:47.129007+0000","last_peered":"2023-12-12T09:19:47.129007+0000","last_clean":"2023-12-12T09:19:47.129007+0000","last_became_active":"2023-12-12T09:19:41.133248+0000","last_became_peered":"2023-12-12T09:19:41.133248+0000","last_unstale":"2023-12-12T09:19:47.129007+0000","last_undegraded":"2023-12-12T09:19:47.129007+0000","last_fullsized":"2023-12-12T09:19:47.129007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:35.003697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128002+0000","last_change":"2023-12-12T09:19:46.187952+0000","last_active":"2023-12-12T09:19:48.128002+0000","last_peered":"2023-12-12T09:19:48.128002+0000","last_clean":"2023-12-12T09:19:48.128002+0000","last_became_active":"2023-12-12T09:19:46.187441+0000","last_became_peered":"2023-12-12T09:19:46.187441+0000","last_unstale":"2023-12-12T09:19:48.128002+0000","last_undegraded":"2023-12-12T09:19:48.128002+0000","last_fullsized":"2023-12-12T09:19:48.128002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:46:54.723850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128820+0000","last_change":"2023-12-12T09:19:41.874029+0000","last_active":"2023-12-12T09:19:47.128820+0000","last_peered":"2023-12-12T09:19:47.128820+0000","last_clean":"2023-12-12T09:19:47.128820+0000","last_became_active":"2023-12-12T09:19:41.873678+0000","last_became_peered":"2023-12-12T09:19:41.873678+0000","last_unstale":"2023-12-12T09:19:47.128820+0000","last_undegraded":"2023-12-12T09:19:47.128820+0000","last_fullsized":"2023-12-12T09:19:47.128820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:53.429076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020897+0000","last_change":"2023-12-12T09:19:41.136636+0000","last_active":"2023-12-12T09:19:48.020897+0000","last_peered":"2023-12-12T09:19:48.020897+0000","last_clean":"2023-12-12T09:19:48.020897+0000","last_became_active":"2023-12-12T09:19:41.136314+0000","last_became_peered":"2023-12-12T09:19:41.136314+0000","last_unstale":"2023-12-12T09:19:48.020897+0000","last_undegraded":"2023-12-12T09:19:48.020897+0000","last_fullsized":"2023-12-12T09:19:48.020897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:35.268242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127896+0000","last_change":"2023-12-12T09:19:46.955741+0000","last_active":"2023-12-12T09:19:48.127896+0000","last_peered":"2023-12-12T09:19:48.127896+0000","last_clean":"2023-12-12T09:19:48.127896+0000","last_became_active":"2023-12-12T09:19:46.950425+0000","last_became_peered":"2023-12-12T09:19:46.950425+0000","last_unstale":"2023-12-12T09:19:48.127896+0000","last_undegraded":"2023-12-12T09:19:48.127896+0000","last_fullsized":"2023-12-12T09:19:48.127896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:56:11.700203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171062+0000","last_change":"2023-12-12T09:19:46.943384+0000","last_active":"2023-12-12T09:19:48.171062+0000","last_peered":"2023-12-12T09:19:48.171062+0000","last_clean":"2023-12-12T09:19:48.171062+0000","last_became_active":"2023-12-12T09:19:46.942319+0000","last_became_peered":"2023-12-12T09:19:46.942319+0000","last_unstale":"2023-12-12T09:19:48.171062+0000","last_undegraded":"2023-12-12T09:19:48.171062+0000","last_fullsized":"2023-12-12T09:19:48.171062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444647+0000","last_change":"2023-12-12T09:19:41.871355+0000","last_active":"2023-12-12T09:19:47.444647+0000","last_peered":"2023-12-12T09:19:47.444647+0000","last_clean":"2023-12-12T09:19:47.444647+0000","last_became_active":"2023-12-12T09:19:41.871096+0000","last_became_peered":"2023-12-12T09:19:41.871096+0000","last_unstale":"2023-12-12T09:19:47.444647+0000","last_undegraded":"2023-12-12T09:19:47.444647+0000","last_fullsized":"2023-12-12T09:19:47.444647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130761+0000","last_change":"2023-12-12T09:19:41.123288+0000","last_active":"2023-12-12T09:19:47.130761+0000","last_peered":"2023-12-12T09:19:47.130761+0000","last_clean":"2023-12-12T09:19:47.130761+0000","last_became_active":"2023-12-12T09:19:41.122752+0000","last_became_peered":"2023-12-12T09:19:41.122752+0000","last_unstale":"2023-12-12T09:19:47.130761+0000","last_undegraded":"2023-12-12T09:19:47.130761+0000","last_fullsized":"2023-12-12T09:19:47.130761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:55.931283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.173331+0000","last_change":"2023-12-12T09:19:46.195051+0000","last_active":"2023-12-12T09:19:48.173331+0000","last_peered":"2023-12-12T09:19:48.173331+0000","last_clean":"2023-12-12T09:19:48.173331+0000","last_became_active":"2023-12-12T09:19:46.194655+0000","last_became_peered":"2023-12-12T09:19:46.194655+0000","last_unstale":"2023-12-12T09:19:48.173331+0000","last_undegraded":"2023-12-12T09:19:48.173331+0000","last_fullsized":"2023-12-12T09:19:48.173331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:24.767108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956243+0000","last_change":"2023-12-12T09:19:41.861972+0000","last_active":"2023-12-12T09:19:47.956243+0000","last_peered":"2023-12-12T09:19:47.956243+0000","last_clean":"2023-12-12T09:19:47.956243+0000","last_became_active":"2023-12-12T09:19:41.861683+0000","last_became_peered":"2023-12-12T09:19:41.861683+0000","last_unstale":"2023-12-12T09:19:47.956243+0000","last_undegraded":"2023-12-12T09:19:47.956243+0000","last_fullsized":"2023-12-12T09:19:47.956243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:45:09.496901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956289+0000","last_change":"2023-12-12T09:19:41.130199+0000","last_active":"2023-12-12T09:19:47.956289+0000","last_peered":"2023-12-12T09:19:47.956289+0000","last_clean":"2023-12-12T09:19:47.956289+0000","last_became_active":"2023-12-12T09:19:41.129901+0000","last_became_peered":"2023-12-12T09:19:41.129901+0000","last_unstale":"2023-12-12T09:19:47.956289+0000","last_undegraded":"2023-12-12T09:19:47.956289+0000","last_fullsized":"2023-12-12T09:19:47.956289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:20:13.334305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020336+0000","last_change":"2023-12-12T09:19:41.135226+0000","last_active":"2023-12-12T09:19:48.020336+0000","last_peered":"2023-12-12T09:19:48.020336+0000","last_clean":"2023-12-12T09:19:48.020336+0000","last_became_active":"2023-12-12T09:19:41.134249+0000","last_became_peered":"2023-12-12T09:19:41.134249+0000","last_unstale":"2023-12-12T09:19:48.020336+0000","last_undegraded":"2023-12-12T09:19:48.020336+0000","last_fullsized":"2023-12-12T09:19:48.020336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:02.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951009+0000","last_change":"2023-12-12T09:19:41.853034+0000","last_active":"2023-12-12T09:19:47.951009+0000","last_peered":"2023-12-12T09:19:47.951009+0000","last_clean":"2023-12-12T09:19:47.951009+0000","last_became_active":"2023-12-12T09:19:41.852723+0000","last_became_peered":"2023-12-12T09:19:41.852723+0000","last_unstale":"2023-12-12T09:19:47.951009+0000","last_undegraded":"2023-12-12T09:19:47.951009+0000","last_fullsized":"2023-12-12T09:19:47.951009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.167998+0000","last_change":"2023-12-12T09:19:46.187764+0000","last_active":"2023-12-12T09:19:48.167998+0000","last_peered":"2023-12-12T09:19:48.167998+0000","last_clean":"2023-12-12T09:19:48.167998+0000","last_became_active":"2023-12-12T09:19:46.186203+0000","last_became_peered":"2023-12-12T09:19:46.186203+0000","last_unstale":"2023-12-12T09:19:48.167998+0000","last_undegraded":"2023-12-12T09:19:48.167998+0000","last_fullsized":"2023-12-12T09:19:48.167998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:23.753673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956499+0000","last_change":"2023-12-12T09:19:41.128685+0000","last_active":"2023-12-12T09:19:47.956499+0000","last_peered":"2023-12-12T09:19:47.956499+0000","last_clean":"2023-12-12T09:19:47.956499+0000","last_became_active":"2023-12-12T09:19:41.127743+0000","last_became_peered":"2023-12-12T09:19:41.127743+0000","last_unstale":"2023-12-12T09:19:47.956499+0000","last_undegraded":"2023-12-12T09:19:47.956499+0000","last_fullsized":"2023-12-12T09:19:47.956499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:32:47.519167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130033+0000","last_change":"2023-12-12T09:19:41.860010+0000","last_active":"2023-12-12T09:19:47.130033+0000","last_peered":"2023-12-12T09:19:47.130033+0000","last_clean":"2023-12-12T09:19:47.130033+0000","last_became_active":"2023-12-12T09:19:41.859472+0000","last_became_peered":"2023-12-12T09:19:41.859472+0000","last_unstale":"2023-12-12T09:19:47.130033+0000","last_undegraded":"2023-12-12T09:19:47.130033+0000","last_fullsized":"2023-12-12T09:19:47.130033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:36.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128477+0000","last_change":"2023-12-12T09:19:46.184369+0000","last_active":"2023-12-12T09:19:48.128477+0000","last_peered":"2023-12-12T09:19:48.128477+0000","last_clean":"2023-12-12T09:19:48.128477+0000","last_became_active":"2023-12-12T09:19:46.180831+0000","last_became_peered":"2023-12-12T09:19:46.180831+0000","last_unstale":"2023-12-12T09:19:48.128477+0000","last_undegraded":"2023-12-12T09:19:48.128477+0000","last_fullsized":"2023-12-12T09:19:48.128477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:44.706388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019602+0000","last_change":"2023-12-12T09:19:41.866259+0000","last_active":"2023-12-12T09:19:48.019602+0000","last_peered":"2023-12-12T09:19:48.019602+0000","last_clean":"2023-12-12T09:19:48.019602+0000","last_became_active":"2023-12-12T09:19:41.865940+0000","last_became_peered":"2023-12-12T09:19:41.865940+0000","last_unstale":"2023-12-12T09:19:48.019602+0000","last_undegraded":"2023-12-12T09:19:48.019602+0000","last_fullsized":"2023-12-12T09:19:48.019602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:19.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.125929+0000","last_change":"2023-12-12T09:19:41.867023+0000","last_active":"2023-12-12T09:19:47.125929+0000","last_peered":"2023-12-12T09:19:47.125929+0000","last_clean":"2023-12-12T09:19:47.125929+0000","last_became_active":"2023-12-12T09:19:41.866764+0000","last_became_peered":"2023-12-12T09:19:41.866764+0000","last_unstale":"2023-12-12T09:19:47.125929+0000","last_undegraded":"2023-12-12T09:19:47.125929+0000","last_fullsized":"2023-12-12T09:19:47.125929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:32.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127901+0000","last_change":"2023-12-12T09:19:41.867979+0000","last_active":"2023-12-12T09:19:47.127901+0000","last_peered":"2023-12-12T09:19:47.127901+0000","last_clean":"2023-12-12T09:19:47.127901+0000","last_became_active":"2023-12-12T09:19:41.867701+0000","last_became_peered":"2023-12-12T09:19:41.867701+0000","last_unstale":"2023-12-12T09:19:47.127901+0000","last_undegraded":"2023-12-12T09:19:47.127901+0000","last_fullsized":"2023-12-12T09:19:47.127901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:14.546295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950773+0000","last_change":"2023-12-12T09:19:41.866057+0000","last_active":"2023-12-12T09:19:47.950773+0000","last_peered":"2023-12-12T09:19:47.950773+0000","last_clean":"2023-12-12T09:19:47.950773+0000","last_became_active":"2023-12-12T09:19:41.865684+0000","last_became_peered":"2023-12-12T09:19:41.865684+0000","last_unstale":"2023-12-12T09:19:47.950773+0000","last_undegraded":"2023-12-12T09:19:47.950773+0000","last_fullsized":"2023-12-12T09:19:47.950773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:19.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956904+0000","last_change":"2023-12-12T09:19:41.870549+0000","last_active":"2023-12-12T09:19:47.956904+0000","last_peered":"2023-12-12T09:19:47.956904+0000","last_clean":"2023-12-12T09:19:47.956904+0000","last_became_active":"2023-12-12T09:19:41.870253+0000","last_became_peered":"2023-12-12T09:19:41.870253+0000","last_unstale":"2023-12-12T09:19:47.956904+0000","last_undegraded":"2023-12-12T09:19:47.956904+0000","last_fullsized":"2023-12-12T09:19:47.956904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:28:38.925176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445258+0000","last_change":"2023-12-12T09:19:41.868298+0000","last_active":"2023-12-12T09:19:47.445258+0000","last_peered":"2023-12-12T09:19:47.445258+0000","last_clean":"2023-12-12T09:19:47.445258+0000","last_became_active":"2023-12-12T09:19:41.866056+0000","last_became_peered":"2023-12-12T09:19:41.866056+0000","last_unstale":"2023-12-12T09:19:47.445258+0000","last_undegraded":"2023-12-12T09:19:47.445258+0000","last_fullsized":"2023-12-12T09:19:47.445258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021114+0000","last_change":"2023-12-12T09:19:41.870795+0000","last_active":"2023-12-12T09:19:48.021114+0000","last_peered":"2023-12-12T09:19:48.021114+0000","last_clean":"2023-12-12T09:19:48.021114+0000","last_became_active":"2023-12-12T09:19:41.869377+0000","last_became_peered":"2023-12-12T09:19:41.869377+0000","last_unstale":"2023-12-12T09:19:48.021114+0000","last_undegraded":"2023-12-12T09:19:48.021114+0000","last_fullsized":"2023-12-12T09:19:48.021114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957512+0000","last_change":"2023-12-12T09:19:41.871326+0000","last_active":"2023-12-12T09:19:47.957512+0000","last_peered":"2023-12-12T09:19:47.957512+0000","last_clean":"2023-12-12T09:19:47.957512+0000","last_became_active":"2023-12-12T09:19:41.870253+0000","last_became_peered":"2023-12-12T09:19:41.870253+0000","last_unstale":"2023-12-12T09:19:47.957512+0000","last_undegraded":"2023-12-12T09:19:47.957512+0000","last_fullsized":"2023-12-12T09:19:47.957512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:15:05.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130531+0000","last_change":"2023-12-12T09:19:41.866400+0000","last_active":"2023-12-12T09:19:47.130531+0000","last_peered":"2023-12-12T09:19:47.130531+0000","last_clean":"2023-12-12T09:19:47.130531+0000","last_became_active":"2023-12-12T09:19:41.866125+0000","last_became_peered":"2023-12-12T09:19:41.866125+0000","last_unstale":"2023-12-12T09:19:47.130531+0000","last_undegraded":"2023-12-12T09:19:47.130531+0000","last_fullsized":"2023-12-12T09:19:47.130531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956057+0000","last_change":"2023-12-12T09:19:41.871487+0000","last_active":"2023-12-12T09:19:47.956057+0000","last_peered":"2023-12-12T09:19:47.956057+0000","last_clean":"2023-12-12T09:19:47.956057+0000","last_became_active":"2023-12-12T09:19:41.871121+0000","last_became_peered":"2023-12-12T09:19:41.871121+0000","last_unstale":"2023-12-12T09:19:47.956057+0000","last_undegraded":"2023-12-12T09:19:47.956057+0000","last_fullsized":"2023-12-12T09:19:47.956057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:04.587709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127718+0000","last_change":"2023-12-12T09:19:41.877637+0000","last_active":"2023-12-12T09:19:47.127718+0000","last_peered":"2023-12-12T09:19:47.127718+0000","last_clean":"2023-12-12T09:19:47.127718+0000","last_became_active":"2023-12-12T09:19:41.877279+0000","last_became_peered":"2023-12-12T09:19:41.877279+0000","last_unstale":"2023-12-12T09:19:47.127718+0000","last_undegraded":"2023-12-12T09:19:47.127718+0000","last_fullsized":"2023-12-12T09:19:47.127718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:40.867544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950503+0000","last_change":"2023-12-12T09:19:41.858678+0000","last_active":"2023-12-12T09:19:47.950503+0000","last_peered":"2023-12-12T09:19:47.950503+0000","last_clean":"2023-12-12T09:19:47.950503+0000","last_became_active":"2023-12-12T09:19:41.858368+0000","last_became_peered":"2023-12-12T09:19:41.858368+0000","last_unstale":"2023-12-12T09:19:47.950503+0000","last_undegraded":"2023-12-12T09:19:47.950503+0000","last_fullsized":"2023-12-12T09:19:47.950503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:08:53.064814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020884+0000","last_change":"2023-12-12T09:19:41.874119+0000","last_active":"2023-12-12T09:19:48.020884+0000","last_peered":"2023-12-12T09:19:48.020884+0000","last_clean":"2023-12-12T09:19:48.020884+0000","last_became_active":"2023-12-12T09:19:41.873475+0000","last_became_peered":"2023-12-12T09:19:41.873475+0000","last_unstale":"2023-12-12T09:19:48.020884+0000","last_undegraded":"2023-12-12T09:19:48.020884+0000","last_fullsized":"2023-12-12T09:19:48.020884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303796+0000","last_change":"2023-12-12T09:19:41.880927+0000","last_active":"2023-12-12T09:19:47.303796+0000","last_peered":"2023-12-12T09:19:47.303796+0000","last_clean":"2023-12-12T09:19:47.303796+0000","last_became_active":"2023-12-12T09:19:41.880553+0000","last_became_peered":"2023-12-12T09:19:41.880553+0000","last_unstale":"2023-12-12T09:19:47.303796+0000","last_undegraded":"2023-12-12T09:19:47.303796+0000","last_fullsized":"2023-12-12T09:19:47.303796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:29.573933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126787+0000","last_change":"2023-12-12T09:19:41.865313+0000","last_active":"2023-12-12T09:19:47.126787+0000","last_peered":"2023-12-12T09:19:47.126787+0000","last_clean":"2023-12-12T09:19:47.126787+0000","last_became_active":"2023-12-12T09:19:41.864264+0000","last_became_peered":"2023-12-12T09:19:41.864264+0000","last_unstale":"2023-12-12T09:19:47.126787+0000","last_undegraded":"2023-12-12T09:19:47.126787+0000","last_fullsized":"2023-12-12T09:19:47.126787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:09.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129613+0000","last_change":"2023-12-12T09:19:41.873905+0000","last_active":"2023-12-12T09:19:47.129613+0000","last_peered":"2023-12-12T09:19:47.129613+0000","last_clean":"2023-12-12T09:19:47.129613+0000","last_became_active":"2023-12-12T09:19:41.873699+0000","last_became_peered":"2023-12-12T09:19:41.873699+0000","last_unstale":"2023-12-12T09:19:47.129613+0000","last_undegraded":"2023-12-12T09:19:47.129613+0000","last_fullsized":"2023-12-12T09:19:47.129613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:20.718098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130289+0000","last_change":"2023-12-12T09:19:41.869722+0000","last_active":"2023-12-12T09:19:47.130289+0000","last_peered":"2023-12-12T09:19:47.130289+0000","last_clean":"2023-12-12T09:19:47.130289+0000","last_became_active":"2023-12-12T09:19:41.867498+0000","last_became_peered":"2023-12-12T09:19:41.867498+0000","last_unstale":"2023-12-12T09:19:47.130289+0000","last_undegraded":"2023-12-12T09:19:47.130289+0000","last_fullsized":"2023-12-12T09:19:47.130289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:37.971340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444692+0000","last_change":"2023-12-12T09:19:41.866112+0000","last_active":"2023-12-12T09:19:47.444692+0000","last_peered":"2023-12-12T09:19:47.444692+0000","last_clean":"2023-12-12T09:19:47.444692+0000","last_became_active":"2023-12-12T09:19:41.865801+0000","last_became_peered":"2023-12-12T09:19:41.865801+0000","last_unstale":"2023-12-12T09:19:47.444692+0000","last_undegraded":"2023-12-12T09:19:47.444692+0000","last_fullsized":"2023-12-12T09:19:47.444692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950664+0000","last_change":"2023-12-12T09:19:41.856237+0000","last_active":"2023-12-12T09:19:47.950664+0000","last_peered":"2023-12-12T09:19:47.950664+0000","last_clean":"2023-12-12T09:19:47.950664+0000","last_became_active":"2023-12-12T09:19:41.854807+0000","last_became_peered":"2023-12-12T09:19:41.854807+0000","last_unstale":"2023-12-12T09:19:47.950664+0000","last_undegraded":"2023-12-12T09:19:47.950664+0000","last_fullsized":"2023-12-12T09:19:47.950664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956161+0000","last_change":"2023-12-12T09:19:41.864225+0000","last_active":"2023-12-12T09:19:47.956161+0000","last_peered":"2023-12-12T09:19:47.956161+0000","last_clean":"2023-12-12T09:19:47.956161+0000","last_became_active":"2023-12-12T09:19:41.863889+0000","last_became_peered":"2023-12-12T09:19:41.863889+0000","last_unstale":"2023-12-12T09:19:47.956161+0000","last_undegraded":"2023-12-12T09:19:47.956161+0000","last_fullsized":"2023-12-12T09:19:47.956161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:28.079653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130755+0000","last_change":"2023-12-12T09:19:41.864900+0000","last_active":"2023-12-12T09:19:47.130755+0000","last_peered":"2023-12-12T09:19:47.130755+0000","last_clean":"2023-12-12T09:19:47.130755+0000","last_became_active":"2023-12-12T09:19:41.864317+0000","last_became_peered":"2023-12-12T09:19:41.864317+0000","last_unstale":"2023-12-12T09:19:47.130755+0000","last_undegraded":"2023-12-12T09:19:47.130755+0000","last_fullsized":"2023-12-12T09:19:47.130755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:09.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020367+0000","last_change":"2023-12-12T09:19:41.878679+0000","last_active":"2023-12-12T09:19:48.020367+0000","last_peered":"2023-12-12T09:19:48.020367+0000","last_clean":"2023-12-12T09:19:48.020367+0000","last_became_active":"2023-12-12T09:19:41.878386+0000","last_became_peered":"2023-12-12T09:19:41.878386+0000","last_unstale":"2023-12-12T09:19:48.020367+0000","last_undegraded":"2023-12-12T09:19:48.020367+0000","last_fullsized":"2023-12-12T09:19:48.020367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021119+0000","last_change":"2023-12-12T09:19:41.876850+0000","last_active":"2023-12-12T09:19:48.021119+0000","last_peered":"2023-12-12T09:19:48.021119+0000","last_clean":"2023-12-12T09:19:48.021119+0000","last_became_active":"2023-12-12T09:19:41.876562+0000","last_became_peered":"2023-12-12T09:19:41.876562+0000","last_unstale":"2023-12-12T09:19:48.021119+0000","last_undegraded":"2023-12-12T09:19:48.021119+0000","last_fullsized":"2023-12-12T09:19:48.021119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304376+0000","last_change":"2023-12-12T09:19:41.883253+0000","last_active":"2023-12-12T09:19:47.304376+0000","last_peered":"2023-12-12T09:19:47.304376+0000","last_clean":"2023-12-12T09:19:47.304376+0000","last_became_active":"2023-12-12T09:19:41.882726+0000","last_became_peered":"2023-12-12T09:19:41.882726+0000","last_unstale":"2023-12-12T09:19:47.304376+0000","last_undegraded":"2023-12-12T09:19:47.304376+0000","last_fullsized":"2023-12-12T09:19:47.304376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:31.700244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.955946+0000","last_change":"2023-12-12T09:19:41.877684+0000","last_active":"2023-12-12T09:19:47.955946+0000","last_peered":"2023-12-12T09:19:47.955946+0000","last_clean":"2023-12-12T09:19:47.955946+0000","last_became_active":"2023-12-12T09:19:41.877339+0000","last_became_peered":"2023-12-12T09:19:41.877339+0000","last_unstale":"2023-12-12T09:19:47.955946+0000","last_undegraded":"2023-12-12T09:19:47.955946+0000","last_fullsized":"2023-12-12T09:19:47.955946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:03.365677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302878+0000","last_change":"2023-12-12T09:19:41.868128+0000","last_active":"2023-12-12T09:19:47.302878+0000","last_peered":"2023-12-12T09:19:47.302878+0000","last_clean":"2023-12-12T09:19:47.302878+0000","last_became_active":"2023-12-12T09:19:41.867856+0000","last_became_peered":"2023-12-12T09:19:41.867856+0000","last_unstale":"2023-12-12T09:19:47.302878+0000","last_undegraded":"2023-12-12T09:19:47.302878+0000","last_fullsized":"2023-12-12T09:19:47.302878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:37.971340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127464+0000","last_change":"2023-12-12T09:19:41.869966+0000","last_active":"2023-12-12T09:19:47.127464+0000","last_peered":"2023-12-12T09:19:47.127464+0000","last_clean":"2023-12-12T09:19:47.127464+0000","last_became_active":"2023-12-12T09:19:41.868229+0000","last_became_peered":"2023-12-12T09:19:41.868229+0000","last_unstale":"2023-12-12T09:19:47.127464+0000","last_undegraded":"2023-12-12T09:19:47.127464+0000","last_fullsized":"2023-12-12T09:19:47.127464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303428+0000","last_change":"2023-12-12T09:19:41.871972+0000","last_active":"2023-12-12T09:19:47.303428+0000","last_peered":"2023-12-12T09:19:47.303428+0000","last_clean":"2023-12-12T09:19:47.303428+0000","last_became_active":"2023-12-12T09:19:41.871670+0000","last_became_peered":"2023-12-12T09:19:41.871670+0000","last_unstale":"2023-12-12T09:19:47.303428+0000","last_undegraded":"2023-12-12T09:19:47.303428+0000","last_fullsized":"2023-12-12T09:19:47.303428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:25.789938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127735+0000","last_change":"2023-12-12T09:19:41.870884+0000","last_active":"2023-12-12T09:19:47.127735+0000","last_peered":"2023-12-12T09:19:47.127735+0000","last_clean":"2023-12-12T09:19:47.127735+0000","last_became_active":"2023-12-12T09:19:41.868918+0000","last_became_peered":"2023-12-12T09:19:41.868918+0000","last_unstale":"2023-12-12T09:19:47.127735+0000","last_undegraded":"2023-12-12T09:19:47.127735+0000","last_fullsized":"2023-12-12T09:19:47.127735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:24.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950799+0000","last_change":"2023-12-12T09:19:41.852563+0000","last_active":"2023-12-12T09:19:47.950799+0000","last_peered":"2023-12-12T09:19:47.950799+0000","last_clean":"2023-12-12T09:19:47.950799+0000","last_became_active":"2023-12-12T09:19:41.851419+0000","last_became_peered":"2023-12-12T09:19:41.851419+0000","last_unstale":"2023-12-12T09:19:47.950799+0000","last_undegraded":"2023-12-12T09:19:47.950799+0000","last_fullsized":"2023-12-12T09:19:47.950799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:10.837542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445576+0000","last_change":"2023-12-12T09:19:41.865052+0000","last_active":"2023-12-12T09:19:47.445576+0000","last_peered":"2023-12-12T09:19:47.445576+0000","last_clean":"2023-12-12T09:19:47.445576+0000","last_became_active":"2023-12-12T09:19:41.864707+0000","last_became_peered":"2023-12-12T09:19:41.864707+0000","last_unstale":"2023-12-12T09:19:47.445576+0000","last_undegraded":"2023-12-12T09:19:47.445576+0000","last_fullsized":"2023-12-12T09:19:47.445576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304266+0000","last_change":"2023-12-12T09:19:41.881336+0000","last_active":"2023-12-12T09:19:47.304266+0000","last_peered":"2023-12-12T09:19:47.304266+0000","last_clean":"2023-12-12T09:19:47.304266+0000","last_became_active":"2023-12-12T09:19:41.880783+0000","last_became_peered":"2023-12-12T09:19:41.880783+0000","last_unstale":"2023-12-12T09:19:47.304266+0000","last_undegraded":"2023-12-12T09:19:47.304266+0000","last_fullsized":"2023-12-12T09:19:47.304266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:20.718098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":701102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":110242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8089999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:20:10.080 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:20:10.080 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-12T09:20:10.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-12T09:20:10.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-12T09:20:10.081 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-12T09:20:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.329+0000 7f4ff8836640 1 Processor -- start 2023-12-12T09:20:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.329+0000 7f4ff8836640 1 -- start start 2023-12-12T09:20:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.330+0000 7f4ff8836640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4ff40b47e0 0x7f4ff4071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.330+0000 7f4ff8836640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40cea30 con 0x7f4ff4143d20 2023-12-12T09:20:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.330+0000 7f4ff8836640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40702b0 con 0x7f4ff40ce550 2023-12-12T09:20:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.330+0000 7f4ff8836640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff4070590 con 0x7f4ff40b47e0 2023-12-12T09:20:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.331+0000 7f4ff259c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4ff4143d20 0x7f4ff40b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50142/0 (socket says 172.21.15.84:50142) 2023-12-12T09:20:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.331+0000 7f4ff259c640 1 -- 172.21.15.84:0/1527506842 learned_addr learned my addr 172.21.15.84:0/1527506842 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.331+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52988340 0 0) 0x7f4ff40cea30 con 0x7f4ff4143d20 2023-12-12T09:20:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.331+0000 7f4febfff640 1 --2- 172.21.15.84:0/1527506842 >> v2:172.21.15.99:3300/0 conn(0x7f4ff40b47e0 0x7f4ff4071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.331+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe0003520 con 0x7f4ff4143d20 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.331+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1195927008 0 0) 0x7f4fe0003520 con 0x7f4ff4143d20 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 >> v2:172.21.15.99:3300/0 conn(0x7f4ff40b47e0 msgr2=0x7f4ff4071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 --2- 172.21.15.84:0/1527506842 >> v2:172.21.15.99:3300/0 conn(0x7f4ff40b47e0 0x7f4ff4071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 >> v1:172.21.15.99:6789/0 conn(0x7f4ff40ce550 legacy=0x7f4ff40715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4070870 con 0x7f4ff4143d20 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f4fe4001670 con 0x7f4ff4143d20 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 >> v1:172.21.15.84:6789/0 conn(0x7f4ff4143d20 legacy=0x7f4ff40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fe0003970 0x7f4fe0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4fe00047c0 0x7f4fe0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4fe000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4070590 con 0x7f4fe0005180 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe000c0b0 con 0x7f4fe0003970 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe000c270 con 0x7f4fe00047c0 2023-12-12T09:20:10.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff2d9d640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4fe000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4ff259c640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fe0003970 0x7f4fe0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.332+0000 7f4febfff640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4fe00047c0 0x7f4fe0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.333+0000 7f4ff2d9d640 1 -- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4fe00047c0 msgr2=0x7f4fe0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.333+0000 7f4ff2d9d640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4fe00047c0 0x7f4fe0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.333+0000 7f4ff2d9d640 1 -- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fe0003970 msgr2=0x7f4fe0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.333+0000 7f4ff2d9d640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fe0003970 0x7f4fe0003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.333+0000 7f4ff2d9d640 1 -- 172.21.15.84:0/1527506842 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe0003520 con 0x7f4fe0005180 2023-12-12T09:20:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.333+0000 7f4ff259c640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fe0003970 0x7f4fe0003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.334+0000 7f4ff2d9d640 1 -- 172.21.15.84:0/1527506842 reap_dead start 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.334+0000 7f4ff2d9d640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4fe000b980 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40ce960 tx=0x7f4fe00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210cb7328f6c714c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.334+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec006b50 con 0x7f4fe0005180 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.334+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec006cd0 con 0x7f4fe0005180 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.334+0000 7f4ff1d9b640 1 -- 172.21.15.84:0/1527506842 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec007260 con 0x7f4fe0005180 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.334+0000 7f4ff8836640 1 -- 172.21.15.84:0/1527506842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 msgr2=0x7f4fe000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.334+0000 7f4ff8836640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4fe000b980 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40ce960 tx=0x7f4fe00057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.335+0000 7f4ff8836640 1 -- 172.21.15.84:0/1527506842 shutdown_connections 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.335+0000 7f4ff8836640 1 --2- 172.21.15.84:0/1527506842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4fe000b980 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.335+0000 7f4ff8836640 1 -- 172.21.15.84:0/1527506842 >> 172.21.15.84:0/1527506842 conn(0x7f4ff406c3d0 msgr2=0x7f4ff406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.335+0000 7f4ff8836640 1 -- 172.21.15.84:0/1527506842 shutdown_connections 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.335+0000 7f4ff8836640 1 -- 172.21.15.84:0/1527506842 wait complete. 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.336+0000 7f4ff8836640 1 Processor -- start 2023-12-12T09:20:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.337+0000 7f4ff8836640 1 -- start start 2023-12-12T09:20:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.337+0000 7f4ff8836640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4ff415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff8836640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ff41f3ff0 0x7f4ff41379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff8836640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ff41f4470 0x7f4ff40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff8836640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff413a510 con 0x7f4fe0005180 2023-12-12T09:20:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff8836640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff415ac70 con 0x7f4ff41f4470 2023-12-12T09:20:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff8836640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4139bb0 con 0x7f4ff41f3ff0 2023-12-12T09:20:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4ff415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4ff415a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34318/0 (socket says 172.21.15.84:34318) 2023-12-12T09:20:10.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 -- 172.21.15.84:0/3611334188 learned_addr learned my addr 172.21.15.84:0/3611334188 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:10.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4febfff640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ff41f3ff0 0x7f4ff41379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 -- 172.21.15.84:0/3611334188 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ff41f3ff0 msgr2=0x7f4ff41379b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ff41f3ff0 0x7f4ff41379b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 -- 172.21.15.84:0/3611334188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ff41f4470 msgr2=0x7f4ff40ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ff41f4470 0x7f4ff40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 -- 172.21.15.84:0/3611334188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4139e50 con 0x7f4fe0005180 2023-12-12T09:20:10.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.338+0000 7f4ff259c640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4ff415a730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400e7d0 tx=0x7f4fe400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:10.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.339+0000 7f4feaffd640 1 -- 172.21.15.84:0/3611334188 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400eee0 con 0x7f4fe0005180 2023-12-12T09:20:10.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.339+0000 7f4feaffd640 1 -- 172.21.15.84:0/3611334188 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe400c870 con 0x7f4fe0005180 2023-12-12T09:20:10.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.339+0000 7f4feaffd640 1 -- 172.21.15.84:0/3611334188 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400cbe0 con 0x7f4fe0005180 2023-12-12T09:20:10.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.339+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff413a130 con 0x7f4fe0005180 2023-12-12T09:20:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.339+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff41f3c60 con 0x7f4fe0005180 2023-12-12T09:20:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.340+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff413a650 con 0x7f4fe0005180 2023-12-12T09:20:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.341+0000 7f4feaffd640 1 -- 172.21.15.84:0/3611334188 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4fe400cd40 con 0x7f4fe0005180 2023-12-12T09:20:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.342+0000 7f4feaffd640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4fd406ae40 0x7f4fd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.342+0000 7f4feaffd640 1 -- 172.21.15.84:0/3611334188 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4fe4089830 con 0x7f4fe0005180 2023-12-12T09:20:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.342+0000 7f4febfff640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4fd406ae40 0x7f4fd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.343+0000 7f4febfff640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4fd406ae40 0x7f4fd406d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4137950 tx=0x7f4fdc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.346+0000 7f4feaffd640 1 -- 172.21.15.84:0/3611334188 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ff413a650 con 0x7f4fe0005180 2023-12-12T09:20:10.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.589+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4ff413a650 con 0x7f4fe0005180 2023-12-12T09:20:10.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.598+0000 7f4feaffd640 1 -- 172.21.15.84:0/3611334188 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171031 (secure 0 0 0) 0x7f4ff413a650 con 0x7f4fe0005180 2023-12-12T09:20:10.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:10.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4fd406ae40 msgr2=0x7f4fd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4fd406ae40 0x7f4fd406d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4137950 tx=0x7f4fdc008040 comp rx=0 tx=0).stop 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 msgr2=0x7f4ff415a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4ff415a730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400e7d0 tx=0x7f4fe400ec90 comp rx=0 tx=0).stop 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 shutdown_connections 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ff41f4470 0x7f4ff40ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ff41f3ff0 0x7f4ff41379b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4fd406ae40 0x7f4fd406d300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 --2- 172.21.15.84:0/3611334188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fe0005180 0x7f4ff415a730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 >> 172.21.15.84:0/3611334188 conn(0x7f4ff406c3d0 msgr2=0x7f4ff406d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 shutdown_connections 2023-12-12T09:20:10.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.602+0000 7f4ff8836640 1 -- 172.21.15.84:0/3611334188 wait complete. 2023-12-12T09:20:10.622 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":2629859879},{"type":"v1","addr":"172.21.15.84:6833","nonce":2629859879}]},"active_addr":"172.21.15.84:6833/2629859879","active_change":"2023-12-12T09:19:27.052066+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":4039384057}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":423701822}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2416822684}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2040094541}]}]} 2023-12-12T09:20:10.625 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-12T09:20:10.625 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-12T09:20:10.625 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:10.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.841+0000 7f5937ada640 1 Processor -- start 2023-12-12T09:20:10.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.841+0000 7f5937ada640 1 -- start start 2023-12-12T09:20:10.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5937ada640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f59300ce550 0x7f5930071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5937ada640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300cea30 con 0x7f5930143d20 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5937ada640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59300702b0 con 0x7f59300b47e0 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5937ada640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5930070590 con 0x7f59300ce550 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5935876640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5930143d20 0x7f59300b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50154/0 (socket says 172.21.15.84:50154) 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5935876640 1 -- 172.21.15.84:0/2042481236 learned_addr learned my addr 172.21.15.84:0/2042481236 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5936077640 1 --2- 172.21.15.84:0/2042481236 >> v2:172.21.15.84:3300/0 conn(0x7f59300ce550 0x7f5930071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5936077640 1 -- 172.21.15.84:0/2042481236 >> v1:172.21.15.99:6789/0 conn(0x7f59300b47e0 legacy=0x7f5930071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5936077640 1 -- 172.21.15.84:0/2042481236 >> v1:172.21.15.84:6789/0 conn(0x7f5930143d20 legacy=0x7f59300b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5936077640 1 -- 172.21.15.84:0/2042481236 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930070870 con 0x7f59300ce550 2023-12-12T09:20:10.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.843+0000 7f5934874640 1 -- 172.21.15.84:0/2042481236 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581188348 0 0) 0x7f59300cea30 con 0x7f5930143d20 2023-12-12T09:20:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.844+0000 7f5936077640 1 --2- 172.21.15.84:0/2042481236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f5930071780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5928009d90 tx=0x7f592802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e443f305c103cc5e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.845+0000 7f5934874640 1 -- 172.21.15.84:0/2042481236 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592802cc60 con 0x7f59300ce550 2023-12-12T09:20:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.845+0000 7f5934874640 1 -- 172.21.15.84:0/2042481236 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592802cdc0 con 0x7f59300ce550 2023-12-12T09:20:10.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.845+0000 7f5934874640 1 -- 172.21.15.84:0/2042481236 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928034660 con 0x7f59300ce550 2023-12-12T09:20:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.845+0000 7f5937ada640 1 -- 172.21.15.84:0/2042481236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 msgr2=0x7f5930071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.845+0000 7f5937ada640 1 --2- 172.21.15.84:0/2042481236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f5930071780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5928009d90 tx=0x7f592802beb0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.845+0000 7f5937ada640 1 -- 172.21.15.84:0/2042481236 shutdown_connections 2023-12-12T09:20:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.845+0000 7f5937ada640 1 --2- 172.21.15.84:0/2042481236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f5930071780 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.845+0000 7f5937ada640 1 -- 172.21.15.84:0/2042481236 >> 172.21.15.84:0/2042481236 conn(0x7f593006c3d0 msgr2=0x7f593006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.846+0000 7f5937ada640 1 -- 172.21.15.84:0/2042481236 shutdown_connections 2023-12-12T09:20:10.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.846+0000 7f5937ada640 1 -- 172.21.15.84:0/2042481236 wait complete. 2023-12-12T09:20:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.847+0000 7f5937ada640 1 Processor -- start 2023-12-12T09:20:10.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.848+0000 7f5937ada640 1 -- start start 2023-12-12T09:20:10.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.848+0000 7f5937ada640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f59300b47e0 0x7f593015a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.848+0000 7f5937ada640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f593015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5937ada640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5930143d20 0x7f593015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5937ada640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301e6580 con 0x7f59300ce550 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5937ada640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301389b0 con 0x7f5930143d20 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5937ada640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593015ad80 con 0x7f59300b47e0 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935075640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f593015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935075640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f593015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34338/0 (socket says 172.21.15.84:34338) 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935075640 1 -- 172.21.15.84:0/1805050570 learned_addr learned my addr 172.21.15.84:0/1805050570 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935876640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f59300b47e0 0x7f593015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935075640 1 -- 172.21.15.84:0/1805050570 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f59300b47e0 msgr2=0x7f593015a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935075640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f59300b47e0 0x7f593015a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5936077640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5930143d20 0x7f593015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935075640 1 -- 172.21.15.84:0/1805050570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5930143d20 msgr2=0x7f593015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935075640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5930143d20 0x7f593015ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.849+0000 7f5935075640 1 -- 172.21.15.84:0/1805050570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009a70 con 0x7f59300ce550 2023-12-12T09:20:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.850+0000 7f5935075640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f593015b550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f592000c430 tx=0x7f592000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:10.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.850+0000 7f59267fc640 1 -- 172.21.15.84:0/1805050570 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011790 con 0x7f59300ce550 2023-12-12T09:20:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.850+0000 7f59267fc640 1 -- 172.21.15.84:0/1805050570 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59200118f0 con 0x7f59300ce550 2023-12-12T09:20:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.850+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59301e62a0 con 0x7f59300ce550 2023-12-12T09:20:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.850+0000 7f59267fc640 1 -- 172.21.15.84:0/1805050570 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011ce0 con 0x7f59300ce550 2023-12-12T09:20:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.850+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5930138f30 con 0x7f59300ce550 2023-12-12T09:20:10.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.851+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593015fa00 con 0x7f59300ce550 2023-12-12T09:20:10.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.853+0000 7f59267fc640 1 -- 172.21.15.84:0/1805050570 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f592001c460 con 0x7f59300ce550 2023-12-12T09:20:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.853+0000 7f59267fc640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f591406ae40 0x7f591406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.854+0000 7f59267fc640 1 -- 172.21.15.84:0/1805050570 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5920089850 con 0x7f59300ce550 2023-12-12T09:20:10.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.854+0000 7f5935876640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f591406ae40 0x7f591406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:10.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.855+0000 7f5935876640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f591406ae40 0x7f591406d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f592c000f60 tx=0x7f592c007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:10.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:10.858+0000 7f59267fc640 1 -- 172.21.15.84:0/1805050570 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5920054610 con 0x7f59300ce550 2023-12-12T09:20:11.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.054+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59300673c0 con 0x7f59300ce550 2023-12-12T09:20:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.057+0000 7f59267fc640 1 -- 172.21.15.84:0/1805050570 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f5920057c30 con 0x7f59300ce550 2023-12-12T09:20:11.059 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:11.059 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f591406ae40 msgr2=0x7f591406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f591406ae40 0x7f591406d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f592c000f60 tx=0x7f592c007c00 comp rx=0 tx=0).stop 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 msgr2=0x7f593015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f593015b550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f592000c430 tx=0x7f592000c8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 shutdown_connections 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5930143d20 0x7f593015ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f591406ae40 0x7f591406d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59300ce550 0x7f593015b550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 --2- 172.21.15.84:0/1805050570 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f59300b47e0 0x7f593015a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 >> 172.21.15.84:0/1805050570 conn(0x7f593006c3d0 msgr2=0x7f59300afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 shutdown_connections 2023-12-12T09:20:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.060+0000 7f5937ada640 1 -- 172.21.15.84:0/1805050570 wait complete. 2023-12-12T09:20:11.082 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-12T09:20:11.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:11.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.287+0000 7fc4ed831640 1 Processor -- start 2023-12-12T09:20:11.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.287+0000 7fc4ed831640 1 -- start start 2023-12-12T09:20:11.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.289+0000 7fc4ed831640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc4e813ff90 0x7fc4e8142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.289+0000 7fc4ed831640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e815e0b0 0x7fc4e8142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.289+0000 7fc4ed831640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e80b3b60 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.289+0000 7fc4ed831640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e815e6d0 con 0x7fc4e813ff90 2023-12-12T09:20:11.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.289+0000 7fc4ed831640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e80b3de0 con 0x7fc4e815e0b0 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.289+0000 7fc4de7fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc4e80b4ba0 0x7fc4e815d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50158/0 (socket says 172.21.15.84:50158) 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.289+0000 7fc4de7fc640 1 -- 172.21.15.84:0/2031673769 learned_addr learned my addr 172.21.15.84:0/2031673769 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e77fe640 1 --2- 172.21.15.84:0/2031673769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e815e0b0 0x7fc4e8142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e6ffd640 1 --2- 172.21.15.84:0/2031673769 >> v2:172.21.15.99:3300/0 conn(0x7fc4e813ff90 0x7fc4e8142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e67fc640 1 -- 172.21.15.84:0/2031673769 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859017904 0 0) 0x7fc4e80b3b60 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e67fc640 1 -- 172.21.15.84:0/2031673769 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4d4003520 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e67fc640 1 -- 172.21.15.84:0/2031673769 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309952660 0 0) 0x7fc4d4003520 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e77fe640 1 -- 172.21.15.84:0/2031673769 >> v2:172.21.15.99:3300/0 conn(0x7fc4e813ff90 msgr2=0x7fc4e8142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e77fe640 1 --2- 172.21.15.84:0/2031673769 >> v2:172.21.15.99:3300/0 conn(0x7fc4e813ff90 0x7fc4e8142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e77fe640 1 -- 172.21.15.84:0/2031673769 >> v1:172.21.15.84:6789/0 conn(0x7fc4e80b4ba0 legacy=0x7fc4e815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.290+0000 7fc4e77fe640 1 -- 172.21.15.84:0/2031673769 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e80b40c0 con 0x7fc4e815e0b0 2023-12-12T09:20:11.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.292+0000 7fc4e77fe640 1 --2- 172.21.15.84:0/2031673769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e815e0b0 0x7fc4e8142d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009d90 tx=0x7fc4e002bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=522008daa1cbb97f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4e67fc640 1 -- 172.21.15.84:0/2031673769 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0001670 con 0x7fc4e815e0b0 2023-12-12T09:20:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4e67fc640 1 -- 172.21.15.84:0/2031673769 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e002c8a0 con 0x7fc4e815e0b0 2023-12-12T09:20:11.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4e67fc640 1 -- 172.21.15.84:0/2031673769 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e002cc10 con 0x7fc4e815e0b0 2023-12-12T09:20:11.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4ed831640 1 -- 172.21.15.84:0/2031673769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e815e0b0 msgr2=0x7fc4e8142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2031673769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e815e0b0 0x7fc4e8142d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009d90 tx=0x7fc4e002bd70 comp rx=0 tx=0).stop 2023-12-12T09:20:11.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4ed831640 1 -- 172.21.15.84:0/2031673769 shutdown_connections 2023-12-12T09:20:11.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2031673769 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e815e0b0 0x7fc4e8142d70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2031673769 >> v2:172.21.15.99:3300/0 conn(0x7fc4e813ff90 0x7fc4e8142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4ed831640 1 -- 172.21.15.84:0/2031673769 >> 172.21.15.84:0/2031673769 conn(0x7fc4e806c3d0 msgr2=0x7fc4e806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4ed831640 1 -- 172.21.15.84:0/2031673769 shutdown_connections 2023-12-12T09:20:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.293+0000 7fc4ed831640 1 -- 172.21.15.84:0/2031673769 wait complete. 2023-12-12T09:20:11.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.295+0000 7fc4ed831640 1 Processor -- start 2023-12-12T09:20:11.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.295+0000 7fc4ed831640 1 -- start start 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4ed831640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e80b4ba0 0x7fc4e8154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4ed831640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e813ff90 0x7fc4e8156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4ed831640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4e815e0b0 0x7fc4e815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4ed831640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e81f2990 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4ed831640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e81f27a0 con 0x7fc4e815e0b0 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4ed831640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8157060 con 0x7fc4e813ff90 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4e6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e80b4ba0 0x7fc4e8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4e6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e80b4ba0 0x7fc4e8154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34344/0 (socket says 172.21.15.84:34344) 2023-12-12T09:20:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.296+0000 7fc4e6ffd640 1 -- 172.21.15.84:0/2715255322 learned_addr learned my addr 172.21.15.84:0/2715255322 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e77fe640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4e815e0b0 0x7fc4e815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4de7fc640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e813ff90 0x7fc4e8156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e6ffd640 1 -- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e813ff90 msgr2=0x7fc4e8156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e6ffd640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e813ff90 0x7fc4e8156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e6ffd640 1 -- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4e815e0b0 msgr2=0x7fc4e815a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e6ffd640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4e815e0b0 0x7fc4e815a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e6ffd640 1 -- 172.21.15.84:0/2715255322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0009a70 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e77fe640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4e815e0b0 0x7fc4e815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e6ffd640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e80b4ba0 0x7fc4e8154530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e9b0 tx=0x7fc4d800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.297+0000 7fc4e4ff9640 1 -- 172.21.15.84:0/2715255322 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8009670 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.298+0000 7fc4e4ff9640 1 -- 172.21.15.84:0/2715255322 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d800c9a0 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.298+0000 7fc4e4ff9640 1 -- 172.21.15.84:0/2715255322 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800cd50 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.298+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e815ac40 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.298+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e8154ea0 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.299+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e81f2c00 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.300+0000 7fc4e4ff9640 1 -- 172.21.15.84:0/2715255322 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4d8013470 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.301+0000 7fc4e4ff9640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc4c806ae40 0x7fc4c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.301+0000 7fc4e4ff9640 1 -- 172.21.15.84:0/2715255322 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4d8089bf0 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.301+0000 7fc4de7fc640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc4c806ae40 0x7fc4c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.302+0000 7fc4de7fc640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc4c806ae40 0x7fc4c806d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00011e0 tx=0x7fc4d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.305+0000 7fc4e4ff9640 1 -- 172.21.15.84:0/2715255322 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc4d8054910 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.497+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4e80673c0 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.499+0000 7fc4e4ff9640 1 -- 172.21.15.84:0/2715255322 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7fc4d8017090 con 0x7fc4e80b4ba0 2023-12-12T09:20:11.500 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:11.500 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.501+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc4c806ae40 msgr2=0x7fc4c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.501+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc4c806ae40 0x7fc4c806d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00011e0 tx=0x7fc4d0009040 comp rx=0 tx=0).stop 2023-12-12T09:20:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.501+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e80b4ba0 msgr2=0x7fc4e8154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.501+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e80b4ba0 0x7fc4e8154530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e9b0 tx=0x7fc4d800ee70 comp rx=0 tx=0).stop 2023-12-12T09:20:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.502+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 shutdown_connections 2023-12-12T09:20:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.502+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4e815e0b0 0x7fc4e815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.502+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc4e813ff90 0x7fc4e8156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.502+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc4c806ae40 0x7fc4c806d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.502+0000 7fc4ed831640 1 --2- 172.21.15.84:0/2715255322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4e80b4ba0 0x7fc4e8154530 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.502+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 >> 172.21.15.84:0/2715255322 conn(0x7fc4e806c3d0 msgr2=0x7fc4e815c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.502+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 shutdown_connections 2023-12-12T09:20:11.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.502+0000 7fc4ed831640 1 -- 172.21.15.84:0/2715255322 wait complete. 2023-12-12T09:20:11.522 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-12T09:20:11.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-12T09:20:11.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-12T09:20:11.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-12T09:20:11.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-12T09:20:11.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-12T09:20:11.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-12T09:20:11.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-12T09:20:11.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.826+0000 7fd7bc4bb640 1 Processor -- start 2023-12-12T09:20:11.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.827+0000 7fd7bc4bb640 1 -- start start 2023-12-12T09:20:11.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.828+0000 7fd7bc4bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7ac0e77c0 0x7fd7ac04ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.828+0000 7f15455e6640 1 Processor -- start 2023-12-12T09:20:11.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.828+0000 7f15455e6640 1 -- start start 2023-12-12T09:20:11.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.829+0000 7fd7bc4bb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd7ac038080 0x7fd7ac053570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.829+0000 7fd7bc4bb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ac0061e0 con 0x7fd7ac038500 2023-12-12T09:20:11.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.829+0000 7fd7bc4bb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac04cfb0 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.829+0000 7fd7bc4bb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ac056eb0 con 0x7fd7ac038080 2023-12-12T09:20:11.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7fd7ba257640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7ac0e77c0 0x7fd7ac04ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7fd7ba257640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7ac0e77c0 0x7fd7ac04ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34352/0 (socket says 172.21.15.84:34352) 2023-12-12T09:20:11.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7f15455e6640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1538053c40 0x7f1538038050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7fd7ba257640 1 -- 172.21.15.84:0/2664020859 learned_addr learned my addr 172.21.15.84:0/2664020859 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7fd7b9a56640 1 --2- 172.21.15.84:0/2664020859 >> v2:172.21.15.99:3300/0 conn(0x7fd7ac038080 0x7fd7ac053570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7f15455e6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1538054490 con 0x7f1538033ec0 2023-12-12T09:20:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7f15455e6640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15380541b0 con 0x7f153800c070 2023-12-12T09:20:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7f15455e6640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1538005f50 con 0x7f1538053c40 2023-12-12T09:20:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7f1544de5640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1538033ec0 0x7f153804fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50166/0 (socket says 172.21.15.84:50166) 2023-12-12T09:20:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.830+0000 7f1544de5640 1 -- 172.21.15.84:0/916085302 learned_addr learned my addr 172.21.15.84:0/916085302 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.831+0000 7fd7ba257640 1 -- 172.21.15.84:0/2664020859 >> v2:172.21.15.99:3300/0 conn(0x7fd7ac038080 msgr2=0x7fd7ac053570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.831+0000 7fd7ba257640 1 --2- 172.21.15.84:0/2664020859 >> v2:172.21.15.99:3300/0 conn(0x7fd7ac038080 0x7fd7ac053570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.831+0000 7fd7ba257640 1 -- 172.21.15.84:0/2664020859 >> v1:172.21.15.99:6789/0 conn(0x7fd7ac038500 legacy=0x7fd7ac006f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.831+0000 7f153f7fe640 1 --2- 172.21.15.84:0/916085302 >> v2:172.21.15.99:3300/0 conn(0x7f1538053c40 0x7f1538038050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.831+0000 7fd7ba257640 1 -- 172.21.15.84:0/2664020859 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac006430 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.831+0000 7f153effd640 1 -- 172.21.15.84:0/916085302 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803827867 0 0) 0x7f1538054490 con 0x7f1538033ec0 2023-12-12T09:20:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.831+0000 7f153effd640 1 -- 172.21.15.84:0/916085302 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1530003520 con 0x7f1538033ec0 2023-12-12T09:20:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.832+0000 7f153effd640 1 -- 172.21.15.84:0/916085302 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026177581 0 0) 0x7f15380541b0 con 0x7f153800c070 2023-12-12T09:20:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.832+0000 7f153f7fe640 1 -- 172.21.15.84:0/916085302 >> v1:172.21.15.99:6789/0 conn(0x7f153800c070 legacy=0x7f15380df1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.832+0000 7f153f7fe640 1 -- 172.21.15.84:0/916085302 >> v1:172.21.15.84:6789/0 conn(0x7f1538033ec0 legacy=0x7f153804fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.832+0000 7f153f7fe640 1 -- 172.21.15.84:0/916085302 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538006230 con 0x7f1538053c40 2023-12-12T09:20:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.833+0000 7fd7ba257640 1 --2- 172.21.15.84:0/2664020859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 0x7fd7ac04ca70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac008630 tx=0x7fd7a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2049835cf378f2a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.833+0000 7fd7b9255640 1 -- 172.21.15.84:0/2664020859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40317e0 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.833+0000 7fd7b9255640 1 -- 172.21.15.84:0/2664020859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a4031940 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.833+0000 7fd7b9255640 1 -- 172.21.15.84:0/2664020859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4031cd0 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.834+0000 7f153f7fe640 1 --2- 172.21.15.84:0/916085302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 0x7f1538038050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f152c00ba40 tx=0x7f152c02de60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8639810639dc44f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.834+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/2664020859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 msgr2=0x7fd7ac04ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.834+0000 7fd7bc4bb640 1 --2- 172.21.15.84:0/2664020859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 0x7fd7ac04ca70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac008630 tx=0x7fd7a402b880 comp rx=0 tx=0).stop 2023-12-12T09:20:11.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/2664020859 shutdown_connections 2023-12-12T09:20:11.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7fd7bc4bb640 1 --2- 172.21.15.84:0/2664020859 >> v2:172.21.15.99:3300/0 conn(0x7fd7ac038080 0x7fd7ac053570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7fd7bc4bb640 1 --2- 172.21.15.84:0/2664020859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 0x7fd7ac04ca70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/2664020859 >> 172.21.15.84:0/2664020859 conn(0x7fd7ac03aa10 msgr2=0x7fd7ac03ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/2664020859 shutdown_connections 2023-12-12T09:20:11.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7f153effd640 1 -- 172.21.15.84:0/916085302 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540068760 con 0x7f1538053c40 2023-12-12T09:20:11.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7f153effd640 1 -- 172.21.15.84:0/916085302 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c02e990 con 0x7f1538053c40 2023-12-12T09:20:11.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7f153effd640 1 -- 172.21.15.84:0/916085302 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c02ed00 con 0x7f1538053c40 2023-12-12T09:20:11.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.836+0000 7f15455e6640 1 -- 172.21.15.84:0/916085302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 msgr2=0x7f1538038050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.836+0000 7f15455e6640 1 --2- 172.21.15.84:0/916085302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 0x7f1538038050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f152c00ba40 tx=0x7f152c02de60 comp rx=0 tx=0).stop 2023-12-12T09:20:11.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.835+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/2664020859 wait complete. 2023-12-12T09:20:11.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.837+0000 7f15455e6640 1 -- 172.21.15.84:0/916085302 shutdown_connections 2023-12-12T09:20:11.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.837+0000 7f15455e6640 1 --2- 172.21.15.84:0/916085302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 0x7f1538038050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.837+0000 7f15455e6640 1 -- 172.21.15.84:0/916085302 >> 172.21.15.84:0/916085302 conn(0x7f1538009f80 msgr2=0x7f153800a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.837+0000 7f15455e6640 1 -- 172.21.15.84:0/916085302 shutdown_connections 2023-12-12T09:20:11.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.837+0000 7f8340b88640 1 Processor -- start 2023-12-12T09:20:11.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.837+0000 7f8340b88640 1 -- start start 2023-12-12T09:20:11.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.837+0000 7f15455e6640 1 -- 172.21.15.84:0/916085302 wait complete. 2023-12-12T09:20:11.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.838+0000 7fd7bc4bb640 1 Processor -- start 2023-12-12T09:20:11.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7f8340b88640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83340398a0 0x7f83340dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.838+0000 7fd7bc4bb640 1 -- start start 2023-12-12T09:20:11.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7fd7bc4bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd7ac038080 0x7fd7ac0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7fd7bc4bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7ac038500 0x7fd7ac03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7fd7bc4bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 0x7fd7ac0cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7fd7bc4bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac03ede0 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7fd7bc4bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac0d0920 con 0x7fd7ac038500 2023-12-12T09:20:11.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7fd7bc4bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac050f80 con 0x7fd7ac038080 2023-12-12T09:20:11.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7f8340b88640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83340e03d0 con 0x7f833404fb30 2023-12-12T09:20:11.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7f8340b88640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8334039da0 con 0x7f8334054320 2023-12-12T09:20:11.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.839+0000 7f8340b88640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8334007700 con 0x7f83340398a0 2023-12-12T09:20:11.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.840+0000 7f15455e6640 1 Processor -- start 2023-12-12T09:20:11.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.840+0000 7f833b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83340398a0 0x7f83340dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.841+0000 7f833b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83340398a0 0x7f83340dfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34358/0 (socket says 172.21.15.84:34358) 2023-12-12T09:20:11.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.840+0000 7fd7baa58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 0x7fd7ac0cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.841+0000 7f833b7fe640 1 -- 172.21.15.84:0/1114537872 learned_addr learned my addr 172.21.15.84:0/1114537872 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.840+0000 7fa9f0609640 1 Processor -- start 2023-12-12T09:20:11.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.840+0000 7fa9f0609640 1 -- start start 2023-12-12T09:20:11.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.841+0000 7fd7baa58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 0x7fd7ac0cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34364/0 (socket says 172.21.15.84:34364) 2023-12-12T09:20:11.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.841+0000 7fd7baa58640 1 -- 172.21.15.84:0/1976779480 learned_addr learned my addr 172.21.15.84:0/1976779480 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7fd7baa58640 1 -- 172.21.15.84:0/1976779480 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd7ac038080 msgr2=0x7fd7ac0d03e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T09:20:11.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7f833b7fe640 1 -- 172.21.15.84:0/1114537872 >> v1:172.21.15.99:6789/0 conn(0x7f8334054320 legacy=0x7f83340525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7fd7baa58640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd7ac038080 0x7fd7ac0d03e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7fd7baa58640 1 -- 172.21.15.84:0/1976779480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7ac038500 msgr2=0x7fd7ac03bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7f833b7fe640 1 -- 172.21.15.84:0/1114537872 >> v1:172.21.15.84:6789/0 conn(0x7f833404fb30 legacy=0x7f83340506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.840+0000 7f15455e6640 1 -- start start 2023-12-12T09:20:11.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fa9f0609640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa9e8160860 0x7fa9e80d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fd7b9a56640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7ac038500 0x7fd7ac03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7f833b7fe640 1 -- 172.21.15.84:0/1114537872 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83340e6d80 con 0x7f83340398a0 2023-12-12T09:20:11.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fa9f0609640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fa9f0609640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e80b43d0 con 0x7fa9e80b1e90 2023-12-12T09:20:11.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fa9f0609640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80b4620 con 0x7fa9e8160860 2023-12-12T09:20:11.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fa9f0609640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80b4900 con 0x7fa9e80b3f40 2023-12-12T09:20:11.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fd7baa58640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7ac038500 0x7fd7ac03bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7f15455e6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f153800c070 0x7f153804dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7f15455e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1538033ec0 0x7f153804adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7f15455e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 0x7f153816a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7f15455e6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153804e1b0 con 0x7f1538033ec0 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7f15455e6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153804b300 con 0x7f1538053c40 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.842+0000 7f15455e6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153816aae0 con 0x7f153800c070 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7f153f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1538033ec0 0x7f153804adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7f1544de5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 0x7f153816a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7f1544de5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 0x7f153816a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:34764/0 (socket says 172.21.15.84:34764) 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7f1544de5640 1 -- 172.21.15.84:0/471997783 learned_addr learned my addr 172.21.15.84:0/471997783 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7f153ffff640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f153800c070 0x7f153804dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fd7baa58640 1 -- 172.21.15.84:0/1976779480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a40094d0 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7fa9edba4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.843+0000 7fd7b9a56640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7ac038500 0x7fd7ac03bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7fa9edba4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41332/0 (socket says 172.21.15.84:41332) 2023-12-12T09:20:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7fa9edba4640 1 -- 172.21.15.84:0/4125936556 learned_addr learned my addr 172.21.15.84:0/4125936556 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7fa9ee3a5640 1 --2- 172.21.15.84:0/4125936556 >> v2:172.21.15.99:3300/0 conn(0x7fa9e8160860 0x7fa9e80d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7f153f7fe640 1 -- 172.21.15.84:0/471997783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f153800c070 msgr2=0x7f153804dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7f153f7fe640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f153800c070 0x7f153804dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7f153f7fe640 1 -- 172.21.15.84:0/471997783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 msgr2=0x7f153816a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7f153f7fe640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1538053c40 0x7f153816a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7f153f7fe640 1 -- 172.21.15.84:0/471997783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c00b6a0 con 0x7f1538033ec0 2023-12-12T09:20:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.844+0000 7fd7baa58640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 0x7fd7ac0cfa40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4068330 tx=0x7fd7b4067ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b406bcc0 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7f833b7fe640 1 --2- 172.21.15.84:0/1114537872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 0x7f83340dfe90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8330009870 tx=0x7f833002b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f44d723040b74b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7f4b8b190640 1 Processor -- start 2023-12-12T09:20:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7f79f62b4640 1 Processor -- start 2023-12-12T09:20:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7fa9ee3a5640 1 -- 172.21.15.84:0/4125936556 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 msgr2=0x7fa9e80b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7fa9ee3a5640 1 --2- 172.21.15.84:0/4125936556 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7fa9ee3a5640 1 -- 172.21.15.84:0/4125936556 >> v1:172.21.15.84:6789/0 conn(0x7fa9e80b1e90 legacy=0x7fa9e80b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7f153f7fe640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1538033ec0 0x7f153804adc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f152c035000 tx=0x7f152c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7fa9ee3a5640 1 -- 172.21.15.84:0/4125936556 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80b3740 con 0x7fa9e8160860 2023-12-12T09:20:11.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7f79f62b4640 1 -- start start 2023-12-12T09:20:11.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c003b60 con 0x7f1538033ec0 2023-12-12T09:20:11.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c003cc0 con 0x7f1538033ec0 2023-12-12T09:20:11.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c040440 con 0x7f1538033ec0 2023-12-12T09:20:11.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b406be40 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4072400 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac03c050 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac03e820 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7f833a7fc640 1 -- 172.21.15.84:0/1114537872 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330030710 con 0x7f83340398a0 2023-12-12T09:20:11.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7f833a7fc640 1 -- 172.21.15.84:0/1114537872 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833002e050 con 0x7f83340398a0 2023-12-12T09:20:11.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7f833a7fc640 1 -- 172.21.15.84:0/1114537872 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330030a90 con 0x7f83340398a0 2023-12-12T09:20:11.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.845+0000 7f4b8b190640 1 -- start start 2023-12-12T09:20:11.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1538048760 con 0x7f1538033ec0 2023-12-12T09:20:11.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.846+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1538048d20 con 0x7f1538033ec0 2023-12-12T09:20:11.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.847+0000 7f8340b88640 1 -- 172.21.15.84:0/1114537872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 msgr2=0x7f83340dfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.847+0000 7f8340b88640 1 --2- 172.21.15.84:0/1114537872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 0x7f83340dfe90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8330009870 tx=0x7f833002b620 comp rx=0 tx=0).stop 2023-12-12T09:20:11.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.847+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15380056b0 con 0x7f1538033ec0 2023-12-12T09:20:11.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.847+0000 7f8340b88640 1 -- 172.21.15.84:0/1114537872 shutdown_connections 2023-12-12T09:20:11.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.847+0000 7f8340b88640 1 --2- 172.21.15.84:0/1114537872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 0x7f83340dfe90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.847+0000 7f8340b88640 1 -- 172.21.15.84:0/1114537872 >> 172.21.15.84:0/1114537872 conn(0x7f8334009f80 msgr2=0x7f833400a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7f8340b88640 1 -- 172.21.15.84:0/1114537872 shutdown_connections 2023-12-12T09:20:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7f8340b88640 1 -- 172.21.15.84:0/1114537872 wait complete. 2023-12-12T09:20:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7f79f62b4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 0x7f79f006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7f79f62b4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79f00ce240 0x7f79f0158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7f79f62b4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f79f006e8f0 0x7f79f0159360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7f79f62b4640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00cc7b0 con 0x7f79f00ce240 2023-12-12T09:20:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7f79f62b4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00b25c0 con 0x7f79f006e8f0 2023-12-12T09:20:11.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7f79f62b4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00cd970 con 0x7f79f00b0530 2023-12-12T09:20:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.848+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7ac0556d0 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.849+0000 7f79ef7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79f00ce240 0x7f79f0158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.849+0000 7f79ef7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f79f00ce240 0x7f79f0158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34374/0 (socket says 172.21.15.84:34374) 2023-12-12T09:20:11.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.849+0000 7f79ef7fe640 1 -- 172.21.15.84:0/2496792783 learned_addr learned my addr 172.21.15.84:0/2496792783 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.849+0000 7f79f4851640 1 --2- 172.21.15.84:0/2496792783 >> v2:172.21.15.99:3300/0 conn(0x7f79f006e8f0 0x7f79f0159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.849+0000 7f79effff640 1 --2- 172.21.15.84:0/2496792783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 0x7f79f006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.849+0000 7fd7d877c640 1 Processor -- start 2023-12-12T09:20:11.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7fd7d877c640 1 -- start start 2023-12-12T09:20:11.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7f79ef7fe640 1 -- 172.21.15.84:0/2496792783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 msgr2=0x7f79f006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7f79ef7fe640 1 --2- 172.21.15.84:0/2496792783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 0x7f79f006c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7f79ef7fe640 1 -- 172.21.15.84:0/2496792783 >> v2:172.21.15.99:3300/0 conn(0x7f79f006e8f0 msgr2=0x7f79f0159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7f79ef7fe640 1 --2- 172.21.15.84:0/2496792783 >> v2:172.21.15.99:3300/0 conn(0x7f79f006e8f0 0x7f79f0159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7f79ef7fe640 1 -- 172.21.15.84:0/2496792783 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00cea00 con 0x7f79f00ce240 2023-12-12T09:20:11.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.849+0000 7fa9ee3a5640 1 --2- 172.21.15.84:0/4125936556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 0x7fa9e80d3c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40097a0 tx=0x7fa9e402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f883e7fe55dc1c1e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7fa9ed3a3640 1 -- 172.21.15.84:0/4125936556 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e402e070 con 0x7fa9e8160860 2023-12-12T09:20:11.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f4b8b190640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b840d16f0 0x7f4b840d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f4b8b190640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4b840b04b0 0x7f4b840b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f4b8b190640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b840afd40 con 0x7f4b8415d490 2023-12-12T09:20:11.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f4b8b190640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b840b0090 con 0x7f4b840d16f0 2023-12-12T09:20:11.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f4b8b190640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b840d20c0 con 0x7f4b840b04b0 2023-12-12T09:20:11.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7fa9ed3a3640 1 -- 172.21.15.84:0/4125936556 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e40315a0 con 0x7fa9e8160860 2023-12-12T09:20:11.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7fa9ed3a3640 1 -- 172.21.15.84:0/4125936556 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4031930 con 0x7fa9e8160860 2023-12-12T09:20:11.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7b4072560 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fa9f0609640 1 -- 172.21.15.84:0/4125936556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 msgr2=0x7fa9e80d3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fa9f0609640 1 --2- 172.21.15.84:0/4125936556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 0x7fa9e80d3c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa9e40097a0 tx=0x7fa9e402b840 comp rx=0 tx=0).stop 2023-12-12T09:20:11.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7fd7d877c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd7d00d16f0 0x7fd7d00d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7fd7d877c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7d00b04b0 0x7fd7d00b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7fd7d877c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d00afd40 con 0x7fd7d015d490 2023-12-12T09:20:11.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7fd7d877c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d00b0090 con 0x7fd7d00b04b0 2023-12-12T09:20:11.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7fd7d877c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d00d20c0 con 0x7fd7d00d16f0 2023-12-12T09:20:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f4b88f2c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4b8415d490 0x7f4b840d3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50200/0 (socket says 172.21.15.84:50200) 2023-12-12T09:20:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f4b88f2c640 1 -- 172.21.15.84:0/898843465 learned_addr learned my addr 172.21.15.84:0/898843465 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fd7aaffd640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd79806af10 0x7fd79806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f8340b88640 1 Processor -- start 2023-12-12T09:20:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.851+0000 7f8340b88640 1 -- start start 2023-12-12T09:20:11.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.850+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f152c0405a0 con 0x7f1538033ec0 2023-12-12T09:20:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7b4103680 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fd7d5d17640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd7d00d16f0 0x7fd7d00d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7f153cff9640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f152406ae40 0x7f152406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f152c0ac290 con 0x7f1538033ec0 2023-12-12T09:20:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fd7d6518640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd7d015d490 0x7fd7d00d3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50216/0 (socket says 172.21.15.84:50216) 2023-12-12T09:20:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fd7d6518640 1 -- 172.21.15.84:0/1940454682 learned_addr learned my addr 172.21.15.84:0/1940454682 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7f153cff9640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1524074400 0x7f1524076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 --> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1524076f10 con 0x7f1524074400 2023-12-12T09:20:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fd7aaffd640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7fd798074550 0x7fd798076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 --> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd798077060 con 0x7fd798074550 2023-12-12T09:20:11.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7b4105ca0 con 0x7fd7ac0e77c0 2023-12-12T09:20:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fa9f0609640 1 -- 172.21.15.84:0/4125936556 shutdown_connections 2023-12-12T09:20:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fa9f0609640 1 --2- 172.21.15.84:0/4125936556 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fa9f0609640 1 --2- 172.21.15.84:0/4125936556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 0x7fa9e80d3c10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7fa9f0609640 1 -- 172.21.15.84:0/4125936556 >> 172.21.15.84:0/4125936556 conn(0x7fa9e80d30f0 msgr2=0x7fa9e80d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7f4b8972d640 1 --2- 172.21.15.84:0/898843465 >> v2:172.21.15.99:3300/0 conn(0x7f4b840b04b0 0x7f4b840b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7f4b83fff640 1 --2- 172.21.15.84:0/898843465 >> v2:172.21.15.84:3300/0 conn(0x7f4b840d16f0 0x7f4b840d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.852+0000 7f4b8972d640 1 -- 172.21.15.84:0/898843465 >> v2:172.21.15.84:3300/0 conn(0x7f4b840d16f0 msgr2=0x7f4b840d1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f4b8972d640 1 --2- 172.21.15.84:0/898843465 >> v2:172.21.15.84:3300/0 conn(0x7f4b840d16f0 0x7f4b840d1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f4b8972d640 1 -- 172.21.15.84:0/898843465 >> v1:172.21.15.84:6789/0 conn(0x7f4b8415d490 legacy=0x7f4b840d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f4b8972d640 1 -- 172.21.15.84:0/898843465 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b840ce860 con 0x7f4b840b04b0 2023-12-12T09:20:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f8340b88640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 0x7f83340d3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f4b83fff640 1 --2- 172.21.15.84:0/898843465 >> v2:172.21.15.84:3300/0 conn(0x7f4b840d16f0 0x7f4b840d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7fd7d6d19640 1 --2- 172.21.15.84:0/1940454682 >> v2:172.21.15.84:3300/0 conn(0x7fd7d00b04b0 0x7fd7d00b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7fd7d5d17640 1 -- 172.21.15.84:0/1940454682 >> v2:172.21.15.84:3300/0 conn(0x7fd7d00b04b0 msgr2=0x7fd7d00b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7fd7d5d17640 1 --2- 172.21.15.84:0/1940454682 >> v2:172.21.15.84:3300/0 conn(0x7fd7d00b04b0 0x7fd7d00b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7fd7d5d17640 1 -- 172.21.15.84:0/1940454682 >> v1:172.21.15.84:6789/0 conn(0x7fd7d015d490 legacy=0x7fd7d00d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7fd7d5d17640 1 -- 172.21.15.84:0/1940454682 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d00ce860 con 0x7fd7d00d16f0 2023-12-12T09:20:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f8340b88640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f833404fb30 0x7f83340485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f8340b88640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8334054320 0x7f83340dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f8340b88640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83340d41f0 con 0x7f83340398a0 2023-12-12T09:20:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f8340b88640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83340d44d0 con 0x7f833404fb30 2023-12-12T09:20:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f8340b88640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83340d47b0 con 0x7f8334054320 2023-12-12T09:20:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f79ef7fe640 1 --2- 172.21.15.84:0/2496792783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 0x7f79f0158e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f79f00ce8b0 tx=0x7f79e402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df5fae4e880125b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7f833b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 0x7f83340d3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7f833b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 0x7f83340d3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34408/0 (socket says 172.21.15.84:34408) 2023-12-12T09:20:11.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7f833b7fe640 1 -- 172.21.15.84:0/3445231072 learned_addr learned my addr 172.21.15.84:0/3445231072 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f152c0ac600 con 0x7f1538033ec0 2023-12-12T09:20:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.853+0000 7f153ffff640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f152406ae40 0x7f152406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7f833affd640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f833404fb30 0x7f83340485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7fa9f0609640 1 -- 172.21.15.84:0/4125936556 shutdown_connections 2023-12-12T09:20:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7fa9f0609640 1 -- 172.21.15.84:0/4125936556 wait complete. 2023-12-12T09:20:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7fd7b9a56640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7fd798074550 0x7fd798076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7f4b8972d640 1 --2- 172.21.15.84:0/898843465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b840b04b0 0x7f4b840b08e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4b8406b030 tx=0x7f4b7c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8b5b3a85f77f2dd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.854+0000 7fd7ba257640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd79806af10 0x7fd79806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f833bfff640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8334054320 0x7f83340dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f79eeffd640 1 -- 172.21.15.84:0/2496792783 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4004230 con 0x7f79f00ce240 2023-12-12T09:20:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f79eeffd640 1 -- 172.21.15.84:0/2496792783 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4004390 con 0x7f79f00ce240 2023-12-12T09:20:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f79eeffd640 1 -- 172.21.15.84:0/2496792783 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4003810 con 0x7f79f00ce240 2023-12-12T09:20:11.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f833b7fe640 1 -- 172.21.15.84:0/3445231072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8334054320 msgr2=0x7f83340dc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f833b7fe640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8334054320 0x7f83340dc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f833b7fe640 1 -- 172.21.15.84:0/3445231072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f833404fb30 msgr2=0x7f83340485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f833b7fe640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f833404fb30 0x7f83340485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f833b7fe640 1 -- 172.21.15.84:0/3445231072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300094d0 con 0x7f83340398a0 2023-12-12T09:20:11.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7fd7b9a56640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7fd798074550 0x7fd798076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f4b837fe640 1 -- 172.21.15.84:0/898843465 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c02e070 con 0x7f4b840b04b0 2023-12-12T09:20:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f4b837fe640 1 -- 172.21.15.84:0/898843465 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c0315a0 con 0x7f4b840b04b0 2023-12-12T09:20:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f4b837fe640 1 -- 172.21.15.84:0/898843465 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c031930 con 0x7f4b840b04b0 2023-12-12T09:20:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f1544de5640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1524074400 0x7f1524076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.855+0000 7f153ffff640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f152406ae40 0x7f152406d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1534000f60 tx=0x7f1534009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7f1544de5640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1524074400 0x7f1524076840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7f833b7fe640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 0x7f83340d3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8330009870 tx=0x7f83300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7f4b8b190640 1 -- 172.21.15.84:0/898843465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b840b04b0 msgr2=0x7f4b840b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7f4b8b190640 1 --2- 172.21.15.84:0/898843465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b840b04b0 0x7f4b840b08e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4b8406b030 tx=0x7f4b7c02b840 comp rx=0 tx=0).stop 2023-12-12T09:20:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7f79f62b4640 1 -- 172.21.15.84:0/2496792783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 msgr2=0x7f79f0158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300329d0 con 0x7f83340398a0 2023-12-12T09:20:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8330032b30 con 0x7f83340398a0 2023-12-12T09:20:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833003c470 con 0x7f83340398a0 2023-12-12T09:20:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7fd7d5d17640 1 --2- 172.21.15.84:0/1940454682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 0x7fd7d00d1b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7d008c580 tx=0x7fd7c002b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=142f2870f753da05 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f79f62b4640 1 --2- 172.21.15.84:0/2496792783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 0x7f79f0158e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f79f00ce8b0 tx=0x7f79e402b860 comp rx=0 tx=0).stop 2023-12-12T09:20:11.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83340d4a90 con 0x7f83340398a0 2023-12-12T09:20:11.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83340dc6e0 con 0x7f83340398a0 2023-12-12T09:20:11.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.856+0000 7fd7ba257640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd79806af10 0x7fd79806d3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4036000 tx=0x7fd7a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7fa9f0609640 1 Processor -- start 2023-12-12T09:20:11.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7fa9f0609640 1 -- start start 2023-12-12T09:20:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f79f62b4640 1 -- 172.21.15.84:0/2496792783 shutdown_connections 2023-12-12T09:20:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f79f62b4640 1 --2- 172.21.15.84:0/2496792783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 0x7f79f0158e20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f4b8b190640 1 -- 172.21.15.84:0/898843465 shutdown_connections 2023-12-12T09:20:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f4b8b190640 1 --2- 172.21.15.84:0/898843465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b840b04b0 0x7f4b840b08e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f4b8b190640 1 --2- 172.21.15.84:0/898843465 >> v2:172.21.15.84:3300/0 conn(0x7f4b840d16f0 0x7f4b840d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f4b8b190640 1 -- 172.21.15.84:0/898843465 >> 172.21.15.84:0/898843465 conn(0x7f4b8409c450 msgr2=0x7f4b840d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f79f62b4640 1 --2- 172.21.15.84:0/2496792783 >> v2:172.21.15.99:3300/0 conn(0x7f79f006e8f0 0x7f79f0159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7f79f62b4640 1 --2- 172.21.15.84:0/2496792783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 0x7f79f006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7f79f62b4640 1 -- 172.21.15.84:0/2496792783 >> 172.21.15.84:0/2496792783 conn(0x7f79f00aea30 msgr2=0x7f79f00aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.857+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 <== osd.0 v2:172.21.15.84:6817/3970846200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1524076f10 con 0x7f1524074400 2023-12-12T09:20:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7f979edd7640 1 Processor -- start 2023-12-12T09:20:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 <== osd.1 v2:172.21.15.84:6816/1701316875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd798077060 con 0x7fd798074550 2023-12-12T09:20:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83340d4640 con 0x7f83340398a0 2023-12-12T09:20:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7fd7d5516640 1 -- 172.21.15.84:0/1940454682 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0031520 con 0x7fd7d00d16f0 2023-12-12T09:20:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7fd7d5516640 1 -- 172.21.15.84:0/1940454682 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c0031680 con 0x7fd7d00d16f0 2023-12-12T09:20:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7fd7d5516640 1 -- 172.21.15.84:0/1940454682 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0031a10 con 0x7fd7d00d16f0 2023-12-12T09:20:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7f79f62b4640 1 -- 172.21.15.84:0/2496792783 shutdown_connections 2023-12-12T09:20:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7f79f62b4640 1 -- 172.21.15.84:0/2496792783 wait complete. 2023-12-12T09:20:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.858+0000 7f979edd7640 1 -- start start 2023-12-12T09:20:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fa9f0609640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e80b1e90 0x7fa9e80c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fd7d877c640 1 -- 172.21.15.84:0/1940454682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 msgr2=0x7fd7d00d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fd7d877c640 1 --2- 172.21.15.84:0/1940454682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 0x7fd7d00d1b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7d008c580 tx=0x7fd7c002b7c0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fa9f0609640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7f4b8b190640 1 -- 172.21.15.84:0/898843465 shutdown_connections 2023-12-12T09:20:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fa9f0609640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 0x7fa9e80c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fa9f0609640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e814bb10 con 0x7fa9e80b1e90 2023-12-12T09:20:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fa9f0609640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e814af20 con 0x7fa9e8160860 2023-12-12T09:20:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fa9f0609640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e814b1e0 con 0x7fa9e80b3f40 2023-12-12T09:20:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fd7d877c640 1 -- 172.21.15.84:0/1940454682 shutdown_connections 2023-12-12T09:20:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fd7d877c640 1 --2- 172.21.15.84:0/1940454682 >> v2:172.21.15.84:3300/0 conn(0x7fd7d00b04b0 0x7fd7d00b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fd7d877c640 1 --2- 172.21.15.84:0/1940454682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 0x7fd7d00d1b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.859+0000 7fd7d877c640 1 -- 172.21.15.84:0/1940454682 >> 172.21.15.84:0/1940454682 conn(0x7fd7d009c450 msgr2=0x7fd7d00d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7fa9edba4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7fa9edba4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41370/0 (socket says 172.21.15.84:41370) 2023-12-12T09:20:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7f979edd7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f97980b3f80 0x7f9798162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7f979edd7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b1dc0 0x7f97980703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7f979edd7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980723a0 con 0x7f97980cb2d0 2023-12-12T09:20:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7fa9edba4640 1 -- 172.21.15.84:0/3619330045 learned_addr learned my addr 172.21.15.84:0/3619330045 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7f979edd7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9798162ab0 con 0x7f97980b3f80 2023-12-12T09:20:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7f979edd7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980b2360 con 0x7f97980b1dc0 2023-12-12T09:20:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7fa9ef3a7640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 0x7fa9e80c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7fd7d877c640 1 -- 172.21.15.84:0/1940454682 shutdown_connections 2023-12-12T09:20:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.861+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8330039040 con 0x7f83340398a0 2023-12-12T09:20:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7f8327fff640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006af10 0x7f832006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83300ab5f0 con 0x7f83340398a0 2023-12-12T09:20:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7f833affd640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006af10 0x7f832006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7f8327fff640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f8320074550 0x7f8320076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 --> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8320077060 con 0x7f8320074550 2023-12-12T09:20:11.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83300adc10 con 0x7f83340398a0 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.860+0000 7f4b8b190640 1 -- 172.21.15.84:0/898843465 wait complete. 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7f4b8b190640 1 Processor -- start 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.861+0000 7fa9ee3a5640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e80b1e90 0x7fa9e80c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7fa9ef3a7640 1 -- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 msgr2=0x7fa9e80c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7fa9ef3a7640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa9e80b3f40 0x7fa9e80c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7fa9ef3a7640 1 -- 172.21.15.84:0/3619330045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e80b1e90 msgr2=0x7fa9e80c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7fa9ef3a7640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9e80b1e90 0x7fa9e80c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7fa9ef3a7640 1 -- 172.21.15.84:0/3619330045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e4009400 con 0x7fa9e8160860 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7fa9ef3a7640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 0x7fa9e80c6c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000c780 tx=0x7fa9e000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000aa50 con 0x7fa9e8160860 2023-12-12T09:20:11.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.861+0000 7fd7d877c640 1 -- 172.21.15.84:0/1940454682 wait complete. 2023-12-12T09:20:11.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.861+0000 7f79f62b4640 1 Processor -- start 2023-12-12T09:20:11.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7f79f62b4640 1 -- start start 2023-12-12T09:20:11.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7f79f62b4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f006e8f0 0x7f79f0142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.861+0000 7f979d374640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b1dc0 0x7f97980703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.861+0000 7f979d374640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b1dc0 0x7f97980703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41384/0 (socket says 172.21.15.84:41384) 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.861+0000 7f979d374640 1 -- 172.21.15.84:0/3453352785 learned_addr learned my addr 172.21.15.84:0/3453352785 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.861+0000 7f9797fff640 1 --2- 172.21.15.84:0/3453352785 >> v2:172.21.15.84:3300/0 conn(0x7f97980b3f80 0x7f9798162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7f9797fff640 1 -- 172.21.15.84:0/3453352785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b1dc0 msgr2=0x7f97980703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7f9797fff640 1 --2- 172.21.15.84:0/3453352785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b1dc0 0x7f97980703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7f9797fff640 1 -- 172.21.15.84:0/3453352785 >> v1:172.21.15.84:6789/0 conn(0x7f97980cb2d0 legacy=0x7f97980b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.862+0000 7f9797fff640 1 -- 172.21.15.84:0/3453352785 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980b2640 con 0x7f97980b3f80 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7f4b8b190640 1 -- start start 2023-12-12T09:20:11.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.864+0000 7f79f62b4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 0x7f79f0143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.863+0000 7fd7d877c640 1 Processor -- start 2023-12-12T09:20:11.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.864+0000 7fd7d877c640 1 -- start start 2023-12-12T09:20:11.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.864+0000 7f79f62b4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 0x7f79f01440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.864+0000 7f79effff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f006e8f0 0x7f79f0142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.864+0000 7f9797fff640 1 --2- 172.21.15.84:0/3453352785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980b3f80 0x7f9798162570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97840097a0 tx=0x7f978402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517ee8cb7fd0c784 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.864+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e000abd0 con 0x7fa9e8160860 2023-12-12T09:20:11.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f4b8b190640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b840b04b0 0x7f4b840cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f4b8b190640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b840d16f0 0x7f4b84150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f4b8b190640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b8415d490 0x7f4b840b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f79f62b4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f015c840 con 0x7f79f00ce240 2023-12-12T09:20:11.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f97977fe640 1 -- 172.21.15.84:0/3453352785 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840316f0 con 0x7f97980b3f80 2023-12-12T09:20:11.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f97977fe640 1 -- 172.21.15.84:0/3453352785 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9784031850 con 0x7f97980b3f80 2023-12-12T09:20:11.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f97977fe640 1 -- 172.21.15.84:0/3453352785 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784031be0 con 0x7f97980b3f80 2023-12-12T09:20:11.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f4b8b190640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b840cc890 con 0x7f4b840b04b0 2023-12-12T09:20:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.864+0000 7f833affd640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006af10 0x7f832006d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83340ddad0 tx=0x7f8328009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f79effff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f006e8f0 0x7f79f0142060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:34822/0 (socket says 172.21.15.84:34822) 2023-12-12T09:20:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f79effff640 1 -- 172.21.15.84:0/3644055262 learned_addr learned my addr 172.21.15.84:0/3644055262 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000ce30 con 0x7fa9e8160860 2023-12-12T09:20:11.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.865+0000 7f4b8b190640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84150fa0 con 0x7f4b8415d490 2023-12-12T09:20:11.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e814b4c0 con 0x7fa9e8160860 2023-12-12T09:20:11.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f4b8b190640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b840b1a10 con 0x7f4b840d16f0 2023-12-12T09:20:11.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f4b88f2c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b840b04b0 0x7f4b840cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f4b88f2c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b840b04b0 0x7f4b840cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34444/0 (socket says 172.21.15.84:34444) 2023-12-12T09:20:11.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f4b88f2c640 1 -- 172.21.15.84:0/548232166 learned_addr learned my addr 172.21.15.84:0/548232166 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e80c9a40 con 0x7fa9e8160860 2023-12-12T09:20:11.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01425a0 con 0x7f79f006e8f0 2023-12-12T09:20:11.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f79ef7fe640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 0x7f79f0143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01451f0 con 0x7f79f00b0530 2023-12-12T09:20:11.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f4b8972d640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b8415d490 0x7f4b840b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f979edd7640 1 -- 172.21.15.84:0/3453352785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980b3f80 msgr2=0x7f9798162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7fd7d877c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d00b04b0 0x7fd7d00ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f979edd7640 1 --2- 172.21.15.84:0/3453352785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980b3f80 0x7f9798162570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f97840097a0 tx=0x7f978402b790 comp rx=0 tx=0).stop 2023-12-12T09:20:11.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f4b83fff640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b840d16f0 0x7f4b84150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7fd7d877c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 0x7fd7d0202fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7fd7d877c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd7d015d490 0x7fd7d0203510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f833bfff640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f8320074550 0x7f8320076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7fd7d877c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d0156fc0 con 0x7fd7d00b04b0 2023-12-12T09:20:11.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7fd7d877c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d015ebd0 con 0x7fd7d00d16f0 2023-12-12T09:20:11.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7fd7d877c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00c9770 con 0x7fd7d015d490 2023-12-12T09:20:11.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.866+0000 7f79f4851640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 0x7f79f01440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7f979edd7640 1 -- 172.21.15.84:0/3453352785 shutdown_connections 2023-12-12T09:20:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7f979edd7640 1 --2- 172.21.15.84:0/3453352785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b1dc0 0x7f97980703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7f979edd7640 1 --2- 172.21.15.84:0/3453352785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980b3f80 0x7f9798162570 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7f979edd7640 1 -- 172.21.15.84:0/3453352785 >> 172.21.15.84:0/3453352785 conn(0x7f979806c3d0 msgr2=0x7f979806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7fd7d5d17640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 0x7fd7d0202fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7fd7d6d19640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd7d015d490 0x7fd7d0203510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7fd7d5d17640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 0x7fd7d0202fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:34840/0 (socket says 172.21.15.84:34840) 2023-12-12T09:20:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7fd7d5d17640 1 -- 172.21.15.84:0/4049750869 learned_addr learned my addr 172.21.15.84:0/4049750869 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.867+0000 7fd7d6518640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d00b04b0 0x7fd7d00ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9e81670b0 con 0x7fa9e8160860 2023-12-12T09:20:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f979edd7640 1 -- 172.21.15.84:0/3453352785 shutdown_connections 2023-12-12T09:20:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f4b8972d640 1 -- 172.21.15.84:0/548232166 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b840d16f0 msgr2=0x7f4b84150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f4b8972d640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b840d16f0 0x7f4b84150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f4b8972d640 1 -- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b840b04b0 msgr2=0x7f4b840cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f4b8972d640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b840b04b0 0x7f4b840cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f4b8972d640 1 -- 172.21.15.84:0/548232166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c009400 con 0x7f4b8415d490 2023-12-12T09:20:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f79f4851640 1 -- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 msgr2=0x7f79f0143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f79f4851640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79f00b0530 0x7f79f0143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f79f4851640 1 -- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f006e8f0 msgr2=0x7f79f0142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f79f4851640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79f006e8f0 0x7f79f0142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f79f4851640 1 -- 172.21.15.84:0/3644055262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4009460 con 0x7f79f00ce240 2023-12-12T09:20:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7fd7d6518640 1 -- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd7d015d490 msgr2=0x7fd7d0203510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7fd7d6518640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd7d015d490 0x7fd7d0203510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7fd7d6518640 1 -- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 msgr2=0x7fd7d0202fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7fd7d6518640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7d00d16f0 0x7fd7d0202fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7fd7d6518640 1 -- 172.21.15.84:0/4049750869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0009400 con 0x7fd7d00b04b0 2023-12-12T09:20:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.868+0000 7f979edd7640 1 -- 172.21.15.84:0/3453352785 wait complete. 2023-12-12T09:20:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.869+0000 7fd7d6518640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d00b04b0 0x7fd7d00ccb50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800bd30 tx=0x7fd7c800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.869+0000 7f79f4851640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 0x7f79f01440e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f79e000e7f0 tx=0x7f79e000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.869+0000 7f4b8972d640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b8415d490 0x7f4b840b1ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c033000 tx=0x7f4b7c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.869+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8011710 con 0x7fd7d00b04b0 2023-12-12T09:20:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.869+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c800f050 con 0x7fd7d00b04b0 2023-12-12T09:20:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.869+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8011b10 con 0x7fd7d00b04b0 2023-12-12T09:20:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.869+0000 7fd7d877c640 1 -- 172.21.15.84:0/4049750869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d00c9a50 con 0x7fd7d00b04b0 2023-12-12T09:20:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.870+0000 7fd7d877c640 1 -- 172.21.15.84:0/4049750869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d00c9d30 con 0x7fd7d00b04b0 2023-12-12T09:20:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.870+0000 7f979edd7640 1 Processor -- start 2023-12-12T09:20:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.870+0000 7f979edd7640 1 -- start start 2023-12-12T09:20:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.870+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000ee40 con 0x7f79f00ce240 2023-12-12T09:20:11.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.871+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000c940 con 0x7f79f00ce240 2023-12-12T09:20:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.871+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000ccf0 con 0x7f79f00ce240 2023-12-12T09:20:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.871+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f0144620 con 0x7f79f00ce240 2023-12-12T09:20:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.871+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c032900 con 0x7f4b8415d490 2023-12-12T09:20:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.871+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9e0024430 con 0x7fa9e8160860 2023-12-12T09:20:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.872+0000 7fd7d877c640 1 -- 172.21.15.84:0/4049750869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7d00d3f30 con 0x7fd7d00b04b0 2023-12-12T09:20:11.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.871+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b84151480 con 0x7f4b8415d490 2023-12-12T09:20:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.871+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b840b10e0 con 0x7f4b8415d490 2023-12-12T09:20:11.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.872+0000 7f979edd7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97980b1dc0 0x7f9798156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.872+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c032a60 con 0x7f4b8415d490 2023-12-12T09:20:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.872+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b840d2620 con 0x7f4b8415d490 2023-12-12T09:20:11.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.872+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c032e10 con 0x7f4b8415d490 2023-12-12T09:20:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.872+0000 7f979edd7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b3f80 0x7f979815e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7f979edd7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980cb2d0 0x7f979815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7fa9deffd640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9cc06ae70 0x7fa9cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd7c8011c70 con 0x7fd7d00b04b0 2023-12-12T09:20:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7f979cb73640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97980b1dc0 0x7f9798156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7f979cb73640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97980b1dc0 0x7f9798156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:34856/0 (socket says 172.21.15.84:34856) 2023-12-12T09:20:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7f9797fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b3f80 0x7f979815e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7f979d374640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980cb2d0 0x7f979815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7f979d374640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980cb2d0 0x7f979815cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34460/0 (socket says 172.21.15.84:34460) 2023-12-12T09:20:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7f979cb73640 1 -- 172.21.15.84:0/3116818607 learned_addr learned my addr 172.21.15.84:0/3116818607 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa9e0089c50 con 0x7fa9e8160860 2023-12-12T09:20:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.874+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979815d4c0 con 0x7f97980cb2d0 2023-12-12T09:20:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.874+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798153dc0 con 0x7f97980b1dc0 2023-12-12T09:20:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.873+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f0144ba0 con 0x7f79f00ce240 2023-12-12T09:20:11.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.874+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979815c1c0 con 0x7f97980b3f80 2023-12-12T09:20:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.874+0000 7f833bfff640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f8320074550 0x7f8320076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.874+0000 7fa9deffd640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7fa9cc0743b0 0x7fa9cc0767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.874+0000 7fa9ee3a5640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9cc06ae70 0x7fa9cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.874+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 --> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9cc076ec0 con 0x7fa9cc0743b0 2023-12-12T09:20:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.875+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9e008a0a0 con 0x7fa9e8160860 2023-12-12T09:20:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.875+0000 7f979d374640 1 -- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b3f80 msgr2=0x7f979815e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7fd7c6ffd640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd7b406ae40 0x7fd7b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7fa9ee3a5640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9cc06ae70 0x7fa9cc06d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4036000 tx=0x7fa9e403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7f979d374640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b3f80 0x7f979815e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7f979d374640 1 -- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97980b1dc0 msgr2=0x7f9798156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7f979d374640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97980b1dc0 0x7f9798156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 <== osd.2 v2:172.21.15.84:6808/3546175864 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8320077060 con 0x7f8320074550 2023-12-12T09:20:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7c808a520 con 0x7fd7d00b04b0 2023-12-12T09:20:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7f979d374640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784009400 con 0x7f97980cb2d0 2023-12-12T09:20:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.878+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b7c04e440 con 0x7f4b8415d490 2023-12-12T09:20:11.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7fa9edba4640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7fa9cc0743b0 0x7fa9cc0767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.878+0000 7fa9edba4640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7fa9cc0743b0 0x7fa9cc0767f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7fd7c6ffd640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7fd7b4074400 0x7fd7b4076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 --> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7b4076f10 con 0x7fd7b4074400 2023-12-12T09:20:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7c808cb00 con 0x7fd7d00b04b0 2023-12-12T09:20:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.877+0000 7fd7d5d17640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd7b406ae40 0x7fd7b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.877+0000 7fd7d6d19640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7fd7b4074400 0x7fd7b4076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.878+0000 7fd7d5d17640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd7b406ae40 0x7fd7b406d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00722a0 tx=0x7fd7c0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7f9797fff640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f97980b3f80 0x7f979815e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.876+0000 7f979cb73640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97980b1dc0 0x7f9798156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.877+0000 7f979d374640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980cb2d0 0x7f979815cf80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f979000ee00 tx=0x7f979000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.878+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000cbe0 con 0x7f97980cb2d0 2023-12-12T09:20:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.878+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979815c4a0 con 0x7f97980cb2d0 2023-12-12T09:20:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.879+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979000f040 con 0x7f97980cb2d0 2023-12-12T09:20:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.879+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979815ca60 con 0x7f97980cb2d0 2023-12-12T09:20:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.879+0000 7fd7d6d19640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7fd7b4074400 0x7fd7b4076840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.878+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79e0013470 con 0x7f79f00ce240 2023-12-12T09:20:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.879+0000 7f4b817fa640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b6806aec0 0x7f4b6806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.880+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79f00673c0 con 0x7f79f00ce240 2023-12-12T09:20:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.880+0000 7f79ecff9640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f79dc06af10 0x7f79dc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.879+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790003990 con 0x7f97980cb2d0 2023-12-12T09:20:11.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.880+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97980b2ee0 con 0x7f97980cb2d0 2023-12-12T09:20:11.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.880+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 <== osd.4 v2:172.21.15.99:6800/1049904610 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa9cc076ec0 con 0x7fa9cc0743b0 2023-12-12T09:20:11.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.880+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b7c0abbf0 con 0x7f4b8415d490 2023-12-12T09:20:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.880+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79e0089c80 con 0x7f79f00ce240 2023-12-12T09:20:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7f4b817fa640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f4b68074500 0x7f4b68076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7f4b88f2c640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b6806aec0 0x7f4b6806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7f79ecff9640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7f79dc0744d0 0x7f79dc076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 --> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79dc076fe0 con 0x7f79dc0744d0 2023-12-12T09:20:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 <== osd.5 v2:172.21.15.99:6823/29339213 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd7b4076f10 con 0x7fd7b4074400 2023-12-12T09:20:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79e0054b60 con 0x7f79f00ce240 2023-12-12T09:20:11.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7f79effff640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f79dc06af10 0x7f79dc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 --> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b68077010 con 0x7f4b68074500 2023-12-12T09:20:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.881+0000 7f4b83fff640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f4b68074500 0x7f4b68076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.882+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b7c0ac090 con 0x7f4b8415d490 2023-12-12T09:20:11.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.882+0000 7f79ef7fe640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7f79dc0744d0 0x7f79dc076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.882+0000 7f4b83fff640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f4b68074500 0x7f4b68076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.884+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 <== osd.3 v2:172.21.15.84:6800/587370499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4b68077010 con 0x7f4b68074500 2023-12-12T09:20:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.883+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9790003b30 con 0x7f97980cb2d0 2023-12-12T09:20:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.884+0000 7f79effff640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f79dc06af10 0x7f79dc06d3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f79e8003bc0 tx=0x7f79e8009970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.884+0000 7f79ef7fe640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7f79dc0744d0 0x7f79dc076910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.884+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 --> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7ac053ab0 con 0x7fd798074550 2023-12-12T09:20:11.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.885+0000 7f4b88f2c640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b6806aec0 0x7f4b6806d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b78001e90 tx=0x7f4b78001a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.884+0000 7f97957fa640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f977c06ae90 0x7f977c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.885+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9790089d60 con 0x7f97980cb2d0 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.885+0000 7f97957fa640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f977c0744d0 0x7f977c076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.885+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f977c076fe0 con 0x7f977c0744d0 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.885+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f979008c470 con 0x7f97980cb2d0 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.885+0000 7f979cb73640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f977c06ae90 0x7f977c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.886+0000 7f9797fff640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f977c0744d0 0x7f977c076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.886+0000 7f979cb73640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f977c06ae90 0x7f977c06d350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f978c001860 tx=0x7f978c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.886+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 <== osd.6 v2:172.21.15.99:6816/826618722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f79dc076fe0 con 0x7f79dc0744d0 2023-12-12T09:20:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.886+0000 7fd7aaffd640 1 -- 172.21.15.84:0/1976779480 <== osd.1 v2:172.21.15.84:6816/1701316875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7b0009730 con 0x7fd798074550 2023-12-12T09:20:11.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7f9797fff640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f977c0744d0 0x7f977c076910 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7fd798074550 msgr2=0x7fd798076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7bc4bb640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7fd798074550 0x7fd798076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd79806af10 msgr2=0x7fd79806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7bc4bb640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd79806af10 0x7fd79806d3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7a4036000 tx=0x7fd7a4008030 comp rx=0 tx=0).stop 2023-12-12T09:20:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 msgr2=0x7fd7ac0cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7bc4bb640 1 --2- 172.21.15.84:0/1976779480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7ac0e77c0 0x7fd7ac0cfa40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4068330 tx=0x7fd7b4067ea0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7baa58640 1 -- 172.21.15.84:0/1976779480 reap_dead start 2023-12-12T09:20:11.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 shutdown_connections 2023-12-12T09:20:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.887+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 >> 172.21.15.84:0/1976779480 conn(0x7fd7ac03aa10 msgr2=0x7fd7ac038980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.888+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 shutdown_connections 2023-12-12T09:20:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.889+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 --> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1538050170 con 0x7f1524074400 2023-12-12T09:20:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.889+0000 7fd7bc4bb640 1 -- 172.21.15.84:0/1976779480 wait complete. 2023-12-12T09:20:11.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.889+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 <== osd.7 v2:172.21.15.99:6808/3214921666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f977c076fe0 con 0x7f977c0744d0 2023-12-12T09:20:11.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.890+0000 7f153cff9640 1 -- 172.21.15.84:0/471997783 <== osd.0 v2:172.21.15.84:6817/3970846200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1540074730 con 0x7f1524074400 2023-12-12T09:20:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.891+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1524074400 msgr2=0x7f1524076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.891+0000 7f15455e6640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1524074400 0x7f1524076840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.893+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f152406ae40 msgr2=0x7f152406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.893+0000 7f15455e6640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f152406ae40 0x7f152406d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1534000f60 tx=0x7f1534009040 comp rx=0 tx=0).stop 2023-12-12T09:20:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.893+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1538033ec0 msgr2=0x7f153804adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.893+0000 7f15455e6640 1 --2- 172.21.15.84:0/471997783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1538033ec0 0x7f153804adc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f152c035000 tx=0x7f152c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.893+0000 7f1544de5640 1 -- 172.21.15.84:0/471997783 reap_dead start 2023-12-12T09:20:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.893+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 shutdown_connections 2023-12-12T09:20:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.893+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 >> 172.21.15.84:0/471997783 conn(0x7f1538009f80 msgr2=0x7f15380dbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.894+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 shutdown_connections 2023-12-12T09:20:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.894+0000 7f15455e6640 1 -- 172.21.15.84:0/471997783 wait complete. 2023-12-12T09:20:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.910+0000 7fd7d877c640 1 -- 172.21.15.84:0/4049750869 --> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7d00cee20 con 0x7fd7b4074400 2023-12-12T09:20:11.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.912+0000 7fd7c6ffd640 1 -- 172.21.15.84:0/4049750869 <== osd.5 v2:172.21.15.99:6823/29339213 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7cc009400 con 0x7fd7b4074400 2023-12-12T09:20:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.913+0000 7fd7c4ff9640 1 -- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7fd7b4074400 msgr2=0x7fd7b4076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.913+0000 7fd7c4ff9640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7fd7b4074400 0x7fd7b4076840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.914+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 --> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b840d3f30 con 0x7f4b68074500 2023-12-12T09:20:11.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.914+0000 7f4b817fa640 1 -- 172.21.15.84:0/548232166 <== osd.3 v2:172.21.15.84:6800/587370499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b7000c040 con 0x7f4b68074500 2023-12-12T09:20:11.934 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-12-12T09:20:11.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7fd7c4ff9640 1 -- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd7b406ae40 msgr2=0x7fd7b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7fd7c4ff9640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd7b406ae40 0x7fd7b406d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00722a0 tx=0x7fd7c0030000 comp rx=0 tx=0).stop 2023-12-12T09:20:11.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7fd7c4ff9640 1 -- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d00b04b0 msgr2=0x7fd7d00ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7fd7c4ff9640 1 --2- 172.21.15.84:0/4049750869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7d00b04b0 0x7fd7d00ccb50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800bd30 tx=0x7fd7c800be20 comp rx=0 tx=0).stop 2023-12-12T09:20:11.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7fd7d6d19640 1 -- 172.21.15.84:0/4049750869 reap_dead start 2023-12-12T09:20:11.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-12T09:20:11.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f4b68074500 msgr2=0x7f4b68076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7f4b8b190640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f4b68074500 0x7f4b68076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7fd7c4ff9640 1 -- 172.21.15.84:0/4049750869 shutdown_connections 2023-12-12T09:20:11.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.915+0000 7fd7c4ff9640 1 -- 172.21.15.84:0/4049750869 >> 172.21.15.84:0/4049750869 conn(0x7fd7d009c450 msgr2=0x7fd7d00d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b6806aec0 msgr2=0x7f4b6806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f4b8b190640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b6806aec0 0x7f4b6806d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b78001e90 tx=0x7f4b78001a20 comp rx=0 tx=0).stop 2023-12-12T09:20:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b8415d490 msgr2=0x7f4b840b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f4b8b190640 1 --2- 172.21.15.84:0/548232166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b8415d490 0x7f4b840b1ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c033000 tx=0x7f4b7c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7fd7c4ff9640 1 -- 172.21.15.84:0/4049750869 shutdown_connections 2023-12-12T09:20:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7fd7c4ff9640 1 -- 172.21.15.84:0/4049750869 wait complete. 2023-12-12T09:20:11.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f4b8972d640 1 -- 172.21.15.84:0/548232166 reap_dead start 2023-12-12T09:20:11.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 shutdown_connections 2023-12-12T09:20:11.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 >> 172.21.15.84:0/548232166 conn(0x7f4b8409c450 msgr2=0x7f4b8406cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 --> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9e814bc80 con 0x7fa9cc0743b0 2023-12-12T09:20:11.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 --> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79f015cbe0 con 0x7f79dc0744d0 2023-12-12T09:20:11.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.916+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 shutdown_connections 2023-12-12T09:20:11.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.917+0000 7f4b8b190640 1 -- 172.21.15.84:0/548232166 wait complete. 2023-12-12T09:20:11.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.917+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 --> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f833404f330 con 0x7f8320074550 2023-12-12T09:20:11.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.917+0000 7fa9deffd640 1 -- 172.21.15.84:0/3619330045 <== osd.4 v2:172.21.15.99:6800/1049904610 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9e814bc80 con 0x7fa9cc0743b0 2023-12-12T09:20:11.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7f8327fff640 1 -- 172.21.15.84:0/3445231072 <== osd.2 v2:172.21.15.84:6808/3546175864 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f833c04ed60 con 0x7f8320074550 2023-12-12T09:20:11.940 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-12-12T09:20:11.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-12T09:20:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7f79ecff9640 1 -- 172.21.15.84:0/3644055262 <== osd.6 v2:172.21.15.99:6816/826618722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f79f015cbe0 con 0x7f79dc0744d0 2023-12-12T09:20:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7fa9cc0743b0 msgr2=0x7fa9cc0767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7fa9f0609640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7fa9cc0743b0 0x7fa9cc0767f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f8320074550 msgr2=0x7f8320076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7f8340b88640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f8320074550 0x7f8320076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006af10 msgr2=0x7f832006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7f8340b88640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006af10 0x7f832006d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83340ddad0 tx=0x7f8328009040 comp rx=0 tx=0).stop 2023-12-12T09:20:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 msgr2=0x7f83340d3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.918+0000 7f8340b88640 1 --2- 172.21.15.84:0/3445231072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83340398a0 0x7f83340d3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8330009870 tx=0x7f83300046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7f79dc0744d0 msgr2=0x7f79dc076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f79f62b4640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7f79dc0744d0 0x7f79dc076910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f833bfff640 1 -- 172.21.15.84:0/3445231072 reap_dead start 2023-12-12T09:20:11.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 shutdown_connections 2023-12-12T09:20:11.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 >> 172.21.15.84:0/3445231072 conn(0x7f8334009f80 msgr2=0x7f83340e5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9cc06ae70 msgr2=0x7fa9cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9f0609640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa9cc06ae70 0x7fa9cc06d330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4036000 tx=0x7fa9e403d040 comp rx=0 tx=0).stop 2023-12-12T09:20:11.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 msgr2=0x7fa9e80c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9f0609640 1 --2- 172.21.15.84:0/3619330045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e8160860 0x7fa9e80c6c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000c780 tx=0x7fa9e000cc40 comp rx=0 tx=0).stop 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9ef3a7640 1 -- 172.21.15.84:0/3619330045 reap_dead start 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 shutdown_connections 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 >> 172.21.15.84:0/3619330045 conn(0x7fa9e80d30f0 msgr2=0x7fa9e806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 shutdown_connections 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f79dc06af10 msgr2=0x7f79dc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f79f62b4640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f79dc06af10 0x7f79dc06d3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f79e8003bc0 tx=0x7f79e8009970 comp rx=0 tx=0).stop 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 msgr2=0x7f79f01440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f79f62b4640 1 --2- 172.21.15.84:0/3644055262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79f00ce240 0x7f79f01440e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f79e000e7f0 tx=0x7f79e000ebf0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f79f4851640 1 -- 172.21.15.84:0/3644055262 reap_dead start 2023-12-12T09:20:11.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7fa9f0609640 1 -- 172.21.15.84:0/3619330045 wait complete. 2023-12-12T09:20:11.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 shutdown_connections 2023-12-12T09:20:11.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.919+0000 7f8340b88640 1 -- 172.21.15.84:0/3445231072 wait complete. 2023-12-12T09:20:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.920+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 shutdown_connections 2023-12-12T09:20:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.920+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 >> 172.21.15.84:0/3644055262 conn(0x7f79f00aea30 msgr2=0x7f79f006d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.920+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 shutdown_connections 2023-12-12T09:20:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.920+0000 7f79f62b4640 1 -- 172.21.15.84:0/3644055262 wait complete. 2023-12-12T09:20:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.924+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 --> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97980b2c00 con 0x7f977c0744d0 2023-12-12T09:20:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.925+0000 7f97957fa640 1 -- 172.21.15.84:0/3116818607 <== osd.7 v2:172.21.15.99:6808/3214921666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9784031610 con 0x7f977c0744d0 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.926+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f977c0744d0 msgr2=0x7f977c076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.926+0000 7f979edd7640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f977c0744d0 0x7f977c076910 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.926+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f977c06ae90 msgr2=0x7f977c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.926+0000 7f979edd7640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f977c06ae90 0x7f977c06d350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f978c001860 tx=0x7f978c009040 comp rx=0 tx=0).stop 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.926+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980cb2d0 msgr2=0x7f979815cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.926+0000 7f979edd7640 1 --2- 172.21.15.84:0/3116818607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f97980cb2d0 0x7f979815cf80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f979000ee00 tx=0x7f979000c490 comp rx=0 tx=0).stop 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.926+0000 7f979d374640 1 -- 172.21.15.84:0/3116818607 reap_dead start 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.927+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 shutdown_connections 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.927+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 >> 172.21.15.84:0/3116818607 conn(0x7f979806c3d0 msgr2=0x7f979815ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.927+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 shutdown_connections 2023-12-12T09:20:11.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:11.927+0000 7f979edd7640 1 -- 172.21.15.84:0/3116818607 wait complete. 2023-12-12T09:20:11.950 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-12-12T09:20:11.950 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-12T09:20:11.951 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-12-12T09:20:11.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-12T09:20:11.953 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-12-12T09:20:11.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-12T09:20:11.954 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-12-12T09:20:11.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-12T09:20:11.955 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-12-12T09:20:11.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-12T09:20:11.956 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-12-12T09:20:11.956 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-12T09:20:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.203+0000 7f17c9ae6640 1 Processor -- start 2023-12-12T09:20:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.203+0000 7f17c9ae6640 1 -- start start 2023-12-12T09:20:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.205+0000 7f17c9ae6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc0e77c0 0x7f17bc04ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.205+0000 7f17c9ae6640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17bc038080 0x7f17bc053570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.205+0000 7f17c9ae6640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17bc0061e0 con 0x7f17bc038500 2023-12-12T09:20:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.205+0000 7f17c9ae6640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17bc04cfb0 con 0x7f17bc038080 2023-12-12T09:20:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.205+0000 7f17c9ae6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc056eb0 con 0x7f17bc0e77c0 2023-12-12T09:20:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.206+0000 7f17c3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17bc038080 0x7f17bc053570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.206+0000 7f17c3fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f17bc038080 0x7f17bc053570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:34870/0 (socket says 172.21.15.84:34870) 2023-12-12T09:20:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.206+0000 7f17c8ae4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc0e77c0 0x7f17bc04ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.206+0000 7f17c8ae4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc0e77c0 0x7f17bc04ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41438/0 (socket says 172.21.15.84:41438) 2023-12-12T09:20:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.206+0000 7f17c8ae4640 1 -- 172.21.15.84:0/504622683 learned_addr learned my addr 172.21.15.84:0/504622683 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.207+0000 7f17c8ae4640 1 -- 172.21.15.84:0/504622683 >> v2:172.21.15.99:3300/0 conn(0x7f17bc038080 msgr2=0x7f17bc053570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.207+0000 7f17c8ae4640 1 --2- 172.21.15.84:0/504622683 >> v2:172.21.15.99:3300/0 conn(0x7f17bc038080 0x7f17bc053570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.207+0000 7f17c37fe640 1 -- 172.21.15.84:0/504622683 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124241544 0 0) 0x7f17bc0061e0 con 0x7f17bc038500 2023-12-12T09:20:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.207+0000 7f17c8ae4640 1 -- 172.21.15.84:0/504622683 >> v1:172.21.15.99:6789/0 conn(0x7f17bc038500 legacy=0x7f17bc006f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.207+0000 7f17c8ae4640 1 -- 172.21.15.84:0/504622683 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc006430 con 0x7f17bc0e77c0 2023-12-12T09:20:12.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.209+0000 7f17c8ae4640 1 --2- 172.21.15.84:0/504622683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc0e77c0 0x7f17bc04ca70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17c402cee0 tx=0x7f17c40a5af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffad31a9887e318a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.209+0000 7f17c37fe640 1 -- 172.21.15.84:0/504622683 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40a7970 con 0x7f17bc0e77c0 2023-12-12T09:20:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.209+0000 7f17c37fe640 1 -- 172.21.15.84:0/504622683 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c40a7ad0 con 0x7f17bc0e77c0 2023-12-12T09:20:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.209+0000 7f17c37fe640 1 -- 172.21.15.84:0/504622683 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40a8480 con 0x7f17bc0e77c0 2023-12-12T09:20:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.210+0000 7f660f89b640 1 Processor -- start 2023-12-12T09:20:12.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.210+0000 7f660f89b640 1 -- start start 2023-12-12T09:20:12.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f17c9ae6640 1 -- 172.21.15.84:0/504622683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc0e77c0 msgr2=0x7f17bc04ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/504622683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc0e77c0 0x7f17bc04ca70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17c402cee0 tx=0x7f17c40a5af0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f660f89b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6608165eb0 0x7f66080b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f660f89b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66080b1fa0 0x7f66080cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f17c9ae6640 1 -- 172.21.15.84:0/504622683 shutdown_connections 2023-12-12T09:20:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/504622683 >> v2:172.21.15.99:3300/0 conn(0x7f17bc038080 0x7f17bc053570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/504622683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc0e77c0 0x7f17bc04ca70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f17c9ae6640 1 -- 172.21.15.84:0/504622683 >> 172.21.15.84:0/504622683 conn(0x7f17bc03aa10 msgr2=0x7f17bc03ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f660d637640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f660814ac30 0x7f6608161b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50234/0 (socket says 172.21.15.84:50234) 2023-12-12T09:20:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.213+0000 7f660d637640 1 -- 172.21.15.84:0/1541472450 learned_addr learned my addr 172.21.15.84:0/1541472450 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.214+0000 7f660f89b640 1 -- 172.21.15.84:0/1541472450 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080b2440 con 0x7f660814ac30 2023-12-12T09:20:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.214+0000 7f660f89b640 1 -- 172.21.15.84:0/1541472450 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660806c310 con 0x7f66080b1fa0 2023-12-12T09:20:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.214+0000 7f660f89b640 1 -- 172.21.15.84:0/1541472450 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660806c5f0 con 0x7f6608165eb0 2023-12-12T09:20:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.214+0000 7f660ce36640 1 --2- 172.21.15.84:0/1541472450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6608165eb0 0x7f66080b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.214+0000 7f17c9ae6640 1 -- 172.21.15.84:0/504622683 shutdown_connections 2023-12-12T09:20:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.214+0000 7f660de38640 1 --2- 172.21.15.84:0/1541472450 >> v2:172.21.15.84:3300/0 conn(0x7f66080b1fa0 0x7f66080cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.215+0000 7f65fffff640 1 -- 172.21.15.84:0/1541472450 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130096064 0 0) 0x7f66080b2440 con 0x7f660814ac30 2023-12-12T09:20:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.215+0000 7f65fffff640 1 -- 172.21.15.84:0/1541472450 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f4003520 con 0x7f660814ac30 2023-12-12T09:20:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.216+0000 7f660de38640 1 -- 172.21.15.84:0/1541472450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6608165eb0 msgr2=0x7f66080b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.216+0000 7f660de38640 1 --2- 172.21.15.84:0/1541472450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6608165eb0 0x7f66080b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.216+0000 7f660de38640 1 -- 172.21.15.84:0/1541472450 >> v1:172.21.15.84:6789/0 conn(0x7f660814ac30 legacy=0x7f6608161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.215+0000 7f17c9ae6640 1 -- 172.21.15.84:0/504622683 wait complete. 2023-12-12T09:20:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.216+0000 7f660de38640 1 -- 172.21.15.84:0/1541472450 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660806c8d0 con 0x7f66080b1fa0 2023-12-12T09:20:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.217+0000 7f17c9ae6640 1 Processor -- start 2023-12-12T09:20:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.218+0000 7f17c9ae6640 1 -- start start 2023-12-12T09:20:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.218+0000 7f660de38640 1 --2- 172.21.15.84:0/1541472450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 0x7f66080cef00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f660000b050 tx=0x7f660002c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4985066952bce75c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.219+0000 7f65fffff640 1 -- 172.21.15.84:0/1541472450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660002cce0 con 0x7f66080b1fa0 2023-12-12T09:20:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.219+0000 7f65fffff640 1 -- 172.21.15.84:0/1541472450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660002ce40 con 0x7f66080b1fa0 2023-12-12T09:20:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.220+0000 7f17c9ae6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17bc038080 0x7f17bc0e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.220+0000 7f17c9ae6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc038500 0x7f17bc03d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.220+0000 7f17c9ae6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17bc0e77c0 0x7f17bc0e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.219+0000 7f65fffff640 1 -- 172.21.15.84:0/1541472450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600034660 con 0x7f66080b1fa0 2023-12-12T09:20:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.220+0000 7f17c9ae6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc03e6a0 con 0x7f17bc038080 2023-12-12T09:20:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.220+0000 7f17c9ae6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc03de00 con 0x7f17bc0e77c0 2023-12-12T09:20:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.220+0000 7f17c9ae6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc03e0e0 con 0x7f17bc038500 2023-12-12T09:20:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.221+0000 7f17c8ae4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17bc038080 0x7f17bc0e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.221+0000 7f17c8ae4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17bc038080 0x7f17bc0e2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34488/0 (socket says 172.21.15.84:34488) 2023-12-12T09:20:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.221+0000 7f17c8ae4640 1 -- 172.21.15.84:0/3572293046 learned_addr learned my addr 172.21.15.84:0/3572293046 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.220+0000 7f660f89b640 1 -- 172.21.15.84:0/1541472450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 msgr2=0x7f66080cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.220+0000 7f660f89b640 1 --2- 172.21.15.84:0/1541472450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 0x7f66080cef00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f660000b050 tx=0x7f660002c140 comp rx=0 tx=0).stop 2023-12-12T09:20:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.222+0000 7f17c92e5640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17bc0e77c0 0x7f17bc0e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.222+0000 7f17c3fff640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc038500 0x7f17bc03d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.223+0000 7f660f89b640 1 -- 172.21.15.84:0/1541472450 shutdown_connections 2023-12-12T09:20:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.223+0000 7f660f89b640 1 --2- 172.21.15.84:0/1541472450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 0x7f66080cef00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.223+0000 7f17c8ae4640 1 -- 172.21.15.84:0/3572293046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc038500 msgr2=0x7f17bc03d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.224+0000 7f660f89b640 1 --2- 172.21.15.84:0/1541472450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6608165eb0 0x7f66080b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.224+0000 7f660f89b640 1 -- 172.21.15.84:0/1541472450 >> 172.21.15.84:0/1541472450 conn(0x7f660806a920 msgr2=0x7f660806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.225+0000 7f660f89b640 1 -- 172.21.15.84:0/1541472450 shutdown_connections 2023-12-12T09:20:12.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.226+0000 7f660f89b640 1 -- 172.21.15.84:0/1541472450 wait complete. 2023-12-12T09:20:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.231+0000 7f660f89b640 1 Processor -- start 2023-12-12T09:20:12.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.233+0000 7f660f89b640 1 -- start start 2023-12-12T09:20:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.223+0000 7f17c8ae4640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc038500 0x7f17bc03d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.223+0000 7f17c8ae4640 1 -- 172.21.15.84:0/3572293046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17bc0e77c0 msgr2=0x7f17bc0e5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.223+0000 7f17c8ae4640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17bc0e77c0 0x7f17bc0e5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.223+0000 7f17c8ae4640 1 -- 172.21.15.84:0/3572293046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17bc03e3c0 con 0x7f17bc038080 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.223+0000 7f17c8ae4640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17bc038080 0x7f17bc0e2d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f17c4000b60 tx=0x7f17c406a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.224+0000 7f17c17fa640 1 -- 172.21.15.84:0/3572293046 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40b5040 con 0x7f17bc038080 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.224+0000 7f17c17fa640 1 -- 172.21.15.84:0/3572293046 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c40bc450 con 0x7f17bc038080 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.224+0000 7f17c17fa640 1 -- 172.21.15.84:0/3572293046 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40bc7c0 con 0x7f17bc038080 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.224+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17bc0e8d30 con 0x7f17bc038080 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.224+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17bc03da10 con 0x7f17bc038080 2023-12-12T09:20:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.227+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17bc0e8b70 con 0x7f17bc038080 2023-12-12T09:20:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.237+0000 7f17c17fa640 1 -- 172.21.15.84:0/3572293046 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17c40b8070 con 0x7f17bc038080 2023-12-12T09:20:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.240+0000 7f660f89b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 0x7f66080ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.240+0000 7f660f89b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f660814ac30 0x7f6608146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.240+0000 7f660f89b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66080aa270 0x7f66080aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.240+0000 7f660f89b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080ad700 con 0x7f66080b1fa0 2023-12-12T09:20:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.240+0000 7f660f89b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080acd30 con 0x7f66080aa270 2023-12-12T09:20:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.240+0000 7f660f89b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080aad10 con 0x7f660814ac30 2023-12-12T09:20:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.241+0000 7f660de38640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66080aa270 0x7f66080aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.241+0000 7f660de38640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66080aa270 0x7f66080aa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:34878/0 (socket says 172.21.15.84:34878) 2023-12-12T09:20:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.241+0000 7f660de38640 1 -- 172.21.15.84:0/4182825686 learned_addr learned my addr 172.21.15.84:0/4182825686 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.242+0000 7f660ce36640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f660814ac30 0x7f6608146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.242+0000 7f660d637640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 0x7f66080ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.242+0000 7f17c17fa640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17b006ae70 0x7f17b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.242+0000 7f660de38640 1 -- 172.21.15.84:0/4182825686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f660814ac30 msgr2=0x7f6608146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.243+0000 7f17c17fa640 1 -- 172.21.15.84:0/3572293046 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17c4125ff0 con 0x7f17bc038080 2023-12-12T09:20:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.242+0000 7f660de38640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f660814ac30 0x7f6608146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.243+0000 7f660de38640 1 -- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 msgr2=0x7f66080ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.243+0000 7f17c17fa640 1 -- 172.21.15.84:0/3572293046 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17c41263d0 con 0x7f17bc038080 2023-12-12T09:20:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.243+0000 7f660de38640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 0x7f66080ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.243+0000 7f660de38640 1 -- 172.21.15.84:0/4182825686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600009a70 con 0x7f66080aa270 2023-12-12T09:20:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.243+0000 7f660d637640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 0x7f66080ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.244+0000 7f660de38640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66080aa270 0x7f66080aa720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6600037040 tx=0x7f6600004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.247+0000 7f65fdffb640 1 -- 172.21.15.84:0/4182825686 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600004800 con 0x7f66080aa270 2023-12-12T09:20:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.247+0000 7f65fdffb640 1 -- 172.21.15.84:0/4182825686 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600003e30 con 0x7f66080aa270 2023-12-12T09:20:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.247+0000 7f65fdffb640 1 -- 172.21.15.84:0/4182825686 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600034680 con 0x7f66080aa270 2023-12-12T09:20:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.247+0000 7f17c3fff640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17b006ae70 0x7f17b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.247+0000 7f660f89b640 1 -- 172.21.15.84:0/4182825686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660814b310 con 0x7f66080aa270 2023-12-12T09:20:12.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.248+0000 7f17c3fff640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17b006ae70 0x7f17b006d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17bc053080 tx=0x7f17b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.247+0000 7f660f89b640 1 -- 172.21.15.84:0/4182825686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66080ac6e0 con 0x7f66080aa270 2023-12-12T09:20:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.252+0000 7f65eb7fe640 1 -- 172.21.15.84:0/4182825686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66080acee0 con 0x7f66080aa270 2023-12-12T09:20:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.252+0000 7f65fdffb640 1 -- 172.21.15.84:0/4182825686 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f660003b050 con 0x7f66080aa270 2023-12-12T09:20:12.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.254+0000 7f65fdffb640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f65ec06af10 0x7f65ec06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.254+0000 7f65fdffb640 1 -- 172.21.15.84:0/4182825686 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f66000aba80 con 0x7f66080aa270 2023-12-12T09:20:12.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.254+0000 7f660d637640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f65ec06af10 0x7f65ec06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.256+0000 7f660d637640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f65ec06af10 0x7f65ec06d3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f66040011e0 tx=0x7f6604009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.271+0000 7f65fdffb640 1 -- 172.21.15.84:0/4182825686 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f66080acee0 con 0x7f66080aa270 2023-12-12T09:20:12.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.281+0000 7f630a5be640 1 Processor -- start 2023-12-12T09:20:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.282+0000 7f630a5be640 1 -- start start 2023-12-12T09:20:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.284+0000 7f630a5be640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63040d16f0 0x7f63040d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.284+0000 7f630a5be640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63040b04b0 0x7f63040b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.284+0000 7f63037fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63040d16f0 0x7f63040d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.285+0000 7f630a5be640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63040afd40 con 0x7f630415d490 2023-12-12T09:20:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.285+0000 7f630a5be640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63040b0090 con 0x7f63040d16f0 2023-12-12T09:20:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.285+0000 7f630a5be640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63040d20c0 con 0x7f63040b04b0 2023-12-12T09:20:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.285+0000 7f63037fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f63040d16f0 0x7f63040d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34494/0 (socket says 172.21.15.84:34494) 2023-12-12T09:20:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.285+0000 7f63037fe640 1 -- 172.21.15.84:0/2013918273 learned_addr learned my addr 172.21.15.84:0/2013918273 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.286+0000 7f63037fe640 1 -- 172.21.15.84:0/2013918273 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63040b04b0 msgr2=0x7f63040b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.286+0000 7f63037fe640 1 --2- 172.21.15.84:0/2013918273 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63040b04b0 0x7f63040b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.286+0000 7f63037fe640 1 -- 172.21.15.84:0/2013918273 >> v1:172.21.15.99:6789/0 conn(0x7f630415d490 legacy=0x7f63040d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.286+0000 7f63037fe640 1 -- 172.21.15.84:0/2013918273 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040ce860 con 0x7f63040d16f0 2023-12-12T09:20:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.288+0000 7f63037fe640 1 --2- 172.21.15.84:0/2013918273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040d16f0 0x7f63040d1b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009e50 tx=0x7f62fc02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aad200aed719341 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.289+0000 7f6302ffd640 1 -- 172.21.15.84:0/2013918273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc02caa0 con 0x7f63040d16f0 2023-12-12T09:20:12.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.289+0000 7f6302ffd640 1 -- 172.21.15.84:0/2013918273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc02cc00 con 0x7f63040d16f0 2023-12-12T09:20:12.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.289+0000 7f3dc869b640 1 Processor -- start 2023-12-12T09:20:12.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.289+0000 7f3dc869b640 1 -- start start 2023-12-12T09:20:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.290+0000 7f6302ffd640 1 -- 172.21.15.84:0/2013918273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0343f0 con 0x7f63040d16f0 2023-12-12T09:20:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f630a5be640 1 -- 172.21.15.84:0/2013918273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040d16f0 msgr2=0x7f63040d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f630a5be640 1 --2- 172.21.15.84:0/2013918273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040d16f0 0x7f63040d1b80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009e50 tx=0x7f62fc02bf00 comp rx=0 tx=0).stop 2023-12-12T09:20:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f630a5be640 1 -- 172.21.15.84:0/2013918273 shutdown_connections 2023-12-12T09:20:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f630a5be640 1 --2- 172.21.15.84:0/2013918273 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63040b04b0 0x7f63040b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f630a5be640 1 --2- 172.21.15.84:0/2013918273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040d16f0 0x7f63040d1b80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f630a5be640 1 -- 172.21.15.84:0/2013918273 >> 172.21.15.84:0/2013918273 conn(0x7f630409c450 msgr2=0x7f63040d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f3dc869b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3dc00cb2d0 0x7f3dc0162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f3dc869b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc00723a0 con 0x7f3dc00b1dc0 2023-12-12T09:20:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f3dc869b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc00b2360 con 0x7f3dc00b3f80 2023-12-12T09:20:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.291+0000 7f3dc869b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc0162ab0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.292+0000 7f630a5be640 1 -- 172.21.15.84:0/2013918273 shutdown_connections 2023-12-12T09:20:12.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.292+0000 7f630a5be640 1 -- 172.21.15.84:0/2013918273 wait complete. 2023-12-12T09:20:12.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.292+0000 7f3dc5c36640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3dc00b1dc0 0x7f3dc00b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50236/0 (socket says 172.21.15.84:50236) 2023-12-12T09:20:12.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.292+0000 7f3dc5c36640 1 -- 172.21.15.84:0/1464953986 learned_addr learned my addr 172.21.15.84:0/1464953986 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:12.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.293+0000 7f3dc6437640 1 --2- 172.21.15.84:0/1464953986 >> v2:172.21.15.84:3300/0 conn(0x7f3dc00cb2d0 0x7f3dc0162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.293+0000 7f3dc5435640 1 -- 172.21.15.84:0/1464953986 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926723591 0 0) 0x7f3dc00723a0 con 0x7f3dc00b1dc0 2023-12-12T09:20:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.293+0000 7f3dc5435640 1 -- 172.21.15.84:0/1464953986 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dac003520 con 0x7f3dc00b1dc0 2023-12-12T09:20:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.294+0000 7f630a5be640 1 Processor -- start 2023-12-12T09:20:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.294+0000 7f3dc6437640 1 -- 172.21.15.84:0/1464953986 >> v1:172.21.15.99:6789/0 conn(0x7f3dc00b3f80 legacy=0x7f3dc00703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.294+0000 7f3dc6437640 1 -- 172.21.15.84:0/1464953986 >> v1:172.21.15.84:6789/0 conn(0x7f3dc00b1dc0 legacy=0x7f3dc00b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.294+0000 7f3dc6437640 1 -- 172.21.15.84:0/1464953986 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00b2640 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.295+0000 7f630a5be640 1 -- start start 2023-12-12T09:20:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.295+0000 7f3dc6437640 1 --2- 172.21.15.84:0/1464953986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc0162570 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009a00 tx=0x7f3dbc02bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f0b21884b85670 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.296+0000 7f3dc5435640 1 -- 172.21.15.84:0/1464953986 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc02d6e0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.296+0000 7f3dc5435640 1 -- 172.21.15.84:0/1464953986 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc02d840 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.296+0000 7f3dc5435640 1 -- 172.21.15.84:0/1464953986 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc02dbd0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.297+0000 7f630a5be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040b04b0 0x7f63040c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.297+0000 7f3dc869b640 1 -- 172.21.15.84:0/1464953986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 msgr2=0x7f3dc0162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.297+0000 7f3dc869b640 1 --2- 172.21.15.84:0/1464953986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc0162570 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009a00 tx=0x7f3dbc02bb30 comp rx=0 tx=0).stop 2023-12-12T09:20:12.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.297+0000 7f630a5be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63040d16f0 0x7f63040c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.297+0000 7f630a5be640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f630415d490 0x7f63040c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f630a5be640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63041f7010 con 0x7f63040b04b0 2023-12-12T09:20:12.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f3dc869b640 1 -- 172.21.15.84:0/1464953986 shutdown_connections 2023-12-12T09:20:12.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f3dc869b640 1 --2- 172.21.15.84:0/1464953986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc0162570 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f3dc869b640 1 -- 172.21.15.84:0/1464953986 >> 172.21.15.84:0/1464953986 conn(0x7f3dc006c3d0 msgr2=0x7f3dc006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f630a5be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040ca1e0 con 0x7f63040d16f0 2023-12-12T09:20:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f630a5be640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63040c9450 con 0x7f630415d490 2023-12-12T09:20:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f6308b5b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f630415d490 0x7f63040c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f6308b5b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f630415d490 0x7f63040c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41472/0 (socket says 172.21.15.84:41472) 2023-12-12T09:20:12.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f6308b5b640 1 -- 172.21.15.84:0/2695935160 learned_addr learned my addr 172.21.15.84:0/2695935160 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f3dc869b640 1 -- 172.21.15.84:0/1464953986 shutdown_connections 2023-12-12T09:20:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f3dc869b640 1 -- 172.21.15.84:0/1464953986 wait complete. 2023-12-12T09:20:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f6303fff640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040b04b0 0x7f63040c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.299+0000 7f6308b5b640 1 -- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63040d16f0 msgr2=0x7f63040c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.298+0000 7f63037fe640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63040d16f0 0x7f63040c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.299+0000 7f6308b5b640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63040d16f0 0x7f63040c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.299+0000 7f6308b5b640 1 -- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040b04b0 msgr2=0x7f63040c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.299+0000 7f6308b5b640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040b04b0 0x7f63040c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.299+0000 7f6308b5b640 1 -- 172.21.15.84:0/2695935160 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc009b30 con 0x7f630415d490 2023-12-12T09:20:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.300+0000 7f63037fe640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63040d16f0 0x7f63040c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.300+0000 7f6308b5b640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f630415d490 0x7f63040c7180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f62f800b410 tx=0x7f62f800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.300+0000 7f6300ff9640 1 -- 172.21.15.84:0/2695935160 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8011830 con 0x7f630415d490 2023-12-12T09:20:12.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.301+0000 7f6300ff9640 1 -- 172.21.15.84:0/2695935160 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f8011990 con 0x7f630415d490 2023-12-12T09:20:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.301+0000 7f6300ff9640 1 -- 172.21.15.84:0/2695935160 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8011d20 con 0x7f630415d490 2023-12-12T09:20:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.301+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63040ca430 con 0x7f630415d490 2023-12-12T09:20:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.301+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63040ca9f0 con 0x7f630415d490 2023-12-12T09:20:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.301+0000 7f3dc869b640 1 Processor -- start 2023-12-12T09:20:12.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.302+0000 7f3dc869b640 1 -- start start 2023-12-12T09:20:12.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f4f80e2b640 1 Processor -- start 2023-12-12T09:20:12.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6304072b80 con 0x7f630415d490 2023-12-12T09:20:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f3dc869b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc00b1dc0 0x7f3dc0203500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f3dc869b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3dc00b3f80 0x7f3dc0160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f3dc869b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc01ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f3dc869b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc0203da0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f3dc869b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc0204080 con 0x7f3dc00b1dc0 2023-12-12T09:20:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f3dc869b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc0204360 con 0x7f3dc00b3f80 2023-12-12T09:20:12.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.303+0000 7f4f80e2b640 1 -- start start 2023-12-12T09:20:12.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.304+0000 7f3dc6c38640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc01ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.304+0000 7fdfa38da640 1 Processor -- start 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.304+0000 7f3dc6c38640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc01ff5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34518/0 (socket says 172.21.15.84:34518) 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.304+0000 7f3dc6c38640 1 -- 172.21.15.84:0/78114671 learned_addr learned my addr 172.21.15.84:0/78114671 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.304+0000 7f3dc6437640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc00b1dc0 0x7f3dc0203500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.304+0000 7f3dc5c36640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3dc00b3f80 0x7f3dc0160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f3dc6c38640 1 -- 172.21.15.84:0/78114671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3dc00b3f80 msgr2=0x7f3dc0160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f3dc6c38640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3dc00b3f80 0x7f3dc0160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f3dc6c38640 1 -- 172.21.15.84:0/78114671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc00b1dc0 msgr2=0x7f3dc0203500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f3dc6c38640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc00b1dc0 0x7f3dc0203500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f3dc6c38640 1 -- 172.21.15.84:0/78114671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc009400 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.304+0000 7fdfa38da640 1 -- start start 2023-12-12T09:20:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f4f80e2b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f4f80e2b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4f7c159470 0x7f4f7c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f4f80e2b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f7c0cc7b0 con 0x7f4f7c159090 2023-12-12T09:20:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f4f80e2b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f7c0b3820 con 0x7f4f7c159470 2023-12-12T09:20:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f4f80e2b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c0b25c0 con 0x7f4f7c0b4570 2023-12-12T09:20:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7f4f7a59c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4f7c159090 0x7f4f7c0b3e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:46840/0 (socket says 172.21.15.84:46840) 2023-12-12T09:20:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7efe1397c640 1 Processor -- start 2023-12-12T09:20:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7fdfa38da640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c14ac30 0x7fdf9c161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7fdfa38da640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdf9c165eb0 0x7fdf9c0b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7f4f7a59c640 1 -- 172.21.15.84:0/3737385297 learned_addr learned my addr 172.21.15.84:0/3737385297 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7f4f79d9b640 1 --2- 172.21.15.84:0/3737385297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.307+0000 7fdfa38da640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9c0b2440 con 0x7fdf9c0b1fa0 2023-12-12T09:20:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.307+0000 7fdfa38da640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9c06c310 con 0x7fdf9c165eb0 2023-12-12T09:20:12.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.307+0000 7fdfa38da640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c06c5f0 con 0x7fdf9c14ac30 2023-12-12T09:20:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.307+0000 7f4f7ad9d640 1 --2- 172.21.15.84:0/3737385297 >> v2:172.21.15.84:3300/0 conn(0x7f4f7c159470 0x7f4f7c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.305+0000 7f3dc6c38640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc01ff5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3db800c710 tx=0x7f3db800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7f3db6ffd640 1 -- 172.21.15.84:0/78114671 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8003b70 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7f3db6ffd640 1 -- 172.21.15.84:0/78114671 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db8003cd0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7f3db6ffd640 1 -- 172.21.15.84:0/78114671 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800aa90 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc0160290 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.306+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc0203a40 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7f4f7ad9d640 1 -- 172.21.15.84:0/3737385297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 msgr2=0x7f4f7c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:12.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7f4f7ad9d640 1 --2- 172.21.15.84:0/3737385297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c06c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7f4f7ad9d640 1 -- 172.21.15.84:0/3737385297 >> v1:172.21.15.99:6789/0 conn(0x7f4f7c159090 legacy=0x7f4f7c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7f4f7ad9d640 1 -- 172.21.15.84:0/3737385297 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0cc9e0 con 0x7f4f7c159470 2023-12-12T09:20:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.307+0000 7fdfa1676640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c14ac30 0x7fdf9c161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.307+0000 7fdfa1e77640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdf9c0b1fa0 0x7fdf9c0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:46844/0 (socket says 172.21.15.84:46844) 2023-12-12T09:20:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.307+0000 7fdfa1e77640 1 -- 172.21.15.84:0/463056005 learned_addr learned my addr 172.21.15.84:0/463056005 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7fdfa0e75640 1 --2- 172.21.15.84:0/463056005 >> v2:172.21.15.99:3300/0 conn(0x7fdf9c165eb0 0x7fdf9c0b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7fdfa1676640 1 -- 172.21.15.84:0/463056005 >> v2:172.21.15.99:3300/0 conn(0x7fdf9c165eb0 msgr2=0x7fdf9c0b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7fdfa1676640 1 --2- 172.21.15.84:0/463056005 >> v2:172.21.15.99:3300/0 conn(0x7fdf9c165eb0 0x7fdf9c0b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7fdfa1676640 1 -- 172.21.15.84:0/463056005 >> v1:172.21.15.99:6789/0 conn(0x7fdf9c0b1fa0 legacy=0x7fdf9c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.309+0000 7fdfa1676640 1 -- 172.21.15.84:0/463056005 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c06c8d0 con 0x7fdf9c14ac30 2023-12-12T09:20:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.308+0000 7f6300ff9640 1 -- 172.21.15.84:0/2695935160 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f62f801a400 con 0x7f630415d490 2023-12-12T09:20:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.309+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc01600f0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.307+0000 7efe1397c640 1 -- start start 2023-12-12T09:20:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.309+0000 7efe1397c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe0c0cfa50 0x7efe0c0d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.309+0000 7efe1397c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efe0c0b4520 0x7efe0c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.309+0000 7efe1397c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfe30 0x7efe0c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.309+0000 7efe1397c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c0ce6c0 con 0x7efe0c0cfa50 2023-12-12T09:20:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.309+0000 7efe1397c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c0d3cf0 con 0x7efe0c0b4520 2023-12-12T09:20:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.309+0000 7efe1397c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0b3a60 con 0x7efe0c0cfe30 2023-12-12T09:20:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7f6300ff9640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f62f006ae40 0x7f62f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7f4f7ad9d640 1 --2- 172.21.15.84:0/3737385297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f7c159470 0x7f4f7c0b2a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400b050 tx=0x7f4f7402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff1d50dbbf198b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7efe11718640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe0c0cfa50 0x7efe0c0d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7efe11718640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efe0c0cfa50 0x7efe0c0d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34544/0 (socket says 172.21.15.84:34544) 2023-12-12T09:20:12.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7f6300ff9640 1 -- 172.21.15.84:0/2695935160 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62f8089ff0 con 0x7f630415d490 2023-12-12T09:20:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7efe11f19640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfe30 0x7efe0c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7efe11f19640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfe30 0x7efe0c0c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41502/0 (socket says 172.21.15.84:41502) 2023-12-12T09:20:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7efe11f19640 1 -- 172.21.15.84:0/806000779 learned_addr learned my addr 172.21.15.84:0/806000779 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7f4f7959a640 1 -- 172.21.15.84:0/3737385297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7402c9d0 con 0x7f4f7c159470 2023-12-12T09:20:12.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7efe10f17640 1 --2- 172.21.15.84:0/806000779 >> v2:172.21.15.99:3300/0 conn(0x7efe0c0b4520 0x7efe0c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7f4f7959a640 1 -- 172.21.15.84:0/3737385297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7402cb30 con 0x7f4f7c159470 2023-12-12T09:20:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.310+0000 7f4f7959a640 1 -- 172.21.15.84:0/3737385297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74034440 con 0x7f4f7c159470 2023-12-12T09:20:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.311+0000 7f6303fff640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f62f006ae40 0x7f62f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.311+0000 7fdfa1676640 1 --2- 172.21.15.84:0/463056005 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c14ac30 0x7fdf9c161b60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf980097a0 tx=0x7fdf9802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb90390a84e3aa1e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.311+0000 7f3db6ffd640 1 -- 172.21.15.84:0/78114671 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3db800abf0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.311+0000 7efe10f17640 1 -- 172.21.15.84:0/806000779 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfe30 msgr2=0x7efe0c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.311+0000 7efe10f17640 1 --2- 172.21.15.84:0/806000779 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfe30 0x7efe0c0c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.311+0000 7efe10f17640 1 -- 172.21.15.84:0/806000779 >> v2:172.21.15.84:3300/0 conn(0x7efe0c0cfa50 msgr2=0x7efe0c0d37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.311+0000 7efe10f17640 1 --2- 172.21.15.84:0/806000779 >> v2:172.21.15.84:3300/0 conn(0x7efe0c0cfa50 0x7efe0c0d37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.312+0000 7efe10f17640 1 -- 172.21.15.84:0/806000779 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0ce8d0 con 0x7efe0c0b4520 2023-12-12T09:20:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.312+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3737385297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f7c159470 msgr2=0x7f4f7c0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.312+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3737385297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f7c159470 0x7f4f7c0b2a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400b050 tx=0x7f4f7402beb0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.312+0000 7f6303fff640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f62f006ae40 0x7f62f006d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f62f4000f60 tx=0x7f62f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.312+0000 7f3db6ffd640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3da406ae90 0x7f3da406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3737385297 shutdown_connections 2023-12-12T09:20:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3737385297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f7c159470 0x7f4f7c0b2a50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3737385297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3737385297 >> 172.21.15.84:0/3737385297 conn(0x7f4f7c0aea30 msgr2=0x7f4f7c0aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7f3db6ffd640 1 -- 172.21.15.84:0/78114671 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3db8089570 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3737385297 shutdown_connections 2023-12-12T09:20:12.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3737385297 wait complete. 2023-12-12T09:20:12.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7f3dc6437640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3da406ae90 0x7f3da406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7efe11f19640 1 --2- 172.21.15.84:0/806000779 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfe30 0x7efe0c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:20:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.313+0000 7efe11718640 1 --2- 172.21.15.84:0/806000779 >> v2:172.21.15.84:3300/0 conn(0x7efe0c0cfa50 0x7efe0c0d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:20:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.314+0000 7efe10f17640 1 --2- 172.21.15.84:0/806000779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0b4520 0x7efe0c0c5ca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efe0c06abd0 tx=0x7efdfc02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1bb2cc108056c78 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.314+0000 7f3dc6437640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3da406ae90 0x7f3da406d350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc036000 tx=0x7f3dbc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.314+0000 7efe03fff640 1 -- 172.21.15.84:0/806000779 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0317e0 con 0x7efe0c0b4520 2023-12-12T09:20:12.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.315+0000 7efe03fff640 1 -- 172.21.15.84:0/806000779 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc031940 con 0x7efe0c0b4520 2023-12-12T09:20:12.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.315+0000 7fd5c314e640 1 Processor -- start 2023-12-12T09:20:12.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.315+0000 7fd5c314e640 1 -- start start 2023-12-12T09:20:12.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe03fff640 1 -- 172.21.15.84:0/806000779 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc031d10 con 0x7efe0c0b4520 2023-12-12T09:20:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7f4f80e2b640 1 Processor -- start 2023-12-12T09:20:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 -- 172.21.15.84:0/806000779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0b4520 msgr2=0x7efe0c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 --2- 172.21.15.84:0/806000779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0b4520 0x7efe0c0c5ca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efe0c06abd0 tx=0x7efdfc02b880 comp rx=0 tx=0).stop 2023-12-12T09:20:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 -- 172.21.15.84:0/806000779 shutdown_connections 2023-12-12T09:20:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 --2- 172.21.15.84:0/806000779 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfe30 0x7efe0c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 --2- 172.21.15.84:0/806000779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0b4520 0x7efe0c0c5ca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 --2- 172.21.15.84:0/806000779 >> v2:172.21.15.84:3300/0 conn(0x7efe0c0cfa50 0x7efe0c0d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 -- 172.21.15.84:0/806000779 >> 172.21.15.84:0/806000779 conn(0x7efe0c09c3e0 msgr2=0x7efe0c0d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7f4f80e2b640 1 -- start start 2023-12-12T09:20:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 -- 172.21.15.84:0/806000779 shutdown_connections 2023-12-12T09:20:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.316+0000 7efe1397c640 1 -- 172.21.15.84:0/806000779 wait complete. 2023-12-12T09:20:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.317+0000 7fd5c314e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5b4053780 0x7fd5b4053b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.317+0000 7fd5c314e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b4007870 con 0x7fd5b40061e0 2023-12-12T09:20:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.317+0000 7fd5c314e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b4058180 con 0x7fd5b4006670 2023-12-12T09:20:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.317+0000 7fd5c314e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40540a0 con 0x7fd5b4053780 2023-12-12T09:20:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.317+0000 7fd5c214c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5b4053780 0x7fd5b4053b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7fd5c214c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5b4053780 0x7fd5b4053b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34560/0 (socket says 172.21.15.84:34560) 2023-12-12T09:20:12.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7fd5c214c640 1 -- 172.21.15.84:0/1675704486 learned_addr learned my addr 172.21.15.84:0/1675704486 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f80e2b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f80e2b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f7c159090 0x7f4f7c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f80e2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f7c159470 0x7f4f7c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f80e2b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c150570 con 0x7f4f7c159090 2023-12-12T09:20:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f80e2b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c150850 con 0x7f4f7c159470 2023-12-12T09:20:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f80e2b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7c150b30 con 0x7f4f7c0b4570 2023-12-12T09:20:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f7ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f7c159470 0x7f4f7c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f7ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f7c159470 0x7f4f7c0ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:34920/0 (socket says 172.21.15.84:34920) 2023-12-12T09:20:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.318+0000 7f4f7ad9d640 1 -- 172.21.15.84:0/3361695987 learned_addr learned my addr 172.21.15.84:0/3361695987 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7f3db6ffd640 1 -- 172.21.15.84:0/78114671 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3dc01600f0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7f4f7a59c640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7fd5c114a640 1 -- 172.21.15.84:0/1675704486 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804025972 0 0) 0x7fd5b4058180 con 0x7fd5b4006670 2023-12-12T09:20:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7fd5c114a640 1 -- 172.21.15.84:0/1675704486 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a8003520 con 0x7fd5b4006670 2023-12-12T09:20:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7fd5c114a640 1 -- 172.21.15.84:0/1675704486 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977717996 0 0) 0x7fd5b4007870 con 0x7fd5b40061e0 2023-12-12T09:20:12.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7fd5c114a640 1 -- 172.21.15.84:0/1675704486 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b4058180 con 0x7fd5b40061e0 2023-12-12T09:20:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7f4f7ad9d640 1 -- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 msgr2=0x7f4f7c151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7f4f7ad9d640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7f4f7ad9d640 1 -- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f7c159090 msgr2=0x7f4f7c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7f4f7ad9d640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f7c159090 0x7f4f7c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7f4f7ad9d640 1 -- 172.21.15.84:0/3361695987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009a70 con 0x7f4f7c159470 2023-12-12T09:20:12.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7f4f7a59c640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:12.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7fd5c214c640 1 -- 172.21.15.84:0/1675704486 >> v1:172.21.15.99:6789/0 conn(0x7fd5b4006670 legacy=0x7fd5b4057a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7fd5c214c640 1 -- 172.21.15.84:0/1675704486 >> v1:172.21.15.84:6789/0 conn(0x7fd5b40061e0 legacy=0x7fd5b4057360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7fd5c214c640 1 -- 172.21.15.84:0/1675704486 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b4006c60 con 0x7fd5b4053780 2023-12-12T09:20:12.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.319+0000 7efe1397c640 1 Processor -- start 2023-12-12T09:20:12.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.320+0000 7efe1397c640 1 -- start start 2023-12-12T09:20:12.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.320+0000 7f4f7ad9d640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f7c159470 0x7f4f7c0ad780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400b050 tx=0x7f4f74004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.321+0000 7f4f6affd640 1 -- 172.21.15.84:0/3361695987 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74003b90 con 0x7f4f7c159470 2023-12-12T09:20:12.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.321+0000 7f4f6affd640 1 -- 172.21.15.84:0/3361695987 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f74003cf0 con 0x7f4f7c159470 2023-12-12T09:20:12.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.321+0000 7f4f6affd640 1 -- 172.21.15.84:0/3361695987 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74004270 con 0x7f4f7c159470 2023-12-12T09:20:12.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.321+0000 7fd5c214c640 1 --2- 172.21.15.84:0/1675704486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4053780 0x7fd5b4053b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80098a0 tx=0x7fd5b802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde80252de44991a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.321+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7c150e10 con 0x7f4f7c159470 2023-12-12T09:20:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.321+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7c150220 con 0x7f4f7c159470 2023-12-12T09:20:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.322+0000 7efe1397c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0b4520 0x7efe0c0ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.322+0000 7efe1397c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfa50 0x7efe0c0c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.322+0000 7fdf93fff640 1 -- 172.21.15.84:0/463056005 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98031640 con 0x7fdf9c14ac30 2023-12-12T09:20:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.322+0000 7fdf93fff640 1 -- 172.21.15.84:0/463056005 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf980317a0 con 0x7fdf9c14ac30 2023-12-12T09:20:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.322+0000 7fdf93fff640 1 -- 172.21.15.84:0/463056005 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98031b70 con 0x7fdf9c14ac30 2023-12-12T09:20:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.322+0000 7efe1397c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0cfe30 0x7efe0c152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.322+0000 7f6300ff9640 1 -- 172.21.15.84:0/2695935160 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62f8054d90 con 0x7f630415d490 2023-12-12T09:20:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7c151330 con 0x7f4f7c159470 2023-12-12T09:20:12.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7efe1397c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0cc770 con 0x7efe0c0b4520 2023-12-12T09:20:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7efe1397c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0cbe40 con 0x7efe0c0cfe30 2023-12-12T09:20:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7efe1397c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0cc120 con 0x7efe0c0cfa50 2023-12-12T09:20:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7efe10f17640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfa50 0x7efe0c0c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7efe11718640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0b4520 0x7efe0c0ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7efe10f17640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfa50 0x7efe0c0c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41520/0 (socket says 172.21.15.84:41520) 2023-12-12T09:20:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7efe10f17640 1 -- 172.21.15.84:0/4282263276 learned_addr learned my addr 172.21.15.84:0/4282263276 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7fdfa38da640 1 -- 172.21.15.84:0/463056005 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c14ac30 msgr2=0x7fdf9c161b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7fdfa38da640 1 --2- 172.21.15.84:0/463056005 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c14ac30 0x7fdf9c161b60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf980097a0 tx=0x7fdf9802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7fd5c114a640 1 -- 172.21.15.84:0/1675704486 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8030860 con 0x7fd5b4053780 2023-12-12T09:20:12.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7fd5c114a640 1 -- 172.21.15.84:0/1675704486 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b80309c0 con 0x7fd5b4053780 2023-12-12T09:20:12.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7fd5c114a640 1 -- 172.21.15.84:0/1675704486 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8030d50 con 0x7fd5b4053780 2023-12-12T09:20:12.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.323+0000 7efe11f19640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0cfe30 0x7efe0c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.324+0000 7fd5c314e640 1 -- 172.21.15.84:0/1675704486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4053780 msgr2=0x7fd5b4053b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.324+0000 7fd5c314e640 1 --2- 172.21.15.84:0/1675704486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4053780 0x7fd5b4053b60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80098a0 tx=0x7fd5b802b9a0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.324+0000 7efe10f17640 1 -- 172.21.15.84:0/4282263276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0cfe30 msgr2=0x7efe0c152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.324+0000 7efe10f17640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0cfe30 0x7efe0c152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.324+0000 7efe10f17640 1 -- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0b4520 msgr2=0x7efe0c0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7efe10f17640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0b4520 0x7efe0c0ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7efe10f17640 1 -- 172.21.15.84:0/4282263276 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08009400 con 0x7efe0c0cfa50 2023-12-12T09:20:12.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7efe11718640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0b4520 0x7efe0c0ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fd5c314e640 1 -- 172.21.15.84:0/1675704486 shutdown_connections 2023-12-12T09:20:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fd5c314e640 1 --2- 172.21.15.84:0/1675704486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4053780 0x7fd5b4053b60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fd5c314e640 1 -- 172.21.15.84:0/1675704486 >> 172.21.15.84:0/1675704486 conn(0x7fd5b403aa10 msgr2=0x7fd5b403ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fdfa38da640 1 -- 172.21.15.84:0/463056005 shutdown_connections 2023-12-12T09:20:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fdfa38da640 1 --2- 172.21.15.84:0/463056005 >> v2:172.21.15.99:3300/0 conn(0x7fdf9c165eb0 0x7fdf9c0b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fdfa38da640 1 --2- 172.21.15.84:0/463056005 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c14ac30 0x7fdf9c161b60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fdfa38da640 1 -- 172.21.15.84:0/463056005 >> 172.21.15.84:0/463056005 conn(0x7fdf9c06a920 msgr2=0x7fdf9c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fd5c314e640 1 -- 172.21.15.84:0/1675704486 shutdown_connections 2023-12-12T09:20:12.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fdfa38da640 1 -- 172.21.15.84:0/463056005 shutdown_connections 2023-12-12T09:20:12.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.325+0000 7fdfa38da640 1 -- 172.21.15.84:0/463056005 wait complete. 2023-12-12T09:20:12.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.326+0000 7efe10f17640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfa50 0x7efe0c0c5b40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efdfc02b8c0 tx=0x7efdfc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.326+0000 7efe01ffb640 1 -- 172.21.15.84:0/4282263276 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc032880 con 0x7efe0c0cfa50 2023-12-12T09:20:12.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.326+0000 7efe01ffb640 1 -- 172.21.15.84:0/4282263276 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc032a00 con 0x7efe0c0cfa50 2023-12-12T09:20:12.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.326+0000 7efe01ffb640 1 -- 172.21.15.84:0/4282263276 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc032db0 con 0x7efe0c0cfa50 2023-12-12T09:20:12.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.326+0000 7fd5c314e640 1 -- 172.21.15.84:0/1675704486 wait complete. 2023-12-12T09:20:12.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.327+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe04009b30 con 0x7efe0c0cfa50 2023-12-12T09:20:12.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.327+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc009400 con 0x7efe0c0cfa50 2023-12-12T09:20:12.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.326+0000 7f4f6affd640 1 -- 172.21.15.84:0/3361695987 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f7403b070 con 0x7f4f7c159470 2023-12-12T09:20:12.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec005250 con 0x7efe0c0cfa50 2023-12-12T09:20:12.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7f4f6affd640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f5c06af10 0x7f4f5c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7f4f6affd640 1 -- 172.21.15.84:0/3361695987 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f740ac560 con 0x7f4f7c159470 2023-12-12T09:20:12.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.327+0000 7fdfa38da640 1 Processor -- start 2023-12-12T09:20:12.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.327+0000 7fdfa38da640 1 -- start start 2023-12-12T09:20:12.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.328+0000 7fdfa38da640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c0b1fa0 0x7fdf9c135920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.328+0000 7fdfa38da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c14ac30 0x7fdf9c0ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.328+0000 7fdfa38da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c0acdc0 0x7fdf9c160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.328+0000 7fdfa38da640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c0a8480 con 0x7fdf9c14ac30 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.328+0000 7fdfa38da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c0a9000 con 0x7fdf9c0acdc0 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.328+0000 7fdfa38da640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9c0ad250 con 0x7fdf9c0b1fa0 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa0e75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c14ac30 0x7fdf9c0ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa0e75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c14ac30 0x7fdf9c0ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34588/0 (socket says 172.21.15.84:34588) 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa0e75640 1 -- 172.21.15.84:0/2258985337 learned_addr learned my addr 172.21.15.84:0/2258985337 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa1e77640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c0acdc0 0x7fdf9c160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa1676640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c0b1fa0 0x7fdf9c135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa0e75640 1 -- 172.21.15.84:0/2258985337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c0b1fa0 msgr2=0x7fdf9c135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa0e75640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c0b1fa0 0x7fdf9c135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa0e75640 1 -- 172.21.15.84:0/2258985337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c0acdc0 msgr2=0x7fdf9c160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fdfa0e75640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c0acdc0 0x7fdf9c160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.330+0000 7fdfa0e75640 1 -- 172.21.15.84:0/2258985337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98009400 con 0x7fdf9c14ac30 2023-12-12T09:20:12.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.330+0000 7f4f7a59c640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f5c06af10 0x7f4f5c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.330+0000 7fdfa0e75640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c14ac30 0x7fdf9c0ac880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00d950 tx=0x7fdf8c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.330+0000 7fdf91ffb640 1 -- 172.21.15.84:0/2258985337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00b980 con 0x7fdf9c14ac30 2023-12-12T09:20:12.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.331+0000 7fdf91ffb640 1 -- 172.21.15.84:0/2258985337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c00bae0 con 0x7fdf9c14ac30 2023-12-12T09:20:12.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.331+0000 7fdf91ffb640 1 -- 172.21.15.84:0/2258985337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00be70 con 0x7fdf9c14ac30 2023-12-12T09:20:12.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.331+0000 7f4f7a59c640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f5c06af10 0x7f4f5c06d3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c000f60 tx=0x7f4f6c007ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.331+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9c0a86d0 con 0x7fdf9c14ac30 2023-12-12T09:20:12.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.331+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9c0a8c90 con 0x7fdf9c14ac30 2023-12-12T09:20:12.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.329+0000 7fd5c314e640 1 Processor -- start 2023-12-12T09:20:12.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.330+0000 7fd5c314e640 1 -- start start 2023-12-12T09:20:12.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.331+0000 7fd5c314e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b40061e0 0x7fd5b4185720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.331+0000 7fd5c314e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4006670 0x7fd5b400a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.331+0000 7fd5c314e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b4053780 0x7fd5b403c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.332+0000 7fd5c314e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4185c60 con 0x7fd5b4006670 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.332+0000 7fd5c314e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b400b410 con 0x7fd5b40061e0 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.332+0000 7fd5c314e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b400b6f0 con 0x7fd5b4053780 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.332+0000 7fd5c194b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4006670 0x7fd5b400a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.333+0000 7fd5c194b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4006670 0x7fd5b400a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34602/0 (socket says 172.21.15.84:34602) 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.333+0000 7fd5c194b640 1 -- 172.21.15.84:0/3564531915 learned_addr learned my addr 172.21.15.84:0/3564531915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:12.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.333+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9c0673c0 con 0x7fdf9c14ac30 2023-12-12T09:20:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.334+0000 7fd5c214c640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b40061e0 0x7fd5b4185720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.334+0000 7fd5c294d640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b4053780 0x7fd5b403c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.334+0000 7fd5c194b640 1 -- 172.21.15.84:0/3564531915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b4053780 msgr2=0x7fd5b403c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.334+0000 7fd5c194b640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b4053780 0x7fd5b403c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.334+0000 7fd5c194b640 1 -- 172.21.15.84:0/3564531915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b40061e0 msgr2=0x7fd5b4185720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.334+0000 7fd5c194b640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b40061e0 0x7fd5b4185720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.334+0000 7fd5c194b640 1 -- 172.21.15.84:0/3564531915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80094d0 con 0x7fd5b4006670 2023-12-12T09:20:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.334+0000 7fdf91ffb640 1 -- 172.21.15.84:0/2258985337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf8c040460 con 0x7fdf9c14ac30 2023-12-12T09:20:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.335+0000 7fd5c194b640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4006670 0x7fd5b400a980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c460 tx=0x7fd5ac00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.336+0000 7fdf91ffb640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf8006ae40 0x7fdf8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.336+0000 7efe01ffb640 1 -- 172.21.15.84:0/4282263276 <== mon.2 v2:172.21.15.99:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdfc04e440 con 0x7efe0c0cfa50 2023-12-12T09:20:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.338+0000 7efe01ffb640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efdf006ae40 0x7efdf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.336+0000 7fdf91ffb640 1 -- 172.21.15.84:0/2258985337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf8c0ac090 con 0x7fdf9c14ac30 2023-12-12T09:20:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.337+0000 7fdfa1676640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf8006ae40 0x7fdf8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.337+0000 7fdfa1676640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf8006ae40 0x7fdf8006d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf98036000 tx=0x7fdf9803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.338+0000 7efe01ffb640 1 -- 172.21.15.84:0/4282263276 <== mon.2 v2:172.21.15.99:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efdfc0abde0 con 0x7efe0c0cfa50 2023-12-12T09:20:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.340+0000 7efe11718640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efdf006ae40 0x7efdf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.340+0000 7f4f6affd640 1 -- 172.21.15.84:0/3361695987 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f74077300 con 0x7f4f7c159470 2023-12-12T09:20:12.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.341+0000 7efe11718640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efdf006ae40 0x7efdf006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0b2d40 tx=0x7efe08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.345+0000 7fd5b2ffd640 1 -- 172.21.15.84:0/3564531915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac005480 con 0x7fd5b4006670 2023-12-12T09:20:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.345+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b400b9d0 con 0x7fd5b4006670 2023-12-12T09:20:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.346+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b400bf90 con 0x7fd5b4006670 2023-12-12T09:20:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.346+0000 7fd5b2ffd640 1 -- 172.21.15.84:0/3564531915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac0035f0 con 0x7fd5b4006670 2023-12-12T09:20:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.347+0000 7fd5b2ffd640 1 -- 172.21.15.84:0/3564531915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac005480 con 0x7fd5b4006670 2023-12-12T09:20:12.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.346+0000 7fdf91ffb640 1 -- 172.21.15.84:0/2258985337 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf8c076ee0 con 0x7fdf9c14ac30 2023-12-12T09:20:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.347+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a4005250 con 0x7fd5b4006670 2023-12-12T09:20:12.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.348+0000 7efe01ffb640 1 -- 172.21.15.84:0/4282263276 <== mon.2 v2:172.21.15.99:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdfc076b80 con 0x7efe0c0cfa50 2023-12-12T09:20:12.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.357+0000 7fd5b2ffd640 1 -- 172.21.15.84:0/3564531915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5ac0037a0 con 0x7fd5b4006670 2023-12-12T09:20:12.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.358+0000 7fd5b2ffd640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd5a006af00 0x7fd5a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:12.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.362+0000 7fd5b2ffd640 1 -- 172.21.15.84:0/3564531915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5ac0578a0 con 0x7fd5b4006670 2023-12-12T09:20:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.363+0000 7fd5c214c640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd5a006af00 0x7fd5a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:12.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.363+0000 7fd5b2ffd640 1 -- 172.21.15.84:0/3564531915 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5ac054370 con 0x7fd5b4006670 2023-12-12T09:20:12.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.368+0000 7fd5c214c640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd5a006af00 0x7fd5a006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8036000 tx=0x7fd5b8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:12.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.645+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17bc03e220 con 0x7f17bc038080 2023-12-12T09:20:12.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.647+0000 7f17c17fa640 1 -- 172.21.15.84:0/3572293046 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17bc03e220 con 0x7f17bc038080 2023-12-12T09:20:12.648 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-12-12T09:20:12.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.651+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17b006ae70 msgr2=0x7f17b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.651+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17b006ae70 0x7f17b006d330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17bc053080 tx=0x7f17b8008040 comp rx=0 tx=0).stop 2023-12-12T09:20:12.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.651+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17bc038080 msgr2=0x7f17bc0e2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.651+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17bc038080 0x7f17bc0e2d50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f17c4000b60 tx=0x7f17c406a160 comp rx=0 tx=0).stop 2023-12-12T09:20:12.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.652+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 shutdown_connections 2023-12-12T09:20:12.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.652+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17bc0e77c0 0x7f17bc0e5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.652+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f17bc038500 0x7f17bc03d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.652+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f17b006ae70 0x7f17b006d330 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.652+0000 7f17c9ae6640 1 --2- 172.21.15.84:0/3572293046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17bc038080 0x7f17bc0e2d50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.652+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 >> 172.21.15.84:0/3572293046 conn(0x7f17bc03aa10 msgr2=0x7f17bc058010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.653+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 shutdown_connections 2023-12-12T09:20:12.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.653+0000 7f17c9ae6640 1 -- 172.21.15.84:0/3572293046 wait complete. 2023-12-12T09:20:12.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.0 2023-12-12T09:20:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.694+0000 7f65eb7fe640 1 -- 172.21.15.84:0/4182825686 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66080673c0 con 0x7f66080aa270 2023-12-12T09:20:12.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.695+0000 7f65fdffb640 1 -- 172.21.15.84:0/4182825686 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6600039070 con 0x7f66080aa270 2023-12-12T09:20:12.696 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-12-12T09:20:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 -- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f65ec06af10 msgr2=0x7f65ec06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f65ec06af10 0x7f65ec06d3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f66040011e0 tx=0x7f6604009040 comp rx=0 tx=0).stop 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 -- 172.21.15.84:0/4182825686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66080aa270 msgr2=0x7f66080aa720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66080aa270 0x7f66080aa720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6600037040 tx=0x7f6600004a40 comp rx=0 tx=0).stop 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 -- 172.21.15.84:0/4182825686 shutdown_connections 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66080aa270 0x7f66080aa720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f660814ac30 0x7f6608146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f65ec06af10 0x7f65ec06d3d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 --2- 172.21.15.84:0/4182825686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66080b1fa0 0x7f66080ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.699+0000 7f65eb7fe640 1 -- 172.21.15.84:0/4182825686 >> 172.21.15.84:0/4182825686 conn(0x7f660806a920 msgr2=0x7f6608161a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.700+0000 7f65eb7fe640 1 -- 172.21.15.84:0/4182825686 shutdown_connections 2023-12-12T09:20:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.700+0000 7f65eb7fe640 1 -- 172.21.15.84:0/4182825686 wait complete. 2023-12-12T09:20:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.704+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f63040673c0 con 0x7f630415d490 2023-12-12T09:20:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.705+0000 7f6300ff9640 1 -- 172.21.15.84:0/2695935160 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62f8015090 con 0x7f630415d490 2023-12-12T09:20:12.707 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2023-12-12T09:20:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f62f006ae40 msgr2=0x7f62f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f62f006ae40 0x7f62f006d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f62f4000f60 tx=0x7f62f4009040 comp rx=0 tx=0).stop 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f630415d490 msgr2=0x7f63040c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f630415d490 0x7f63040c7180 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f62f800b410 tx=0x7f62f800b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 shutdown_connections 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f630415d490 0x7f63040c7180 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63040d16f0 0x7f63040c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f62f006ae40 0x7f62f006d300 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f62f4000f60 tx=0x7f62f4009040 comp rx=0 tx=0).stop 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 --2- 172.21.15.84:0/2695935160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63040b04b0 0x7f63040c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 >> 172.21.15.84:0/2695935160 conn(0x7f630409c450 msgr2=0x7f63040d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.708+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 shutdown_connections 2023-12-12T09:20:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.709+0000 7f630a5be640 1 -- 172.21.15.84:0/2695935160 wait complete. 2023-12-12T09:20:12.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.5 2023-12-12T09:20:12.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.726+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3dc01600f0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.726+0000 7f3db6ffd640 1 -- 172.21.15.84:0/78114671 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3dc01600f0 con 0x7f3dc00cb2d0 2023-12-12T09:20:12.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.1 2023-12-12T09:20:12.729 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-12-12T09:20:12.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3da406ae90 msgr2=0x7f3da406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3da406ae90 0x7f3da406d350 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc036000 tx=0x7f3dbc008030 comp rx=0 tx=0).stop 2023-12-12T09:20:12.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 msgr2=0x7f3dc01ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc01ff5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3db800c710 tx=0x7f3db800cbd0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 shutdown_connections 2023-12-12T09:20:12.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3da406ae90 0x7f3da406d350 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3dc00cb2d0 0x7f3dc01ff5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3dc00b3f80 0x7f3dc0160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 --2- 172.21.15.84:0/78114671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc00b1dc0 0x7f3dc0203500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 >> 172.21.15.84:0/78114671 conn(0x7f3dc006c3d0 msgr2=0x7f3dc00ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 shutdown_connections 2023-12-12T09:20:12.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.729+0000 7f3dc869b640 1 -- 172.21.15.84:0/78114671 wait complete. 2023-12-12T09:20:12.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2023-12-12T09:20:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.756+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f7c151330 con 0x7f4f7c159470 2023-12-12T09:20:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.757+0000 7f4f6affd640 1 -- 172.21.15.84:0/3361695987 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f7c151330 con 0x7f4f7c159470 2023-12-12T09:20:12.758 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-12-12T09:20:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f5c06af10 msgr2=0x7f4f5c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f5c06af10 0x7f4f5c06d3d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c000f60 tx=0x7f4f6c007ce0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f7c159470 msgr2=0x7f4f7c0ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f7c159470 0x7f4f7c0ad780 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400b050 tx=0x7f4f74004a40 comp rx=0 tx=0).stop 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 shutdown_connections 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f7c159470 0x7f4f7c0ad780 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4f5c06af10 0x7f4f5c06d3d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f7c159090 0x7f4f7c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 --2- 172.21.15.84:0/3361695987 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4f7c0b4570 0x7f4f7c151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 >> 172.21.15.84:0/3361695987 conn(0x7f4f7c0aea30 msgr2=0x7f4f7c0ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 shutdown_connections 2023-12-12T09:20:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.760+0000 7f4f80e2b640 1 -- 172.21.15.84:0/3361695987 wait complete. 2023-12-12T09:20:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.761+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efdec0057d0 con 0x7efe0c0cfa50 2023-12-12T09:20:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.762+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdf9c0a9140 con 0x7fdf9c14ac30 2023-12-12T09:20:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.762+0000 7efe01ffb640 1 -- 172.21.15.84:0/4282263276 <== mon.2 v2:172.21.15.99:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdfc07a1a0 con 0x7efe0c0cfa50 2023-12-12T09:20:12.763 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-12-12T09:20:12.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.762+0000 7fdf91ffb640 1 -- 172.21.15.84:0/2258985337 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf8c07a500 con 0x7fdf9c14ac30 2023-12-12T09:20:12.764 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2023-12-12T09:20:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.765+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efdf006ae40 msgr2=0x7efdf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.765+0000 7efe1397c640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efdf006ae40 0x7efdf006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0b2d40 tx=0x7efe08008040 comp rx=0 tx=0).stop 2023-12-12T09:20:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.765+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf8006ae40 msgr2=0x7fdf8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.765+0000 7fdfa38da640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf8006ae40 0x7fdf8006d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf98036000 tx=0x7fdf9803c040 comp rx=0 tx=0).stop 2023-12-12T09:20:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.765+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfa50 msgr2=0x7efe0c0c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.765+0000 7efe1397c640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfa50 0x7efe0c0c5b40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efdfc02b8c0 tx=0x7efdfc0046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.765+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c14ac30 msgr2=0x7fdf9c0ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.765+0000 7fdfa38da640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c14ac30 0x7fdf9c0ac880 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00d950 tx=0x7fdf8c00de10 comp rx=0 tx=0).stop 2023-12-12T09:20:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 shutdown_connections 2023-12-12T09:20:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7efe1397c640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe0c0cfe30 0x7efe0c152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7efe1397c640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efe0c0cfa50 0x7efe0c0c5b40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7efe1397c640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efdf006ae40 0x7efdf006d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7efe1397c640 1 --2- 172.21.15.84:0/4282263276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe0c0b4520 0x7efe0c0ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 >> 172.21.15.84:0/4282263276 conn(0x7efe0c09c3e0 msgr2=0x7efe0c06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 shutdown_connections 2023-12-12T09:20:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7fdfa38da640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf9c0acdc0 0x7fdf9c160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7fdfa38da640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf8006ae40 0x7fdf8006d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 shutdown_connections 2023-12-12T09:20:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7fdfa38da640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf9c14ac30 0x7fdf9c0ac880 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7efe1397c640 1 -- 172.21.15.84:0/4282263276 wait complete. 2023-12-12T09:20:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7fdfa38da640 1 --2- 172.21.15.84:0/2258985337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf9c0b1fa0 0x7fdf9c135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 >> 172.21.15.84:0/2258985337 conn(0x7fdf9c06a920 msgr2=0x7fdf9c06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 shutdown_connections 2023-12-12T09:20:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.766+0000 7fdfa38da640 1 -- 172.21.15.84:0/2258985337 wait complete. 2023-12-12T09:20:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.772+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd5a40057d0 con 0x7fd5b4006670 2023-12-12T09:20:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.773+0000 7fd5b2ffd640 1 -- 172.21.15.84:0/3564531915 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5ac021070 con 0x7fd5b4006670 2023-12-12T09:20:12.774 INFO:teuthology.orchestra.run.smithi084.stdout:60129542152 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd5a006af00 msgr2=0x7fd5a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd5a006af00 0x7fd5a006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8036000 tx=0x7fd5b8008030 comp rx=0 tx=0).stop 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4006670 msgr2=0x7fd5b400a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4006670 0x7fd5b400a980 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c460 tx=0x7fd5ac00c920 comp rx=0 tx=0).stop 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 shutdown_connections 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b4053780 0x7fd5b403c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd5a006af00 0x7fd5a006d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b4006670 0x7fd5b400a980 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 --2- 172.21.15.84:0/3564531915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b40061e0 0x7fd5b4185720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.776+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 >> 172.21.15.84:0/3564531915 conn(0x7fd5b403aa10 msgr2=0x7fd5b40e21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.777+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 shutdown_connections 2023-12-12T09:20:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:12.777+0000 7fd5c314e640 1 -- 172.21.15.84:0/3564531915 wait complete. 2023-12-12T09:20:12.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2023-12-12T09:20:12.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.2 2023-12-12T09:20:12.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.6 2023-12-12T09:20:12.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2023-12-12T09:20:13.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-12T09:20:13.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-12T09:20:13.730 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-12T09:20:13.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-12T09:20:13.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-12T09:20:13.791 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-12T09:20:13.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-12T09:20:13.798 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-12T09:20:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.930+0000 7f5d5070f640 1 Processor -- start 2023-12-12T09:20:13.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.931+0000 7f5d5070f640 1 -- start start 2023-12-12T09:20:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.934+0000 7f5d5070f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d400061e0 0x7f5d40006640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.935+0000 7f5d5070f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d40007870 con 0x7f5d40053780 2023-12-12T09:20:13.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.935+0000 7f5d5070f640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d40006c60 con 0x7f5d4003c0c0 2023-12-12T09:20:13.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.936+0000 7f5d4dcaa640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d400061e0 0x7f5d40006640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.936+0000 7f5d5070f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d40006f40 con 0x7f5d400061e0 2023-12-12T09:20:13.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.936+0000 7f5d4ecac640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5d4003c0c0 0x7f5d4003c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:46854/0 (socket says 172.21.15.84:46854) 2023-12-12T09:20:13.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.936+0000 7f5d4ecac640 1 -- 172.21.15.84:0/1383615040 learned_addr learned my addr 172.21.15.84:0/1383615040 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:13.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.937+0000 7f5d4d4a9640 1 -- 172.21.15.84:0/1383615040 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127284243 0 0) 0x7f5d40006c60 con 0x7f5d4003c0c0 2023-12-12T09:20:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.938+0000 7f5d4d4a9640 1 -- 172.21.15.84:0/1383615040 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d34003520 con 0x7f5d4003c0c0 2023-12-12T09:20:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.938+0000 7f5d4dcaa640 1 -- 172.21.15.84:0/1383615040 >> v1:172.21.15.99:6789/0 conn(0x7f5d4003c0c0 legacy=0x7f5d4003c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.938+0000 7f5d4dcaa640 1 -- 172.21.15.84:0/1383615040 >> v1:172.21.15.84:6789/0 conn(0x7f5d40053780 legacy=0x7f5d40053b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.938+0000 7f5d4dcaa640 1 -- 172.21.15.84:0/1383615040 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40007220 con 0x7f5d400061e0 2023-12-12T09:20:13.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.940+0000 7f5d4dcaa640 1 --2- 172.21.15.84:0/1383615040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d400061e0 0x7f5d40006640 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d380097d0 tx=0x7f5d3802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba6664c1c72b3278 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:13.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.941+0000 7f5d4d4a9640 1 -- 172.21.15.84:0/1383615040 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3802d040 con 0x7f5d400061e0 2023-12-12T09:20:13.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.941+0000 7f5d4d4a9640 1 -- 172.21.15.84:0/1383615040 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38031810 con 0x7f5d400061e0 2023-12-12T09:20:13.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.941+0000 7f5d4d4a9640 1 -- 172.21.15.84:0/1383615040 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38031ba0 con 0x7f5d400061e0 2023-12-12T09:20:13.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.942+0000 7f5d5070f640 1 -- 172.21.15.84:0/1383615040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d400061e0 msgr2=0x7f5d40006640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.942+0000 7f5d5070f640 1 --2- 172.21.15.84:0/1383615040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d400061e0 0x7f5d40006640 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5d380097d0 tx=0x7f5d3802b8b0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.943+0000 7f5d5070f640 1 -- 172.21.15.84:0/1383615040 shutdown_connections 2023-12-12T09:20:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.943+0000 7f5d5070f640 1 --2- 172.21.15.84:0/1383615040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d400061e0 0x7f5d40006640 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.943+0000 7f5d5070f640 1 -- 172.21.15.84:0/1383615040 >> 172.21.15.84:0/1383615040 conn(0x7f5d4003aa10 msgr2=0x7f5d4003ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.943+0000 7f5d5070f640 1 -- 172.21.15.84:0/1383615040 shutdown_connections 2023-12-12T09:20:13.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.944+0000 7f5d5070f640 1 -- 172.21.15.84:0/1383615040 wait complete. 2023-12-12T09:20:13.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.947+0000 7f5d5070f640 1 Processor -- start 2023-12-12T09:20:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.948+0000 7f5d5070f640 1 -- start start 2023-12-12T09:20:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.949+0000 7f5d5070f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d400061e0 0x7f5d400d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.949+0000 7f5d5070f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4003c0c0 0x7f5d400e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.949+0000 7f5d5070f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40053780 0x7f5d400e6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.949+0000 7f5d5070f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4004e3d0 con 0x7f5d400061e0 2023-12-12T09:20:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.949+0000 7f5d5070f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4004e7f0 con 0x7f5d40053780 2023-12-12T09:20:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.949+0000 7f5d5070f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4004d750 con 0x7f5d4003c0c0 2023-12-12T09:20:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.951+0000 7f5d4dcaa640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4003c0c0 0x7f5d400e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.951+0000 7f5d4dcaa640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4003c0c0 0x7f5d400e6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41554/0 (socket says 172.21.15.84:41554) 2023-12-12T09:20:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.951+0000 7f5d4ecac640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40053780 0x7f5d400e6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.951+0000 7f5d4ecac640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40053780 0x7f5d400e6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:34966/0 (socket says 172.21.15.84:34966) 2023-12-12T09:20:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.951+0000 7f5d4ecac640 1 -- 172.21.15.84:0/3348918831 learned_addr learned my addr 172.21.15.84:0/3348918831 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.952+0000 7f5d4e4ab640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d400061e0 0x7f5d400d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.953+0000 7f5d4ecac640 1 -- 172.21.15.84:0/3348918831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4003c0c0 msgr2=0x7f5d400e6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.953+0000 7f5d4ecac640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4003c0c0 0x7f5d400e6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.953+0000 7f5d4ecac640 1 -- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d400061e0 msgr2=0x7f5d400d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.953+0000 7f5d4ecac640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d400061e0 0x7f5d400d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.953+0000 7f5d4ecac640 1 -- 172.21.15.84:0/3348918831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38009400 con 0x7f5d40053780 2023-12-12T09:20:13.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.954+0000 7f5d4e4ab640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d400061e0 0x7f5d400d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:20:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.955+0000 7f5d4ecac640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40053780 0x7f5d400e6550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d48064260 tx=0x7f5d48067ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.955+0000 7f5d3effd640 1 -- 172.21.15.84:0/3348918831 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4806bac0 con 0x7f5d40053780 2023-12-12T09:20:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.955+0000 7f5d3effd640 1 -- 172.21.15.84:0/3348918831 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4806bc40 con 0x7f5d40053780 2023-12-12T09:20:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.955+0000 7f5d3effd640 1 -- 172.21.15.84:0/3348918831 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48074070 con 0x7f5d40053780 2023-12-12T09:20:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.955+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4004da30 con 0x7f5d40053780 2023-12-12T09:20:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.956+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4004dff0 con 0x7f5d40053780 2023-12-12T09:20:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.959+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4004e510 con 0x7f5d40053780 2023-12-12T09:20:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.963+0000 7f5d3effd640 1 -- 172.21.15.84:0/3348918831 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d480741f0 con 0x7f5d40053780 2023-12-12T09:20:13.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.964+0000 7f5d3effd640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5d2c06ae40 0x7f5d2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.965+0000 7f5d3effd640 1 -- 172.21.15.84:0/3348918831 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d48103440 con 0x7f5d40053780 2023-12-12T09:20:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.966+0000 7f5d4e4ab640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5d2c06ae40 0x7f5d2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.967+0000 7f5d4e4ab640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5d2c06ae40 0x7f5d2c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5d44000f60 tx=0x7f5d44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.969+0000 7f5991631640 1 Processor -- start 2023-12-12T09:20:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.969+0000 7f5991631640 1 -- start start 2023-12-12T09:20:13.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.970+0000 7f8f059e9640 1 Processor -- start 2023-12-12T09:20:13.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.970+0000 7f8f059e9640 1 -- start start 2023-12-12T09:20:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.972+0000 7f5991631640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c0cf610 0x7f598c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.972+0000 7f5991631640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f598c070750 0x7f598c06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.972+0000 7f5991631640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c0b2090 con 0x7f598c15d080 2023-12-12T09:20:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.972+0000 7f5991631640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c0b2330 con 0x7f598c070750 2023-12-12T09:20:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.972+0000 7f5991631640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0b2610 con 0x7f598c0cf610 2023-12-12T09:20:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f598a7fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c0cf610 0x7f598c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f059e9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ef80eacd0 0x7f8ef804fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f059e9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ef804ffa0 0x7f8ef8037ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f059e9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8038570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f059e9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef8054300 con 0x7f8ef80eacd0 2023-12-12T09:20:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f059e9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef80536f0 con 0x7f8ef804ffa0 2023-12-12T09:20:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f598a7fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c0cf610 0x7f598c06c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41562/0 (socket says 172.21.15.84:41562) 2023-12-12T09:20:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f598a7fc640 1 -- 172.21.15.84:0/2021379122 learned_addr learned my addr 172.21.15.84:0/2021379122 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f059e9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80539d0 con 0x7f8ef80380e0 2023-12-12T09:20:13.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f598b7fe640 1 --2- 172.21.15.84:0/2021379122 >> v2:172.21.15.99:3300/0 conn(0x7f598c070750 0x7f598c06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f049e7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ef80eacd0 0x7f8ef804fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f049e7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ef80eacd0 0x7f8ef804fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34610/0 (socket says 172.21.15.84:34610) 2023-12-12T09:20:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.973+0000 7f8f049e7640 1 -- 172.21.15.84:0/1520938790 learned_addr learned my addr 172.21.15.84:0/1520938790 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.974+0000 7f8efffff640 1 --2- 172.21.15.84:0/1520938790 >> v2:172.21.15.99:3300/0 conn(0x7f8ef804ffa0 0x7f8ef8037ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.974+0000 7f8f051e8640 1 --2- 172.21.15.84:0/1520938790 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8038570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.974+0000 7f598a7fc640 1 -- 172.21.15.84:0/2021379122 >> v2:172.21.15.99:3300/0 conn(0x7f598c070750 msgr2=0x7f598c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.974+0000 7f598a7fc640 1 --2- 172.21.15.84:0/2021379122 >> v2:172.21.15.99:3300/0 conn(0x7f598c070750 0x7f598c06c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.974+0000 7f598a7fc640 1 -- 172.21.15.84:0/2021379122 >> v1:172.21.15.99:6789/0 conn(0x7f598c15d080 legacy=0x7f598c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.974+0000 7f598a7fc640 1 -- 172.21.15.84:0/2021379122 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c0b28f0 con 0x7f598c0cf610 2023-12-12T09:20:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.974+0000 7f8f049e7640 1 -- 172.21.15.84:0/1520938790 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 msgr2=0x7f8ef8038570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.975+0000 7f8f049e7640 1 --2- 172.21.15.84:0/1520938790 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8038570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.975+0000 7f8f049e7640 1 -- 172.21.15.84:0/1520938790 >> v2:172.21.15.99:3300/0 conn(0x7f8ef804ffa0 msgr2=0x7f8ef8037ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.975+0000 7f8f049e7640 1 --2- 172.21.15.84:0/1520938790 >> v2:172.21.15.99:3300/0 conn(0x7f8ef804ffa0 0x7f8ef8037ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.975+0000 7f8f049e7640 1 -- 172.21.15.84:0/1520938790 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef8053cb0 con 0x7f8ef80eacd0 2023-12-12T09:20:13.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.975+0000 7f8f051e8640 1 --2- 172.21.15.84:0/1520938790 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8038570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:20:13.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.975+0000 7f8efffff640 1 --2- 172.21.15.84:0/1520938790 >> v2:172.21.15.99:3300/0 conn(0x7f8ef804ffa0 0x7f8ef8037ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:13.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.976+0000 7f598a7fc640 1 --2- 172.21.15.84:0/2021379122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c0cf610 0x7f598c06c070 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f597c009870 tx=0x7f597c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6610d2bb1cb44bfe server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:13.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.976+0000 7f5989ffb640 1 -- 172.21.15.84:0/2021379122 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c030840 con 0x7f598c0cf610 2023-12-12T09:20:13.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.976+0000 7f5989ffb640 1 -- 172.21.15.84:0/2021379122 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c0309a0 con 0x7f598c0cf610 2023-12-12T09:20:13.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.976+0000 7f5989ffb640 1 -- 172.21.15.84:0/2021379122 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c030d30 con 0x7f598c0cf610 2023-12-12T09:20:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.976+0000 7f8f049e7640 1 --2- 172.21.15.84:0/1520938790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef80eacd0 0x7f8ef804fa60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8036530 tx=0x7f8ef402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6330b5fc99631d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.977+0000 7f8eff7fe640 1 -- 172.21.15.84:0/1520938790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4031880 con 0x7f8ef80eacd0 2023-12-12T09:20:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.977+0000 7f5991631640 1 -- 172.21.15.84:0/2021379122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c0cf610 msgr2=0x7f598c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.977+0000 7f5991631640 1 --2- 172.21.15.84:0/2021379122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c0cf610 0x7f598c06c070 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f597c009870 tx=0x7f597c02b980 comp rx=0 tx=0).stop 2023-12-12T09:20:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.977+0000 7f8eff7fe640 1 -- 172.21.15.84:0/1520938790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef40319e0 con 0x7f8ef80eacd0 2023-12-12T09:20:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.977+0000 7f8eff7fe640 1 -- 172.21.15.84:0/1520938790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4031d70 con 0x7f8ef80eacd0 2023-12-12T09:20:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.978+0000 7f5991631640 1 -- 172.21.15.84:0/2021379122 shutdown_connections 2023-12-12T09:20:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.978+0000 7f5991631640 1 --2- 172.21.15.84:0/2021379122 >> v2:172.21.15.99:3300/0 conn(0x7f598c070750 0x7f598c06c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.978+0000 7f5991631640 1 --2- 172.21.15.84:0/2021379122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c0cf610 0x7f598c06c070 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f597c009870 tx=0x7f597c02b980 comp rx=0 tx=0).stop 2023-12-12T09:20:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.978+0000 7f5991631640 1 -- 172.21.15.84:0/2021379122 >> 172.21.15.84:0/2021379122 conn(0x7f598c06a920 msgr2=0x7f598c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.977+0000 7f5d3effd640 1 -- 172.21.15.84:0/3348918831 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d480ce350 con 0x7f5d40053780 2023-12-12T09:20:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 -- 172.21.15.84:0/1520938790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef80eacd0 msgr2=0x7f8ef804fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 --2- 172.21.15.84:0/1520938790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef80eacd0 0x7f8ef804fa60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8036530 tx=0x7f8ef402b920 comp rx=0 tx=0).stop 2023-12-12T09:20:13.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 -- 172.21.15.84:0/1520938790 shutdown_connections 2023-12-12T09:20:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 --2- 172.21.15.84:0/1520938790 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8038570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 --2- 172.21.15.84:0/1520938790 >> v2:172.21.15.99:3300/0 conn(0x7f8ef804ffa0 0x7f8ef8037ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 --2- 172.21.15.84:0/1520938790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef80eacd0 0x7f8ef804fa60 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8036530 tx=0x7f8ef402b920 comp rx=0 tx=0).stop 2023-12-12T09:20:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 -- 172.21.15.84:0/1520938790 >> 172.21.15.84:0/1520938790 conn(0x7f8ef8009f80 msgr2=0x7f8ef800a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 -- 172.21.15.84:0/1520938790 shutdown_connections 2023-12-12T09:20:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.979+0000 7f8f059e9640 1 -- 172.21.15.84:0/1520938790 wait complete. 2023-12-12T09:20:13.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.980+0000 7f5991631640 1 -- 172.21.15.84:0/2021379122 shutdown_connections 2023-12-12T09:20:13.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.982+0000 7f8f059e9640 1 Processor -- start 2023-12-12T09:20:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.980+0000 7f5991631640 1 -- 172.21.15.84:0/2021379122 wait complete. 2023-12-12T09:20:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.982+0000 7f5991631640 1 Processor -- start 2023-12-12T09:20:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.982+0000 7f8f059e9640 1 -- start start 2023-12-12T09:20:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.984+0000 7f8f059e9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8044790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.983+0000 7f5991631640 1 -- start start 2023-12-12T09:20:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.984+0000 7f8f059e9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef804ffa0 0x7f8ef80deea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.984+0000 7f8f059e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef8044e80 0x7f8ef80452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.985+0000 7f8f059e9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8044370 con 0x7f8ef8044e80 2023-12-12T09:20:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.985+0000 7f8f059e9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8045820 con 0x7f8ef804ffa0 2023-12-12T09:20:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.985+0000 7f8f059e9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80436f0 con 0x7f8ef80380e0 2023-12-12T09:20:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.984+0000 7f5991631640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f598c070750 0x7f598c14f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.984+0000 7f5991631640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c15d080 0x7f598c0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.984+0000 7f5991631640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f598c0cc450 0x7f598c1f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.985+0000 7f8efffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef804ffa0 0x7f8ef80deea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.985+0000 7f8f049e7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8044790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.985+0000 7f8f049e7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8044790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41572/0 (socket says 172.21.15.84:41572) 2023-12-12T09:20:13.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.986+0000 7f8f049e7640 1 -- 172.21.15.84:0/4178280212 learned_addr learned my addr 172.21.15.84:0/4178280212 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.986+0000 7f8f051e8640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef8044e80 0x7f8ef80452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.987+0000 7f8efffff640 1 -- 172.21.15.84:0/4178280212 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 msgr2=0x7f8ef8044790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.987+0000 7f8efffff640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8044790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.987+0000 7f8efffff640 1 -- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef8044e80 msgr2=0x7f8ef80452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.987+0000 7f8efffff640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef8044e80 0x7f8ef80452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.987+0000 7f8efffff640 1 -- 172.21.15.84:0/4178280212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40094d0 con 0x7f8ef804ffa0 2023-12-12T09:20:13.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.987+0000 7f598b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f598c0cc450 0x7f598c1f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.987+0000 7f8efffff640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef804ffa0 0x7f8ef80deea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00e7e0 tx=0x7f8eec00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:13.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.987+0000 7f598b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f598c0cc450 0x7f598c1f36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34638/0 (socket says 172.21.15.84:34638) 2023-12-12T09:20:13.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.988+0000 7f8efd7fa640 1 -- 172.21.15.84:0/4178280212 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec004030 con 0x7f8ef804ffa0 2023-12-12T09:20:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.988+0000 7f8efd7fa640 1 -- 172.21.15.84:0/4178280212 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec004190 con 0x7f8ef804ffa0 2023-12-12T09:20:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.988+0000 7f598affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f598c070750 0x7f598c14f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.988+0000 7f598affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f598c070750 0x7f598c14f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:35002/0 (socket says 172.21.15.84:35002) 2023-12-12T09:20:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.989+0000 7f598a7fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c15d080 0x7f598c0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.989+0000 7f598a7fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c15d080 0x7f598c0cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41578/0 (socket says 172.21.15.84:41578) 2023-12-12T09:20:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.988+0000 7f8efd7fa640 1 -- 172.21.15.84:0/4178280212 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00c6d0 con 0x7f8ef804ffa0 2023-12-12T09:20:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.988+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef80439d0 con 0x7f8ef804ffa0 2023-12-12T09:20:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.988+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef8043f90 con 0x7f8ef804ffa0 2023-12-12T09:20:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.989+0000 7f598b7fe640 1 -- 172.21.15.84:0/528093575 learned_addr learned my addr 172.21.15.84:0/528093575 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.989+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0cc8f0 con 0x7f598c0cc450 2023-12-12T09:20:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.989+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0ccbd0 con 0x7f598c070750 2023-12-12T09:20:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.989+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c0cceb0 con 0x7f598c15d080 2023-12-12T09:20:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.990+0000 7f598b7fe640 1 -- 172.21.15.84:0/528093575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c15d080 msgr2=0x7f598c0cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.990+0000 7f598b7fe640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c15d080 0x7f598c0cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.990+0000 7f598b7fe640 1 -- 172.21.15.84:0/528093575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f598c070750 msgr2=0x7f598c14f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.991+0000 7f598b7fe640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f598c070750 0x7f598c14f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.991+0000 7f598b7fe640 1 -- 172.21.15.84:0/528093575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0094d0 con 0x7f598c0cc450 2023-12-12T09:20:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.991+0000 7f598b7fe640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f598c0cc450 0x7f598c1f36d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f598400efc0 tx=0x7f598400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:13.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.992+0000 7f59737fe640 1 -- 172.21.15.84:0/528093575 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984014480 con 0x7f598c0cc450 2023-12-12T09:20:13.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.992+0000 7f59737fe640 1 -- 172.21.15.84:0/528093575 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598400f040 con 0x7f598c0cc450 2023-12-12T09:20:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.992+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c0cd190 con 0x7f598c0cc450 2023-12-12T09:20:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.993+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c14f7d0 con 0x7f598c0cc450 2023-12-12T09:20:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.991+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef80444b0 con 0x7f8ef804ffa0 2023-12-12T09:20:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.993+0000 7f59737fe640 1 -- 172.21.15.84:0/528093575 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984014820 con 0x7f598c0cc450 2023-12-12T09:20:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.997+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c005250 con 0x7f598c0cc450 2023-12-12T09:20:14.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.999+0000 7f59737fe640 1 -- 172.21.15.84:0/528093575 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5984014980 con 0x7f598c0cc450 2023-12-12T09:20:14.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.000+0000 7f59737fe640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f597806ae40 0x7f597806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.998+0000 7f8efd7fa640 1 -- 172.21.15.84:0/4178280212 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8eec00c830 con 0x7f8ef804ffa0 2023-12-12T09:20:14.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.999+0000 7f8efd7fa640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8ee406ae40 0x7f8ee406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:13.999+0000 7f8efd7fa640 1 -- 172.21.15.84:0/4178280212 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8eec0898f0 con 0x7f8ef804ffa0 2023-12-12T09:20:14.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.001+0000 7f59737fe640 1 -- 172.21.15.84:0/528093575 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f598408a410 con 0x7f598c0cc450 2023-12-12T09:20:14.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.001+0000 7f598affd640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f597806ae40 0x7f597806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.003+0000 7f8f049e7640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8ee406ae40 0x7f8ee406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.004+0000 7f598affd640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f597806ae40 0x7f597806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5980000f60 tx=0x7f5980009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.005+0000 7f8f049e7640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8ee406ae40 0x7f8ee406d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ef402b960 tx=0x7f8ef403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.008+0000 7f8efd7fa640 1 -- 172.21.15.84:0/4178280212 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8eec0547d0 con 0x7f8ef804ffa0 2023-12-12T09:20:14.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.010+0000 7f59737fe640 1 -- 172.21.15.84:0/528093575 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5984055130 con 0x7f598c0cc450 2023-12-12T09:20:14.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.053+0000 7fc1f50e1640 1 Processor -- start 2023-12-12T09:20:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.054+0000 7fc1f50e1640 1 -- start start 2023-12-12T09:20:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.055+0000 7fc1f50e1640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e80061e0 0x7fc1e8006640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.055+0000 7fc1f50e1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1e803c0c0 0x7fc1e803c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.055+0000 7fc1f50e1640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e8007870 con 0x7fc1e8053780 2023-12-12T09:20:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.056+0000 7fc1f50e1640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e8006c60 con 0x7fc1e803c0c0 2023-12-12T09:20:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.056+0000 7fc1f50e1640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8006f40 con 0x7fc1e80061e0 2023-12-12T09:20:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.057+0000 7fc1f48e0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1e803c0c0 0x7fc1e803c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.057+0000 7fc1f48e0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc1e803c0c0 0x7fc1e803c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34652/0 (socket says 172.21.15.84:34652) 2023-12-12T09:20:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.057+0000 7fc1f48e0640 1 -- 172.21.15.84:0/2298205835 learned_addr learned my addr 172.21.15.84:0/2298205835 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.057+0000 7fc1ef7fe640 1 --2- 172.21.15.84:0/2298205835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e80061e0 0x7fc1e8006640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.058+0000 7fc1ef7fe640 1 -- 172.21.15.84:0/2298205835 >> v2:172.21.15.84:3300/0 conn(0x7fc1e803c0c0 msgr2=0x7fc1e803c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.058+0000 7fc1ef7fe640 1 --2- 172.21.15.84:0/2298205835 >> v2:172.21.15.84:3300/0 conn(0x7fc1e803c0c0 0x7fc1e803c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.058+0000 7fc1ef7fe640 1 -- 172.21.15.84:0/2298205835 >> v1:172.21.15.84:6789/0 conn(0x7fc1e8053780 legacy=0x7fc1e8053b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.059+0000 7fc1ef7fe640 1 -- 172.21.15.84:0/2298205835 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8007220 con 0x7fc1e80061e0 2023-12-12T09:20:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.059+0000 7fc1f48e0640 1 --2- 172.21.15.84:0/2298205835 >> v2:172.21.15.84:3300/0 conn(0x7fc1e803c0c0 0x7fc1e803c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:20:14.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.064+0000 7fc1ef7fe640 1 --2- 172.21.15.84:0/2298205835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e80061e0 0x7fc1e8006640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40097a0 tx=0x7fc1e402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d55e1dfcd6908d7c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.065+0000 7fc1eeffd640 1 -- 172.21.15.84:0/2298205835 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e402d040 con 0x7fc1e80061e0 2023-12-12T09:20:14.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.065+0000 7fc1eeffd640 1 -- 172.21.15.84:0/2298205835 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4031810 con 0x7fc1e80061e0 2023-12-12T09:20:14.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.065+0000 7fc1eeffd640 1 -- 172.21.15.84:0/2298205835 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4031ba0 con 0x7fc1e80061e0 2023-12-12T09:20:14.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.066+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2298205835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e80061e0 msgr2=0x7fc1e8006640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.066+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2298205835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e80061e0 0x7fc1e8006640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40097a0 tx=0x7fc1e402b8b0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.066+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2298205835 shutdown_connections 2023-12-12T09:20:14.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.066+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2298205835 >> v2:172.21.15.84:3300/0 conn(0x7fc1e803c0c0 0x7fc1e803c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.066+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2298205835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e80061e0 0x7fc1e8006640 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.066+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2298205835 >> 172.21.15.84:0/2298205835 conn(0x7fc1e803aa10 msgr2=0x7fc1e803ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.069+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2298205835 shutdown_connections 2023-12-12T09:20:14.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.069+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2298205835 wait complete. 2023-12-12T09:20:14.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.072+0000 7fc1f50e1640 1 Processor -- start 2023-12-12T09:20:14.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.072+0000 7fc1f50e1640 1 -- start start 2023-12-12T09:20:14.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.074+0000 7fc1f50e1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1e80061e0 0x7fc1e80ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.074+0000 7fc1f50e1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e803c0c0 0x7fc1e8057360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.074+0000 7fc1f50e1640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e8053780 0x7fc1e80578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.074+0000 7fc1f50e1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80e6760 con 0x7fc1e80061e0 2023-12-12T09:20:14.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.074+0000 7fc1f50e1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80e6480 con 0x7fc1e803c0c0 2023-12-12T09:20:14.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.074+0000 7fc1f50e1640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80cef00 con 0x7fc1e8053780 2023-12-12T09:20:14.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.075+0000 7fc1f48e0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e8053780 0x7fc1e80578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.075+0000 7fc1effff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1e80061e0 0x7fc1e80ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.075+0000 7fc1ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e803c0c0 0x7fc1e8057360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.075+0000 7fc1ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e803c0c0 0x7fc1e8057360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:35018/0 (socket says 172.21.15.84:35018) 2023-12-12T09:20:14.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.075+0000 7fc1ef7fe640 1 -- 172.21.15.84:0/2488642359 learned_addr learned my addr 172.21.15.84:0/2488642359 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.077+0000 7fc1ef7fe640 1 -- 172.21.15.84:0/2488642359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e8053780 msgr2=0x7fc1e80578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.077+0000 7fc1ef7fe640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e8053780 0x7fc1e80578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.077+0000 7fc1ef7fe640 1 -- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1e80061e0 msgr2=0x7fc1e80ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.077+0000 7fc1ef7fe640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1e80061e0 0x7fc1e80ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.077+0000 7fc1ef7fe640 1 -- 172.21.15.84:0/2488642359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4009400 con 0x7fc1e803c0c0 2023-12-12T09:20:14.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.078+0000 7fc1ef7fe640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e803c0c0 0x7fc1e8057360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40096f0 tx=0x7fc1e40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.079+0000 7fc1ecff9640 1 -- 172.21.15.84:0/2488642359 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e403ad60 con 0x7fc1e803c0c0 2023-12-12T09:20:14.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.079+0000 7fc1ecff9640 1 -- 172.21.15.84:0/2488642359 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4044400 con 0x7fc1e803c0c0 2023-12-12T09:20:14.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.079+0000 7fc1ecff9640 1 -- 172.21.15.84:0/2488642359 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40447b0 con 0x7fc1e803c0c0 2023-12-12T09:20:14.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.079+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e80cf1e0 con 0x7fc1e803c0c0 2023-12-12T09:20:14.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.079+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e80e56c0 con 0x7fc1e803c0c0 2023-12-12T09:20:14.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.080+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e80ced60 con 0x7fc1e803c0c0 2023-12-12T09:20:14.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.083+0000 7fc1ecff9640 1 -- 172.21.15.84:0/2488642359 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1e404d440 con 0x7fc1e803c0c0 2023-12-12T09:20:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.085+0000 7fc1ecff9640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.086+0000 7fc1ecff9640 1 -- 172.21.15.84:0/2488642359 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1e40abe80 con 0x7fc1e803c0c0 2023-12-12T09:20:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.086+0000 7fc1effff640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.088+0000 7fc1effff640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc1d406ae40 0x7fc1d406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000f60 tx=0x7fc1dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.095+0000 7fc1ecff9640 1 -- 172.21.15.84:0/2488642359 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1e4076cd0 con 0x7fc1e803c0c0 2023-12-12T09:20:14.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.119+0000 7fab27121640 1 Processor -- start 2023-12-12T09:20:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.119+0000 7fab27121640 1 -- start start 2023-12-12T09:20:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.121+0000 7fab27121640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab1804a2f0 0x7fab18039b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.121+0000 7fab27121640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab18036180 0x7fab1803c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.121+0000 7fab27121640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1803b310 con 0x7fab180529c0 2023-12-12T09:20:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.121+0000 7fab27121640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1803b5b0 con 0x7fab1804a2f0 2023-12-12T09:20:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.121+0000 7fab27121640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1803b890 con 0x7fab18036180 2023-12-12T09:20:14.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.123+0000 7fab26920640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fab180529c0 0x7fab18054840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50278/0 (socket says 172.21.15.84:50278) 2023-12-12T09:20:14.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.123+0000 7fab2591e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab18036180 0x7fab1803c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.123+0000 7fab2591e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab18036180 0x7fab1803c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41596/0 (socket says 172.21.15.84:41596) 2023-12-12T09:20:14.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.123+0000 7fab2591e640 1 -- 172.21.15.84:0/3172339657 learned_addr learned my addr 172.21.15.84:0/3172339657 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.124+0000 7fab2611f640 1 --2- 172.21.15.84:0/3172339657 >> v2:172.21.15.84:3300/0 conn(0x7fab1804a2f0 0x7fab18039b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.124+0000 7fab2511d640 1 -- 172.21.15.84:0/3172339657 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752198180 0 0) 0x7fab1803b310 con 0x7fab180529c0 2023-12-12T09:20:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.124+0000 7fab2511d640 1 -- 172.21.15.84:0/3172339657 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab0c003520 con 0x7fab180529c0 2023-12-12T09:20:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.125+0000 7fab2611f640 1 -- 172.21.15.84:0/3172339657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab18036180 msgr2=0x7fab1803c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.125+0000 7fab2611f640 1 --2- 172.21.15.84:0/3172339657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab18036180 0x7fab1803c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.125+0000 7fab2611f640 1 -- 172.21.15.84:0/3172339657 >> v1:172.21.15.84:6789/0 conn(0x7fab180529c0 legacy=0x7fab18054840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.125+0000 7fab2511d640 1 -- 172.21.15.84:0/3172339657 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1962335475 0 0) 0x7fab0c003520 con 0x7fab180529c0 2023-12-12T09:20:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.126+0000 7fab2611f640 1 -- 172.21.15.84:0/3172339657 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1803bb70 con 0x7fab1804a2f0 2023-12-12T09:20:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.127+0000 7fab2611f640 1 --2- 172.21.15.84:0/3172339657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1804a2f0 0x7fab18039b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0097a0 tx=0x7fab1c02b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70752352732f37e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.128+0000 7fab2511d640 1 -- 172.21.15.84:0/3172339657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20068760 con 0x7fab1804a2f0 2023-12-12T09:20:14.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.128+0000 7fab2511d640 1 -- 172.21.15.84:0/3172339657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c02e050 con 0x7fab1804a2f0 2023-12-12T09:20:14.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.128+0000 7fab2511d640 1 -- 172.21.15.84:0/3172339657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20068760 con 0x7fab1804a2f0 2023-12-12T09:20:14.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.129+0000 7fab27121640 1 -- 172.21.15.84:0/3172339657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1804a2f0 msgr2=0x7fab18039b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.129+0000 7fab27121640 1 --2- 172.21.15.84:0/3172339657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1804a2f0 0x7fab18039b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0097a0 tx=0x7fab1c02b770 comp rx=0 tx=0).stop 2023-12-12T09:20:14.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.130+0000 7fab27121640 1 -- 172.21.15.84:0/3172339657 shutdown_connections 2023-12-12T09:20:14.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.130+0000 7fab27121640 1 --2- 172.21.15.84:0/3172339657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab18036180 0x7fab1803c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.130+0000 7fab27121640 1 --2- 172.21.15.84:0/3172339657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab1804a2f0 0x7fab18039b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.130+0000 7fab27121640 1 -- 172.21.15.84:0/3172339657 >> 172.21.15.84:0/3172339657 conn(0x7fab18053780 msgr2=0x7fab18053b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.130+0000 7fab27121640 1 -- 172.21.15.84:0/3172339657 shutdown_connections 2023-12-12T09:20:14.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.131+0000 7fab27121640 1 -- 172.21.15.84:0/3172339657 wait complete. 2023-12-12T09:20:14.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.133+0000 7fab27121640 1 Processor -- start 2023-12-12T09:20:14.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.134+0000 7fab27121640 1 -- start start 2023-12-12T09:20:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.136+0000 7fab27121640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab18036180 0x7fab180d5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.136+0000 7fab27121640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab1804a2f0 0x7fab1804cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.136+0000 7fab27121640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab180529c0 0x7fab1804d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.137+0000 7fab2611f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab18036180 0x7fab180d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.137+0000 7fab2611f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab18036180 0x7fab180d5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:35024/0 (socket says 172.21.15.84:35024) 2023-12-12T09:20:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.137+0000 7fab2591e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab1804a2f0 0x7fab1804cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.137+0000 7fab26920640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab180529c0 0x7fab1804d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.137+0000 7fab26920640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab180529c0 0x7fab1804d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34684/0 (socket says 172.21.15.84:34684) 2023-12-12T09:20:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.137+0000 7fab2611f640 1 -- 172.21.15.84:0/3376493546 learned_addr learned my addr 172.21.15.84:0/3376493546 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.138+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab180d69c0 con 0x7fab180529c0 2023-12-12T09:20:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.138+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab180095e0 con 0x7fab18036180 2023-12-12T09:20:14.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.138+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab180d5e40 con 0x7fab1804a2f0 2023-12-12T09:20:14.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.139+0000 7fab26920640 1 -- 172.21.15.84:0/3376493546 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab1804a2f0 msgr2=0x7fab1804cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.139+0000 7fab26920640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab1804a2f0 0x7fab1804cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.139+0000 7fab26920640 1 -- 172.21.15.84:0/3376493546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab18036180 msgr2=0x7fab180d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.139+0000 7fab26920640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab18036180 0x7fab180d5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.139+0000 7fab26920640 1 -- 172.21.15.84:0/3376493546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c009400 con 0x7fab180529c0 2023-12-12T09:20:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.139+0000 7fc93f59e640 1 Processor -- start 2023-12-12T09:20:14.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.139+0000 7fc93f59e640 1 -- start start 2023-12-12T09:20:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.140+0000 7fab26920640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab180529c0 0x7fab1804d140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fab20069d50 tx=0x7fab200692a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.141+0000 7fa31fd53640 1 Processor -- start 2023-12-12T09:20:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.141+0000 7fab16ffd640 1 -- 172.21.15.84:0/3376493546 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2006a7d0 con 0x7fab180529c0 2023-12-12T09:20:14.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.141+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab180d6120 con 0x7fab180529c0 2023-12-12T09:20:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.141+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab180d66e0 con 0x7fab180529c0 2023-12-12T09:20:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.141+0000 7fab16ffd640 1 -- 172.21.15.84:0/3376493546 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2006a930 con 0x7fab180529c0 2023-12-12T09:20:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.141+0000 7fab16ffd640 1 -- 172.21.15.84:0/3376493546 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2006a7d0 con 0x7fab180529c0 2023-12-12T09:20:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.142+0000 7fc93f59e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc94013f710 0x7fc94015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.142+0000 7fc93f59e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc940070220 con 0x7fc9400cf5e0 2023-12-12T09:20:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.142+0000 7fc93f59e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94015d2f0 con 0x7fc94006c910 2023-12-12T09:20:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.142+0000 7fc93f59e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94015db90 con 0x7fc94013f710 2023-12-12T09:20:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.142+0000 7fc93e59c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc9400cf5e0 0x7fc94006be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50280/0 (socket says 172.21.15.84:50280) 2023-12-12T09:20:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.142+0000 7fc93e59c640 1 -- 172.21.15.84:0/3893089040 learned_addr learned my addr 172.21.15.84:0/3893089040 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.141+0000 7fa31fd53640 1 -- start start 2023-12-12T09:20:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.143+0000 7fa31fd53640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa31815d490 0x7fa3180d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.143+0000 7fa31fd53640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3180d3d60 0x7fa3180d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.143+0000 7fa31fd53640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180d2080 con 0x7fa3180d1c30 2023-12-12T09:20:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.143+0000 7fa31fd53640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180b0090 con 0x7fa31815d490 2023-12-12T09:20:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.143+0000 7fa31fd53640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180afd40 con 0x7fa3180d3d60 2023-12-12T09:20:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.144+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab18007990 con 0x7fab180529c0 2023-12-12T09:20:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.144+0000 7fa31daef640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa31815d490 0x7fa3180d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.144+0000 7fc93d59a640 1 -- 172.21.15.84:0/3893089040 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539665800 0 0) 0x7fc94015d2f0 con 0x7fc94006c910 2023-12-12T09:20:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.144+0000 7fc93d59a640 1 -- 172.21.15.84:0/3893089040 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc928003520 con 0x7fc94006c910 2023-12-12T09:20:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.144+0000 7fc93dd9b640 1 --2- 172.21.15.84:0/3893089040 >> v2:172.21.15.84:3300/0 conn(0x7fc94013f710 0x7fc94015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.144+0000 7fa31e2f0640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa3180d1c30 0x7fa3180cf740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50282/0 (socket says 172.21.15.84:50282) 2023-12-12T09:20:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.144+0000 7fa31e2f0640 1 -- 172.21.15.84:0/1288693797 learned_addr learned my addr 172.21.15.84:0/1288693797 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.145+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372394999 0 0) 0x7fa308001110 con 0x7fa3180d1c30 2023-12-12T09:20:14.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.145+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa304003520 con 0x7fa3180d1c30 2023-12-12T09:20:14.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.145+0000 7fc93dd9b640 1 -- 172.21.15.84:0/3893089040 >> v1:172.21.15.99:6789/0 conn(0x7fc94006c910 legacy=0x7fc9400706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.145+0000 7fc93dd9b640 1 -- 172.21.15.84:0/3893089040 >> v1:172.21.15.84:6789/0 conn(0x7fc9400cf5e0 legacy=0x7fc94006be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.145+0000 7fc93dd9b640 1 -- 172.21.15.84:0/3893089040 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94015d5d0 con 0x7fc94013f710 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.145+0000 7fa31d2ee640 1 --2- 172.21.15.84:0/1288693797 >> v2:172.21.15.99:3300/0 conn(0x7fa3180d3d60 0x7fa3180d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3555167078 0 0) 0x7fa304003520 con 0x7fa3180d1c30 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 >> v2:172.21.15.99:3300/0 conn(0x7fa3180d3d60 msgr2=0x7fa3180d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 --2- 172.21.15.84:0/1288693797 >> v2:172.21.15.99:3300/0 conn(0x7fa3180d3d60 0x7fa3180d16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 >> v2:172.21.15.84:3300/0 conn(0x7fa31815d490 msgr2=0x7fa3180d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 --2- 172.21.15.84:0/1288693797 >> v2:172.21.15.84:3300/0 conn(0x7fa31815d490 0x7fa3180d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180ce860 con 0x7fa3180d1c30 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa308001800 con 0x7fa3180d1c30 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 >> v1:172.21.15.84:6789/0 conn(0x7fa3180d1c30 legacy=0x7fa3180cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3040039c0 0x7fa304003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040047c0 0x7fa304004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3040052a0 0x7fa30400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180b0090 con 0x7fa3040039c0 2023-12-12T09:20:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180afd40 con 0x7fa3040052a0 2023-12-12T09:20:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.146+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30400c240 con 0x7fa3040047c0 2023-12-12T09:20:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.147+0000 7fa31e2f0640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3040052a0 0x7fa30400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.147+0000 7fc93dd9b640 1 --2- 172.21.15.84:0/3893089040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc94015cc60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc9340097a0 tx=0x7fc93402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301b5a0066f6fa4a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.147+0000 7fa31d2ee640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040047c0 0x7fa304004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.147+0000 7fc93d59a640 1 -- 172.21.15.84:0/3893089040 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934031830 con 0x7fc94013f710 2023-12-12T09:20:14.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.147+0000 7fc93d59a640 1 -- 172.21.15.84:0/3893089040 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc934031990 con 0x7fc94013f710 2023-12-12T09:20:14.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.147+0000 7fc93d59a640 1 -- 172.21.15.84:0/3893089040 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934031d20 con 0x7fc94013f710 2023-12-12T09:20:14.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.148+0000 7fa31e2f0640 1 -- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040047c0 msgr2=0x7fa304004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:14.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.148+0000 7fa31e2f0640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040047c0 0x7fa304004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.148+0000 7fab16ffd640 1 -- 172.21.15.84:0/3376493546 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab2006ab60 con 0x7fab180529c0 2023-12-12T09:20:14.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.148+0000 7fa31e2f0640 1 -- 172.21.15.84:0/1288693797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3040039c0 msgr2=0x7fa304003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T09:20:14.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.148+0000 7fa31daef640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3040039c0 0x7fa304003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.148+0000 7fa31e2f0640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3040039c0 0x7fa304003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.149+0000 7fab16ffd640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab0406aea0 0x7fab0406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.148+0000 7fa31e2f0640 1 -- 172.21.15.84:0/1288693797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304003520 con 0x7fa3040052a0 2023-12-12T09:20:14.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.148+0000 7fa31daef640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3040039c0 0x7fa304003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:14.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fa31e2f0640 1 -- 172.21.15.84:0/1288693797 reap_dead start 2023-12-12T09:20:14.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fab16ffd640 1 -- 172.21.15.84:0/3376493546 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab20102f20 con 0x7fab180529c0 2023-12-12T09:20:14.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fab2611f640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab0406aea0 0x7fab0406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fc93f59e640 1 -- 172.21.15.84:0/3893089040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 msgr2=0x7fc94015cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fc93f59e640 1 --2- 172.21.15.84:0/3893089040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc94015cc60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc9340097a0 tx=0x7fc93402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fa31e2f0640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3040052a0 0x7fa30400b980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa30800c110 tx=0x7fa3040057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a89dfb45955bd34 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fc93f59e640 1 -- 172.21.15.84:0/3893089040 shutdown_connections 2023-12-12T09:20:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fc93f59e640 1 --2- 172.21.15.84:0/3893089040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc94015cc60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.150+0000 7fc93f59e640 1 -- 172.21.15.84:0/3893089040 >> 172.21.15.84:0/3893089040 conn(0x7fc9400ceac0 msgr2=0x7fc9400ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.151+0000 7fab2611f640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab0406aea0 0x7fab0406d360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0097a0 tx=0x7fab1c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.151+0000 7fc93f59e640 1 -- 172.21.15.84:0/3893089040 shutdown_connections 2023-12-12T09:20:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.151+0000 7fc93f59e640 1 -- 172.21.15.84:0/3893089040 wait complete. 2023-12-12T09:20:14.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.151+0000 7f2033b01640 1 Processor -- start 2023-12-12T09:20:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.151+0000 7f2033b01640 1 -- start start 2023-12-12T09:20:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.152+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308005ad0 con 0x7fa3040052a0 2023-12-12T09:20:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.152+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa308005c50 con 0x7fa3040052a0 2023-12-12T09:20:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.152+0000 7fa31caed640 1 -- 172.21.15.84:0/1288693797 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30802c810 con 0x7fa3040052a0 2023-12-12T09:20:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.153+0000 7f2033b01640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f202c15d490 0x7f202c0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.153+0000 7f2033b01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c0d1e00 0x7f202c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.153+0000 7f2033b01640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0afd40 con 0x7f202c0d3d60 2023-12-12T09:20:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.153+0000 7f2033b01640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0b0090 con 0x7f202c15d490 2023-12-12T09:20:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.153+0000 7f2033b01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0ce860 con 0x7f202c0d1e00 2023-12-12T09:20:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.153+0000 7fc93f59e640 1 Processor -- start 2023-12-12T09:20:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.153+0000 7fa31fd53640 1 -- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3040052a0 msgr2=0x7fa30400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.153+0000 7fa31fd53640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3040052a0 0x7fa30400b980 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa30800c110 tx=0x7fa3040057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.154+0000 7fc93f59e640 1 -- start start 2023-12-12T09:20:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.154+0000 7f203189d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f202c15d490 0x7f202c0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.154+0000 7f203109c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f202c0d3d60 0x7f202c0d16f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50296/0 (socket says 172.21.15.84:50296) 2023-12-12T09:20:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.154+0000 7f203109c640 1 -- 172.21.15.84:0/1171256910 learned_addr learned my addr 172.21.15.84:0/1171256910 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.155+0000 7f203189d640 1 -- 172.21.15.84:0/1171256910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c0d1e00 msgr2=0x7f202c0b04b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T09:20:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.155+0000 7f203189d640 1 --2- 172.21.15.84:0/1171256910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c0d1e00 0x7f202c0b04b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.155+0000 7f203189d640 1 -- 172.21.15.84:0/1171256910 >> v1:172.21.15.84:6789/0 conn(0x7f202c0d3d60 legacy=0x7f202c0d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.155+0000 7f203189d640 1 -- 172.21.15.84:0/1171256910 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0ceb40 con 0x7f202c15d490 2023-12-12T09:20:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.155+0000 7fa31fd53640 1 -- 172.21.15.84:0/1288693797 shutdown_connections 2023-12-12T09:20:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fa31fd53640 1 --2- 172.21.15.84:0/1288693797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3040052a0 0x7fa30400b980 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fa31fd53640 1 -- 172.21.15.84:0/1288693797 >> 172.21.15.84:0/1288693797 conn(0x7fa31809c450 msgr2=0x7fa3180d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fc93f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc94006c910 0x7fc9401348a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fc93f59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9400cf5e0 0x7fc940135350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fc93f59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc9400b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fc93f59e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94014e7a0 con 0x7fc94013f710 2023-12-12T09:20:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fc93f59e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94014de00 con 0x7fc94006c910 2023-12-12T09:20:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fc93f59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94014e0e0 con 0x7fc9400cf5e0 2023-12-12T09:20:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fa31fd53640 1 -- 172.21.15.84:0/1288693797 shutdown_connections 2023-12-12T09:20:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.156+0000 7fa31fd53640 1 -- 172.21.15.84:0/1288693797 wait complete. 2023-12-12T09:20:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.157+0000 7fc93ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc9400b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.157+0000 7fc93dd9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9400cf5e0 0x7fc940135350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.157+0000 7fc93ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc9400b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34740/0 (socket says 172.21.15.84:34740) 2023-12-12T09:20:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.158+0000 7f203189d640 1 --2- 172.21.15.84:0/1171256910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c15d490 0x7f202c0d3820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097a0 tx=0x7f201c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25cb4f1df679ca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.157+0000 7fc93ed9d640 1 -- 172.21.15.84:0/678858577 learned_addr learned my addr 172.21.15.84:0/678858577 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.157+0000 7fc93e59c640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc94006c910 0x7fc9401348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.158+0000 7fc93ed9d640 1 -- 172.21.15.84:0/678858577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9400cf5e0 msgr2=0x7fc940135350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.158+0000 7fab16ffd640 1 -- 172.21.15.84:0/3376493546 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab200cdc40 con 0x7fab180529c0 2023-12-12T09:20:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.158+0000 7fc93ed9d640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9400cf5e0 0x7fc940135350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.158+0000 7fc93ed9d640 1 -- 172.21.15.84:0/678858577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc94006c910 msgr2=0x7fc9401348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.158+0000 7fc93ed9d640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc94006c910 0x7fc9401348a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.158+0000 7fc93ed9d640 1 -- 172.21.15.84:0/678858577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934009400 con 0x7fc94013f710 2023-12-12T09:20:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.159+0000 7fc93ed9d640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc9400b2390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c810 tx=0x7fc93800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.159+0000 7fa31fd53640 1 Processor -- start 2023-12-12T09:20:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.159+0000 7f203089b640 1 -- 172.21.15.84:0/1171256910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c02e070 con 0x7f202c15d490 2023-12-12T09:20:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.159+0000 7f203089b640 1 -- 172.21.15.84:0/1171256910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0315a0 con 0x7f202c15d490 2023-12-12T09:20:14.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.159+0000 7f203089b640 1 -- 172.21.15.84:0/1171256910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c02e070 con 0x7f202c15d490 2023-12-12T09:20:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.159+0000 7fa31fd53640 1 -- start start 2023-12-12T09:20:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.160+0000 7fc92effd640 1 -- 172.21.15.84:0/678858577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938003da0 con 0x7fc94013f710 2023-12-12T09:20:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.160+0000 7fc92effd640 1 -- 172.21.15.84:0/678858577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc938005070 con 0x7fc94013f710 2023-12-12T09:20:14.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.160+0000 7fc92effd640 1 -- 172.21.15.84:0/678858577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938003da0 con 0x7fc94013f710 2023-12-12T09:20:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.160+0000 7f2033b01640 1 -- 172.21.15.84:0/1171256910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c15d490 msgr2=0x7f202c0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.160+0000 7f2033b01640 1 --2- 172.21.15.84:0/1171256910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c15d490 0x7f202c0d3820 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097a0 tx=0x7f201c02b840 comp rx=0 tx=0).stop 2023-12-12T09:20:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.161+0000 7f2033b01640 1 -- 172.21.15.84:0/1171256910 shutdown_connections 2023-12-12T09:20:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.161+0000 7f2033b01640 1 --2- 172.21.15.84:0/1171256910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c0d1e00 0x7f202c0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.161+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94014e3c0 con 0x7fc94013f710 2023-12-12T09:20:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.161+0000 7fa31fd53640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040052a0 0x7fa31815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.161+0000 7f2033b01640 1 --2- 172.21.15.84:0/1171256910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c15d490 0x7f202c0d3820 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31fd53640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3180b6210 0x7fa31815df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31fd53640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180cb740 0x7fa3180cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.161+0000 7f2033b01640 1 -- 172.21.15.84:0/1171256910 >> 172.21.15.84:0/1171256910 conn(0x7f202c09c450 msgr2=0x7f202c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31daef640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040052a0 0x7fa31815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7f2033b01640 1 -- 172.21.15.84:0/1171256910 shutdown_connections 2023-12-12T09:20:14.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31d2ee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3180b6210 0x7fa31815df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7f2033b01640 1 -- 172.21.15.84:0/1171256910 wait complete. 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31e2f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180cb740 0x7fa3180cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31d2ee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3180b6210 0x7fa31815df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:35062/0 (socket says 172.21.15.84:35062) 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31fd53640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180b72e0 con 0x7fa3180cb740 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31e2f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180cb740 0x7fa3180cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34748/0 (socket says 172.21.15.84:34748) 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31e2f0640 1 -- 172.21.15.84:0/4082979283 learned_addr learned my addr 172.21.15.84:0/4082979283 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180b66d0 con 0x7fa3180b6210 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.162+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180b69b0 con 0x7fa3040052a0 2023-12-12T09:20:14.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.164+0000 7fa31d2ee640 1 -- 172.21.15.84:0/4082979283 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040052a0 msgr2=0x7fa31815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.164+0000 7fa31d2ee640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040052a0 0x7fa31815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.164+0000 7fa31d2ee640 1 -- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180cb740 msgr2=0x7fa3180cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.164+0000 7fa31d2ee640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180cb740 0x7fa3180cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.164+0000 7fa31d2ee640 1 -- 172.21.15.84:0/4082979283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180b6c90 con 0x7fa3180b6210 2023-12-12T09:20:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.164+0000 7fa31e2f0640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180cb740 0x7fa3180cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.164+0000 7fa31daef640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040052a0 0x7fa31815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.165+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9400b28d0 con 0x7fc94013f710 2023-12-12T09:20:14.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.165+0000 7f2033b01640 1 Processor -- start 2023-12-12T09:20:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.165+0000 7fa31d2ee640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3180b6210 0x7fa31815df30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa31000ecf0 tx=0x7fa31000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.166+0000 7fa30e7fc640 1 -- 172.21.15.84:0/4082979283 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310003b90 con 0x7fa3180b6210 2023-12-12T09:20:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.166+0000 7fa30e7fc640 1 -- 172.21.15.84:0/4082979283 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310013070 con 0x7fa3180b6210 2023-12-12T09:20:14.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.166+0000 7fa30e7fc640 1 -- 172.21.15.84:0/4082979283 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310004020 con 0x7fa3180b6210 2023-12-12T09:20:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.165+0000 7f2033b01640 1 -- start start 2023-12-12T09:20:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.166+0000 7fc92effd640 1 -- 172.21.15.84:0/678858577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc938005220 con 0x7fc94013f710 2023-12-12T09:20:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.166+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94014e8e0 con 0x7fc94013f710 2023-12-12T09:20:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.166+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3180b6f70 con 0x7fa3180b6210 2023-12-12T09:20:14.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.166+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3180cc310 con 0x7fa3180b6210 2023-12-12T09:20:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.167+0000 7f2033b01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c0d1e00 0x7f202c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.167+0000 7f2033b01640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c0d3d60 0x7f202c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.168+0000 7f203189d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c0d1e00 0x7f202c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.168+0000 7f203189d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c0d1e00 0x7f202c0cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:35072/0 (socket says 172.21.15.84:35072) 2023-12-12T09:20:14.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.168+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa318072b80 con 0x7fa3180b6210 2023-12-12T09:20:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.168+0000 7fc92effd640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc92006aed0 0x7fc92006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.168+0000 7f203189d640 1 -- 172.21.15.84:0/2834844003 learned_addr learned my addr 172.21.15.84:0/2834844003 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.169+0000 7f2033b01640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c15d490 0x7f202c15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.169+0000 7fc93e59c640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc92006aed0 0x7fc92006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.170+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15e6a0 con 0x7f202c0d3d60 2023-12-12T09:20:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.170+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15da90 con 0x7f202c0d1e00 2023-12-12T09:20:14.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.171+0000 7fc92effd640 1 -- 172.21.15.84:0/678858577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9380575c0 con 0x7fc94013f710 2023-12-12T09:20:14.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.171+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15dd70 con 0x7f202c15d490 2023-12-12T09:20:14.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.172+0000 7f203209e640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c15d490 0x7f202c15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.172+0000 7f203109c640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c0d3d60 0x7f202c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.172+0000 7fc93e59c640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc92006aed0 0x7fc92006d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc930005880 tx=0x7fc930009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.174+0000 7f203189d640 1 -- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c15d490 msgr2=0x7f202c15eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.174+0000 7f203189d640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c15d490 0x7f202c15eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.174+0000 7f203189d640 1 -- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c0d3d60 msgr2=0x7f202c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.174+0000 7f203189d640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c0d3d60 0x7f202c1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.174+0000 7f203189d640 1 -- 172.21.15.84:0/2834844003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009400 con 0x7f202c0d1e00 2023-12-12T09:20:14.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.175+0000 7fa30e7fc640 1 -- 172.21.15.84:0/4082979283 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa310004180 con 0x7fa3180b6210 2023-12-12T09:20:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.176+0000 7fa30e7fc640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa2fc06ae70 0x7fa2fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.176+0000 7fa30e7fc640 1 -- 172.21.15.84:0/4082979283 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa310015070 con 0x7fa3180b6210 2023-12-12T09:20:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.177+0000 7f203189d640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c0d1e00 0x7f202c0cb0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f201c000c00 tx=0x7f201c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.177+0000 7fa31daef640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa2fc06ae70 0x7fa2fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.178+0000 7fc92effd640 1 -- 172.21.15.84:0/678858577 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc938054090 con 0x7fc94013f710 2023-12-12T09:20:14.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.179+0000 7fa31daef640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa2fc06ae70 0x7fa2fc06d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa314006fd0 tx=0x7fa314008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.182+0000 7f20227fc640 1 -- 172.21.15.84:0/2834844003 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c003a20 con 0x7f202c0d1e00 2023-12-12T09:20:14.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.183+0000 7f20227fc640 1 -- 172.21.15.84:0/2834844003 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c040070 con 0x7f202c0d1e00 2023-12-12T09:20:14.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.183+0000 7f20227fc640 1 -- 172.21.15.84:0/2834844003 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c003de0 con 0x7f202c0d1e00 2023-12-12T09:20:14.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.183+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c15e050 con 0x7f202c0d1e00 2023-12-12T09:20:14.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.183+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c0ccee0 con 0x7f202c0d1e00 2023-12-12T09:20:14.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.184+0000 7fa30e7fc640 1 -- 172.21.15.84:0/4082979283 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3100557e0 con 0x7fa3180b6210 2023-12-12T09:20:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.186+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c072b80 con 0x7f202c0d1e00 2023-12-12T09:20:14.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.187+0000 7f20227fc640 1 -- 172.21.15.84:0/2834844003 <== mon.1 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f201c047480 con 0x7f202c0d1e00 2023-12-12T09:20:14.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.188+0000 7f20227fc640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f201006aec0 0x7f201006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.189+0000 7f20227fc640 1 -- 172.21.15.84:0/2834844003 <== mon.1 v2:172.21.15.99:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f201c042070 con 0x7f202c0d1e00 2023-12-12T09:20:14.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.190+0000 7f203109c640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f201006aec0 0x7f201006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.191+0000 7f203109c640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f201006aec0 0x7f201006d380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f202c0b1210 tx=0x7f2028009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.202+0000 7f20227fc640 1 -- 172.21.15.84:0/2834844003 <== mon.1 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f201c076f20 con 0x7f202c0d1e00 2023-12-12T09:20:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.373+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5d4004e510 con 0x7f5d40053780 2023-12-12T09:20:14.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.374+0000 7f5d3effd640 1 -- 172.21.15.84:0/3348918831 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d4004e510 con 0x7f5d40053780 2023-12-12T09:20:14.378 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-12-12T09:20:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.378+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5d2c06ae40 msgr2=0x7f5d2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.378+0000 7f5d5070f640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5d2c06ae40 0x7f5d2c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5d44000f60 tx=0x7f5d44009040 comp rx=0 tx=0).stop 2023-12-12T09:20:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.378+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40053780 msgr2=0x7f5d400e6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.378+0000 7f5d5070f640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40053780 0x7f5d400e6550 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d48064260 tx=0x7f5d48067ea0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.379+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 shutdown_connections 2023-12-12T09:20:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.379+0000 7f5d5070f640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40053780 0x7f5d400e6550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.379+0000 7f5d5070f640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5d4003c0c0 0x7f5d400e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.379+0000 7f5d5070f640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5d2c06ae40 0x7f5d2c06d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.379+0000 7f5d5070f640 1 --2- 172.21.15.84:0/3348918831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d400061e0 0x7f5d400d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.379+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 >> 172.21.15.84:0/3348918831 conn(0x7f5d4003aa10 msgr2=0x7f5d40057f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.379+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 shutdown_connections 2023-12-12T09:20:14.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.379+0000 7f5d5070f640 1 -- 172.21.15.84:0/3348918831 wait complete. 2023-12-12T09:20:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.390+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8ef80444b0 con 0x7f8ef804ffa0 2023-12-12T09:20:14.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.391+0000 7f8efd7fa640 1 -- 172.21.15.84:0/4178280212 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8eec020020 con 0x7f8ef804ffa0 2023-12-12T09:20:14.393 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-12-12T09:20:14.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.395+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8ee406ae40 msgr2=0x7f8ee406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8ee406ae40 0x7f8ee406d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8ef402b960 tx=0x7f8ef403c040 comp rx=0 tx=0).stop 2023-12-12T09:20:14.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef804ffa0 msgr2=0x7f8ef80deea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef804ffa0 0x7f8ef80deea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00e7e0 tx=0x7f8eec00eca0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 shutdown_connections 2023-12-12T09:20:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8ee406ae40 0x7f8ee406d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ef8044e80 0x7f8ef80452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef804ffa0 0x7f8ef80deea0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 --2- 172.21.15.84:0/4178280212 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ef80380e0 0x7f8ef8044790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.396+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 >> 172.21.15.84:0/4178280212 conn(0x7f8ef8009f80 msgr2=0x7f8ef8036400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.397+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 shutdown_connections 2023-12-12T09:20:14.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.397+0000 7f8f059e9640 1 -- 172.21.15.84:0/4178280212 wait complete. 2023-12-12T09:20:14.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2023-12-12T09:20:14.409 DEBUG:teuthology.parallel:result is None 2023-12-12T09:20:14.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.5 2023-12-12T09:20:14.427 DEBUG:teuthology.parallel:result is None 2023-12-12T09:20:14.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.429+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f596c005500 con 0x7f598c0cc450 2023-12-12T09:20:14.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.430+0000 7f59737fe640 1 -- 172.21.15.84:0/528093575 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5984058750 con 0x7f598c0cc450 2023-12-12T09:20:14.432 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-12-12T09:20:14.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f597806ae40 msgr2=0x7f597806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f597806ae40 0x7f597806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5980000f60 tx=0x7f5980009040 comp rx=0 tx=0).stop 2023-12-12T09:20:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f598c0cc450 msgr2=0x7f598c1f36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f598c0cc450 0x7f598c1f36d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f598400efc0 tx=0x7f598400c490 comp rx=0 tx=0).stop 2023-12-12T09:20:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 shutdown_connections 2023-12-12T09:20:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f597806ae40 0x7f597806d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f598c0cc450 0x7f598c1f36d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f598c15d080 0x7f598c0cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 --2- 172.21.15.84:0/528093575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f598c070750 0x7f598c14f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.433+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 >> 172.21.15.84:0/528093575 conn(0x7f598c06a920 msgr2=0x7f598c15ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.434+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 shutdown_connections 2023-12-12T09:20:14.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.434+0000 7f5991631640 1 -- 172.21.15.84:0/528093575 wait complete. 2023-12-12T09:20:14.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.1 2023-12-12T09:20:14.460 DEBUG:teuthology.parallel:result is None 2023-12-12T09:20:14.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.470+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc1e80cf700 con 0x7fc1e803c0c0 2023-12-12T09:20:14.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.471+0000 7fc1ecff9640 1 -- 172.21.15.84:0/2488642359 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1e4035020 con 0x7fc1e803c0c0 2023-12-12T09:20:14.472 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc1d406ae40 msgr2=0x7fc1d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc1d406ae40 0x7fc1d406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc000f60 tx=0x7fc1dc009040 comp rx=0 tx=0).stop 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e803c0c0 msgr2=0x7fc1e8057360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e803c0c0 0x7fc1e8057360 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40096f0 tx=0x7fc1e40046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 shutdown_connections 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc1e8053780 0x7fc1e80578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1e803c0c0 0x7fc1e8057360 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 --2- 172.21.15.84:0/2488642359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1e80061e0 0x7fc1e80ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 >> 172.21.15.84:0/2488642359 conn(0x7fc1e803aa10 msgr2=0x7fc1e803e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.473+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 shutdown_connections 2023-12-12T09:20:14.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.474+0000 7fc1f50e1640 1 -- 172.21.15.84:0/2488642359 wait complete. 2023-12-12T09:20:14.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.483+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab180056e0 con 0x7fab180529c0 2023-12-12T09:20:14.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.483+0000 7fab16ffd640 1 -- 172.21.15.84:0/3376493546 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab2008e020 con 0x7fab180529c0 2023-12-12T09:20:14.485 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-12-12T09:20:14.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab0406aea0 msgr2=0x7fab0406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab0406aea0 0x7fab0406d360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0097a0 tx=0x7fab1c008030 comp rx=0 tx=0).stop 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab180529c0 msgr2=0x7fab1804d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab180529c0 0x7fab1804d140 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fab20069d50 tx=0x7fab200692a0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 shutdown_connections 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab0406aea0 0x7fab0406d360 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab180529c0 0x7fab1804d140 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab1804a2f0 0x7fab1804cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 --2- 172.21.15.84:0/3376493546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab18036180 0x7fab180d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 >> 172.21.15.84:0/3376493546 conn(0x7fab18053780 msgr2=0x7fab18036720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 shutdown_connections 2023-12-12T09:20:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.486+0000 7fab27121640 1 -- 172.21.15.84:0/3376493546 wait complete. 2023-12-12T09:20:14.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.4 2023-12-12T09:20:14.500 DEBUG:teuthology.parallel:result is None 2023-12-12T09:20:14.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2023-12-12T09:20:14.503 DEBUG:teuthology.parallel:result is None 2023-12-12T09:20:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.525+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f202c0673c0 con 0x7f202c0d1e00 2023-12-12T09:20:14.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.525+0000 7f20227fc640 1 -- 172.21.15.84:0/2834844003 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f201c07a540 con 0x7f202c0d1e00 2023-12-12T09:20:14.527 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-12-12T09:20:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.527+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f201006aec0 msgr2=0x7f201006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.527+0000 7f2033b01640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f201006aec0 0x7f201006d380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f202c0b1210 tx=0x7f2028009040 comp rx=0 tx=0).stop 2023-12-12T09:20:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.527+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c0d1e00 msgr2=0x7f202c0cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.527+0000 7f2033b01640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c0d1e00 0x7f202c0cb0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f201c000c00 tx=0x7f201c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.528+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 shutdown_connections 2023-12-12T09:20:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.528+0000 7f2033b01640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f202c15d490 0x7f202c15eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.528+0000 7f2033b01640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f201006aec0 0x7f201006d380 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.528+0000 7f2033b01640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f202c0d3d60 0x7f202c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.528+0000 7f2033b01640 1 --2- 172.21.15.84:0/2834844003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f202c0d1e00 0x7f202c0cb0d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.528+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 >> 172.21.15.84:0/2834844003 conn(0x7f202c09c450 msgr2=0x7f202c0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.528+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 shutdown_connections 2023-12-12T09:20:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.528+0000 7f2033b01640 1 -- 172.21.15.84:0/2834844003 wait complete. 2023-12-12T09:20:14.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2023-12-12T09:20:14.545 DEBUG:teuthology.parallel:result is None 2023-12-12T09:20:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.545+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc94014e8e0 con 0x7fc94013f710 2023-12-12T09:20:14.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.546+0000 7fc92effd640 1 -- 172.21.15.84:0/678858577 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc938017070 con 0x7fc94013f710 2023-12-12T09:20:14.547 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-12-12T09:20:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc92006aed0 msgr2=0x7fc92006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc92006aed0 0x7fc92006d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc930005880 tx=0x7fc930009040 comp rx=0 tx=0).stop 2023-12-12T09:20:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 msgr2=0x7fc9400b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc9400b2390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c810 tx=0x7fc93800ccd0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 shutdown_connections 2023-12-12T09:20:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc92006aed0 0x7fc92006d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc94013f710 0x7fc9400b2390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9400cf5e0 0x7fc940135350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 --2- 172.21.15.84:0/678858577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc94006c910 0x7fc9401348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 >> 172.21.15.84:0/678858577 conn(0x7fc9400ceac0 msgr2=0x7fc94013a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.548+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 shutdown_connections 2023-12-12T09:20:14.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.549+0000 7fc93f59e640 1 -- 172.21.15.84:0/678858577 wait complete. 2023-12-12T09:20:14.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.554+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa3180cf100 con 0x7fa3180b6210 2023-12-12T09:20:14.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.555+0000 7fa30e7fc640 1 -- 172.21.15.84:0/4082979283 <== mon.1 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa31001e020 con 0x7fa3180b6210 2023-12-12T09:20:14.556 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-12-12T09:20:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa2fc06ae70 msgr2=0x7fa2fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa2fc06ae70 0x7fa2fc06d330 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa314006fd0 tx=0x7fa314008040 comp rx=0 tx=0).stop 2023-12-12T09:20:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3180b6210 msgr2=0x7fa31815df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3180b6210 0x7fa31815df30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa31000ecf0 tx=0x7fa31000c6e0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 shutdown_connections 2023-12-12T09:20:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa2fc06ae70 0x7fa2fc06d330 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3180cb740 0x7fa3180cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3180b6210 0x7fa31815df30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 --2- 172.21.15.84:0/4082979283 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa3040052a0 0x7fa31815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 >> 172.21.15.84:0/4082979283 conn(0x7fa31809c450 msgr2=0x7fa3180d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 shutdown_connections 2023-12-12T09:20:14.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.557+0000 7fa31fd53640 1 -- 172.21.15.84:0/4082979283 wait complete. 2023-12-12T09:20:14.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.2 2023-12-12T09:20:14.566 DEBUG:teuthology.parallel:result is None 2023-12-12T09:20:14.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.6 2023-12-12T09:20:14.574 DEBUG:teuthology.parallel:result is None 2023-12-12T09:20:14.574 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-12T09:20:14.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:20:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.823+0000 7f520723d640 1 Processor -- start 2023-12-12T09:20:14.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.823+0000 7f520723d640 1 -- start start 2023-12-12T09:20:14.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.825+0000 7f520723d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5200143d20 0x7f52000b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.825+0000 7f520723d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f52001447f0 0x7f52000b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.825+0000 7f520723d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52000cea30 con 0x7f52000ce550 2023-12-12T09:20:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.825+0000 7f520723d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52000702b0 con 0x7f5200143d20 2023-12-12T09:20:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.825+0000 7f520723d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5200070590 con 0x7f52001447f0 2023-12-12T09:20:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.825+0000 7f5204fd9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5200143d20 0x7f52000b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.825+0000 7f5204fd9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5200143d20 0x7f52000b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34758/0 (socket says 172.21.15.84:34758) 2023-12-12T09:20:14.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.825+0000 7f5204fd9640 1 -- 172.21.15.84:0/2686188042 learned_addr learned my addr 172.21.15.84:0/2686188042 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.826+0000 7f52057da640 1 --2- 172.21.15.84:0/2686188042 >> v2:172.21.15.99:3300/0 conn(0x7f52001447f0 0x7f52000b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.826+0000 7f5204fd9640 1 -- 172.21.15.84:0/2686188042 >> v2:172.21.15.99:3300/0 conn(0x7f52001447f0 msgr2=0x7f52000b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.826+0000 7f5204fd9640 1 --2- 172.21.15.84:0/2686188042 >> v2:172.21.15.99:3300/0 conn(0x7f52001447f0 0x7f52000b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.826+0000 7f5204fd9640 1 -- 172.21.15.84:0/2686188042 >> v1:172.21.15.99:6789/0 conn(0x7f52000ce550 legacy=0x7f520015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:14.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.826+0000 7f5204fd9640 1 -- 172.21.15.84:0/2686188042 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200070870 con 0x7f5200143d20 2023-12-12T09:20:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.826+0000 7f52057da640 1 --2- 172.21.15.84:0/2686188042 >> v2:172.21.15.99:3300/0 conn(0x7f52001447f0 0x7f52000b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.827+0000 7f5204fd9640 1 --2- 172.21.15.84:0/2686188042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200143d20 0x7f52000b40d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52000ae330 tx=0x7f51f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9341a7b5a9cebd8e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.827+0000 7f51ff7fe640 1 -- 172.21.15.84:0/2686188042 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f002ca80 con 0x7f5200143d20 2023-12-12T09:20:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.827+0000 7f51ff7fe640 1 -- 172.21.15.84:0/2686188042 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f002cbe0 con 0x7f5200143d20 2023-12-12T09:20:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.827+0000 7f51ff7fe640 1 -- 172.21.15.84:0/2686188042 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00343f0 con 0x7f5200143d20 2023-12-12T09:20:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.828+0000 7f520723d640 1 -- 172.21.15.84:0/2686188042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200143d20 msgr2=0x7f52000b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.828+0000 7f520723d640 1 --2- 172.21.15.84:0/2686188042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200143d20 0x7f52000b40d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52000ae330 tx=0x7f51f002bee0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.828+0000 7f520723d640 1 -- 172.21.15.84:0/2686188042 shutdown_connections 2023-12-12T09:20:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.828+0000 7f520723d640 1 --2- 172.21.15.84:0/2686188042 >> v2:172.21.15.99:3300/0 conn(0x7f52001447f0 0x7f52000b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.828+0000 7f520723d640 1 --2- 172.21.15.84:0/2686188042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5200143d20 0x7f52000b40d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.828+0000 7f520723d640 1 -- 172.21.15.84:0/2686188042 >> 172.21.15.84:0/2686188042 conn(0x7f520006c3d0 msgr2=0x7f520006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.828+0000 7f520723d640 1 -- 172.21.15.84:0/2686188042 shutdown_connections 2023-12-12T09:20:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.828+0000 7f520723d640 1 -- 172.21.15.84:0/2686188042 wait complete. 2023-12-12T09:20:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.830+0000 7f520723d640 1 Processor -- start 2023-12-12T09:20:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.830+0000 7f520723d640 1 -- start start 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f520723d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52000ce550 0x7f52000a8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f520723d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5200143d20 0x7f520013b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f520723d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52001447f0 0x7f5200139510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f520723d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52000a8e90 con 0x7f52001447f0 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f520723d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520013b5c0 con 0x7f52000ce550 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f520723d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520013c400 con 0x7f5200143d20 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f52057da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52001447f0 0x7f5200139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f52057da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52001447f0 0x7f5200139510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34772/0 (socket says 172.21.15.84:34772) 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f52057da640 1 -- 172.21.15.84:0/898128167 learned_addr learned my addr 172.21.15.84:0/898128167 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f52057da640 1 -- 172.21.15.84:0/898128167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5200143d20 msgr2=0x7f520013b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.831+0000 7f52057da640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5200143d20 0x7f520013b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f52057da640 1 -- 172.21.15.84:0/898128167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52000ce550 msgr2=0x7f52000a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f52057da640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52000ce550 0x7f52000a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f52057da640 1 -- 172.21.15.84:0/898128167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009b30 con 0x7f52001447f0 2023-12-12T09:20:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f52057da640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52001447f0 0x7f5200139510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c5f0 tx=0x7f51f800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f51fd7fa640 1 -- 172.21.15.84:0/898128167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8011800 con 0x7f52001447f0 2023-12-12T09:20:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f51fd7fa640 1 -- 172.21.15.84:0/898128167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8011980 con 0x7f52001447f0 2023-12-12T09:20:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520013b7f0 con 0x7f52001447f0 2023-12-12T09:20:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f51fd7fa640 1 -- 172.21.15.84:0/898128167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8011d30 con 0x7f52001447f0 2023-12-12T09:20:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.832+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520013bdb0 con 0x7f52001447f0 2023-12-12T09:20:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.833+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52000673c0 con 0x7f52001447f0 2023-12-12T09:20:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.834+0000 7f51fd7fa640 1 -- 172.21.15.84:0/898128167 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51f8022350 con 0x7f52001447f0 2023-12-12T09:20:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.835+0000 7f51fd7fa640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f51e006ae40 0x7f51e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.836+0000 7f51fd7fa640 1 -- 172.21.15.84:0/898128167 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51f8089a00 con 0x7f52001447f0 2023-12-12T09:20:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.836+0000 7f5204fd9640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f51e006ae40 0x7f51e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.836+0000 7f5204fd9640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f51e006ae40 0x7f51e006d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f51f0035000 tx=0x7f51f002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:14.840+0000 7f51fd7fa640 1 -- 172.21.15.84:0/898128167 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51f8054740 con 0x7f52001447f0 2023-12-12T09:20:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.012+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f520013c570 con 0x7f51e006ae40 2023-12-12T09:20:15.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.021+0000 7f51fd7fa640 1 -- 172.21.15.84:0/898128167 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345103 (secure 0 0 0) 0x7f520013c570 con 0x7f51e006ae40 2023-12-12T09:20:15.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:20:15.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f51e006ae40 msgr2=0x7f51e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f51e006ae40 0x7f51e006d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f51f0035000 tx=0x7f51f002e000 comp rx=0 tx=0).stop 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52001447f0 msgr2=0x7f5200139510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52001447f0 0x7f5200139510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c5f0 tx=0x7f51f800cab0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 shutdown_connections 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f51e006ae40 0x7f51e006d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52001447f0 0x7f5200139510 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5200143d20 0x7f520013b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 --2- 172.21.15.84:0/898128167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52000ce550 0x7f52000a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 >> 172.21.15.84:0/898128167 conn(0x7f520006c3d0 msgr2=0x7f520015b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 shutdown_connections 2023-12-12T09:20:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.029+0000 7f520723d640 1 -- 172.21.15.84:0/898128167 wait complete. 2023-12-12T09:20:15.049 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-12T09:20:13.083564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219544,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":3448832,"data_stored":2071226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004555"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951816+0000","last_change":"2023-12-12T09:19:41.122279+0000","last_active":"2023-12-12T09:19:47.951816+0000","last_peered":"2023-12-12T09:19:47.951816+0000","last_clean":"2023-12-12T09:19:47.951816+0000","last_became_active":"2023-12-12T09:19:41.122032+0000","last_became_peered":"2023-12-12T09:19:41.122032+0000","last_unstale":"2023-12-12T09:19:47.951816+0000","last_undegraded":"2023-12-12T09:19:47.951816+0000","last_fullsized":"2023-12-12T09:19:47.951816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957378+0000","last_change":"2023-12-12T09:19:41.863190+0000","last_active":"2023-12-12T09:19:47.957378+0000","last_peered":"2023-12-12T09:19:47.957378+0000","last_clean":"2023-12-12T09:19:47.957378+0000","last_became_active":"2023-12-12T09:19:41.862923+0000","last_became_peered":"2023-12-12T09:19:41.862923+0000","last_unstale":"2023-12-12T09:19:47.957378+0000","last_undegraded":"2023-12-12T09:19:47.957378+0000","last_fullsized":"2023-12-12T09:19:47.957378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:12.357618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127983+0000","last_change":"2023-12-12T09:19:46.953136+0000","last_active":"2023-12-12T09:19:48.127983+0000","last_peered":"2023-12-12T09:19:48.127983+0000","last_clean":"2023-12-12T09:19:48.127983+0000","last_became_active":"2023-12-12T09:19:46.951967+0000","last_became_peered":"2023-12-12T09:19:46.951967+0000","last_unstale":"2023-12-12T09:19:48.127983+0000","last_undegraded":"2023-12-12T09:19:48.127983+0000","last_fullsized":"2023-12-12T09:19:48.127983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:57:42.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957667+0000","last_change":"2023-12-12T09:19:41.121042+0000","last_active":"2023-12-12T09:19:47.957667+0000","last_peered":"2023-12-12T09:19:47.957667+0000","last_clean":"2023-12-12T09:19:47.957667+0000","last_became_active":"2023-12-12T09:19:41.120807+0000","last_became_peered":"2023-12-12T09:19:41.120807+0000","last_unstale":"2023-12-12T09:19:47.957667+0000","last_undegraded":"2023-12-12T09:19:47.957667+0000","last_fullsized":"2023-12-12T09:19:47.957667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:13:12.317036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951513+0000","last_change":"2023-12-12T09:19:41.878335+0000","last_active":"2023-12-12T09:19:47.951513+0000","last_peered":"2023-12-12T09:19:47.951513+0000","last_clean":"2023-12-12T09:19:47.951513+0000","last_became_active":"2023-12-12T09:19:41.878074+0000","last_became_peered":"2023-12-12T09:19:41.878074+0000","last_unstale":"2023-12-12T09:19:47.951513+0000","last_undegraded":"2023-12-12T09:19:47.951513+0000","last_fullsized":"2023-12-12T09:19:47.951513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130375+0000","last_change":"2023-12-12T09:19:46.188502+0000","last_active":"2023-12-12T09:19:48.130375+0000","last_peered":"2023-12-12T09:19:48.130375+0000","last_clean":"2023-12-12T09:19:48.130375+0000","last_became_active":"2023-12-12T09:19:46.187905+0000","last_became_peered":"2023-12-12T09:19:46.187905+0000","last_unstale":"2023-12-12T09:19:48.130375+0000","last_undegraded":"2023-12-12T09:19:48.130375+0000","last_fullsized":"2023-12-12T09:19:48.130375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:47:39.097135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303686+0000","last_change":"2023-12-12T09:19:41.138949+0000","last_active":"2023-12-12T09:19:47.303686+0000","last_peered":"2023-12-12T09:19:47.303686+0000","last_clean":"2023-12-12T09:19:47.303686+0000","last_became_active":"2023-12-12T09:19:41.138599+0000","last_became_peered":"2023-12-12T09:19:41.138599+0000","last_unstale":"2023-12-12T09:19:47.303686+0000","last_undegraded":"2023-12-12T09:19:47.303686+0000","last_fullsized":"2023-12-12T09:19:47.303686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127902+0000","last_change":"2023-12-12T09:19:41.871082+0000","last_active":"2023-12-12T09:19:47.127902+0000","last_peered":"2023-12-12T09:19:47.127902+0000","last_clean":"2023-12-12T09:19:47.127902+0000","last_became_active":"2023-12-12T09:19:41.870566+0000","last_became_peered":"2023-12-12T09:19:41.870566+0000","last_unstale":"2023-12-12T09:19:47.127902+0000","last_undegraded":"2023-12-12T09:19:47.127902+0000","last_fullsized":"2023-12-12T09:19:47.127902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:25.789938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131233+0000","last_change":"2023-12-12T09:19:46.189328+0000","last_active":"2023-12-12T09:19:48.131233+0000","last_peered":"2023-12-12T09:19:48.131233+0000","last_clean":"2023-12-12T09:19:48.131233+0000","last_became_active":"2023-12-12T09:19:46.187611+0000","last_became_peered":"2023-12-12T09:19:46.187611+0000","last_unstale":"2023-12-12T09:19:48.131233+0000","last_undegraded":"2023-12-12T09:19:48.131233+0000","last_fullsized":"2023-12-12T09:19:48.131233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303363+0000","last_change":"2023-12-12T09:19:41.137054+0000","last_active":"2023-12-12T09:19:47.303363+0000","last_peered":"2023-12-12T09:19:47.303363+0000","last_clean":"2023-12-12T09:19:47.303363+0000","last_became_active":"2023-12-12T09:19:41.136605+0000","last_became_peered":"2023-12-12T09:19:41.136605+0000","last_unstale":"2023-12-12T09:19:47.303363+0000","last_undegraded":"2023-12-12T09:19:47.303363+0000","last_fullsized":"2023-12-12T09:19:47.303363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127898+0000","last_change":"2023-12-12T09:19:41.874505+0000","last_active":"2023-12-12T09:19:47.127898+0000","last_peered":"2023-12-12T09:19:47.127898+0000","last_clean":"2023-12-12T09:19:47.127898+0000","last_became_active":"2023-12-12T09:19:41.867235+0000","last_became_peered":"2023-12-12T09:19:41.867235+0000","last_unstale":"2023-12-12T09:19:47.127898+0000","last_undegraded":"2023-12-12T09:19:47.127898+0000","last_fullsized":"2023-12-12T09:19:47.127898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:24.432590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130292+0000","last_change":"2023-12-12T09:19:46.181752+0000","last_active":"2023-12-12T09:19:48.130292+0000","last_peered":"2023-12-12T09:19:48.130292+0000","last_clean":"2023-12-12T09:19:48.130292+0000","last_became_active":"2023-12-12T09:19:46.181333+0000","last_became_peered":"2023-12-12T09:19:46.181333+0000","last_unstale":"2023-12-12T09:19:48.130292+0000","last_undegraded":"2023-12-12T09:19:48.130292+0000","last_fullsized":"2023-12-12T09:19:48.130292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:24.767108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019710+0000","last_change":"2023-12-12T09:19:41.875596+0000","last_active":"2023-12-12T09:19:48.019710+0000","last_peered":"2023-12-12T09:19:48.019710+0000","last_clean":"2023-12-12T09:19:48.019710+0000","last_became_active":"2023-12-12T09:19:41.874550+0000","last_became_peered":"2023-12-12T09:19:41.874550+0000","last_unstale":"2023-12-12T09:19:48.019710+0000","last_undegraded":"2023-12-12T09:19:48.019710+0000","last_fullsized":"2023-12-12T09:19:48.019710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303839+0000","last_change":"2023-12-12T09:19:41.134017+0000","last_active":"2023-12-12T09:19:47.303839+0000","last_peered":"2023-12-12T09:19:47.303839+0000","last_clean":"2023-12-12T09:19:47.303839+0000","last_became_active":"2023-12-12T09:19:41.133112+0000","last_became_peered":"2023-12-12T09:19:41.133112+0000","last_unstale":"2023-12-12T09:19:47.303839+0000","last_undegraded":"2023-12-12T09:19:47.303839+0000","last_fullsized":"2023-12-12T09:19:47.303839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:30.833996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132530+0000","last_change":"2023-12-12T09:19:46.183576+0000","last_active":"2023-12-12T09:19:48.132530+0000","last_peered":"2023-12-12T09:19:48.132530+0000","last_clean":"2023-12-12T09:19:48.132530+0000","last_became_active":"2023-12-12T09:19:46.182655+0000","last_became_peered":"2023-12-12T09:19:46.182655+0000","last_unstale":"2023-12-12T09:19:48.132530+0000","last_undegraded":"2023-12-12T09:19:48.132530+0000","last_fullsized":"2023-12-12T09:19:48.132530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:46.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956362+0000","last_change":"2023-12-12T09:19:41.862462+0000","last_active":"2023-12-12T09:19:47.956362+0000","last_peered":"2023-12-12T09:19:47.956362+0000","last_clean":"2023-12-12T09:19:47.956362+0000","last_became_active":"2023-12-12T09:19:41.860988+0000","last_became_peered":"2023-12-12T09:19:41.860988+0000","last_unstale":"2023-12-12T09:19:47.956362+0000","last_undegraded":"2023-12-12T09:19:47.956362+0000","last_fullsized":"2023-12-12T09:19:47.956362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:26.864874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444995+0000","last_change":"2023-12-12T09:19:41.124071+0000","last_active":"2023-12-12T09:19:47.444995+0000","last_peered":"2023-12-12T09:19:47.444995+0000","last_clean":"2023-12-12T09:19:47.444995+0000","last_became_active":"2023-12-12T09:19:41.123806+0000","last_became_peered":"2023-12-12T09:19:41.123806+0000","last_unstale":"2023-12-12T09:19:47.444995+0000","last_undegraded":"2023-12-12T09:19:47.444995+0000","last_fullsized":"2023-12-12T09:19:47.444995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131780+0000","last_change":"2023-12-12T09:19:46.188994+0000","last_active":"2023-12-12T09:19:48.131780+0000","last_peered":"2023-12-12T09:19:48.131780+0000","last_clean":"2023-12-12T09:19:48.131780+0000","last_became_active":"2023-12-12T09:19:46.188551+0000","last_became_peered":"2023-12-12T09:19:46.188551+0000","last_unstale":"2023-12-12T09:19:48.131780+0000","last_undegraded":"2023-12-12T09:19:48.131780+0000","last_fullsized":"2023-12-12T09:19:48.131780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956335+0000","last_change":"2023-12-12T09:19:41.857578+0000","last_active":"2023-12-12T09:19:47.956335+0000","last_peered":"2023-12-12T09:19:47.956335+0000","last_clean":"2023-12-12T09:19:47.956335+0000","last_became_active":"2023-12-12T09:19:41.857262+0000","last_became_peered":"2023-12-12T09:19:41.857262+0000","last_unstale":"2023-12-12T09:19:47.956335+0000","last_undegraded":"2023-12-12T09:19:47.956335+0000","last_fullsized":"2023-12-12T09:19:47.956335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:23:10.886043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444759+0000","last_change":"2023-12-12T09:19:41.124140+0000","last_active":"2023-12-12T09:19:47.444759+0000","last_peered":"2023-12-12T09:19:47.444759+0000","last_clean":"2023-12-12T09:19:47.444759+0000","last_became_active":"2023-12-12T09:19:41.123866+0000","last_became_peered":"2023-12-12T09:19:41.123866+0000","last_unstale":"2023-12-12T09:19:47.444759+0000","last_undegraded":"2023-12-12T09:19:47.444759+0000","last_fullsized":"2023-12-12T09:19:47.444759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:30.833996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169980+0000","last_change":"2023-12-12T09:19:46.944967+0000","last_active":"2023-12-12T09:19:48.169980+0000","last_peered":"2023-12-12T09:19:48.169980+0000","last_clean":"2023-12-12T09:19:48.169980+0000","last_became_active":"2023-12-12T09:19:46.942177+0000","last_became_peered":"2023-12-12T09:19:46.942177+0000","last_unstale":"2023-12-12T09:19:48.169980+0000","last_undegraded":"2023-12-12T09:19:48.169980+0000","last_fullsized":"2023-12-12T09:19:48.169980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129676+0000","last_change":"2023-12-12T09:19:41.861866+0000","last_active":"2023-12-12T09:19:47.129676+0000","last_peered":"2023-12-12T09:19:47.129676+0000","last_clean":"2023-12-12T09:19:47.129676+0000","last_became_active":"2023-12-12T09:19:41.861471+0000","last_became_peered":"2023-12-12T09:19:41.861471+0000","last_unstale":"2023-12-12T09:19:47.129676+0000","last_undegraded":"2023-12-12T09:19:47.129676+0000","last_fullsized":"2023-12-12T09:19:47.129676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:19.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302819+0000","last_change":"2023-12-12T09:19:41.132420+0000","last_active":"2023-12-12T09:19:47.302819+0000","last_peered":"2023-12-12T09:19:47.302819+0000","last_clean":"2023-12-12T09:19:47.302819+0000","last_became_active":"2023-12-12T09:19:41.130901+0000","last_became_peered":"2023-12-12T09:19:41.130901+0000","last_unstale":"2023-12-12T09:19:47.302819+0000","last_undegraded":"2023-12-12T09:19:47.302819+0000","last_fullsized":"2023-12-12T09:19:47.302819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:38.516239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132323+0000","last_change":"2023-12-12T09:19:46.190546+0000","last_active":"2023-12-12T09:19:48.132323+0000","last_peered":"2023-12-12T09:19:48.132323+0000","last_clean":"2023-12-12T09:19:48.132323+0000","last_became_active":"2023-12-12T09:19:46.190080+0000","last_became_peered":"2023-12-12T09:19:46.190080+0000","last_unstale":"2023-12-12T09:19:48.132323+0000","last_undegraded":"2023-12-12T09:19:48.132323+0000","last_fullsized":"2023-12-12T09:19:48.132323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951268+0000","last_change":"2023-12-12T09:19:41.858094+0000","last_active":"2023-12-12T09:19:47.951268+0000","last_peered":"2023-12-12T09:19:47.951268+0000","last_clean":"2023-12-12T09:19:47.951268+0000","last_became_active":"2023-12-12T09:19:41.857826+0000","last_became_peered":"2023-12-12T09:19:41.857826+0000","last_unstale":"2023-12-12T09:19:47.951268+0000","last_undegraded":"2023-12-12T09:19:47.951268+0000","last_fullsized":"2023-12-12T09:19:47.951268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021166+0000","last_change":"2023-12-12T09:19:41.135301+0000","last_active":"2023-12-12T09:19:48.021166+0000","last_peered":"2023-12-12T09:19:48.021166+0000","last_clean":"2023-12-12T09:19:48.021166+0000","last_became_active":"2023-12-12T09:19:41.134467+0000","last_became_peered":"2023-12-12T09:19:41.134467+0000","last_unstale":"2023-12-12T09:19:48.021166+0000","last_undegraded":"2023-12-12T09:19:48.021166+0000","last_fullsized":"2023-12-12T09:19:48.021166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132355+0000","last_change":"2023-12-12T09:19:46.943689+0000","last_active":"2023-12-12T09:19:48.132355+0000","last_peered":"2023-12-12T09:19:48.132355+0000","last_clean":"2023-12-12T09:19:48.132355+0000","last_became_active":"2023-12-12T09:19:46.942093+0000","last_became_peered":"2023-12-12T09:19:46.942093+0000","last_unstale":"2023-12-12T09:19:48.132355+0000","last_undegraded":"2023-12-12T09:19:48.132355+0000","last_fullsized":"2023-12-12T09:19:48.132355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:00.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957608+0000","last_change":"2023-12-12T09:19:41.861945+0000","last_active":"2023-12-12T09:19:47.957608+0000","last_peered":"2023-12-12T09:19:47.957608+0000","last_clean":"2023-12-12T09:19:47.957608+0000","last_became_active":"2023-12-12T09:19:41.861570+0000","last_became_peered":"2023-12-12T09:19:41.861570+0000","last_unstale":"2023-12-12T09:19:47.957608+0000","last_undegraded":"2023-12-12T09:19:47.957608+0000","last_fullsized":"2023-12-12T09:19:47.957608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:49.539855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445666+0000","last_change":"2023-12-12T09:19:41.131818+0000","last_active":"2023-12-12T09:19:47.445666+0000","last_peered":"2023-12-12T09:19:47.445666+0000","last_clean":"2023-12-12T09:19:47.445666+0000","last_became_active":"2023-12-12T09:19:41.131557+0000","last_became_peered":"2023-12-12T09:19:41.131557+0000","last_unstale":"2023-12-12T09:19:47.445666+0000","last_undegraded":"2023-12-12T09:19:47.445666+0000","last_fullsized":"2023-12-12T09:19:47.445666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:18.435713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127909+0000","last_change":"2023-12-12T09:19:46.955434+0000","last_active":"2023-12-12T09:19:48.127909+0000","last_peered":"2023-12-12T09:19:48.127909+0000","last_clean":"2023-12-12T09:19:48.127909+0000","last_became_active":"2023-12-12T09:19:46.949579+0000","last_became_peered":"2023-12-12T09:19:46.949579+0000","last_unstale":"2023-12-12T09:19:48.127909+0000","last_undegraded":"2023-12-12T09:19:48.127909+0000","last_fullsized":"2023-12-12T09:19:48.127909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:30:22.426722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445297+0000","last_change":"2023-12-12T09:19:41.864811+0000","last_active":"2023-12-12T09:19:47.445297+0000","last_peered":"2023-12-12T09:19:47.445297+0000","last_clean":"2023-12-12T09:19:47.445297+0000","last_became_active":"2023-12-12T09:19:41.863476+0000","last_became_peered":"2023-12-12T09:19:41.863476+0000","last_unstale":"2023-12-12T09:19:47.445297+0000","last_undegraded":"2023-12-12T09:19:47.445297+0000","last_fullsized":"2023-12-12T09:19:47.445297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303909+0000","last_change":"2023-12-12T09:19:41.134083+0000","last_active":"2023-12-12T09:19:47.303909+0000","last_peered":"2023-12-12T09:19:47.303909+0000","last_clean":"2023-12-12T09:19:47.303909+0000","last_became_active":"2023-12-12T09:19:41.133702+0000","last_became_peered":"2023-12-12T09:19:41.133702+0000","last_unstale":"2023-12-12T09:19:47.303909+0000","last_undegraded":"2023-12-12T09:19:47.303909+0000","last_fullsized":"2023-12-12T09:19:47.303909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:55.931283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170416+0000","last_change":"2023-12-12T09:19:46.943046+0000","last_active":"2023-12-12T09:19:48.170416+0000","last_peered":"2023-12-12T09:19:48.170416+0000","last_clean":"2023-12-12T09:19:48.170416+0000","last_became_active":"2023-12-12T09:19:46.941680+0000","last_became_peered":"2023-12-12T09:19:46.941680+0000","last_unstale":"2023-12-12T09:19:48.170416+0000","last_undegraded":"2023-12-12T09:19:48.170416+0000","last_fullsized":"2023-12-12T09:19:48.170416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128054+0000","last_change":"2023-12-12T09:19:41.865106+0000","last_active":"2023-12-12T09:19:47.128054+0000","last_peered":"2023-12-12T09:19:47.128054+0000","last_clean":"2023-12-12T09:19:47.128054+0000","last_became_active":"2023-12-12T09:19:41.864807+0000","last_became_peered":"2023-12-12T09:19:41.864807+0000","last_unstale":"2023-12-12T09:19:47.128054+0000","last_undegraded":"2023-12-12T09:19:47.128054+0000","last_fullsized":"2023-12-12T09:19:47.128054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:32.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445367+0000","last_change":"2023-12-12T09:19:41.116293+0000","last_active":"2023-12-12T09:19:47.445367+0000","last_peered":"2023-12-12T09:19:47.445367+0000","last_clean":"2023-12-12T09:19:47.445367+0000","last_became_active":"2023-12-12T09:19:41.115995+0000","last_became_peered":"2023-12-12T09:19:41.115995+0000","last_unstale":"2023-12-12T09:19:47.445367+0000","last_undegraded":"2023-12-12T09:19:47.445367+0000","last_fullsized":"2023-12-12T09:19:47.445367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:02.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.168829+0000","last_change":"2023-12-12T09:19:46.184450+0000","last_active":"2023-12-12T09:19:48.168829+0000","last_peered":"2023-12-12T09:19:48.168829+0000","last_clean":"2023-12-12T09:19:48.168829+0000","last_became_active":"2023-12-12T09:19:46.183856+0000","last_became_peered":"2023-12-12T09:19:46.183856+0000","last_unstale":"2023-12-12T09:19:48.168829+0000","last_undegraded":"2023-12-12T09:19:48.168829+0000","last_fullsized":"2023-12-12T09:19:48.168829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.131191+0000","last_change":"2023-12-12T09:19:41.859699+0000","last_active":"2023-12-12T09:19:47.131191+0000","last_peered":"2023-12-12T09:19:47.131191+0000","last_clean":"2023-12-12T09:19:47.131191+0000","last_became_active":"2023-12-12T09:19:41.859271+0000","last_became_peered":"2023-12-12T09:19:41.859271+0000","last_unstale":"2023-12-12T09:19:47.131191+0000","last_undegraded":"2023-12-12T09:19:47.131191+0000","last_fullsized":"2023-12-12T09:19:47.131191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:23:52.795227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128310+0000","last_change":"2023-12-12T09:19:41.127974+0000","last_active":"2023-12-12T09:19:47.128310+0000","last_peered":"2023-12-12T09:19:47.128310+0000","last_clean":"2023-12-12T09:19:47.128310+0000","last_became_active":"2023-12-12T09:19:41.127284+0000","last_became_peered":"2023-12-12T09:19:41.127284+0000","last_unstale":"2023-12-12T09:19:47.128310+0000","last_undegraded":"2023-12-12T09:19:47.128310+0000","last_fullsized":"2023-12-12T09:19:47.128310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:27.876703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169383+0000","last_change":"2023-12-12T09:19:46.187283+0000","last_active":"2023-12-12T09:19:48.169383+0000","last_peered":"2023-12-12T09:19:48.169383+0000","last_clean":"2023-12-12T09:19:48.169383+0000","last_became_active":"2023-12-12T09:19:46.184094+0000","last_became_peered":"2023-12-12T09:19:46.184094+0000","last_unstale":"2023-12-12T09:19:48.169383+0000","last_undegraded":"2023-12-12T09:19:48.169383+0000","last_fullsized":"2023-12-12T09:19:48.169383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444747+0000","last_change":"2023-12-12T09:19:41.860571+0000","last_active":"2023-12-12T09:19:47.444747+0000","last_peered":"2023-12-12T09:19:47.444747+0000","last_clean":"2023-12-12T09:19:47.444747+0000","last_became_active":"2023-12-12T09:19:41.860299+0000","last_became_peered":"2023-12-12T09:19:41.860299+0000","last_unstale":"2023-12-12T09:19:47.444747+0000","last_undegraded":"2023-12-12T09:19:47.444747+0000","last_fullsized":"2023-12-12T09:19:47.444747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126141+0000","last_change":"2023-12-12T09:19:41.117790+0000","last_active":"2023-12-12T09:19:47.126141+0000","last_peered":"2023-12-12T09:19:47.126141+0000","last_clean":"2023-12-12T09:19:47.126141+0000","last_became_active":"2023-12-12T09:19:41.117558+0000","last_became_peered":"2023-12-12T09:19:41.117558+0000","last_unstale":"2023-12-12T09:19:47.126141+0000","last_undegraded":"2023-12-12T09:19:47.126141+0000","last_fullsized":"2023-12-12T09:19:47.126141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:34:48.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170143+0000","last_change":"2023-12-12T09:19:46.182717+0000","last_active":"2023-12-12T09:19:48.170143+0000","last_peered":"2023-12-12T09:19:48.170143+0000","last_clean":"2023-12-12T09:19:48.170143+0000","last_became_active":"2023-12-12T09:19:46.179138+0000","last_became_peered":"2023-12-12T09:19:46.179138+0000","last_unstale":"2023-12-12T09:19:48.170143+0000","last_undegraded":"2023-12-12T09:19:48.170143+0000","last_fullsized":"2023-12-12T09:19:48.170143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950048+0000","last_change":"2023-12-12T09:19:41.850752+0000","last_active":"2023-12-12T09:19:47.950048+0000","last_peered":"2023-12-12T09:19:47.950048+0000","last_clean":"2023-12-12T09:19:47.950048+0000","last_became_active":"2023-12-12T09:19:41.849147+0000","last_became_peered":"2023-12-12T09:19:41.849147+0000","last_unstale":"2023-12-12T09:19:47.950048+0000","last_undegraded":"2023-12-12T09:19:47.950048+0000","last_fullsized":"2023-12-12T09:19:47.950048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:03.309104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302812+0000","last_change":"2023-12-12T09:19:41.134276+0000","last_active":"2023-12-12T09:19:47.302812+0000","last_peered":"2023-12-12T09:19:47.302812+0000","last_clean":"2023-12-12T09:19:47.302812+0000","last_became_active":"2023-12-12T09:19:41.133924+0000","last_became_peered":"2023-12-12T09:19:41.133924+0000","last_unstale":"2023-12-12T09:19:47.302812+0000","last_undegraded":"2023-12-12T09:19:47.302812+0000","last_fullsized":"2023-12-12T09:19:47.302812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171202+0000","last_change":"2023-12-12T09:19:46.947025+0000","last_active":"2023-12-12T09:19:48.171202+0000","last_peered":"2023-12-12T09:19:48.171202+0000","last_clean":"2023-12-12T09:19:48.171202+0000","last_became_active":"2023-12-12T09:19:46.945211+0000","last_became_peered":"2023-12-12T09:19:46.945211+0000","last_unstale":"2023-12-12T09:19:48.171202+0000","last_undegraded":"2023-12-12T09:19:48.171202+0000","last_fullsized":"2023-12-12T09:19:48.171202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.955803+0000","last_change":"2023-12-12T09:19:41.877643+0000","last_active":"2023-12-12T09:19:47.955803+0000","last_peered":"2023-12-12T09:19:47.955803+0000","last_clean":"2023-12-12T09:19:47.955803+0000","last_became_active":"2023-12-12T09:19:41.877316+0000","last_became_peered":"2023-12-12T09:19:41.877316+0000","last_unstale":"2023-12-12T09:19:47.955803+0000","last_undegraded":"2023-12-12T09:19:47.955803+0000","last_fullsized":"2023-12-12T09:19:47.955803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:14:08.288770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127400+0000","last_change":"2023-12-12T09:19:41.113788+0000","last_active":"2023-12-12T09:19:47.127400+0000","last_peered":"2023-12-12T09:19:47.127400+0000","last_clean":"2023-12-12T09:19:47.127400+0000","last_became_active":"2023-12-12T09:19:41.112577+0000","last_became_peered":"2023-12-12T09:19:41.112577+0000","last_unstale":"2023-12-12T09:19:47.127400+0000","last_undegraded":"2023-12-12T09:19:47.127400+0000","last_fullsized":"2023-12-12T09:19:47.127400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:42.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303078+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:19:47.303078+0000","last_peered":"2023-12-12T09:19:47.303078+0000","last_clean":"2023-12-12T09:19:47.303078+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:19:47.303078+0000","last_undegraded":"2023-12-12T09:19:47.303078+0000","last_fullsized":"2023-12-12T09:19:47.303078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.172709+0000","last_change":"2023-12-12T09:19:46.944981+0000","last_active":"2023-12-12T09:19:48.172709+0000","last_peered":"2023-12-12T09:19:48.172709+0000","last_clean":"2023-12-12T09:19:48.172709+0000","last_became_active":"2023-12-12T09:19:46.943825+0000","last_became_peered":"2023-12-12T09:19:46.943825+0000","last_unstale":"2023-12-12T09:19:48.172709+0000","last_undegraded":"2023-12-12T09:19:48.172709+0000","last_fullsized":"2023-12-12T09:19:48.172709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:33.622944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303399+0000","last_change":"2023-12-12T09:19:41.883110+0000","last_active":"2023-12-12T09:19:47.303399+0000","last_peered":"2023-12-12T09:19:47.303399+0000","last_clean":"2023-12-12T09:19:47.303399+0000","last_became_active":"2023-12-12T09:19:41.882836+0000","last_became_peered":"2023-12-12T09:19:41.882836+0000","last_unstale":"2023-12-12T09:19:47.303399+0000","last_undegraded":"2023-12-12T09:19:47.303399+0000","last_fullsized":"2023-12-12T09:19:47.303399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:53.429076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127491+0000","last_change":"2023-12-12T09:19:41.128783+0000","last_active":"2023-12-12T09:19:47.127491+0000","last_peered":"2023-12-12T09:19:47.127491+0000","last_clean":"2023-12-12T09:19:47.127491+0000","last_became_active":"2023-12-12T09:19:41.128390+0000","last_became_peered":"2023-12-12T09:19:41.128390+0000","last_unstale":"2023-12-12T09:19:47.127491+0000","last_undegraded":"2023-12-12T09:19:47.127491+0000","last_fullsized":"2023-12-12T09:19:47.127491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:38.516239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170902+0000","last_change":"2023-12-12T09:19:46.945892+0000","last_active":"2023-12-12T09:19:48.170902+0000","last_peered":"2023-12-12T09:19:48.170902+0000","last_clean":"2023-12-12T09:19:48.170902+0000","last_became_active":"2023-12-12T09:19:46.944874+0000","last_became_peered":"2023-12-12T09:19:46.944874+0000","last_unstale":"2023-12-12T09:19:48.170902+0000","last_undegraded":"2023-12-12T09:19:48.170902+0000","last_fullsized":"2023-12-12T09:19:48.170902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:36.314213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127967+0000","last_change":"2023-12-12T09:19:41.861777+0000","last_active":"2023-12-12T09:19:47.127967+0000","last_peered":"2023-12-12T09:19:47.127967+0000","last_clean":"2023-12-12T09:19:47.127967+0000","last_became_active":"2023-12-12T09:19:41.861449+0000","last_became_peered":"2023-12-12T09:19:41.861449+0000","last_unstale":"2023-12-12T09:19:47.127967+0000","last_undegraded":"2023-12-12T09:19:47.127967+0000","last_fullsized":"2023-12-12T09:19:47.127967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:29.573933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445429+0000","last_change":"2023-12-12T09:19:41.119895+0000","last_active":"2023-12-12T09:19:47.445429+0000","last_peered":"2023-12-12T09:19:47.445429+0000","last_clean":"2023-12-12T09:19:47.445429+0000","last_became_active":"2023-12-12T09:19:41.119579+0000","last_became_peered":"2023-12-12T09:19:41.119579+0000","last_unstale":"2023-12-12T09:19:47.445429+0000","last_undegraded":"2023-12-12T09:19:47.445429+0000","last_fullsized":"2023-12-12T09:19:47.445429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170457+0000","last_change":"2023-12-12T09:19:46.184299+0000","last_active":"2023-12-12T09:19:48.170457+0000","last_peered":"2023-12-12T09:19:48.170457+0000","last_clean":"2023-12-12T09:19:48.170457+0000","last_became_active":"2023-12-12T09:19:46.182654+0000","last_became_peered":"2023-12-12T09:19:46.182654+0000","last_unstale":"2023-12-12T09:19:48.170457+0000","last_undegraded":"2023-12-12T09:19:48.170457+0000","last_fullsized":"2023-12-12T09:19:48.170457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304529+0000","last_change":"2023-12-12T09:19:41.881513+0000","last_active":"2023-12-12T09:19:47.304529+0000","last_peered":"2023-12-12T09:19:47.304529+0000","last_clean":"2023-12-12T09:19:47.304529+0000","last_became_active":"2023-12-12T09:19:41.881128+0000","last_became_peered":"2023-12-12T09:19:41.881128+0000","last_unstale":"2023-12-12T09:19:47.304529+0000","last_undegraded":"2023-12-12T09:19:47.304529+0000","last_fullsized":"2023-12-12T09:19:47.304529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:47:35.048125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126858+0000","last_change":"2023-12-12T09:19:41.116076+0000","last_active":"2023-12-12T09:19:47.126858+0000","last_peered":"2023-12-12T09:19:47.126858+0000","last_clean":"2023-12-12T09:19:47.126858+0000","last_became_active":"2023-12-12T09:19:41.115133+0000","last_became_peered":"2023-12-12T09:19:41.115133+0000","last_unstale":"2023-12-12T09:19:47.126858+0000","last_undegraded":"2023-12-12T09:19:47.126858+0000","last_fullsized":"2023-12-12T09:19:47.126858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.129238+0000","last_change":"2023-12-12T09:19:46.944320+0000","last_active":"2023-12-12T09:19:48.129238+0000","last_peered":"2023-12-12T09:19:48.129238+0000","last_clean":"2023-12-12T09:19:48.129238+0000","last_became_active":"2023-12-12T09:19:46.941541+0000","last_became_peered":"2023-12-12T09:19:46.941541+0000","last_unstale":"2023-12-12T09:19:48.129238+0000","last_undegraded":"2023-12-12T09:19:48.129238+0000","last_fullsized":"2023-12-12T09:19:48.129238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304268+0000","last_change":"2023-12-12T09:19:41.877256+0000","last_active":"2023-12-12T09:19:47.304268+0000","last_peered":"2023-12-12T09:19:47.304268+0000","last_clean":"2023-12-12T09:19:47.304268+0000","last_became_active":"2023-12-12T09:19:41.875186+0000","last_became_peered":"2023-12-12T09:19:41.875186+0000","last_unstale":"2023-12-12T09:19:47.304268+0000","last_undegraded":"2023-12-12T09:19:47.304268+0000","last_fullsized":"2023-12-12T09:19:47.304268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:32.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.131383+0000","last_change":"2023-12-12T09:19:41.119283+0000","last_active":"2023-12-12T09:19:47.131383+0000","last_peered":"2023-12-12T09:19:47.131383+0000","last_clean":"2023-12-12T09:19:47.131383+0000","last_became_active":"2023-12-12T09:19:41.118924+0000","last_became_peered":"2023-12-12T09:19:41.118924+0000","last_unstale":"2023-12-12T09:19:47.131383+0000","last_undegraded":"2023-12-12T09:19:47.131383+0000","last_fullsized":"2023-12-12T09:19:47.131383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:34:48.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131732+0000","last_change":"2023-12-12T09:19:46.186473+0000","last_active":"2023-12-12T09:19:48.131732+0000","last_peered":"2023-12-12T09:19:48.131732+0000","last_clean":"2023-12-12T09:19:48.131732+0000","last_became_active":"2023-12-12T09:19:46.185905+0000","last_became_peered":"2023-12-12T09:19:46.185905+0000","last_unstale":"2023-12-12T09:19:48.131732+0000","last_undegraded":"2023-12-12T09:19:48.131732+0000","last_fullsized":"2023-12-12T09:19:48.131732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303587+0000","last_change":"2023-12-12T09:19:41.877853+0000","last_active":"2023-12-12T09:19:47.303587+0000","last_peered":"2023-12-12T09:19:47.303587+0000","last_clean":"2023-12-12T09:19:47.303587+0000","last_became_active":"2023-12-12T09:19:41.875044+0000","last_became_peered":"2023-12-12T09:19:41.875044+0000","last_unstale":"2023-12-12T09:19:47.303587+0000","last_undegraded":"2023-12-12T09:19:47.303587+0000","last_fullsized":"2023-12-12T09:19:47.303587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:14.546295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.125556+0000","last_change":"2023-12-12T09:19:41.120939+0000","last_active":"2023-12-12T09:19:47.125556+0000","last_peered":"2023-12-12T09:19:47.125556+0000","last_clean":"2023-12-12T09:19:47.125556+0000","last_became_active":"2023-12-12T09:19:41.120648+0000","last_became_peered":"2023-12-12T09:19:41.120648+0000","last_unstale":"2023-12-12T09:19:47.125556+0000","last_undegraded":"2023-12-12T09:19:47.125556+0000","last_fullsized":"2023-12-12T09:19:47.125556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:50:22.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171167+0000","last_change":"2023-12-12T09:19:46.189274+0000","last_active":"2023-12-12T09:19:48.171167+0000","last_peered":"2023-12-12T09:19:48.171167+0000","last_clean":"2023-12-12T09:19:48.171167+0000","last_became_active":"2023-12-12T09:19:46.188822+0000","last_became_peered":"2023-12-12T09:19:46.188822+0000","last_unstale":"2023-12-12T09:19:48.171167+0000","last_undegraded":"2023-12-12T09:19:48.171167+0000","last_fullsized":"2023-12-12T09:19:48.171167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019851+0000","last_change":"2023-12-12T09:19:41.864891+0000","last_active":"2023-12-12T09:19:48.019851+0000","last_peered":"2023-12-12T09:19:48.019851+0000","last_clean":"2023-12-12T09:19:48.019851+0000","last_became_active":"2023-12-12T09:19:41.864627+0000","last_became_peered":"2023-12-12T09:19:41.864627+0000","last_unstale":"2023-12-12T09:19:48.019851+0000","last_undegraded":"2023-12-12T09:19:48.019851+0000","last_fullsized":"2023-12-12T09:19:48.019851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020105+0000","last_change":"2023-12-12T09:19:41.133652+0000","last_active":"2023-12-12T09:19:48.020105+0000","last_peered":"2023-12-12T09:19:48.020105+0000","last_clean":"2023-12-12T09:19:48.020105+0000","last_became_active":"2023-12-12T09:19:41.133408+0000","last_became_peered":"2023-12-12T09:19:41.133408+0000","last_unstale":"2023-12-12T09:19:48.020105+0000","last_undegraded":"2023-12-12T09:19:48.020105+0000","last_fullsized":"2023-12-12T09:19:48.020105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:08.194468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128487+0000","last_change":"2023-12-12T09:19:46.948569+0000","last_active":"2023-12-12T09:19:48.128487+0000","last_peered":"2023-12-12T09:19:48.128487+0000","last_clean":"2023-12-12T09:19:48.128487+0000","last_became_active":"2023-12-12T09:19:46.947137+0000","last_became_peered":"2023-12-12T09:19:46.947137+0000","last_unstale":"2023-12-12T09:19:48.128487+0000","last_undegraded":"2023-12-12T09:19:48.128487+0000","last_fullsized":"2023-12-12T09:19:48.128487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:05:18.225548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303688+0000","last_change":"2023-12-12T09:19:41.877782+0000","last_active":"2023-12-12T09:19:47.303688+0000","last_peered":"2023-12-12T09:19:47.303688+0000","last_clean":"2023-12-12T09:19:47.303688+0000","last_became_active":"2023-12-12T09:19:41.877386+0000","last_became_peered":"2023-12-12T09:19:41.877386+0000","last_unstale":"2023-12-12T09:19:47.303688+0000","last_undegraded":"2023-12-12T09:19:47.303688+0000","last_fullsized":"2023-12-12T09:19:47.303688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:24.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128131+0000","last_change":"2023-12-12T09:19:41.132860+0000","last_active":"2023-12-12T09:19:47.128131+0000","last_peered":"2023-12-12T09:19:47.128131+0000","last_clean":"2023-12-12T09:19:47.128131+0000","last_became_active":"2023-12-12T09:19:41.132569+0000","last_became_peered":"2023-12-12T09:19:41.132569+0000","last_unstale":"2023-12-12T09:19:47.128131+0000","last_undegraded":"2023-12-12T09:19:47.128131+0000","last_fullsized":"2023-12-12T09:19:47.128131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:18.435713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128599+0000","last_change":"2023-12-12T09:19:46.950471+0000","last_active":"2023-12-12T09:19:48.128599+0000","last_peered":"2023-12-12T09:19:48.128599+0000","last_clean":"2023-12-12T09:19:48.128599+0000","last_became_active":"2023-12-12T09:19:46.949395+0000","last_became_peered":"2023-12-12T09:19:46.949395+0000","last_unstale":"2023-12-12T09:19:48.128599+0000","last_undegraded":"2023-12-12T09:19:48.128599+0000","last_fullsized":"2023-12-12T09:19:48.128599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:23:10.613536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950800+0000","last_change":"2023-12-12T09:19:41.869585+0000","last_active":"2023-12-12T09:19:47.950800+0000","last_peered":"2023-12-12T09:19:47.950800+0000","last_clean":"2023-12-12T09:19:47.950800+0000","last_became_active":"2023-12-12T09:19:41.869388+0000","last_became_peered":"2023-12-12T09:19:41.869388+0000","last_unstale":"2023-12-12T09:19:47.950800+0000","last_undegraded":"2023-12-12T09:19:47.950800+0000","last_fullsized":"2023-12-12T09:19:47.950800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951035+0000","last_change":"2023-12-12T09:19:41.123186+0000","last_active":"2023-12-12T09:19:47.951035+0000","last_peered":"2023-12-12T09:19:47.951035+0000","last_clean":"2023-12-12T09:19:47.951035+0000","last_became_active":"2023-12-12T09:19:41.122891+0000","last_became_peered":"2023-12-12T09:19:41.122891+0000","last_unstale":"2023-12-12T09:19:47.951035+0000","last_undegraded":"2023-12-12T09:19:47.951035+0000","last_fullsized":"2023-12-12T09:19:47.951035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:23:51.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130720+0000","last_change":"2023-12-12T09:19:46.943661+0000","last_active":"2023-12-12T09:19:48.130720+0000","last_peered":"2023-12-12T09:19:48.130720+0000","last_clean":"2023-12-12T09:19:48.130720+0000","last_became_active":"2023-12-12T09:19:46.942612+0000","last_became_peered":"2023-12-12T09:19:46.942612+0000","last_unstale":"2023-12-12T09:19:48.130720+0000","last_undegraded":"2023-12-12T09:19:48.130720+0000","last_fullsized":"2023-12-12T09:19:48.130720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:00.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303253+0000","last_change":"2023-12-12T09:19:41.879007+0000","last_active":"2023-12-12T09:19:47.303253+0000","last_peered":"2023-12-12T09:19:47.303253+0000","last_clean":"2023-12-12T09:19:47.303253+0000","last_became_active":"2023-12-12T09:19:41.878653+0000","last_became_peered":"2023-12-12T09:19:41.878653+0000","last_unstale":"2023-12-12T09:19:47.303253+0000","last_undegraded":"2023-12-12T09:19:47.303253+0000","last_fullsized":"2023-12-12T09:19:47.303253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:24.432590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:59.537079+0000","last_change":"2023-12-12T09:19:41.130448+0000","last_active":"2023-12-12T09:19:59.537079+0000","last_peered":"2023-12-12T09:19:59.537079+0000","last_clean":"2023-12-12T09:19:59.537079+0000","last_became_active":"2023-12-12T09:19:41.129913+0000","last_became_peered":"2023-12-12T09:19:41.129913+0000","last_unstale":"2023-12-12T09:19:59.537079+0000","last_undegraded":"2023-12-12T09:19:59.537079+0000","last_fullsized":"2023-12-12T09:19:59.537079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169031+0000","last_change":"2023-12-12T09:19:46.193832+0000","last_active":"2023-12-12T09:19:48.169031+0000","last_peered":"2023-12-12T09:19:48.169031+0000","last_clean":"2023-12-12T09:19:48.169031+0000","last_became_active":"2023-12-12T09:19:46.193427+0000","last_became_peered":"2023-12-12T09:19:46.193427+0000","last_unstale":"2023-12-12T09:19:48.169031+0000","last_undegraded":"2023-12-12T09:19:48.169031+0000","last_fullsized":"2023-12-12T09:19:48.169031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130880+0000","last_change":"2023-12-12T09:19:41.866473+0000","last_active":"2023-12-12T09:19:47.130880+0000","last_peered":"2023-12-12T09:19:47.130880+0000","last_clean":"2023-12-12T09:19:47.130880+0000","last_became_active":"2023-12-12T09:19:41.865426+0000","last_became_peered":"2023-12-12T09:19:41.865426+0000","last_unstale":"2023-12-12T09:19:47.130880+0000","last_undegraded":"2023-12-12T09:19:47.130880+0000","last_fullsized":"2023-12-12T09:19:47.130880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:32.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445355+0000","last_change":"2023-12-12T09:19:41.128579+0000","last_active":"2023-12-12T09:19:47.445355+0000","last_peered":"2023-12-12T09:19:47.445355+0000","last_clean":"2023-12-12T09:19:47.445355+0000","last_became_active":"2023-12-12T09:19:41.127500+0000","last_became_peered":"2023-12-12T09:19:41.127500+0000","last_unstale":"2023-12-12T09:19:47.445355+0000","last_undegraded":"2023-12-12T09:19:47.445355+0000","last_fullsized":"2023-12-12T09:19:47.445355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:08:51.795865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131533+0000","last_change":"2023-12-12T09:19:46.192023+0000","last_active":"2023-12-12T09:19:48.131533+0000","last_peered":"2023-12-12T09:19:48.131533+0000","last_clean":"2023-12-12T09:19:48.131533+0000","last_became_active":"2023-12-12T09:19:46.190736+0000","last_became_peered":"2023-12-12T09:19:46.190736+0000","last_unstale":"2023-12-12T09:19:48.131533+0000","last_undegraded":"2023-12-12T09:19:48.131533+0000","last_fullsized":"2023-12-12T09:19:48.131533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951755+0000","last_change":"2023-12-12T09:19:41.878135+0000","last_active":"2023-12-12T09:19:47.951755+0000","last_peered":"2023-12-12T09:19:47.951755+0000","last_clean":"2023-12-12T09:19:47.951755+0000","last_became_active":"2023-12-12T09:19:41.877619+0000","last_became_peered":"2023-12-12T09:19:41.877619+0000","last_unstale":"2023-12-12T09:19:47.951755+0000","last_undegraded":"2023-12-12T09:19:47.951755+0000","last_fullsized":"2023-12-12T09:19:47.951755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129007+0000","last_change":"2023-12-12T09:19:41.133535+0000","last_active":"2023-12-12T09:19:47.129007+0000","last_peered":"2023-12-12T09:19:47.129007+0000","last_clean":"2023-12-12T09:19:47.129007+0000","last_became_active":"2023-12-12T09:19:41.133248+0000","last_became_peered":"2023-12-12T09:19:41.133248+0000","last_unstale":"2023-12-12T09:19:47.129007+0000","last_undegraded":"2023-12-12T09:19:47.129007+0000","last_fullsized":"2023-12-12T09:19:47.129007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:35.003697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128002+0000","last_change":"2023-12-12T09:19:46.187952+0000","last_active":"2023-12-12T09:19:48.128002+0000","last_peered":"2023-12-12T09:19:48.128002+0000","last_clean":"2023-12-12T09:19:48.128002+0000","last_became_active":"2023-12-12T09:19:46.187441+0000","last_became_peered":"2023-12-12T09:19:46.187441+0000","last_unstale":"2023-12-12T09:19:48.128002+0000","last_undegraded":"2023-12-12T09:19:48.128002+0000","last_fullsized":"2023-12-12T09:19:48.128002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:46:54.723850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128820+0000","last_change":"2023-12-12T09:19:41.874029+0000","last_active":"2023-12-12T09:19:47.128820+0000","last_peered":"2023-12-12T09:19:47.128820+0000","last_clean":"2023-12-12T09:19:47.128820+0000","last_became_active":"2023-12-12T09:19:41.873678+0000","last_became_peered":"2023-12-12T09:19:41.873678+0000","last_unstale":"2023-12-12T09:19:47.128820+0000","last_undegraded":"2023-12-12T09:19:47.128820+0000","last_fullsized":"2023-12-12T09:19:47.128820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:53.429076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020897+0000","last_change":"2023-12-12T09:19:41.136636+0000","last_active":"2023-12-12T09:19:48.020897+0000","last_peered":"2023-12-12T09:19:48.020897+0000","last_clean":"2023-12-12T09:19:48.020897+0000","last_became_active":"2023-12-12T09:19:41.136314+0000","last_became_peered":"2023-12-12T09:19:41.136314+0000","last_unstale":"2023-12-12T09:19:48.020897+0000","last_undegraded":"2023-12-12T09:19:48.020897+0000","last_fullsized":"2023-12-12T09:19:48.020897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:35.268242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127896+0000","last_change":"2023-12-12T09:19:46.955741+0000","last_active":"2023-12-12T09:19:48.127896+0000","last_peered":"2023-12-12T09:19:48.127896+0000","last_clean":"2023-12-12T09:19:48.127896+0000","last_became_active":"2023-12-12T09:19:46.950425+0000","last_became_peered":"2023-12-12T09:19:46.950425+0000","last_unstale":"2023-12-12T09:19:48.127896+0000","last_undegraded":"2023-12-12T09:19:48.127896+0000","last_fullsized":"2023-12-12T09:19:48.127896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:56:11.700203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171062+0000","last_change":"2023-12-12T09:19:46.943384+0000","last_active":"2023-12-12T09:19:48.171062+0000","last_peered":"2023-12-12T09:19:48.171062+0000","last_clean":"2023-12-12T09:19:48.171062+0000","last_became_active":"2023-12-12T09:19:46.942319+0000","last_became_peered":"2023-12-12T09:19:46.942319+0000","last_unstale":"2023-12-12T09:19:48.171062+0000","last_undegraded":"2023-12-12T09:19:48.171062+0000","last_fullsized":"2023-12-12T09:19:48.171062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444647+0000","last_change":"2023-12-12T09:19:41.871355+0000","last_active":"2023-12-12T09:19:47.444647+0000","last_peered":"2023-12-12T09:19:47.444647+0000","last_clean":"2023-12-12T09:19:47.444647+0000","last_became_active":"2023-12-12T09:19:41.871096+0000","last_became_peered":"2023-12-12T09:19:41.871096+0000","last_unstale":"2023-12-12T09:19:47.444647+0000","last_undegraded":"2023-12-12T09:19:47.444647+0000","last_fullsized":"2023-12-12T09:19:47.444647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130761+0000","last_change":"2023-12-12T09:19:41.123288+0000","last_active":"2023-12-12T09:19:47.130761+0000","last_peered":"2023-12-12T09:19:47.130761+0000","last_clean":"2023-12-12T09:19:47.130761+0000","last_became_active":"2023-12-12T09:19:41.122752+0000","last_became_peered":"2023-12-12T09:19:41.122752+0000","last_unstale":"2023-12-12T09:19:47.130761+0000","last_undegraded":"2023-12-12T09:19:47.130761+0000","last_fullsized":"2023-12-12T09:19:47.130761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:55.931283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.173331+0000","last_change":"2023-12-12T09:19:46.195051+0000","last_active":"2023-12-12T09:19:48.173331+0000","last_peered":"2023-12-12T09:19:48.173331+0000","last_clean":"2023-12-12T09:19:48.173331+0000","last_became_active":"2023-12-12T09:19:46.194655+0000","last_became_peered":"2023-12-12T09:19:46.194655+0000","last_unstale":"2023-12-12T09:19:48.173331+0000","last_undegraded":"2023-12-12T09:19:48.173331+0000","last_fullsized":"2023-12-12T09:19:48.173331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:24.767108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956243+0000","last_change":"2023-12-12T09:19:41.861972+0000","last_active":"2023-12-12T09:19:47.956243+0000","last_peered":"2023-12-12T09:19:47.956243+0000","last_clean":"2023-12-12T09:19:47.956243+0000","last_became_active":"2023-12-12T09:19:41.861683+0000","last_became_peered":"2023-12-12T09:19:41.861683+0000","last_unstale":"2023-12-12T09:19:47.956243+0000","last_undegraded":"2023-12-12T09:19:47.956243+0000","last_fullsized":"2023-12-12T09:19:47.956243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:45:09.496901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956289+0000","last_change":"2023-12-12T09:19:41.130199+0000","last_active":"2023-12-12T09:19:47.956289+0000","last_peered":"2023-12-12T09:19:47.956289+0000","last_clean":"2023-12-12T09:19:47.956289+0000","last_became_active":"2023-12-12T09:19:41.129901+0000","last_became_peered":"2023-12-12T09:19:41.129901+0000","last_unstale":"2023-12-12T09:19:47.956289+0000","last_undegraded":"2023-12-12T09:19:47.956289+0000","last_fullsized":"2023-12-12T09:19:47.956289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:20:13.334305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020336+0000","last_change":"2023-12-12T09:19:41.135226+0000","last_active":"2023-12-12T09:19:48.020336+0000","last_peered":"2023-12-12T09:19:48.020336+0000","last_clean":"2023-12-12T09:19:48.020336+0000","last_became_active":"2023-12-12T09:19:41.134249+0000","last_became_peered":"2023-12-12T09:19:41.134249+0000","last_unstale":"2023-12-12T09:19:48.020336+0000","last_undegraded":"2023-12-12T09:19:48.020336+0000","last_fullsized":"2023-12-12T09:19:48.020336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:02.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951009+0000","last_change":"2023-12-12T09:19:41.853034+0000","last_active":"2023-12-12T09:19:47.951009+0000","last_peered":"2023-12-12T09:19:47.951009+0000","last_clean":"2023-12-12T09:19:47.951009+0000","last_became_active":"2023-12-12T09:19:41.852723+0000","last_became_peered":"2023-12-12T09:19:41.852723+0000","last_unstale":"2023-12-12T09:19:47.951009+0000","last_undegraded":"2023-12-12T09:19:47.951009+0000","last_fullsized":"2023-12-12T09:19:47.951009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.167998+0000","last_change":"2023-12-12T09:19:46.187764+0000","last_active":"2023-12-12T09:19:48.167998+0000","last_peered":"2023-12-12T09:19:48.167998+0000","last_clean":"2023-12-12T09:19:48.167998+0000","last_became_active":"2023-12-12T09:19:46.186203+0000","last_became_peered":"2023-12-12T09:19:46.186203+0000","last_unstale":"2023-12-12T09:19:48.167998+0000","last_undegraded":"2023-12-12T09:19:48.167998+0000","last_fullsized":"2023-12-12T09:19:48.167998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:23.753673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956499+0000","last_change":"2023-12-12T09:19:41.128685+0000","last_active":"2023-12-12T09:19:47.956499+0000","last_peered":"2023-12-12T09:19:47.956499+0000","last_clean":"2023-12-12T09:19:47.956499+0000","last_became_active":"2023-12-12T09:19:41.127743+0000","last_became_peered":"2023-12-12T09:19:41.127743+0000","last_unstale":"2023-12-12T09:19:47.956499+0000","last_undegraded":"2023-12-12T09:19:47.956499+0000","last_fullsized":"2023-12-12T09:19:47.956499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:32:47.519167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130033+0000","last_change":"2023-12-12T09:19:41.860010+0000","last_active":"2023-12-12T09:19:47.130033+0000","last_peered":"2023-12-12T09:19:47.130033+0000","last_clean":"2023-12-12T09:19:47.130033+0000","last_became_active":"2023-12-12T09:19:41.859472+0000","last_became_peered":"2023-12-12T09:19:41.859472+0000","last_unstale":"2023-12-12T09:19:47.130033+0000","last_undegraded":"2023-12-12T09:19:47.130033+0000","last_fullsized":"2023-12-12T09:19:47.130033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:36.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128477+0000","last_change":"2023-12-12T09:19:46.184369+0000","last_active":"2023-12-12T09:19:48.128477+0000","last_peered":"2023-12-12T09:19:48.128477+0000","last_clean":"2023-12-12T09:19:48.128477+0000","last_became_active":"2023-12-12T09:19:46.180831+0000","last_became_peered":"2023-12-12T09:19:46.180831+0000","last_unstale":"2023-12-12T09:19:48.128477+0000","last_undegraded":"2023-12-12T09:19:48.128477+0000","last_fullsized":"2023-12-12T09:19:48.128477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:44.706388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019602+0000","last_change":"2023-12-12T09:19:41.866259+0000","last_active":"2023-12-12T09:19:48.019602+0000","last_peered":"2023-12-12T09:19:48.019602+0000","last_clean":"2023-12-12T09:19:48.019602+0000","last_became_active":"2023-12-12T09:19:41.865940+0000","last_became_peered":"2023-12-12T09:19:41.865940+0000","last_unstale":"2023-12-12T09:19:48.019602+0000","last_undegraded":"2023-12-12T09:19:48.019602+0000","last_fullsized":"2023-12-12T09:19:48.019602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:19.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.125929+0000","last_change":"2023-12-12T09:19:41.867023+0000","last_active":"2023-12-12T09:19:47.125929+0000","last_peered":"2023-12-12T09:19:47.125929+0000","last_clean":"2023-12-12T09:19:47.125929+0000","last_became_active":"2023-12-12T09:19:41.866764+0000","last_became_peered":"2023-12-12T09:19:41.866764+0000","last_unstale":"2023-12-12T09:19:47.125929+0000","last_undegraded":"2023-12-12T09:19:47.125929+0000","last_fullsized":"2023-12-12T09:19:47.125929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:32.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127901+0000","last_change":"2023-12-12T09:19:41.867979+0000","last_active":"2023-12-12T09:19:47.127901+0000","last_peered":"2023-12-12T09:19:47.127901+0000","last_clean":"2023-12-12T09:19:47.127901+0000","last_became_active":"2023-12-12T09:19:41.867701+0000","last_became_peered":"2023-12-12T09:19:41.867701+0000","last_unstale":"2023-12-12T09:19:47.127901+0000","last_undegraded":"2023-12-12T09:19:47.127901+0000","last_fullsized":"2023-12-12T09:19:47.127901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:14.546295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950773+0000","last_change":"2023-12-12T09:19:41.866057+0000","last_active":"2023-12-12T09:19:47.950773+0000","last_peered":"2023-12-12T09:19:47.950773+0000","last_clean":"2023-12-12T09:19:47.950773+0000","last_became_active":"2023-12-12T09:19:41.865684+0000","last_became_peered":"2023-12-12T09:19:41.865684+0000","last_unstale":"2023-12-12T09:19:47.950773+0000","last_undegraded":"2023-12-12T09:19:47.950773+0000","last_fullsized":"2023-12-12T09:19:47.950773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:19.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956904+0000","last_change":"2023-12-12T09:19:41.870549+0000","last_active":"2023-12-12T09:19:47.956904+0000","last_peered":"2023-12-12T09:19:47.956904+0000","last_clean":"2023-12-12T09:19:47.956904+0000","last_became_active":"2023-12-12T09:19:41.870253+0000","last_became_peered":"2023-12-12T09:19:41.870253+0000","last_unstale":"2023-12-12T09:19:47.956904+0000","last_undegraded":"2023-12-12T09:19:47.956904+0000","last_fullsized":"2023-12-12T09:19:47.956904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:28:38.925176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445258+0000","last_change":"2023-12-12T09:19:41.868298+0000","last_active":"2023-12-12T09:19:47.445258+0000","last_peered":"2023-12-12T09:19:47.445258+0000","last_clean":"2023-12-12T09:19:47.445258+0000","last_became_active":"2023-12-12T09:19:41.866056+0000","last_became_peered":"2023-12-12T09:19:41.866056+0000","last_unstale":"2023-12-12T09:19:47.445258+0000","last_undegraded":"2023-12-12T09:19:47.445258+0000","last_fullsized":"2023-12-12T09:19:47.445258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021114+0000","last_change":"2023-12-12T09:19:41.870795+0000","last_active":"2023-12-12T09:19:48.021114+0000","last_peered":"2023-12-12T09:19:48.021114+0000","last_clean":"2023-12-12T09:19:48.021114+0000","last_became_active":"2023-12-12T09:19:41.869377+0000","last_became_peered":"2023-12-12T09:19:41.869377+0000","last_unstale":"2023-12-12T09:19:48.021114+0000","last_undegraded":"2023-12-12T09:19:48.021114+0000","last_fullsized":"2023-12-12T09:19:48.021114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957512+0000","last_change":"2023-12-12T09:19:41.871326+0000","last_active":"2023-12-12T09:19:47.957512+0000","last_peered":"2023-12-12T09:19:47.957512+0000","last_clean":"2023-12-12T09:19:47.957512+0000","last_became_active":"2023-12-12T09:19:41.870253+0000","last_became_peered":"2023-12-12T09:19:41.870253+0000","last_unstale":"2023-12-12T09:19:47.957512+0000","last_undegraded":"2023-12-12T09:19:47.957512+0000","last_fullsized":"2023-12-12T09:19:47.957512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:15:05.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130531+0000","last_change":"2023-12-12T09:19:41.866400+0000","last_active":"2023-12-12T09:19:47.130531+0000","last_peered":"2023-12-12T09:19:47.130531+0000","last_clean":"2023-12-12T09:19:47.130531+0000","last_became_active":"2023-12-12T09:19:41.866125+0000","last_became_peered":"2023-12-12T09:19:41.866125+0000","last_unstale":"2023-12-12T09:19:47.130531+0000","last_undegraded":"2023-12-12T09:19:47.130531+0000","last_fullsized":"2023-12-12T09:19:47.130531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956057+0000","last_change":"2023-12-12T09:19:41.871487+0000","last_active":"2023-12-12T09:19:47.956057+0000","last_peered":"2023-12-12T09:19:47.956057+0000","last_clean":"2023-12-12T09:19:47.956057+0000","last_became_active":"2023-12-12T09:19:41.871121+0000","last_became_peered":"2023-12-12T09:19:41.871121+0000","last_unstale":"2023-12-12T09:19:47.956057+0000","last_undegraded":"2023-12-12T09:19:47.956057+0000","last_fullsized":"2023-12-12T09:19:47.956057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:04.587709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127718+0000","last_change":"2023-12-12T09:19:41.877637+0000","last_active":"2023-12-12T09:19:47.127718+0000","last_peered":"2023-12-12T09:19:47.127718+0000","last_clean":"2023-12-12T09:19:47.127718+0000","last_became_active":"2023-12-12T09:19:41.877279+0000","last_became_peered":"2023-12-12T09:19:41.877279+0000","last_unstale":"2023-12-12T09:19:47.127718+0000","last_undegraded":"2023-12-12T09:19:47.127718+0000","last_fullsized":"2023-12-12T09:19:47.127718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:40.867544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950503+0000","last_change":"2023-12-12T09:19:41.858678+0000","last_active":"2023-12-12T09:19:47.950503+0000","last_peered":"2023-12-12T09:19:47.950503+0000","last_clean":"2023-12-12T09:19:47.950503+0000","last_became_active":"2023-12-12T09:19:41.858368+0000","last_became_peered":"2023-12-12T09:19:41.858368+0000","last_unstale":"2023-12-12T09:19:47.950503+0000","last_undegraded":"2023-12-12T09:19:47.950503+0000","last_fullsized":"2023-12-12T09:19:47.950503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:08:53.064814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020884+0000","last_change":"2023-12-12T09:19:41.874119+0000","last_active":"2023-12-12T09:19:48.020884+0000","last_peered":"2023-12-12T09:19:48.020884+0000","last_clean":"2023-12-12T09:19:48.020884+0000","last_became_active":"2023-12-12T09:19:41.873475+0000","last_became_peered":"2023-12-12T09:19:41.873475+0000","last_unstale":"2023-12-12T09:19:48.020884+0000","last_undegraded":"2023-12-12T09:19:48.020884+0000","last_fullsized":"2023-12-12T09:19:48.020884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303796+0000","last_change":"2023-12-12T09:19:41.880927+0000","last_active":"2023-12-12T09:19:47.303796+0000","last_peered":"2023-12-12T09:19:47.303796+0000","last_clean":"2023-12-12T09:19:47.303796+0000","last_became_active":"2023-12-12T09:19:41.880553+0000","last_became_peered":"2023-12-12T09:19:41.880553+0000","last_unstale":"2023-12-12T09:19:47.303796+0000","last_undegraded":"2023-12-12T09:19:47.303796+0000","last_fullsized":"2023-12-12T09:19:47.303796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:29.573933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126787+0000","last_change":"2023-12-12T09:19:41.865313+0000","last_active":"2023-12-12T09:19:47.126787+0000","last_peered":"2023-12-12T09:19:47.126787+0000","last_clean":"2023-12-12T09:19:47.126787+0000","last_became_active":"2023-12-12T09:19:41.864264+0000","last_became_peered":"2023-12-12T09:19:41.864264+0000","last_unstale":"2023-12-12T09:19:47.126787+0000","last_undegraded":"2023-12-12T09:19:47.126787+0000","last_fullsized":"2023-12-12T09:19:47.126787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:09.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129613+0000","last_change":"2023-12-12T09:19:41.873905+0000","last_active":"2023-12-12T09:19:47.129613+0000","last_peered":"2023-12-12T09:19:47.129613+0000","last_clean":"2023-12-12T09:19:47.129613+0000","last_became_active":"2023-12-12T09:19:41.873699+0000","last_became_peered":"2023-12-12T09:19:41.873699+0000","last_unstale":"2023-12-12T09:19:47.129613+0000","last_undegraded":"2023-12-12T09:19:47.129613+0000","last_fullsized":"2023-12-12T09:19:47.129613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:20.718098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130289+0000","last_change":"2023-12-12T09:19:41.869722+0000","last_active":"2023-12-12T09:19:47.130289+0000","last_peered":"2023-12-12T09:19:47.130289+0000","last_clean":"2023-12-12T09:19:47.130289+0000","last_became_active":"2023-12-12T09:19:41.867498+0000","last_became_peered":"2023-12-12T09:19:41.867498+0000","last_unstale":"2023-12-12T09:19:47.130289+0000","last_undegraded":"2023-12-12T09:19:47.130289+0000","last_fullsized":"2023-12-12T09:19:47.130289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:37.971340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444692+0000","last_change":"2023-12-12T09:19:41.866112+0000","last_active":"2023-12-12T09:19:47.444692+0000","last_peered":"2023-12-12T09:19:47.444692+0000","last_clean":"2023-12-12T09:19:47.444692+0000","last_became_active":"2023-12-12T09:19:41.865801+0000","last_became_peered":"2023-12-12T09:19:41.865801+0000","last_unstale":"2023-12-12T09:19:47.444692+0000","last_undegraded":"2023-12-12T09:19:47.444692+0000","last_fullsized":"2023-12-12T09:19:47.444692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950664+0000","last_change":"2023-12-12T09:19:41.856237+0000","last_active":"2023-12-12T09:19:47.950664+0000","last_peered":"2023-12-12T09:19:47.950664+0000","last_clean":"2023-12-12T09:19:47.950664+0000","last_became_active":"2023-12-12T09:19:41.854807+0000","last_became_peered":"2023-12-12T09:19:41.854807+0000","last_unstale":"2023-12-12T09:19:47.950664+0000","last_undegraded":"2023-12-12T09:19:47.950664+0000","last_fullsized":"2023-12-12T09:19:47.950664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956161+0000","last_change":"2023-12-12T09:19:41.864225+0000","last_active":"2023-12-12T09:19:47.956161+0000","last_peered":"2023-12-12T09:19:47.956161+0000","last_clean":"2023-12-12T09:19:47.956161+0000","last_became_active":"2023-12-12T09:19:41.863889+0000","last_became_peered":"2023-12-12T09:19:41.863889+0000","last_unstale":"2023-12-12T09:19:47.956161+0000","last_undegraded":"2023-12-12T09:19:47.956161+0000","last_fullsized":"2023-12-12T09:19:47.956161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:28.079653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130755+0000","last_change":"2023-12-12T09:19:41.864900+0000","last_active":"2023-12-12T09:19:47.130755+0000","last_peered":"2023-12-12T09:19:47.130755+0000","last_clean":"2023-12-12T09:19:47.130755+0000","last_became_active":"2023-12-12T09:19:41.864317+0000","last_became_peered":"2023-12-12T09:19:41.864317+0000","last_unstale":"2023-12-12T09:19:47.130755+0000","last_undegraded":"2023-12-12T09:19:47.130755+0000","last_fullsized":"2023-12-12T09:19:47.130755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:09.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020367+0000","last_change":"2023-12-12T09:19:41.878679+0000","last_active":"2023-12-12T09:19:48.020367+0000","last_peered":"2023-12-12T09:19:48.020367+0000","last_clean":"2023-12-12T09:19:48.020367+0000","last_became_active":"2023-12-12T09:19:41.878386+0000","last_became_peered":"2023-12-12T09:19:41.878386+0000","last_unstale":"2023-12-12T09:19:48.020367+0000","last_undegraded":"2023-12-12T09:19:48.020367+0000","last_fullsized":"2023-12-12T09:19:48.020367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021119+0000","last_change":"2023-12-12T09:19:41.876850+0000","last_active":"2023-12-12T09:19:48.021119+0000","last_peered":"2023-12-12T09:19:48.021119+0000","last_clean":"2023-12-12T09:19:48.021119+0000","last_became_active":"2023-12-12T09:19:41.876562+0000","last_became_peered":"2023-12-12T09:19:41.876562+0000","last_unstale":"2023-12-12T09:19:48.021119+0000","last_undegraded":"2023-12-12T09:19:48.021119+0000","last_fullsized":"2023-12-12T09:19:48.021119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304376+0000","last_change":"2023-12-12T09:19:41.883253+0000","last_active":"2023-12-12T09:19:47.304376+0000","last_peered":"2023-12-12T09:19:47.304376+0000","last_clean":"2023-12-12T09:19:47.304376+0000","last_became_active":"2023-12-12T09:19:41.882726+0000","last_became_peered":"2023-12-12T09:19:41.882726+0000","last_unstale":"2023-12-12T09:19:47.304376+0000","last_undegraded":"2023-12-12T09:19:47.304376+0000","last_fullsized":"2023-12-12T09:19:47.304376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:31.700244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.955946+0000","last_change":"2023-12-12T09:19:41.877684+0000","last_active":"2023-12-12T09:19:47.955946+0000","last_peered":"2023-12-12T09:19:47.955946+0000","last_clean":"2023-12-12T09:19:47.955946+0000","last_became_active":"2023-12-12T09:19:41.877339+0000","last_became_peered":"2023-12-12T09:19:41.877339+0000","last_unstale":"2023-12-12T09:19:47.955946+0000","last_undegraded":"2023-12-12T09:19:47.955946+0000","last_fullsized":"2023-12-12T09:19:47.955946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:03.365677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302878+0000","last_change":"2023-12-12T09:19:41.868128+0000","last_active":"2023-12-12T09:19:47.302878+0000","last_peered":"2023-12-12T09:19:47.302878+0000","last_clean":"2023-12-12T09:19:47.302878+0000","last_became_active":"2023-12-12T09:19:41.867856+0000","last_became_peered":"2023-12-12T09:19:41.867856+0000","last_unstale":"2023-12-12T09:19:47.302878+0000","last_undegraded":"2023-12-12T09:19:47.302878+0000","last_fullsized":"2023-12-12T09:19:47.302878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:37.971340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127464+0000","last_change":"2023-12-12T09:19:41.869966+0000","last_active":"2023-12-12T09:19:47.127464+0000","last_peered":"2023-12-12T09:19:47.127464+0000","last_clean":"2023-12-12T09:19:47.127464+0000","last_became_active":"2023-12-12T09:19:41.868229+0000","last_became_peered":"2023-12-12T09:19:41.868229+0000","last_unstale":"2023-12-12T09:19:47.127464+0000","last_undegraded":"2023-12-12T09:19:47.127464+0000","last_fullsized":"2023-12-12T09:19:47.127464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303428+0000","last_change":"2023-12-12T09:19:41.871972+0000","last_active":"2023-12-12T09:19:47.303428+0000","last_peered":"2023-12-12T09:19:47.303428+0000","last_clean":"2023-12-12T09:19:47.303428+0000","last_became_active":"2023-12-12T09:19:41.871670+0000","last_became_peered":"2023-12-12T09:19:41.871670+0000","last_unstale":"2023-12-12T09:19:47.303428+0000","last_undegraded":"2023-12-12T09:19:47.303428+0000","last_fullsized":"2023-12-12T09:19:47.303428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:25.789938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127735+0000","last_change":"2023-12-12T09:19:41.870884+0000","last_active":"2023-12-12T09:19:47.127735+0000","last_peered":"2023-12-12T09:19:47.127735+0000","last_clean":"2023-12-12T09:19:47.127735+0000","last_became_active":"2023-12-12T09:19:41.868918+0000","last_became_peered":"2023-12-12T09:19:41.868918+0000","last_unstale":"2023-12-12T09:19:47.127735+0000","last_undegraded":"2023-12-12T09:19:47.127735+0000","last_fullsized":"2023-12-12T09:19:47.127735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:24.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950799+0000","last_change":"2023-12-12T09:19:41.852563+0000","last_active":"2023-12-12T09:19:47.950799+0000","last_peered":"2023-12-12T09:19:47.950799+0000","last_clean":"2023-12-12T09:19:47.950799+0000","last_became_active":"2023-12-12T09:19:41.851419+0000","last_became_peered":"2023-12-12T09:19:41.851419+0000","last_unstale":"2023-12-12T09:19:47.950799+0000","last_undegraded":"2023-12-12T09:19:47.950799+0000","last_fullsized":"2023-12-12T09:19:47.950799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:10.837542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445576+0000","last_change":"2023-12-12T09:19:41.865052+0000","last_active":"2023-12-12T09:19:47.445576+0000","last_peered":"2023-12-12T09:19:47.445576+0000","last_clean":"2023-12-12T09:19:47.445576+0000","last_became_active":"2023-12-12T09:19:41.864707+0000","last_became_peered":"2023-12-12T09:19:41.864707+0000","last_unstale":"2023-12-12T09:19:47.445576+0000","last_undegraded":"2023-12-12T09:19:47.445576+0000","last_fullsized":"2023-12-12T09:19:47.445576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304266+0000","last_change":"2023-12-12T09:19:41.881336+0000","last_active":"2023-12-12T09:19:47.304266+0000","last_peered":"2023-12-12T09:19:47.304266+0000","last_clean":"2023-12-12T09:19:47.304266+0000","last_became_active":"2023-12-12T09:19:41.880783+0000","last_became_peered":"2023-12-12T09:19:41.880783+0000","last_unstale":"2023-12-12T09:19:47.304266+0000","last_undegraded":"2023-12-12T09:19:47.304266+0000","last_fullsized":"2023-12-12T09:19:47.304266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:20.718098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":701102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1589999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":110242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4790000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4430000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:20:15.057 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:20:15.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.293+0000 7f4812ebb640 1 Processor -- start 2023-12-12T09:20:15.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.293+0000 7f4812ebb640 1 -- start start 2023-12-12T09:20:15.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.294+0000 7f4812ebb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c143d20 0x7f480c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.294+0000 7f4812ebb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f480c0ce550 0x7f480c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.294+0000 7f4812ebb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480c0cea30 con 0x7f480c1447f0 2023-12-12T09:20:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.294+0000 7f4812ebb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480c0702b0 con 0x7f480c0ce550 2023-12-12T09:20:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.294+0000 7f4812ebb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c070590 con 0x7f480c143d20 2023-12-12T09:20:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f4811458640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f480c1447f0 0x7f480c15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50298/0 (socket says 172.21.15.84:50298) 2023-12-12T09:20:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f4811458640 1 -- 172.21.15.84:0/3614977663 learned_addr learned my addr 172.21.15.84:0/3614977663 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480bfff640 1 --2- 172.21.15.84:0/3614977663 >> v2:172.21.15.99:3300/0 conn(0x7f480c0ce550 0x7f480c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f4810c57640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c143d20 0x7f480c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304722385 0 0) 0x7f480c0cea30 con 0x7f480c1447f0 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47fc003520 con 0x7f480c1447f0 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1775272139 0 0) 0x7f47fc003520 con 0x7f480c1447f0 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c143d20 msgr2=0x7f480c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c143d20 0x7f480c0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 >> v2:172.21.15.99:3300/0 conn(0x7f480c0ce550 msgr2=0x7f480c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 --2- 172.21.15.84:0/3614977663 >> v2:172.21.15.99:3300/0 conn(0x7f480c0ce550 0x7f480c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c070870 con 0x7f480c1447f0 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f48040019f0 con 0x7f480c1447f0 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.295+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 >> v1:172.21.15.84:6789/0 conn(0x7f480c1447f0 legacy=0x7f480c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f480b7fe640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47fc003970 0x7f47fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f480b7fe640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c143d20 0x7f47fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f480b7fe640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc004d00 0x7f47fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0702b0 con 0x7f47fc004d00 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c070590 con 0x7f47fc003970 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc00bab0 con 0x7f480c143d20 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f480bfff640 1 --2- 172.21.15.84:0/3614977663 >> v2:172.21.15.99:3300/0 conn(0x7f480c0ce550 0x7f480c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f4811458640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc004d00 0x7f47fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f4811458640 1 -- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c143d20 msgr2=0x7f47fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f4811458640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c143d20 0x7f47fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f4811458640 1 -- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47fc003970 msgr2=0x7f47fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f4811458640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47fc003970 0x7f47fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.296+0000 7f4811458640 1 -- 172.21.15.84:0/3614977663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc003520 con 0x7f47fc004d00 2023-12-12T09:20:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.297+0000 7f4811458640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc004d00 0x7f47fc005180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f480400a760 tx=0x7f47fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4f53cc52d15242 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.297+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804034630 con 0x7f47fc004d00 2023-12-12T09:20:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.297+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480402f070 con 0x7f47fc004d00 2023-12-12T09:20:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.297+0000 7f480b7fe640 1 -- 172.21.15.84:0/3614977663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040349f0 con 0x7f47fc004d00 2023-12-12T09:20:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.298+0000 7f4812ebb640 1 -- 172.21.15.84:0/3614977663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc004d00 msgr2=0x7f47fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.298+0000 7f4812ebb640 1 --2- 172.21.15.84:0/3614977663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47fc004d00 0x7f47fc005180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f480400a760 tx=0x7f47fc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.298+0000 7f4811458640 1 -- 172.21.15.84:0/3614977663 reap_dead start 2023-12-12T09:20:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.298+0000 7f4812ebb640 1 -- 172.21.15.84:0/3614977663 shutdown_connections 2023-12-12T09:20:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.298+0000 7f4812ebb640 1 -- 172.21.15.84:0/3614977663 >> 172.21.15.84:0/3614977663 conn(0x7f480c06c3d0 msgr2=0x7f480c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.298+0000 7f4812ebb640 1 -- 172.21.15.84:0/3614977663 shutdown_connections 2023-12-12T09:20:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.298+0000 7f4812ebb640 1 -- 172.21.15.84:0/3614977663 wait complete. 2023-12-12T09:20:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.300+0000 7f4812ebb640 1 Processor -- start 2023-12-12T09:20:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.300+0000 7f4812ebb640 1 -- start start 2023-12-12T09:20:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4812ebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47fc004d00 0x7f480c1f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4812ebb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c15a620 0x7f480c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4812ebb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f480c0a89c0 0x7f480c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4812ebb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0c3d30 con 0x7f480c0a89c0 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4812ebb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c1f0e30 con 0x7f47fc004d00 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4812ebb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0a8eb0 con 0x7f480c15a620 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4811458640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f480c0a89c0 0x7f480c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4811458640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f480c0a89c0 0x7f480c15c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34794/0 (socket says 172.21.15.84:34794) 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.301+0000 7f4811458640 1 -- 172.21.15.84:0/3199162213 learned_addr learned my addr 172.21.15.84:0/3199162213 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4810c57640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47fc004d00 0x7f480c1f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f480bfff640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c15a620 0x7f480c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4811458640 1 -- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c15a620 msgr2=0x7f480c0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4811458640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c15a620 0x7f480c0a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4811458640 1 -- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47fc004d00 msgr2=0x7f480c1f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4811458640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47fc004d00 0x7f480c1f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4811458640 1 -- 172.21.15.84:0/3199162213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c0a9190 con 0x7f480c0a89c0 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f480bfff640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c15a620 0x7f480c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4811458640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f480c0a89c0 0x7f480c15c570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f480400a880 tx=0x7f4804001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f48097fa640 1 -- 172.21.15.84:0/3199162213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804034630 con 0x7f480c0a89c0 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f48097fa640 1 -- 172.21.15.84:0/3199162213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804034790 con 0x7f480c0a89c0 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f48097fa640 1 -- 172.21.15.84:0/3199162213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804034b00 con 0x7f480c0a89c0 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c0a9470 con 0x7f480c0a89c0 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.302+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c0a9750 con 0x7f480c0a89c0 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.304+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c0a9cd0 con 0x7f480c0a89c0 2023-12-12T09:20:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.304+0000 7f48097fa640 1 -- 172.21.15.84:0/3199162213 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4804031030 con 0x7f480c0a89c0 2023-12-12T09:20:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.305+0000 7f48097fa640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f47f006ae40 0x7f47f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.305+0000 7f48097fa640 1 -- 172.21.15.84:0/3199162213 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f48040abc00 con 0x7f480c0a89c0 2023-12-12T09:20:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.306+0000 7f4810c57640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f47f006ae40 0x7f47f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.306+0000 7f4810c57640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f47f006ae40 0x7f47f006d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48000047b0 tx=0x7f4800008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:15.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.310+0000 7f48097fa640 1 -- 172.21.15.84:0/3199162213 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f480c0a9cd0 con 0x7f480c0a89c0 2023-12-12T09:20:15.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.485+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f480c0a9cd0 con 0x7f47f006ae40 2023-12-12T09:20:15.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.495+0000 7f48097fa640 1 -- 172.21.15.84:0/3199162213 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345103 (secure 0 0 0) 0x7f480c0a9cd0 con 0x7f47f006ae40 2023-12-12T09:20:15.503 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:20:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.502+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f47f006ae40 msgr2=0x7f47f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.502+0000 7f4812ebb640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f47f006ae40 0x7f47f006d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f48000047b0 tx=0x7f4800008040 comp rx=0 tx=0).stop 2023-12-12T09:20:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f480c0a89c0 msgr2=0x7f480c15c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f480c0a89c0 0x7f480c15c570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f480400a880 tx=0x7f4804001cb0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 shutdown_connections 2023-12-12T09:20:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f47f006ae40 0x7f47f006d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f480c0a89c0 0x7f480c15c570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f480c15a620 0x7f480c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 --2- 172.21.15.84:0/3199162213 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47fc004d00 0x7f480c1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 >> 172.21.15.84:0/3199162213 conn(0x7f480c06c3d0 msgr2=0x7f480c0aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 shutdown_connections 2023-12-12T09:20:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.503+0000 7f4812ebb640 1 -- 172.21.15.84:0/3199162213 wait complete. 2023-12-12T09:20:15.523 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-12-12T09:20:15.084709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219544,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755176,"statfs":{"total":773094113280,"available":772869300224,"internally_reserved":0,"allocated":3448832,"data_stored":2071226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004523"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951816+0000","last_change":"2023-12-12T09:19:41.122279+0000","last_active":"2023-12-12T09:19:47.951816+0000","last_peered":"2023-12-12T09:19:47.951816+0000","last_clean":"2023-12-12T09:19:47.951816+0000","last_became_active":"2023-12-12T09:19:41.122032+0000","last_became_peered":"2023-12-12T09:19:41.122032+0000","last_unstale":"2023-12-12T09:19:47.951816+0000","last_undegraded":"2023-12-12T09:19:47.951816+0000","last_fullsized":"2023-12-12T09:19:47.951816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957378+0000","last_change":"2023-12-12T09:19:41.863190+0000","last_active":"2023-12-12T09:19:47.957378+0000","last_peered":"2023-12-12T09:19:47.957378+0000","last_clean":"2023-12-12T09:19:47.957378+0000","last_became_active":"2023-12-12T09:19:41.862923+0000","last_became_peered":"2023-12-12T09:19:41.862923+0000","last_unstale":"2023-12-12T09:19:47.957378+0000","last_undegraded":"2023-12-12T09:19:47.957378+0000","last_fullsized":"2023-12-12T09:19:47.957378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:12.357618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127983+0000","last_change":"2023-12-12T09:19:46.953136+0000","last_active":"2023-12-12T09:19:48.127983+0000","last_peered":"2023-12-12T09:19:48.127983+0000","last_clean":"2023-12-12T09:19:48.127983+0000","last_became_active":"2023-12-12T09:19:46.951967+0000","last_became_peered":"2023-12-12T09:19:46.951967+0000","last_unstale":"2023-12-12T09:19:48.127983+0000","last_undegraded":"2023-12-12T09:19:48.127983+0000","last_fullsized":"2023-12-12T09:19:48.127983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:57:42.202625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957667+0000","last_change":"2023-12-12T09:19:41.121042+0000","last_active":"2023-12-12T09:19:47.957667+0000","last_peered":"2023-12-12T09:19:47.957667+0000","last_clean":"2023-12-12T09:19:47.957667+0000","last_became_active":"2023-12-12T09:19:41.120807+0000","last_became_peered":"2023-12-12T09:19:41.120807+0000","last_unstale":"2023-12-12T09:19:47.957667+0000","last_undegraded":"2023-12-12T09:19:47.957667+0000","last_fullsized":"2023-12-12T09:19:47.957667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:13:12.317036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951513+0000","last_change":"2023-12-12T09:19:41.878335+0000","last_active":"2023-12-12T09:19:47.951513+0000","last_peered":"2023-12-12T09:19:47.951513+0000","last_clean":"2023-12-12T09:19:47.951513+0000","last_became_active":"2023-12-12T09:19:41.878074+0000","last_became_peered":"2023-12-12T09:19:41.878074+0000","last_unstale":"2023-12-12T09:19:47.951513+0000","last_undegraded":"2023-12-12T09:19:47.951513+0000","last_fullsized":"2023-12-12T09:19:47.951513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130375+0000","last_change":"2023-12-12T09:19:46.188502+0000","last_active":"2023-12-12T09:19:48.130375+0000","last_peered":"2023-12-12T09:19:48.130375+0000","last_clean":"2023-12-12T09:19:48.130375+0000","last_became_active":"2023-12-12T09:19:46.187905+0000","last_became_peered":"2023-12-12T09:19:46.187905+0000","last_unstale":"2023-12-12T09:19:48.130375+0000","last_undegraded":"2023-12-12T09:19:48.130375+0000","last_fullsized":"2023-12-12T09:19:48.130375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:47:39.097135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303686+0000","last_change":"2023-12-12T09:19:41.138949+0000","last_active":"2023-12-12T09:19:47.303686+0000","last_peered":"2023-12-12T09:19:47.303686+0000","last_clean":"2023-12-12T09:19:47.303686+0000","last_became_active":"2023-12-12T09:19:41.138599+0000","last_became_peered":"2023-12-12T09:19:41.138599+0000","last_unstale":"2023-12-12T09:19:47.303686+0000","last_undegraded":"2023-12-12T09:19:47.303686+0000","last_fullsized":"2023-12-12T09:19:47.303686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127902+0000","last_change":"2023-12-12T09:19:41.871082+0000","last_active":"2023-12-12T09:19:47.127902+0000","last_peered":"2023-12-12T09:19:47.127902+0000","last_clean":"2023-12-12T09:19:47.127902+0000","last_became_active":"2023-12-12T09:19:41.870566+0000","last_became_peered":"2023-12-12T09:19:41.870566+0000","last_unstale":"2023-12-12T09:19:47.127902+0000","last_undegraded":"2023-12-12T09:19:47.127902+0000","last_fullsized":"2023-12-12T09:19:47.127902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:25.789938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131233+0000","last_change":"2023-12-12T09:19:46.189328+0000","last_active":"2023-12-12T09:19:48.131233+0000","last_peered":"2023-12-12T09:19:48.131233+0000","last_clean":"2023-12-12T09:19:48.131233+0000","last_became_active":"2023-12-12T09:19:46.187611+0000","last_became_peered":"2023-12-12T09:19:46.187611+0000","last_unstale":"2023-12-12T09:19:48.131233+0000","last_undegraded":"2023-12-12T09:19:48.131233+0000","last_fullsized":"2023-12-12T09:19:48.131233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303363+0000","last_change":"2023-12-12T09:19:41.137054+0000","last_active":"2023-12-12T09:19:47.303363+0000","last_peered":"2023-12-12T09:19:47.303363+0000","last_clean":"2023-12-12T09:19:47.303363+0000","last_became_active":"2023-12-12T09:19:41.136605+0000","last_became_peered":"2023-12-12T09:19:41.136605+0000","last_unstale":"2023-12-12T09:19:47.303363+0000","last_undegraded":"2023-12-12T09:19:47.303363+0000","last_fullsized":"2023-12-12T09:19:47.303363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127898+0000","last_change":"2023-12-12T09:19:41.874505+0000","last_active":"2023-12-12T09:19:47.127898+0000","last_peered":"2023-12-12T09:19:47.127898+0000","last_clean":"2023-12-12T09:19:47.127898+0000","last_became_active":"2023-12-12T09:19:41.867235+0000","last_became_peered":"2023-12-12T09:19:41.867235+0000","last_unstale":"2023-12-12T09:19:47.127898+0000","last_undegraded":"2023-12-12T09:19:47.127898+0000","last_fullsized":"2023-12-12T09:19:47.127898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:24.432590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130292+0000","last_change":"2023-12-12T09:19:46.181752+0000","last_active":"2023-12-12T09:19:48.130292+0000","last_peered":"2023-12-12T09:19:48.130292+0000","last_clean":"2023-12-12T09:19:48.130292+0000","last_became_active":"2023-12-12T09:19:46.181333+0000","last_became_peered":"2023-12-12T09:19:46.181333+0000","last_unstale":"2023-12-12T09:19:48.130292+0000","last_undegraded":"2023-12-12T09:19:48.130292+0000","last_fullsized":"2023-12-12T09:19:48.130292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:24.767108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019710+0000","last_change":"2023-12-12T09:19:41.875596+0000","last_active":"2023-12-12T09:19:48.019710+0000","last_peered":"2023-12-12T09:19:48.019710+0000","last_clean":"2023-12-12T09:19:48.019710+0000","last_became_active":"2023-12-12T09:19:41.874550+0000","last_became_peered":"2023-12-12T09:19:41.874550+0000","last_unstale":"2023-12-12T09:19:48.019710+0000","last_undegraded":"2023-12-12T09:19:48.019710+0000","last_fullsized":"2023-12-12T09:19:48.019710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303839+0000","last_change":"2023-12-12T09:19:41.134017+0000","last_active":"2023-12-12T09:19:47.303839+0000","last_peered":"2023-12-12T09:19:47.303839+0000","last_clean":"2023-12-12T09:19:47.303839+0000","last_became_active":"2023-12-12T09:19:41.133112+0000","last_became_peered":"2023-12-12T09:19:41.133112+0000","last_unstale":"2023-12-12T09:19:47.303839+0000","last_undegraded":"2023-12-12T09:19:47.303839+0000","last_fullsized":"2023-12-12T09:19:47.303839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:30.833996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132530+0000","last_change":"2023-12-12T09:19:46.183576+0000","last_active":"2023-12-12T09:19:48.132530+0000","last_peered":"2023-12-12T09:19:48.132530+0000","last_clean":"2023-12-12T09:19:48.132530+0000","last_became_active":"2023-12-12T09:19:46.182655+0000","last_became_peered":"2023-12-12T09:19:46.182655+0000","last_unstale":"2023-12-12T09:19:48.132530+0000","last_undegraded":"2023-12-12T09:19:48.132530+0000","last_fullsized":"2023-12-12T09:19:48.132530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:46.157628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956362+0000","last_change":"2023-12-12T09:19:41.862462+0000","last_active":"2023-12-12T09:19:47.956362+0000","last_peered":"2023-12-12T09:19:47.956362+0000","last_clean":"2023-12-12T09:19:47.956362+0000","last_became_active":"2023-12-12T09:19:41.860988+0000","last_became_peered":"2023-12-12T09:19:41.860988+0000","last_unstale":"2023-12-12T09:19:47.956362+0000","last_undegraded":"2023-12-12T09:19:47.956362+0000","last_fullsized":"2023-12-12T09:19:47.956362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:26.864874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444995+0000","last_change":"2023-12-12T09:19:41.124071+0000","last_active":"2023-12-12T09:19:47.444995+0000","last_peered":"2023-12-12T09:19:47.444995+0000","last_clean":"2023-12-12T09:19:47.444995+0000","last_became_active":"2023-12-12T09:19:41.123806+0000","last_became_peered":"2023-12-12T09:19:41.123806+0000","last_unstale":"2023-12-12T09:19:47.444995+0000","last_undegraded":"2023-12-12T09:19:47.444995+0000","last_fullsized":"2023-12-12T09:19:47.444995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:40:48.958960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131780+0000","last_change":"2023-12-12T09:19:46.188994+0000","last_active":"2023-12-12T09:19:48.131780+0000","last_peered":"2023-12-12T09:19:48.131780+0000","last_clean":"2023-12-12T09:19:48.131780+0000","last_became_active":"2023-12-12T09:19:46.188551+0000","last_became_peered":"2023-12-12T09:19:46.188551+0000","last_unstale":"2023-12-12T09:19:48.131780+0000","last_undegraded":"2023-12-12T09:19:48.131780+0000","last_fullsized":"2023-12-12T09:19:48.131780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956335+0000","last_change":"2023-12-12T09:19:41.857578+0000","last_active":"2023-12-12T09:19:47.956335+0000","last_peered":"2023-12-12T09:19:47.956335+0000","last_clean":"2023-12-12T09:19:47.956335+0000","last_became_active":"2023-12-12T09:19:41.857262+0000","last_became_peered":"2023-12-12T09:19:41.857262+0000","last_unstale":"2023-12-12T09:19:47.956335+0000","last_undegraded":"2023-12-12T09:19:47.956335+0000","last_fullsized":"2023-12-12T09:19:47.956335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:23:10.886043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444759+0000","last_change":"2023-12-12T09:19:41.124140+0000","last_active":"2023-12-12T09:19:47.444759+0000","last_peered":"2023-12-12T09:19:47.444759+0000","last_clean":"2023-12-12T09:19:47.444759+0000","last_became_active":"2023-12-12T09:19:41.123866+0000","last_became_peered":"2023-12-12T09:19:41.123866+0000","last_unstale":"2023-12-12T09:19:47.444759+0000","last_undegraded":"2023-12-12T09:19:47.444759+0000","last_fullsized":"2023-12-12T09:19:47.444759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:30.833996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169980+0000","last_change":"2023-12-12T09:19:46.944967+0000","last_active":"2023-12-12T09:19:48.169980+0000","last_peered":"2023-12-12T09:19:48.169980+0000","last_clean":"2023-12-12T09:19:48.169980+0000","last_became_active":"2023-12-12T09:19:46.942177+0000","last_became_peered":"2023-12-12T09:19:46.942177+0000","last_unstale":"2023-12-12T09:19:48.169980+0000","last_undegraded":"2023-12-12T09:19:48.169980+0000","last_fullsized":"2023-12-12T09:19:48.169980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129676+0000","last_change":"2023-12-12T09:19:41.861866+0000","last_active":"2023-12-12T09:19:47.129676+0000","last_peered":"2023-12-12T09:19:47.129676+0000","last_clean":"2023-12-12T09:19:47.129676+0000","last_became_active":"2023-12-12T09:19:41.861471+0000","last_became_peered":"2023-12-12T09:19:41.861471+0000","last_unstale":"2023-12-12T09:19:47.129676+0000","last_undegraded":"2023-12-12T09:19:47.129676+0000","last_fullsized":"2023-12-12T09:19:47.129676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:19.457728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302819+0000","last_change":"2023-12-12T09:19:41.132420+0000","last_active":"2023-12-12T09:19:47.302819+0000","last_peered":"2023-12-12T09:19:47.302819+0000","last_clean":"2023-12-12T09:19:47.302819+0000","last_became_active":"2023-12-12T09:19:41.130901+0000","last_became_peered":"2023-12-12T09:19:41.130901+0000","last_unstale":"2023-12-12T09:19:47.302819+0000","last_undegraded":"2023-12-12T09:19:47.302819+0000","last_fullsized":"2023-12-12T09:19:47.302819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:38.516239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132323+0000","last_change":"2023-12-12T09:19:46.190546+0000","last_active":"2023-12-12T09:19:48.132323+0000","last_peered":"2023-12-12T09:19:48.132323+0000","last_clean":"2023-12-12T09:19:48.132323+0000","last_became_active":"2023-12-12T09:19:46.190080+0000","last_became_peered":"2023-12-12T09:19:46.190080+0000","last_unstale":"2023-12-12T09:19:48.132323+0000","last_undegraded":"2023-12-12T09:19:48.132323+0000","last_fullsized":"2023-12-12T09:19:48.132323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951268+0000","last_change":"2023-12-12T09:19:41.858094+0000","last_active":"2023-12-12T09:19:47.951268+0000","last_peered":"2023-12-12T09:19:47.951268+0000","last_clean":"2023-12-12T09:19:47.951268+0000","last_became_active":"2023-12-12T09:19:41.857826+0000","last_became_peered":"2023-12-12T09:19:41.857826+0000","last_unstale":"2023-12-12T09:19:47.951268+0000","last_undegraded":"2023-12-12T09:19:47.951268+0000","last_fullsized":"2023-12-12T09:19:47.951268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021166+0000","last_change":"2023-12-12T09:19:41.135301+0000","last_active":"2023-12-12T09:19:48.021166+0000","last_peered":"2023-12-12T09:19:48.021166+0000","last_clean":"2023-12-12T09:19:48.021166+0000","last_became_active":"2023-12-12T09:19:41.134467+0000","last_became_peered":"2023-12-12T09:19:41.134467+0000","last_unstale":"2023-12-12T09:19:48.021166+0000","last_undegraded":"2023-12-12T09:19:48.021166+0000","last_fullsized":"2023-12-12T09:19:48.021166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.132355+0000","last_change":"2023-12-12T09:19:46.943689+0000","last_active":"2023-12-12T09:19:48.132355+0000","last_peered":"2023-12-12T09:19:48.132355+0000","last_clean":"2023-12-12T09:19:48.132355+0000","last_became_active":"2023-12-12T09:19:46.942093+0000","last_became_peered":"2023-12-12T09:19:46.942093+0000","last_unstale":"2023-12-12T09:19:48.132355+0000","last_undegraded":"2023-12-12T09:19:48.132355+0000","last_fullsized":"2023-12-12T09:19:48.132355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:00.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957608+0000","last_change":"2023-12-12T09:19:41.861945+0000","last_active":"2023-12-12T09:19:47.957608+0000","last_peered":"2023-12-12T09:19:47.957608+0000","last_clean":"2023-12-12T09:19:47.957608+0000","last_became_active":"2023-12-12T09:19:41.861570+0000","last_became_peered":"2023-12-12T09:19:41.861570+0000","last_unstale":"2023-12-12T09:19:47.957608+0000","last_undegraded":"2023-12-12T09:19:47.957608+0000","last_fullsized":"2023-12-12T09:19:47.957608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:49.539855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445666+0000","last_change":"2023-12-12T09:19:41.131818+0000","last_active":"2023-12-12T09:19:47.445666+0000","last_peered":"2023-12-12T09:19:47.445666+0000","last_clean":"2023-12-12T09:19:47.445666+0000","last_became_active":"2023-12-12T09:19:41.131557+0000","last_became_peered":"2023-12-12T09:19:41.131557+0000","last_unstale":"2023-12-12T09:19:47.445666+0000","last_undegraded":"2023-12-12T09:19:47.445666+0000","last_fullsized":"2023-12-12T09:19:47.445666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:18.435713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127909+0000","last_change":"2023-12-12T09:19:46.955434+0000","last_active":"2023-12-12T09:19:48.127909+0000","last_peered":"2023-12-12T09:19:48.127909+0000","last_clean":"2023-12-12T09:19:48.127909+0000","last_became_active":"2023-12-12T09:19:46.949579+0000","last_became_peered":"2023-12-12T09:19:46.949579+0000","last_unstale":"2023-12-12T09:19:48.127909+0000","last_undegraded":"2023-12-12T09:19:48.127909+0000","last_fullsized":"2023-12-12T09:19:48.127909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:30:22.426722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445297+0000","last_change":"2023-12-12T09:19:41.864811+0000","last_active":"2023-12-12T09:19:47.445297+0000","last_peered":"2023-12-12T09:19:47.445297+0000","last_clean":"2023-12-12T09:19:47.445297+0000","last_became_active":"2023-12-12T09:19:41.863476+0000","last_became_peered":"2023-12-12T09:19:41.863476+0000","last_unstale":"2023-12-12T09:19:47.445297+0000","last_undegraded":"2023-12-12T09:19:47.445297+0000","last_fullsized":"2023-12-12T09:19:47.445297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303909+0000","last_change":"2023-12-12T09:19:41.134083+0000","last_active":"2023-12-12T09:19:47.303909+0000","last_peered":"2023-12-12T09:19:47.303909+0000","last_clean":"2023-12-12T09:19:47.303909+0000","last_became_active":"2023-12-12T09:19:41.133702+0000","last_became_peered":"2023-12-12T09:19:41.133702+0000","last_unstale":"2023-12-12T09:19:47.303909+0000","last_undegraded":"2023-12-12T09:19:47.303909+0000","last_fullsized":"2023-12-12T09:19:47.303909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:55.931283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170416+0000","last_change":"2023-12-12T09:19:46.943046+0000","last_active":"2023-12-12T09:19:48.170416+0000","last_peered":"2023-12-12T09:19:48.170416+0000","last_clean":"2023-12-12T09:19:48.170416+0000","last_became_active":"2023-12-12T09:19:46.941680+0000","last_became_peered":"2023-12-12T09:19:46.941680+0000","last_unstale":"2023-12-12T09:19:48.170416+0000","last_undegraded":"2023-12-12T09:19:48.170416+0000","last_fullsized":"2023-12-12T09:19:48.170416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128054+0000","last_change":"2023-12-12T09:19:41.865106+0000","last_active":"2023-12-12T09:19:47.128054+0000","last_peered":"2023-12-12T09:19:47.128054+0000","last_clean":"2023-12-12T09:19:47.128054+0000","last_became_active":"2023-12-12T09:19:41.864807+0000","last_became_peered":"2023-12-12T09:19:41.864807+0000","last_unstale":"2023-12-12T09:19:47.128054+0000","last_undegraded":"2023-12-12T09:19:47.128054+0000","last_fullsized":"2023-12-12T09:19:47.128054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:32.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445367+0000","last_change":"2023-12-12T09:19:41.116293+0000","last_active":"2023-12-12T09:19:47.445367+0000","last_peered":"2023-12-12T09:19:47.445367+0000","last_clean":"2023-12-12T09:19:47.445367+0000","last_became_active":"2023-12-12T09:19:41.115995+0000","last_became_peered":"2023-12-12T09:19:41.115995+0000","last_unstale":"2023-12-12T09:19:47.445367+0000","last_undegraded":"2023-12-12T09:19:47.445367+0000","last_fullsized":"2023-12-12T09:19:47.445367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:02.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.168829+0000","last_change":"2023-12-12T09:19:46.184450+0000","last_active":"2023-12-12T09:19:48.168829+0000","last_peered":"2023-12-12T09:19:48.168829+0000","last_clean":"2023-12-12T09:19:48.168829+0000","last_became_active":"2023-12-12T09:19:46.183856+0000","last_became_peered":"2023-12-12T09:19:46.183856+0000","last_unstale":"2023-12-12T09:19:48.168829+0000","last_undegraded":"2023-12-12T09:19:48.168829+0000","last_fullsized":"2023-12-12T09:19:48.168829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:35.749254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.131191+0000","last_change":"2023-12-12T09:19:41.859699+0000","last_active":"2023-12-12T09:19:47.131191+0000","last_peered":"2023-12-12T09:19:47.131191+0000","last_clean":"2023-12-12T09:19:47.131191+0000","last_became_active":"2023-12-12T09:19:41.859271+0000","last_became_peered":"2023-12-12T09:19:41.859271+0000","last_unstale":"2023-12-12T09:19:47.131191+0000","last_undegraded":"2023-12-12T09:19:47.131191+0000","last_fullsized":"2023-12-12T09:19:47.131191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:23:52.795227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128310+0000","last_change":"2023-12-12T09:19:41.127974+0000","last_active":"2023-12-12T09:19:47.128310+0000","last_peered":"2023-12-12T09:19:47.128310+0000","last_clean":"2023-12-12T09:19:47.128310+0000","last_became_active":"2023-12-12T09:19:41.127284+0000","last_became_peered":"2023-12-12T09:19:41.127284+0000","last_unstale":"2023-12-12T09:19:47.128310+0000","last_undegraded":"2023-12-12T09:19:47.128310+0000","last_fullsized":"2023-12-12T09:19:47.128310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:27.876703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169383+0000","last_change":"2023-12-12T09:19:46.187283+0000","last_active":"2023-12-12T09:19:48.169383+0000","last_peered":"2023-12-12T09:19:48.169383+0000","last_clean":"2023-12-12T09:19:48.169383+0000","last_became_active":"2023-12-12T09:19:46.184094+0000","last_became_peered":"2023-12-12T09:19:46.184094+0000","last_unstale":"2023-12-12T09:19:48.169383+0000","last_undegraded":"2023-12-12T09:19:48.169383+0000","last_fullsized":"2023-12-12T09:19:48.169383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444747+0000","last_change":"2023-12-12T09:19:41.860571+0000","last_active":"2023-12-12T09:19:47.444747+0000","last_peered":"2023-12-12T09:19:47.444747+0000","last_clean":"2023-12-12T09:19:47.444747+0000","last_became_active":"2023-12-12T09:19:41.860299+0000","last_became_peered":"2023-12-12T09:19:41.860299+0000","last_unstale":"2023-12-12T09:19:47.444747+0000","last_undegraded":"2023-12-12T09:19:47.444747+0000","last_fullsized":"2023-12-12T09:19:47.444747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126141+0000","last_change":"2023-12-12T09:19:41.117790+0000","last_active":"2023-12-12T09:19:47.126141+0000","last_peered":"2023-12-12T09:19:47.126141+0000","last_clean":"2023-12-12T09:19:47.126141+0000","last_became_active":"2023-12-12T09:19:41.117558+0000","last_became_peered":"2023-12-12T09:19:41.117558+0000","last_unstale":"2023-12-12T09:19:47.126141+0000","last_undegraded":"2023-12-12T09:19:47.126141+0000","last_fullsized":"2023-12-12T09:19:47.126141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:34:48.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170143+0000","last_change":"2023-12-12T09:19:46.182717+0000","last_active":"2023-12-12T09:19:48.170143+0000","last_peered":"2023-12-12T09:19:48.170143+0000","last_clean":"2023-12-12T09:19:48.170143+0000","last_became_active":"2023-12-12T09:19:46.179138+0000","last_became_peered":"2023-12-12T09:19:46.179138+0000","last_unstale":"2023-12-12T09:19:48.170143+0000","last_undegraded":"2023-12-12T09:19:48.170143+0000","last_fullsized":"2023-12-12T09:19:48.170143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950048+0000","last_change":"2023-12-12T09:19:41.850752+0000","last_active":"2023-12-12T09:19:47.950048+0000","last_peered":"2023-12-12T09:19:47.950048+0000","last_clean":"2023-12-12T09:19:47.950048+0000","last_became_active":"2023-12-12T09:19:41.849147+0000","last_became_peered":"2023-12-12T09:19:41.849147+0000","last_unstale":"2023-12-12T09:19:47.950048+0000","last_undegraded":"2023-12-12T09:19:47.950048+0000","last_fullsized":"2023-12-12T09:19:47.950048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:03.309104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302812+0000","last_change":"2023-12-12T09:19:41.134276+0000","last_active":"2023-12-12T09:19:47.302812+0000","last_peered":"2023-12-12T09:19:47.302812+0000","last_clean":"2023-12-12T09:19:47.302812+0000","last_became_active":"2023-12-12T09:19:41.133924+0000","last_became_peered":"2023-12-12T09:19:41.133924+0000","last_unstale":"2023-12-12T09:19:47.302812+0000","last_undegraded":"2023-12-12T09:19:47.302812+0000","last_fullsized":"2023-12-12T09:19:47.302812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171202+0000","last_change":"2023-12-12T09:19:46.947025+0000","last_active":"2023-12-12T09:19:48.171202+0000","last_peered":"2023-12-12T09:19:48.171202+0000","last_clean":"2023-12-12T09:19:48.171202+0000","last_became_active":"2023-12-12T09:19:46.945211+0000","last_became_peered":"2023-12-12T09:19:46.945211+0000","last_unstale":"2023-12-12T09:19:48.171202+0000","last_undegraded":"2023-12-12T09:19:48.171202+0000","last_fullsized":"2023-12-12T09:19:48.171202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.955803+0000","last_change":"2023-12-12T09:19:41.877643+0000","last_active":"2023-12-12T09:19:47.955803+0000","last_peered":"2023-12-12T09:19:47.955803+0000","last_clean":"2023-12-12T09:19:47.955803+0000","last_became_active":"2023-12-12T09:19:41.877316+0000","last_became_peered":"2023-12-12T09:19:41.877316+0000","last_unstale":"2023-12-12T09:19:47.955803+0000","last_undegraded":"2023-12-12T09:19:47.955803+0000","last_fullsized":"2023-12-12T09:19:47.955803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:14:08.288770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127400+0000","last_change":"2023-12-12T09:19:41.113788+0000","last_active":"2023-12-12T09:19:47.127400+0000","last_peered":"2023-12-12T09:19:47.127400+0000","last_clean":"2023-12-12T09:19:47.127400+0000","last_became_active":"2023-12-12T09:19:41.112577+0000","last_became_peered":"2023-12-12T09:19:41.112577+0000","last_unstale":"2023-12-12T09:19:47.127400+0000","last_undegraded":"2023-12-12T09:19:47.127400+0000","last_fullsized":"2023-12-12T09:19:47.127400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:42.765147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303078+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:19:47.303078+0000","last_peered":"2023-12-12T09:19:47.303078+0000","last_clean":"2023-12-12T09:19:47.303078+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:19:47.303078+0000","last_undegraded":"2023-12-12T09:19:47.303078+0000","last_fullsized":"2023-12-12T09:19:47.303078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.172709+0000","last_change":"2023-12-12T09:19:46.944981+0000","last_active":"2023-12-12T09:19:48.172709+0000","last_peered":"2023-12-12T09:19:48.172709+0000","last_clean":"2023-12-12T09:19:48.172709+0000","last_became_active":"2023-12-12T09:19:46.943825+0000","last_became_peered":"2023-12-12T09:19:46.943825+0000","last_unstale":"2023-12-12T09:19:48.172709+0000","last_undegraded":"2023-12-12T09:19:48.172709+0000","last_fullsized":"2023-12-12T09:19:48.172709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:33.622944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303399+0000","last_change":"2023-12-12T09:19:41.883110+0000","last_active":"2023-12-12T09:19:47.303399+0000","last_peered":"2023-12-12T09:19:47.303399+0000","last_clean":"2023-12-12T09:19:47.303399+0000","last_became_active":"2023-12-12T09:19:41.882836+0000","last_became_peered":"2023-12-12T09:19:41.882836+0000","last_unstale":"2023-12-12T09:19:47.303399+0000","last_undegraded":"2023-12-12T09:19:47.303399+0000","last_fullsized":"2023-12-12T09:19:47.303399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:53.429076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127491+0000","last_change":"2023-12-12T09:19:41.128783+0000","last_active":"2023-12-12T09:19:47.127491+0000","last_peered":"2023-12-12T09:19:47.127491+0000","last_clean":"2023-12-12T09:19:47.127491+0000","last_became_active":"2023-12-12T09:19:41.128390+0000","last_became_peered":"2023-12-12T09:19:41.128390+0000","last_unstale":"2023-12-12T09:19:47.127491+0000","last_undegraded":"2023-12-12T09:19:47.127491+0000","last_fullsized":"2023-12-12T09:19:47.127491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:28:38.516239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170902+0000","last_change":"2023-12-12T09:19:46.945892+0000","last_active":"2023-12-12T09:19:48.170902+0000","last_peered":"2023-12-12T09:19:48.170902+0000","last_clean":"2023-12-12T09:19:48.170902+0000","last_became_active":"2023-12-12T09:19:46.944874+0000","last_became_peered":"2023-12-12T09:19:46.944874+0000","last_unstale":"2023-12-12T09:19:48.170902+0000","last_undegraded":"2023-12-12T09:19:48.170902+0000","last_fullsized":"2023-12-12T09:19:48.170902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:36.314213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127967+0000","last_change":"2023-12-12T09:19:41.861777+0000","last_active":"2023-12-12T09:19:47.127967+0000","last_peered":"2023-12-12T09:19:47.127967+0000","last_clean":"2023-12-12T09:19:47.127967+0000","last_became_active":"2023-12-12T09:19:41.861449+0000","last_became_peered":"2023-12-12T09:19:41.861449+0000","last_unstale":"2023-12-12T09:19:47.127967+0000","last_undegraded":"2023-12-12T09:19:47.127967+0000","last_fullsized":"2023-12-12T09:19:47.127967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:29.573933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445429+0000","last_change":"2023-12-12T09:19:41.119895+0000","last_active":"2023-12-12T09:19:47.445429+0000","last_peered":"2023-12-12T09:19:47.445429+0000","last_clean":"2023-12-12T09:19:47.445429+0000","last_became_active":"2023-12-12T09:19:41.119579+0000","last_became_peered":"2023-12-12T09:19:41.119579+0000","last_unstale":"2023-12-12T09:19:47.445429+0000","last_undegraded":"2023-12-12T09:19:47.445429+0000","last_fullsized":"2023-12-12T09:19:47.445429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.170457+0000","last_change":"2023-12-12T09:19:46.184299+0000","last_active":"2023-12-12T09:19:48.170457+0000","last_peered":"2023-12-12T09:19:48.170457+0000","last_clean":"2023-12-12T09:19:48.170457+0000","last_became_active":"2023-12-12T09:19:46.182654+0000","last_became_peered":"2023-12-12T09:19:46.182654+0000","last_unstale":"2023-12-12T09:19:48.170457+0000","last_undegraded":"2023-12-12T09:19:48.170457+0000","last_fullsized":"2023-12-12T09:19:48.170457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304529+0000","last_change":"2023-12-12T09:19:41.881513+0000","last_active":"2023-12-12T09:19:47.304529+0000","last_peered":"2023-12-12T09:19:47.304529+0000","last_clean":"2023-12-12T09:19:47.304529+0000","last_became_active":"2023-12-12T09:19:41.881128+0000","last_became_peered":"2023-12-12T09:19:41.881128+0000","last_unstale":"2023-12-12T09:19:47.304529+0000","last_undegraded":"2023-12-12T09:19:47.304529+0000","last_fullsized":"2023-12-12T09:19:47.304529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:47:35.048125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126858+0000","last_change":"2023-12-12T09:19:41.116076+0000","last_active":"2023-12-12T09:19:47.126858+0000","last_peered":"2023-12-12T09:19:47.126858+0000","last_clean":"2023-12-12T09:19:47.126858+0000","last_became_active":"2023-12-12T09:19:41.115133+0000","last_became_peered":"2023-12-12T09:19:41.115133+0000","last_unstale":"2023-12-12T09:19:47.126858+0000","last_undegraded":"2023-12-12T09:19:47.126858+0000","last_fullsized":"2023-12-12T09:19:47.126858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:18.188780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.129238+0000","last_change":"2023-12-12T09:19:46.944320+0000","last_active":"2023-12-12T09:19:48.129238+0000","last_peered":"2023-12-12T09:19:48.129238+0000","last_clean":"2023-12-12T09:19:48.129238+0000","last_became_active":"2023-12-12T09:19:46.941541+0000","last_became_peered":"2023-12-12T09:19:46.941541+0000","last_unstale":"2023-12-12T09:19:48.129238+0000","last_undegraded":"2023-12-12T09:19:48.129238+0000","last_fullsized":"2023-12-12T09:19:48.129238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:51:29.315462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304268+0000","last_change":"2023-12-12T09:19:41.877256+0000","last_active":"2023-12-12T09:19:47.304268+0000","last_peered":"2023-12-12T09:19:47.304268+0000","last_clean":"2023-12-12T09:19:47.304268+0000","last_became_active":"2023-12-12T09:19:41.875186+0000","last_became_peered":"2023-12-12T09:19:41.875186+0000","last_unstale":"2023-12-12T09:19:47.304268+0000","last_undegraded":"2023-12-12T09:19:47.304268+0000","last_fullsized":"2023-12-12T09:19:47.304268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:10:32.265203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.131383+0000","last_change":"2023-12-12T09:19:41.119283+0000","last_active":"2023-12-12T09:19:47.131383+0000","last_peered":"2023-12-12T09:19:47.131383+0000","last_clean":"2023-12-12T09:19:47.131383+0000","last_became_active":"2023-12-12T09:19:41.118924+0000","last_became_peered":"2023-12-12T09:19:41.118924+0000","last_unstale":"2023-12-12T09:19:47.131383+0000","last_undegraded":"2023-12-12T09:19:47.131383+0000","last_fullsized":"2023-12-12T09:19:47.131383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:34:48.914235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131732+0000","last_change":"2023-12-12T09:19:46.186473+0000","last_active":"2023-12-12T09:19:48.131732+0000","last_peered":"2023-12-12T09:19:48.131732+0000","last_clean":"2023-12-12T09:19:48.131732+0000","last_became_active":"2023-12-12T09:19:46.185905+0000","last_became_peered":"2023-12-12T09:19:46.185905+0000","last_unstale":"2023-12-12T09:19:48.131732+0000","last_undegraded":"2023-12-12T09:19:48.131732+0000","last_fullsized":"2023-12-12T09:19:48.131732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303587+0000","last_change":"2023-12-12T09:19:41.877853+0000","last_active":"2023-12-12T09:19:47.303587+0000","last_peered":"2023-12-12T09:19:47.303587+0000","last_clean":"2023-12-12T09:19:47.303587+0000","last_became_active":"2023-12-12T09:19:41.875044+0000","last_became_peered":"2023-12-12T09:19:41.875044+0000","last_unstale":"2023-12-12T09:19:47.303587+0000","last_undegraded":"2023-12-12T09:19:47.303587+0000","last_fullsized":"2023-12-12T09:19:47.303587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:14.546295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.125556+0000","last_change":"2023-12-12T09:19:41.120939+0000","last_active":"2023-12-12T09:19:47.125556+0000","last_peered":"2023-12-12T09:19:47.125556+0000","last_clean":"2023-12-12T09:19:47.125556+0000","last_became_active":"2023-12-12T09:19:41.120648+0000","last_became_peered":"2023-12-12T09:19:41.120648+0000","last_unstale":"2023-12-12T09:19:47.125556+0000","last_undegraded":"2023-12-12T09:19:47.125556+0000","last_fullsized":"2023-12-12T09:19:47.125556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:50:22.895651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171167+0000","last_change":"2023-12-12T09:19:46.189274+0000","last_active":"2023-12-12T09:19:48.171167+0000","last_peered":"2023-12-12T09:19:48.171167+0000","last_clean":"2023-12-12T09:19:48.171167+0000","last_became_active":"2023-12-12T09:19:46.188822+0000","last_became_peered":"2023-12-12T09:19:46.188822+0000","last_unstale":"2023-12-12T09:19:48.171167+0000","last_undegraded":"2023-12-12T09:19:48.171167+0000","last_fullsized":"2023-12-12T09:19:48.171167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:20:34.448412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019851+0000","last_change":"2023-12-12T09:19:41.864891+0000","last_active":"2023-12-12T09:19:48.019851+0000","last_peered":"2023-12-12T09:19:48.019851+0000","last_clean":"2023-12-12T09:19:48.019851+0000","last_became_active":"2023-12-12T09:19:41.864627+0000","last_became_peered":"2023-12-12T09:19:41.864627+0000","last_unstale":"2023-12-12T09:19:48.019851+0000","last_undegraded":"2023-12-12T09:19:48.019851+0000","last_fullsized":"2023-12-12T09:19:48.019851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020105+0000","last_change":"2023-12-12T09:19:41.133652+0000","last_active":"2023-12-12T09:19:48.020105+0000","last_peered":"2023-12-12T09:19:48.020105+0000","last_clean":"2023-12-12T09:19:48.020105+0000","last_became_active":"2023-12-12T09:19:41.133408+0000","last_became_peered":"2023-12-12T09:19:41.133408+0000","last_unstale":"2023-12-12T09:19:48.020105+0000","last_undegraded":"2023-12-12T09:19:48.020105+0000","last_fullsized":"2023-12-12T09:19:48.020105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:08.194468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128487+0000","last_change":"2023-12-12T09:19:46.948569+0000","last_active":"2023-12-12T09:19:48.128487+0000","last_peered":"2023-12-12T09:19:48.128487+0000","last_clean":"2023-12-12T09:19:48.128487+0000","last_became_active":"2023-12-12T09:19:46.947137+0000","last_became_peered":"2023-12-12T09:19:46.947137+0000","last_unstale":"2023-12-12T09:19:48.128487+0000","last_undegraded":"2023-12-12T09:19:48.128487+0000","last_fullsized":"2023-12-12T09:19:48.128487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:05:18.225548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303688+0000","last_change":"2023-12-12T09:19:41.877782+0000","last_active":"2023-12-12T09:19:47.303688+0000","last_peered":"2023-12-12T09:19:47.303688+0000","last_clean":"2023-12-12T09:19:47.303688+0000","last_became_active":"2023-12-12T09:19:41.877386+0000","last_became_peered":"2023-12-12T09:19:41.877386+0000","last_unstale":"2023-12-12T09:19:47.303688+0000","last_undegraded":"2023-12-12T09:19:47.303688+0000","last_fullsized":"2023-12-12T09:19:47.303688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:24.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128131+0000","last_change":"2023-12-12T09:19:41.132860+0000","last_active":"2023-12-12T09:19:47.128131+0000","last_peered":"2023-12-12T09:19:47.128131+0000","last_clean":"2023-12-12T09:19:47.128131+0000","last_became_active":"2023-12-12T09:19:41.132569+0000","last_became_peered":"2023-12-12T09:19:41.132569+0000","last_unstale":"2023-12-12T09:19:47.128131+0000","last_undegraded":"2023-12-12T09:19:47.128131+0000","last_fullsized":"2023-12-12T09:19:47.128131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:18.435713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128599+0000","last_change":"2023-12-12T09:19:46.950471+0000","last_active":"2023-12-12T09:19:48.128599+0000","last_peered":"2023-12-12T09:19:48.128599+0000","last_clean":"2023-12-12T09:19:48.128599+0000","last_became_active":"2023-12-12T09:19:46.949395+0000","last_became_peered":"2023-12-12T09:19:46.949395+0000","last_unstale":"2023-12-12T09:19:48.128599+0000","last_undegraded":"2023-12-12T09:19:48.128599+0000","last_fullsized":"2023-12-12T09:19:48.128599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:23:10.613536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950800+0000","last_change":"2023-12-12T09:19:41.869585+0000","last_active":"2023-12-12T09:19:47.950800+0000","last_peered":"2023-12-12T09:19:47.950800+0000","last_clean":"2023-12-12T09:19:47.950800+0000","last_became_active":"2023-12-12T09:19:41.869388+0000","last_became_peered":"2023-12-12T09:19:41.869388+0000","last_unstale":"2023-12-12T09:19:47.950800+0000","last_undegraded":"2023-12-12T09:19:47.950800+0000","last_fullsized":"2023-12-12T09:19:47.950800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951035+0000","last_change":"2023-12-12T09:19:41.123186+0000","last_active":"2023-12-12T09:19:47.951035+0000","last_peered":"2023-12-12T09:19:47.951035+0000","last_clean":"2023-12-12T09:19:47.951035+0000","last_became_active":"2023-12-12T09:19:41.122891+0000","last_became_peered":"2023-12-12T09:19:41.122891+0000","last_unstale":"2023-12-12T09:19:47.951035+0000","last_undegraded":"2023-12-12T09:19:47.951035+0000","last_fullsized":"2023-12-12T09:19:47.951035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:23:51.526278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.130720+0000","last_change":"2023-12-12T09:19:46.943661+0000","last_active":"2023-12-12T09:19:48.130720+0000","last_peered":"2023-12-12T09:19:48.130720+0000","last_clean":"2023-12-12T09:19:48.130720+0000","last_became_active":"2023-12-12T09:19:46.942612+0000","last_became_peered":"2023-12-12T09:19:46.942612+0000","last_unstale":"2023-12-12T09:19:48.130720+0000","last_undegraded":"2023-12-12T09:19:48.130720+0000","last_fullsized":"2023-12-12T09:19:48.130720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:00.547442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303253+0000","last_change":"2023-12-12T09:19:41.879007+0000","last_active":"2023-12-12T09:19:47.303253+0000","last_peered":"2023-12-12T09:19:47.303253+0000","last_clean":"2023-12-12T09:19:47.303253+0000","last_became_active":"2023-12-12T09:19:41.878653+0000","last_became_peered":"2023-12-12T09:19:41.878653+0000","last_unstale":"2023-12-12T09:19:47.303253+0000","last_undegraded":"2023-12-12T09:19:47.303253+0000","last_fullsized":"2023-12-12T09:19:47.303253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:24.432590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:59.537079+0000","last_change":"2023-12-12T09:19:41.130448+0000","last_active":"2023-12-12T09:19:59.537079+0000","last_peered":"2023-12-12T09:19:59.537079+0000","last_clean":"2023-12-12T09:19:59.537079+0000","last_became_active":"2023-12-12T09:19:41.129913+0000","last_became_peered":"2023-12-12T09:19:41.129913+0000","last_unstale":"2023-12-12T09:19:59.537079+0000","last_undegraded":"2023-12-12T09:19:59.537079+0000","last_fullsized":"2023-12-12T09:19:59.537079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:09.568593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.169031+0000","last_change":"2023-12-12T09:19:46.193832+0000","last_active":"2023-12-12T09:19:48.169031+0000","last_peered":"2023-12-12T09:19:48.169031+0000","last_clean":"2023-12-12T09:19:48.169031+0000","last_became_active":"2023-12-12T09:19:46.193427+0000","last_became_peered":"2023-12-12T09:19:46.193427+0000","last_unstale":"2023-12-12T09:19:48.169031+0000","last_undegraded":"2023-12-12T09:19:48.169031+0000","last_fullsized":"2023-12-12T09:19:48.169031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130880+0000","last_change":"2023-12-12T09:19:41.866473+0000","last_active":"2023-12-12T09:19:47.130880+0000","last_peered":"2023-12-12T09:19:47.130880+0000","last_clean":"2023-12-12T09:19:47.130880+0000","last_became_active":"2023-12-12T09:19:41.865426+0000","last_became_peered":"2023-12-12T09:19:41.865426+0000","last_unstale":"2023-12-12T09:19:47.130880+0000","last_undegraded":"2023-12-12T09:19:47.130880+0000","last_fullsized":"2023-12-12T09:19:47.130880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:32.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445355+0000","last_change":"2023-12-12T09:19:41.128579+0000","last_active":"2023-12-12T09:19:47.445355+0000","last_peered":"2023-12-12T09:19:47.445355+0000","last_clean":"2023-12-12T09:19:47.445355+0000","last_became_active":"2023-12-12T09:19:41.127500+0000","last_became_peered":"2023-12-12T09:19:41.127500+0000","last_unstale":"2023-12-12T09:19:47.445355+0000","last_undegraded":"2023-12-12T09:19:47.445355+0000","last_fullsized":"2023-12-12T09:19:47.445355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:08:51.795865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.131533+0000","last_change":"2023-12-12T09:19:46.192023+0000","last_active":"2023-12-12T09:19:48.131533+0000","last_peered":"2023-12-12T09:19:48.131533+0000","last_clean":"2023-12-12T09:19:48.131533+0000","last_became_active":"2023-12-12T09:19:46.190736+0000","last_became_peered":"2023-12-12T09:19:46.190736+0000","last_unstale":"2023-12-12T09:19:48.131533+0000","last_undegraded":"2023-12-12T09:19:48.131533+0000","last_fullsized":"2023-12-12T09:19:48.131533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:11:33.864282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951755+0000","last_change":"2023-12-12T09:19:41.878135+0000","last_active":"2023-12-12T09:19:47.951755+0000","last_peered":"2023-12-12T09:19:47.951755+0000","last_clean":"2023-12-12T09:19:47.951755+0000","last_became_active":"2023-12-12T09:19:41.877619+0000","last_became_peered":"2023-12-12T09:19:41.877619+0000","last_unstale":"2023-12-12T09:19:47.951755+0000","last_undegraded":"2023-12-12T09:19:47.951755+0000","last_fullsized":"2023-12-12T09:19:47.951755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129007+0000","last_change":"2023-12-12T09:19:41.133535+0000","last_active":"2023-12-12T09:19:47.129007+0000","last_peered":"2023-12-12T09:19:47.129007+0000","last_clean":"2023-12-12T09:19:47.129007+0000","last_became_active":"2023-12-12T09:19:41.133248+0000","last_became_peered":"2023-12-12T09:19:41.133248+0000","last_unstale":"2023-12-12T09:19:47.129007+0000","last_undegraded":"2023-12-12T09:19:47.129007+0000","last_fullsized":"2023-12-12T09:19:47.129007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:35.003697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128002+0000","last_change":"2023-12-12T09:19:46.187952+0000","last_active":"2023-12-12T09:19:48.128002+0000","last_peered":"2023-12-12T09:19:48.128002+0000","last_clean":"2023-12-12T09:19:48.128002+0000","last_became_active":"2023-12-12T09:19:46.187441+0000","last_became_peered":"2023-12-12T09:19:46.187441+0000","last_unstale":"2023-12-12T09:19:48.128002+0000","last_undegraded":"2023-12-12T09:19:48.128002+0000","last_fullsized":"2023-12-12T09:19:48.128002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:46:54.723850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.128820+0000","last_change":"2023-12-12T09:19:41.874029+0000","last_active":"2023-12-12T09:19:47.128820+0000","last_peered":"2023-12-12T09:19:47.128820+0000","last_clean":"2023-12-12T09:19:47.128820+0000","last_became_active":"2023-12-12T09:19:41.873678+0000","last_became_peered":"2023-12-12T09:19:41.873678+0000","last_unstale":"2023-12-12T09:19:47.128820+0000","last_undegraded":"2023-12-12T09:19:47.128820+0000","last_fullsized":"2023-12-12T09:19:47.128820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:53.429076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020897+0000","last_change":"2023-12-12T09:19:41.136636+0000","last_active":"2023-12-12T09:19:48.020897+0000","last_peered":"2023-12-12T09:19:48.020897+0000","last_clean":"2023-12-12T09:19:48.020897+0000","last_became_active":"2023-12-12T09:19:41.136314+0000","last_became_peered":"2023-12-12T09:19:41.136314+0000","last_unstale":"2023-12-12T09:19:48.020897+0000","last_undegraded":"2023-12-12T09:19:48.020897+0000","last_fullsized":"2023-12-12T09:19:48.020897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:35.268242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.127896+0000","last_change":"2023-12-12T09:19:46.955741+0000","last_active":"2023-12-12T09:19:48.127896+0000","last_peered":"2023-12-12T09:19:48.127896+0000","last_clean":"2023-12-12T09:19:48.127896+0000","last_became_active":"2023-12-12T09:19:46.950425+0000","last_became_peered":"2023-12-12T09:19:46.950425+0000","last_unstale":"2023-12-12T09:19:48.127896+0000","last_undegraded":"2023-12-12T09:19:48.127896+0000","last_fullsized":"2023-12-12T09:19:48.127896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:56:11.700203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.171062+0000","last_change":"2023-12-12T09:19:46.943384+0000","last_active":"2023-12-12T09:19:48.171062+0000","last_peered":"2023-12-12T09:19:48.171062+0000","last_clean":"2023-12-12T09:19:48.171062+0000","last_became_active":"2023-12-12T09:19:46.942319+0000","last_became_peered":"2023-12-12T09:19:46.942319+0000","last_unstale":"2023-12-12T09:19:48.171062+0000","last_undegraded":"2023-12-12T09:19:48.171062+0000","last_fullsized":"2023-12-12T09:19:48.171062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:18:22.175745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444647+0000","last_change":"2023-12-12T09:19:41.871355+0000","last_active":"2023-12-12T09:19:47.444647+0000","last_peered":"2023-12-12T09:19:47.444647+0000","last_clean":"2023-12-12T09:19:47.444647+0000","last_became_active":"2023-12-12T09:19:41.871096+0000","last_became_peered":"2023-12-12T09:19:41.871096+0000","last_unstale":"2023-12-12T09:19:47.444647+0000","last_undegraded":"2023-12-12T09:19:47.444647+0000","last_fullsized":"2023-12-12T09:19:47.444647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:57.200232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130761+0000","last_change":"2023-12-12T09:19:41.123288+0000","last_active":"2023-12-12T09:19:47.130761+0000","last_peered":"2023-12-12T09:19:47.130761+0000","last_clean":"2023-12-12T09:19:47.130761+0000","last_became_active":"2023-12-12T09:19:41.122752+0000","last_became_peered":"2023-12-12T09:19:41.122752+0000","last_unstale":"2023-12-12T09:19:47.130761+0000","last_undegraded":"2023-12-12T09:19:47.130761+0000","last_fullsized":"2023-12-12T09:19:47.130761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:42:55.931283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.173331+0000","last_change":"2023-12-12T09:19:46.195051+0000","last_active":"2023-12-12T09:19:48.173331+0000","last_peered":"2023-12-12T09:19:48.173331+0000","last_clean":"2023-12-12T09:19:48.173331+0000","last_became_active":"2023-12-12T09:19:46.194655+0000","last_became_peered":"2023-12-12T09:19:46.194655+0000","last_unstale":"2023-12-12T09:19:48.173331+0000","last_undegraded":"2023-12-12T09:19:48.173331+0000","last_fullsized":"2023-12-12T09:19:48.173331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:24.767108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956243+0000","last_change":"2023-12-12T09:19:41.861972+0000","last_active":"2023-12-12T09:19:47.956243+0000","last_peered":"2023-12-12T09:19:47.956243+0000","last_clean":"2023-12-12T09:19:47.956243+0000","last_became_active":"2023-12-12T09:19:41.861683+0000","last_became_peered":"2023-12-12T09:19:41.861683+0000","last_unstale":"2023-12-12T09:19:47.956243+0000","last_undegraded":"2023-12-12T09:19:47.956243+0000","last_fullsized":"2023-12-12T09:19:47.956243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:45:09.496901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956289+0000","last_change":"2023-12-12T09:19:41.130199+0000","last_active":"2023-12-12T09:19:47.956289+0000","last_peered":"2023-12-12T09:19:47.956289+0000","last_clean":"2023-12-12T09:19:47.956289+0000","last_became_active":"2023-12-12T09:19:41.129901+0000","last_became_peered":"2023-12-12T09:19:41.129901+0000","last_unstale":"2023-12-12T09:19:47.956289+0000","last_undegraded":"2023-12-12T09:19:47.956289+0000","last_fullsized":"2023-12-12T09:19:47.956289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:20:13.334305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020336+0000","last_change":"2023-12-12T09:19:41.135226+0000","last_active":"2023-12-12T09:19:48.020336+0000","last_peered":"2023-12-12T09:19:48.020336+0000","last_clean":"2023-12-12T09:19:48.020336+0000","last_became_active":"2023-12-12T09:19:41.134249+0000","last_became_peered":"2023-12-12T09:19:41.134249+0000","last_unstale":"2023-12-12T09:19:48.020336+0000","last_undegraded":"2023-12-12T09:19:48.020336+0000","last_fullsized":"2023-12-12T09:19:48.020336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:16:02.040155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.951009+0000","last_change":"2023-12-12T09:19:41.853034+0000","last_active":"2023-12-12T09:19:47.951009+0000","last_peered":"2023-12-12T09:19:47.951009+0000","last_clean":"2023-12-12T09:19:47.951009+0000","last_became_active":"2023-12-12T09:19:41.852723+0000","last_became_peered":"2023-12-12T09:19:41.852723+0000","last_unstale":"2023-12-12T09:19:47.951009+0000","last_undegraded":"2023-12-12T09:19:47.951009+0000","last_fullsized":"2023-12-12T09:19:47.951009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:29.145652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.167998+0000","last_change":"2023-12-12T09:19:46.187764+0000","last_active":"2023-12-12T09:19:48.167998+0000","last_peered":"2023-12-12T09:19:48.167998+0000","last_clean":"2023-12-12T09:19:48.167998+0000","last_became_active":"2023-12-12T09:19:46.186203+0000","last_became_peered":"2023-12-12T09:19:46.186203+0000","last_unstale":"2023-12-12T09:19:48.167998+0000","last_undegraded":"2023-12-12T09:19:48.167998+0000","last_fullsized":"2023-12-12T09:19:48.167998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:23.753673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956499+0000","last_change":"2023-12-12T09:19:41.128685+0000","last_active":"2023-12-12T09:19:47.956499+0000","last_peered":"2023-12-12T09:19:47.956499+0000","last_clean":"2023-12-12T09:19:47.956499+0000","last_became_active":"2023-12-12T09:19:41.127743+0000","last_became_peered":"2023-12-12T09:19:41.127743+0000","last_unstale":"2023-12-12T09:19:47.956499+0000","last_undegraded":"2023-12-12T09:19:47.956499+0000","last_fullsized":"2023-12-12T09:19:47.956499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:39.817062+0000","last_clean_scrub_stamp":"2023-12-12T09:19:39.817062+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:32:47.519167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130033+0000","last_change":"2023-12-12T09:19:41.860010+0000","last_active":"2023-12-12T09:19:47.130033+0000","last_peered":"2023-12-12T09:19:47.130033+0000","last_clean":"2023-12-12T09:19:47.130033+0000","last_became_active":"2023-12-12T09:19:41.859472+0000","last_became_peered":"2023-12-12T09:19:41.859472+0000","last_unstale":"2023-12-12T09:19:47.130033+0000","last_undegraded":"2023-12-12T09:19:47.130033+0000","last_fullsized":"2023-12-12T09:19:47.130033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:59:36.537191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.128477+0000","last_change":"2023-12-12T09:19:46.184369+0000","last_active":"2023-12-12T09:19:48.128477+0000","last_peered":"2023-12-12T09:19:48.128477+0000","last_clean":"2023-12-12T09:19:48.128477+0000","last_became_active":"2023-12-12T09:19:46.180831+0000","last_became_peered":"2023-12-12T09:19:46.180831+0000","last_unstale":"2023-12-12T09:19:48.128477+0000","last_undegraded":"2023-12-12T09:19:48.128477+0000","last_fullsized":"2023-12-12T09:19:48.128477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:45.135021+0000","last_clean_scrub_stamp":"2023-12-12T09:19:45.135021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:44.706388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.019602+0000","last_change":"2023-12-12T09:19:41.866259+0000","last_active":"2023-12-12T09:19:48.019602+0000","last_peered":"2023-12-12T09:19:48.019602+0000","last_clean":"2023-12-12T09:19:48.019602+0000","last_became_active":"2023-12-12T09:19:41.865940+0000","last_became_peered":"2023-12-12T09:19:41.865940+0000","last_unstale":"2023-12-12T09:19:48.019602+0000","last_undegraded":"2023-12-12T09:19:48.019602+0000","last_fullsized":"2023-12-12T09:19:48.019602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:19.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.125929+0000","last_change":"2023-12-12T09:19:41.867023+0000","last_active":"2023-12-12T09:19:47.125929+0000","last_peered":"2023-12-12T09:19:47.125929+0000","last_clean":"2023-12-12T09:19:47.125929+0000","last_became_active":"2023-12-12T09:19:41.866764+0000","last_became_peered":"2023-12-12T09:19:41.866764+0000","last_unstale":"2023-12-12T09:19:47.125929+0000","last_undegraded":"2023-12-12T09:19:47.125929+0000","last_fullsized":"2023-12-12T09:19:47.125929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:59:32.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127901+0000","last_change":"2023-12-12T09:19:41.867979+0000","last_active":"2023-12-12T09:19:47.127901+0000","last_peered":"2023-12-12T09:19:47.127901+0000","last_clean":"2023-12-12T09:19:47.127901+0000","last_became_active":"2023-12-12T09:19:41.867701+0000","last_became_peered":"2023-12-12T09:19:41.867701+0000","last_unstale":"2023-12-12T09:19:47.127901+0000","last_undegraded":"2023-12-12T09:19:47.127901+0000","last_fullsized":"2023-12-12T09:19:47.127901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:06:14.546295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950773+0000","last_change":"2023-12-12T09:19:41.866057+0000","last_active":"2023-12-12T09:19:47.950773+0000","last_peered":"2023-12-12T09:19:47.950773+0000","last_clean":"2023-12-12T09:19:47.950773+0000","last_became_active":"2023-12-12T09:19:41.865684+0000","last_became_peered":"2023-12-12T09:19:41.865684+0000","last_unstale":"2023-12-12T09:19:47.950773+0000","last_undegraded":"2023-12-12T09:19:47.950773+0000","last_fullsized":"2023-12-12T09:19:47.950773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:14:19.704662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956904+0000","last_change":"2023-12-12T09:19:41.870549+0000","last_active":"2023-12-12T09:19:47.956904+0000","last_peered":"2023-12-12T09:19:47.956904+0000","last_clean":"2023-12-12T09:19:47.956904+0000","last_became_active":"2023-12-12T09:19:41.870253+0000","last_became_peered":"2023-12-12T09:19:41.870253+0000","last_unstale":"2023-12-12T09:19:47.956904+0000","last_undegraded":"2023-12-12T09:19:47.956904+0000","last_fullsized":"2023-12-12T09:19:47.956904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:28:38.925176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445258+0000","last_change":"2023-12-12T09:19:41.868298+0000","last_active":"2023-12-12T09:19:47.445258+0000","last_peered":"2023-12-12T09:19:47.445258+0000","last_clean":"2023-12-12T09:19:47.445258+0000","last_became_active":"2023-12-12T09:19:41.866056+0000","last_became_peered":"2023-12-12T09:19:41.866056+0000","last_unstale":"2023-12-12T09:19:47.445258+0000","last_undegraded":"2023-12-12T09:19:47.445258+0000","last_fullsized":"2023-12-12T09:19:47.445258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021114+0000","last_change":"2023-12-12T09:19:41.870795+0000","last_active":"2023-12-12T09:19:48.021114+0000","last_peered":"2023-12-12T09:19:48.021114+0000","last_clean":"2023-12-12T09:19:48.021114+0000","last_became_active":"2023-12-12T09:19:41.869377+0000","last_became_peered":"2023-12-12T09:19:41.869377+0000","last_unstale":"2023-12-12T09:19:48.021114+0000","last_undegraded":"2023-12-12T09:19:48.021114+0000","last_fullsized":"2023-12-12T09:19:48.021114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.957512+0000","last_change":"2023-12-12T09:19:41.871326+0000","last_active":"2023-12-12T09:19:47.957512+0000","last_peered":"2023-12-12T09:19:47.957512+0000","last_clean":"2023-12-12T09:19:47.957512+0000","last_became_active":"2023-12-12T09:19:41.870253+0000","last_became_peered":"2023-12-12T09:19:41.870253+0000","last_unstale":"2023-12-12T09:19:47.957512+0000","last_undegraded":"2023-12-12T09:19:47.957512+0000","last_fullsized":"2023-12-12T09:19:47.957512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:15:05.714268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130531+0000","last_change":"2023-12-12T09:19:41.866400+0000","last_active":"2023-12-12T09:19:47.130531+0000","last_peered":"2023-12-12T09:19:47.130531+0000","last_clean":"2023-12-12T09:19:47.130531+0000","last_became_active":"2023-12-12T09:19:41.866125+0000","last_became_peered":"2023-12-12T09:19:41.866125+0000","last_unstale":"2023-12-12T09:19:47.130531+0000","last_undegraded":"2023-12-12T09:19:47.130531+0000","last_fullsized":"2023-12-12T09:19:47.130531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956057+0000","last_change":"2023-12-12T09:19:41.871487+0000","last_active":"2023-12-12T09:19:47.956057+0000","last_peered":"2023-12-12T09:19:47.956057+0000","last_clean":"2023-12-12T09:19:47.956057+0000","last_became_active":"2023-12-12T09:19:41.871121+0000","last_became_peered":"2023-12-12T09:19:41.871121+0000","last_unstale":"2023-12-12T09:19:47.956057+0000","last_undegraded":"2023-12-12T09:19:47.956057+0000","last_fullsized":"2023-12-12T09:19:47.956057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:38:04.587709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127718+0000","last_change":"2023-12-12T09:19:41.877637+0000","last_active":"2023-12-12T09:19:47.127718+0000","last_peered":"2023-12-12T09:19:47.127718+0000","last_clean":"2023-12-12T09:19:47.127718+0000","last_became_active":"2023-12-12T09:19:41.877279+0000","last_became_peered":"2023-12-12T09:19:41.877279+0000","last_unstale":"2023-12-12T09:19:47.127718+0000","last_undegraded":"2023-12-12T09:19:47.127718+0000","last_fullsized":"2023-12-12T09:19:47.127718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:40.867544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950503+0000","last_change":"2023-12-12T09:19:41.858678+0000","last_active":"2023-12-12T09:19:47.950503+0000","last_peered":"2023-12-12T09:19:47.950503+0000","last_clean":"2023-12-12T09:19:47.950503+0000","last_became_active":"2023-12-12T09:19:41.858368+0000","last_became_peered":"2023-12-12T09:19:41.858368+0000","last_unstale":"2023-12-12T09:19:47.950503+0000","last_undegraded":"2023-12-12T09:19:47.950503+0000","last_fullsized":"2023-12-12T09:19:47.950503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:08:53.064814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020884+0000","last_change":"2023-12-12T09:19:41.874119+0000","last_active":"2023-12-12T09:19:48.020884+0000","last_peered":"2023-12-12T09:19:48.020884+0000","last_clean":"2023-12-12T09:19:48.020884+0000","last_became_active":"2023-12-12T09:19:41.873475+0000","last_became_peered":"2023-12-12T09:19:41.873475+0000","last_unstale":"2023-12-12T09:19:48.020884+0000","last_undegraded":"2023-12-12T09:19:48.020884+0000","last_fullsized":"2023-12-12T09:19:48.020884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303796+0000","last_change":"2023-12-12T09:19:41.880927+0000","last_active":"2023-12-12T09:19:47.303796+0000","last_peered":"2023-12-12T09:19:47.303796+0000","last_clean":"2023-12-12T09:19:47.303796+0000","last_became_active":"2023-12-12T09:19:41.880553+0000","last_became_peered":"2023-12-12T09:19:41.880553+0000","last_unstale":"2023-12-12T09:19:47.303796+0000","last_undegraded":"2023-12-12T09:19:47.303796+0000","last_fullsized":"2023-12-12T09:19:47.303796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:29.573933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.126787+0000","last_change":"2023-12-12T09:19:41.865313+0000","last_active":"2023-12-12T09:19:47.126787+0000","last_peered":"2023-12-12T09:19:47.126787+0000","last_clean":"2023-12-12T09:19:47.126787+0000","last_became_active":"2023-12-12T09:19:41.864264+0000","last_became_peered":"2023-12-12T09:19:41.864264+0000","last_unstale":"2023-12-12T09:19:47.126787+0000","last_undegraded":"2023-12-12T09:19:47.126787+0000","last_fullsized":"2023-12-12T09:19:47.126787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:09.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.129613+0000","last_change":"2023-12-12T09:19:41.873905+0000","last_active":"2023-12-12T09:19:47.129613+0000","last_peered":"2023-12-12T09:19:47.129613+0000","last_clean":"2023-12-12T09:19:47.129613+0000","last_became_active":"2023-12-12T09:19:41.873699+0000","last_became_peered":"2023-12-12T09:19:41.873699+0000","last_unstale":"2023-12-12T09:19:47.129613+0000","last_undegraded":"2023-12-12T09:19:47.129613+0000","last_fullsized":"2023-12-12T09:19:47.129613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:20.718098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130289+0000","last_change":"2023-12-12T09:19:41.869722+0000","last_active":"2023-12-12T09:19:47.130289+0000","last_peered":"2023-12-12T09:19:47.130289+0000","last_clean":"2023-12-12T09:19:47.130289+0000","last_became_active":"2023-12-12T09:19:41.867498+0000","last_became_peered":"2023-12-12T09:19:41.867498+0000","last_unstale":"2023-12-12T09:19:47.130289+0000","last_undegraded":"2023-12-12T09:19:47.130289+0000","last_fullsized":"2023-12-12T09:19:47.130289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:37.971340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.444692+0000","last_change":"2023-12-12T09:19:41.866112+0000","last_active":"2023-12-12T09:19:47.444692+0000","last_peered":"2023-12-12T09:19:47.444692+0000","last_clean":"2023-12-12T09:19:47.444692+0000","last_became_active":"2023-12-12T09:19:41.865801+0000","last_became_peered":"2023-12-12T09:19:41.865801+0000","last_unstale":"2023-12-12T09:19:47.444692+0000","last_undegraded":"2023-12-12T09:19:47.444692+0000","last_fullsized":"2023-12-12T09:19:47.444692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950664+0000","last_change":"2023-12-12T09:19:41.856237+0000","last_active":"2023-12-12T09:19:47.950664+0000","last_peered":"2023-12-12T09:19:47.950664+0000","last_clean":"2023-12-12T09:19:47.950664+0000","last_became_active":"2023-12-12T09:19:41.854807+0000","last_became_peered":"2023-12-12T09:19:41.854807+0000","last_unstale":"2023-12-12T09:19:47.950664+0000","last_undegraded":"2023-12-12T09:19:47.950664+0000","last_fullsized":"2023-12-12T09:19:47.950664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.956161+0000","last_change":"2023-12-12T09:19:41.864225+0000","last_active":"2023-12-12T09:19:47.956161+0000","last_peered":"2023-12-12T09:19:47.956161+0000","last_clean":"2023-12-12T09:19:47.956161+0000","last_became_active":"2023-12-12T09:19:41.863889+0000","last_became_peered":"2023-12-12T09:19:41.863889+0000","last_unstale":"2023-12-12T09:19:47.956161+0000","last_undegraded":"2023-12-12T09:19:47.956161+0000","last_fullsized":"2023-12-12T09:19:47.956161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:10:28.079653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.130755+0000","last_change":"2023-12-12T09:19:41.864900+0000","last_active":"2023-12-12T09:19:47.130755+0000","last_peered":"2023-12-12T09:19:47.130755+0000","last_clean":"2023-12-12T09:19:47.130755+0000","last_became_active":"2023-12-12T09:19:41.864317+0000","last_became_peered":"2023-12-12T09:19:41.864317+0000","last_unstale":"2023-12-12T09:19:47.130755+0000","last_undegraded":"2023-12-12T09:19:47.130755+0000","last_fullsized":"2023-12-12T09:19:47.130755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:04:09.463417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.020367+0000","last_change":"2023-12-12T09:19:41.878679+0000","last_active":"2023-12-12T09:19:48.020367+0000","last_peered":"2023-12-12T09:19:48.020367+0000","last_clean":"2023-12-12T09:19:48.020367+0000","last_became_active":"2023-12-12T09:19:41.878386+0000","last_became_peered":"2023-12-12T09:19:41.878386+0000","last_unstale":"2023-12-12T09:19:48.020367+0000","last_undegraded":"2023-12-12T09:19:48.020367+0000","last_fullsized":"2023-12-12T09:19:48.020367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:26:44.034096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:48.021119+0000","last_change":"2023-12-12T09:19:41.876850+0000","last_active":"2023-12-12T09:19:48.021119+0000","last_peered":"2023-12-12T09:19:48.021119+0000","last_clean":"2023-12-12T09:19:48.021119+0000","last_became_active":"2023-12-12T09:19:41.876562+0000","last_became_peered":"2023-12-12T09:19:41.876562+0000","last_unstale":"2023-12-12T09:19:48.021119+0000","last_undegraded":"2023-12-12T09:19:48.021119+0000","last_fullsized":"2023-12-12T09:19:48.021119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:37.238480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304376+0000","last_change":"2023-12-12T09:19:41.883253+0000","last_active":"2023-12-12T09:19:47.304376+0000","last_peered":"2023-12-12T09:19:47.304376+0000","last_clean":"2023-12-12T09:19:47.304376+0000","last_became_active":"2023-12-12T09:19:41.882726+0000","last_became_peered":"2023-12-12T09:19:41.882726+0000","last_unstale":"2023-12-12T09:19:47.304376+0000","last_undegraded":"2023-12-12T09:19:47.304376+0000","last_fullsized":"2023-12-12T09:19:47.304376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:11:31.700244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.955946+0000","last_change":"2023-12-12T09:19:41.877684+0000","last_active":"2023-12-12T09:19:47.955946+0000","last_peered":"2023-12-12T09:19:47.955946+0000","last_clean":"2023-12-12T09:19:47.955946+0000","last_became_active":"2023-12-12T09:19:41.877339+0000","last_became_peered":"2023-12-12T09:19:41.877339+0000","last_unstale":"2023-12-12T09:19:47.955946+0000","last_undegraded":"2023-12-12T09:19:47.955946+0000","last_fullsized":"2023-12-12T09:19:47.955946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:03.365677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.302878+0000","last_change":"2023-12-12T09:19:41.868128+0000","last_active":"2023-12-12T09:19:47.302878+0000","last_peered":"2023-12-12T09:19:47.302878+0000","last_clean":"2023-12-12T09:19:47.302878+0000","last_became_active":"2023-12-12T09:19:41.867856+0000","last_became_peered":"2023-12-12T09:19:41.867856+0000","last_unstale":"2023-12-12T09:19:47.302878+0000","last_undegraded":"2023-12-12T09:19:47.302878+0000","last_fullsized":"2023-12-12T09:19:47.302878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:37.971340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127464+0000","last_change":"2023-12-12T09:19:41.869966+0000","last_active":"2023-12-12T09:19:47.127464+0000","last_peered":"2023-12-12T09:19:47.127464+0000","last_clean":"2023-12-12T09:19:47.127464+0000","last_became_active":"2023-12-12T09:19:41.868229+0000","last_became_peered":"2023-12-12T09:19:41.868229+0000","last_unstale":"2023-12-12T09:19:47.127464+0000","last_undegraded":"2023-12-12T09:19:47.127464+0000","last_fullsized":"2023-12-12T09:19:47.127464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:43:42.997819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.303428+0000","last_change":"2023-12-12T09:19:41.871972+0000","last_active":"2023-12-12T09:19:47.303428+0000","last_peered":"2023-12-12T09:19:47.303428+0000","last_clean":"2023-12-12T09:19:47.303428+0000","last_became_active":"2023-12-12T09:19:41.871670+0000","last_became_peered":"2023-12-12T09:19:41.871670+0000","last_unstale":"2023-12-12T09:19:47.303428+0000","last_undegraded":"2023-12-12T09:19:47.303428+0000","last_fullsized":"2023-12-12T09:19:47.303428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:25.789938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.127735+0000","last_change":"2023-12-12T09:19:41.870884+0000","last_active":"2023-12-12T09:19:47.127735+0000","last_peered":"2023-12-12T09:19:47.127735+0000","last_clean":"2023-12-12T09:19:47.127735+0000","last_became_active":"2023-12-12T09:19:41.868918+0000","last_became_peered":"2023-12-12T09:19:41.868918+0000","last_unstale":"2023-12-12T09:19:47.127735+0000","last_undegraded":"2023-12-12T09:19:47.127735+0000","last_fullsized":"2023-12-12T09:19:47.127735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:24.765213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.950799+0000","last_change":"2023-12-12T09:19:41.852563+0000","last_active":"2023-12-12T09:19:47.950799+0000","last_peered":"2023-12-12T09:19:47.950799+0000","last_clean":"2023-12-12T09:19:47.950799+0000","last_became_active":"2023-12-12T09:19:41.851419+0000","last_became_peered":"2023-12-12T09:19:41.851419+0000","last_unstale":"2023-12-12T09:19:47.950799+0000","last_undegraded":"2023-12-12T09:19:47.950799+0000","last_fullsized":"2023-12-12T09:19:47.950799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:17:10.837542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.445576+0000","last_change":"2023-12-12T09:19:41.865052+0000","last_active":"2023-12-12T09:19:47.445576+0000","last_peered":"2023-12-12T09:19:47.445576+0000","last_clean":"2023-12-12T09:19:47.445576+0000","last_became_active":"2023-12-12T09:19:41.864707+0000","last_became_peered":"2023-12-12T09:19:41.864707+0000","last_unstale":"2023-12-12T09:19:47.445576+0000","last_undegraded":"2023-12-12T09:19:47.445576+0000","last_fullsized":"2023-12-12T09:19:47.445576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:36.272646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-12T09:19:47.304266+0000","last_change":"2023-12-12T09:19:41.881336+0000","last_active":"2023-12-12T09:19:47.304266+0000","last_peered":"2023-12-12T09:19:47.304266+0000","last_clean":"2023-12-12T09:19:47.304266+0000","last_became_active":"2023-12-12T09:19:41.880783+0000","last_became_peered":"2023-12-12T09:19:41.880783+0000","last_unstale":"2023-12-12T09:19:47.304266+0000","last_undegraded":"2023-12-12T09:19:47.304266+0000","last_fullsized":"2023-12-12T09:19:47.304266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:41.086011+0000","last_clean_scrub_stamp":"2023-12-12T09:19:41.086011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:56:20.718098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":701102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1589999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":110242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":110278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4790000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4430000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":110312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:20:15.531 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-12T09:20:15.531 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-12T09:20:15.532 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-12T09:20:15.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-12T09:20:15.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.771+0000 7f76cabbe640 1 Processor -- start 2023-12-12T09:20:15.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.771+0000 7f76cabbe640 1 -- start start 2023-12-12T09:20:15.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.773+0000 7f76cabbe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f76c4070230 0x7f76c40b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.773+0000 7f76cabbe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76c40706c0 0x7f76c40b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.773+0000 7f76cabbe640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c415bbf0 con 0x7f76c4144710 2023-12-12T09:20:15.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.773+0000 7f76cabbe640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c4144af0 con 0x7f76c40706c0 2023-12-12T09:20:15.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.773+0000 7f76cabbe640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c4070bf0 con 0x7f76c4070230 2023-12-12T09:20:15.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.773+0000 7f76c915b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f76c40706c0 0x7f76c40b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.773+0000 7f76c895a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f76c4144710 0x7f76c415b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50312/0 (socket says 172.21.15.84:50312) 2023-12-12T09:20:15.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.773+0000 7f76c895a640 1 -- 172.21.15.84:0/4118034862 learned_addr learned my addr 172.21.15.84:0/4118034862 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:15.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.774+0000 7f76c3fff640 1 --2- 172.21.15.84:0/4118034862 >> v2:172.21.15.99:3300/0 conn(0x7f76c4070230 0x7f76c40b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.774+0000 7f76c915b640 1 -- 172.21.15.84:0/4118034862 >> v2:172.21.15.99:3300/0 conn(0x7f76c4070230 msgr2=0x7f76c40b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:15.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.774+0000 7f76c915b640 1 --2- 172.21.15.84:0/4118034862 >> v2:172.21.15.99:3300/0 conn(0x7f76c4070230 0x7f76c40b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.774+0000 7f76c915b640 1 -- 172.21.15.84:0/4118034862 >> v1:172.21.15.84:6789/0 conn(0x7f76c4144710 legacy=0x7f76c415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.774+0000 7f76c915b640 1 -- 172.21.15.84:0/4118034862 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4070ed0 con 0x7f76c40706c0 2023-12-12T09:20:15.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.774+0000 7f76c37fe640 1 -- 172.21.15.84:0/4118034862 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775957166 0 0) 0x7f76b8001110 con 0x7f76c4144710 2023-12-12T09:20:15.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.775+0000 7f76c915b640 1 --2- 172.21.15.84:0/4118034862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40706c0 0x7f76c40b46f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76c40aeac0 tx=0x7f76bc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07efcc8e01363de server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:15.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.775+0000 7f76c37fe640 1 -- 172.21.15.84:0/4118034862 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc02cbf0 con 0x7f76c40706c0 2023-12-12T09:20:15.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.775+0000 7f76c37fe640 1 -- 172.21.15.84:0/4118034862 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc02cd50 con 0x7f76c40706c0 2023-12-12T09:20:15.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.775+0000 7f76c37fe640 1 -- 172.21.15.84:0/4118034862 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc034660 con 0x7f76c40706c0 2023-12-12T09:20:15.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.776+0000 7f76cabbe640 1 -- 172.21.15.84:0/4118034862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40706c0 msgr2=0x7f76c40b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.776+0000 7f76cabbe640 1 --2- 172.21.15.84:0/4118034862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40706c0 0x7f76c40b46f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76c40aeac0 tx=0x7f76bc02be40 comp rx=0 tx=0).stop 2023-12-12T09:20:15.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.776+0000 7f76cabbe640 1 -- 172.21.15.84:0/4118034862 shutdown_connections 2023-12-12T09:20:15.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.776+0000 7f76cabbe640 1 --2- 172.21.15.84:0/4118034862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c40706c0 0x7f76c40b46f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.776+0000 7f76cabbe640 1 --2- 172.21.15.84:0/4118034862 >> v2:172.21.15.99:3300/0 conn(0x7f76c4070230 0x7f76c40b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.776+0000 7f76cabbe640 1 -- 172.21.15.84:0/4118034862 >> 172.21.15.84:0/4118034862 conn(0x7f76c406c560 msgr2=0x7f76c406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:15.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.776+0000 7f76cabbe640 1 -- 172.21.15.84:0/4118034862 shutdown_connections 2023-12-12T09:20:15.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.776+0000 7f76cabbe640 1 -- 172.21.15.84:0/4118034862 wait complete. 2023-12-12T09:20:15.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.778+0000 7f76cabbe640 1 Processor -- start 2023-12-12T09:20:15.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.778+0000 7f76cabbe640 1 -- start start 2023-12-12T09:20:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76cabbe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4070230 0x7f76c413fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76cabbe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f76c40706c0 0x7f76c4141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76cabbe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c4144710 0x7f76c415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76cabbe640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4142310 con 0x7f76c4070230 2023-12-12T09:20:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76cabbe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c415abb0 con 0x7f76c4144710 2023-12-12T09:20:15.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76cabbe640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4140440 con 0x7f76c40706c0 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c895a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4070230 0x7f76c413fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c895a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4070230 0x7f76c413fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34812/0 (socket says 172.21.15.84:34812) 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c895a640 1 -- 172.21.15.84:0/3439273807 learned_addr learned my addr 172.21.15.84:0/3439273807 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c3fff640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f76c40706c0 0x7f76c4141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c895a640 1 -- 172.21.15.84:0/3439273807 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f76c40706c0 msgr2=0x7f76c4141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c895a640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f76c40706c0 0x7f76c4141dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c895a640 1 -- 172.21.15.84:0/3439273807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c4144710 msgr2=0x7f76c415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c895a640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c4144710 0x7f76c415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.780+0000 7f76c895a640 1 -- 172.21.15.84:0/3439273807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc009a70 con 0x7f76c4070230 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.781+0000 7f76c895a640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4070230 0x7f76c413fdf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c430 tx=0x7f76b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.781+0000 7f76c17fa640 1 -- 172.21.15.84:0/3439273807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80074e0 con 0x7f76c4070230 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.781+0000 7f76c17fa640 1 -- 172.21.15.84:0/3439273807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b8007660 con 0x7f76c4070230 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.781+0000 7f76c17fa640 1 -- 172.21.15.84:0/3439273807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8004a20 con 0x7f76c4070230 2023-12-12T09:20:15.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.781+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c4140720 con 0x7f76c4070230 2023-12-12T09:20:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.781+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c4140ce0 con 0x7f76c4070230 2023-12-12T09:20:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.782+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c40743d0 con 0x7f76c4070230 2023-12-12T09:20:15.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.783+0000 7f76c17fa640 1 -- 172.21.15.84:0/3439273807 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76b8004b80 con 0x7f76c4070230 2023-12-12T09:20:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.784+0000 7f76c17fa640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f76a806ae70 0x7f76a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.784+0000 7f76c17fa640 1 -- 172.21.15.84:0/3439273807 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76b8089620 con 0x7f76c4070230 2023-12-12T09:20:15.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.784+0000 7f76c3fff640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f76a806ae70 0x7f76a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:15.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.785+0000 7f76c3fff640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f76a806ae70 0x7f76a806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f76c41f65f0 tx=0x7f76b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:15.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.788+0000 7f76c17fa640 1 -- 172.21.15.84:0/3439273807 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76b8054340 con 0x7f76c4070230 2023-12-12T09:20:16.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:15.999+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f76c415bbf0 con 0x7f76c4070230 2023-12-12T09:20:16.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.000+0000 7f76c17fa640 1 -- 172.21.15.84:0/3439273807 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f76c415bbf0 con 0x7f76c4070230 2023-12-12T09:20:16.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:16.002 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-12T09:20:16.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f76a806ae70 msgr2=0x7f76a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f76a806ae70 0x7f76a806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f76c41f65f0 tx=0x7f76b0008040 comp rx=0 tx=0).stop 2023-12-12T09:20:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4070230 msgr2=0x7f76c413fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4070230 0x7f76c413fdf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c430 tx=0x7f76b800c8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 shutdown_connections 2023-12-12T09:20:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76c4144710 0x7f76c415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f76c40706c0 0x7f76c4141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f76a806ae70 0x7f76a806d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.002+0000 7f76cabbe640 1 --2- 172.21.15.84:0/3439273807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76c4070230 0x7f76c413fdf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.003+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 >> 172.21.15.84:0/3439273807 conn(0x7f76c406c560 msgr2=0x7f76c40adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:16.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.003+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 shutdown_connections 2023-12-12T09:20:16.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.003+0000 7f76cabbe640 1 -- 172.21.15.84:0/3439273807 wait complete. 2023-12-12T09:20:16.023 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-12T09:20:16.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:16.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.229+0000 7ff91d6d1640 1 Processor -- start 2023-12-12T09:20:16.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.229+0000 7ff91d6d1640 1 -- start start 2023-12-12T09:20:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.230+0000 7ff91d6d1640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff9180cff90 0x7ff9180d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff91d6d1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9180d1470 0x7ff9180b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff91d6d1640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9180b6460 con 0x7ff91815d130 2023-12-12T09:20:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff91d6d1640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91815d510 con 0x7ff9180d1470 2023-12-12T09:20:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff91d6d1640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180d18c0 con 0x7ff9180cff90 2023-12-12T09:20:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff917fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff91815d130 0x7ff9180cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39404/0 (socket says 172.21.15.84:39404) 2023-12-12T09:20:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff917fff640 1 -- 172.21.15.84:0/2451144834 learned_addr learned my addr 172.21.15.84:0/2451144834 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff91ced0640 1 --2- 172.21.15.84:0/2451144834 >> v2:172.21.15.84:3300/0 conn(0x7ff9180d1470 0x7ff9180b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff9177fe640 1 --2- 172.21.15.84:0/2451144834 >> v2:172.21.15.99:3300/0 conn(0x7ff9180cff90 0x7ff9180d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff916ffd640 1 -- 172.21.15.84:0/2451144834 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517192549 0 0) 0x7ff9180b6460 con 0x7ff91815d130 2023-12-12T09:20:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff916ffd640 1 -- 172.21.15.84:0/2451144834 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff904003520 con 0x7ff91815d130 2023-12-12T09:20:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff91ced0640 1 -- 172.21.15.84:0/2451144834 >> v2:172.21.15.99:3300/0 conn(0x7ff9180cff90 msgr2=0x7ff9180d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.231+0000 7ff91ced0640 1 --2- 172.21.15.84:0/2451144834 >> v2:172.21.15.99:3300/0 conn(0x7ff9180cff90 0x7ff9180d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.232+0000 7ff91ced0640 1 -- 172.21.15.84:0/2451144834 >> v1:172.21.15.84:6789/0 conn(0x7ff91815d130 legacy=0x7ff9180cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.232+0000 7ff91ced0640 1 -- 172.21.15.84:0/2451144834 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180d1b50 con 0x7ff9180d1470 2023-12-12T09:20:16.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.233+0000 7ff91ced0640 1 --2- 172.21.15.84:0/2451144834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180d1470 0x7ff9180b68f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9180d2b10 tx=0x7ff91002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e646cbe54ad0dd89 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:16.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.233+0000 7ff916ffd640 1 -- 172.21.15.84:0/2451144834 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91002cc80 con 0x7ff9180d1470 2023-12-12T09:20:16.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.233+0000 7ff916ffd640 1 -- 172.21.15.84:0/2451144834 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91002cde0 con 0x7ff9180d1470 2023-12-12T09:20:16.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.233+0000 7ff916ffd640 1 -- 172.21.15.84:0/2451144834 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff910034640 con 0x7ff9180d1470 2023-12-12T09:20:16.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.233+0000 7ff91d6d1640 1 -- 172.21.15.84:0/2451144834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180d1470 msgr2=0x7ff9180b68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.233+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/2451144834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180d1470 0x7ff9180b68f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9180d2b10 tx=0x7ff91002bed0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.234+0000 7ff91d6d1640 1 -- 172.21.15.84:0/2451144834 shutdown_connections 2023-12-12T09:20:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.234+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/2451144834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180d1470 0x7ff9180b68f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.234+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/2451144834 >> v2:172.21.15.99:3300/0 conn(0x7ff9180cff90 0x7ff9180d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.234+0000 7ff91d6d1640 1 -- 172.21.15.84:0/2451144834 >> 172.21.15.84:0/2451144834 conn(0x7ff9180d2e90 msgr2=0x7ff9180d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.234+0000 7ff91d6d1640 1 -- 172.21.15.84:0/2451144834 shutdown_connections 2023-12-12T09:20:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.234+0000 7ff91d6d1640 1 -- 172.21.15.84:0/2451144834 wait complete. 2023-12-12T09:20:16.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.235+0000 7ff91d6d1640 1 Processor -- start 2023-12-12T09:20:16.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.236+0000 7ff91d6d1640 1 -- start start 2023-12-12T09:20:16.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.236+0000 7ff91d6d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180cff90 0x7ff918150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.236+0000 7ff91d6d1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9180d1470 0x7ff9180c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff91d6d1640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff91815d130 0x7ff91806c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff91d6d1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c88a0 con 0x7ff9180cff90 2023-12-12T09:20:16.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff91d6d1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c8b80 con 0x7ff9180d1470 2023-12-12T09:20:16.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff91d6d1640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c8e60 con 0x7ff91815d130 2023-12-12T09:20:16.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff917fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180cff90 0x7ff918150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff917fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180cff90 0x7ff918150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41072/0 (socket says 172.21.15.84:41072) 2023-12-12T09:20:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff917fff640 1 -- 172.21.15.84:0/1566809851 learned_addr learned my addr 172.21.15.84:0/1566809851 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff9177fe640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9180d1470 0x7ff9180c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff91ced0640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff91815d130 0x7ff91806c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff917fff640 1 -- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff91815d130 msgr2=0x7ff91806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff917fff640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff91815d130 0x7ff91806c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff917fff640 1 -- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9180d1470 msgr2=0x7ff9180c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff917fff640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9180d1470 0x7ff9180c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff917fff640 1 -- 172.21.15.84:0/1566809851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910009a70 con 0x7ff9180cff90 2023-12-12T09:20:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.237+0000 7ff9177fe640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9180d1470 0x7ff9180c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.238+0000 7ff917fff640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180cff90 0x7ff918150400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c390 tx=0x7ff90800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.238+0000 7ff914ff9640 1 -- 172.21.15.84:0/1566809851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908005ce0 con 0x7ff9180cff90 2023-12-12T09:20:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.238+0000 7ff914ff9640 1 -- 172.21.15.84:0/1566809851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908005e40 con 0x7ff9180cff90 2023-12-12T09:20:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.238+0000 7ff914ff9640 1 -- 172.21.15.84:0/1566809851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080072f0 con 0x7ff9180cff90 2023-12-12T09:20:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.238+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9180c9140 con 0x7ff9180cff90 2023-12-12T09:20:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.238+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180c84e0 con 0x7ff9180cff90 2023-12-12T09:20:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.239+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9180673c0 con 0x7ff9180cff90 2023-12-12T09:20:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.240+0000 7ff914ff9640 1 -- 172.21.15.84:0/1566809851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff908007450 con 0x7ff9180cff90 2023-12-12T09:20:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.241+0000 7ff914ff9640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff8f806ae40 0x7ff8f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.241+0000 7ff914ff9640 1 -- 172.21.15.84:0/1566809851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff908088e90 con 0x7ff9180cff90 2023-12-12T09:20:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.241+0000 7ff9177fe640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff8f806ae40 0x7ff8f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.242+0000 7ff9177fe640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff8f806ae40 0x7ff8f806d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff9180cd470 tx=0x7ff900008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.246+0000 7ff914ff9640 1 -- 172.21.15.84:0/1566809851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff908053ce0 con 0x7ff9180cff90 2023-12-12T09:20:16.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.435+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff918159d30 con 0x7ff9180cff90 2023-12-12T09:20:16.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.437+0000 7ff914ff9640 1 -- 172.21.15.84:0/1566809851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7ff908017020 con 0x7ff9180cff90 2023-12-12T09:20:16.440 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:16.440 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:16.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff8f806ae40 msgr2=0x7ff8f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff8f806ae40 0x7ff8f806d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff9180cd470 tx=0x7ff900008040 comp rx=0 tx=0).stop 2023-12-12T09:20:16.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180cff90 msgr2=0x7ff918150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180cff90 0x7ff918150400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff90800c390 tx=0x7ff90800c850 comp rx=0 tx=0).stop 2023-12-12T09:20:16.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 shutdown_connections 2023-12-12T09:20:16.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff91815d130 0x7ff91806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9180d1470 0x7ff9180c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff8f806ae40 0x7ff8f806d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 --2- 172.21.15.84:0/1566809851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9180cff90 0x7ff918150400 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.440+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 >> 172.21.15.84:0/1566809851 conn(0x7ff9180d2e90 msgr2=0x7ff9180b83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:16.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.441+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 shutdown_connections 2023-12-12T09:20:16.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.441+0000 7ff91d6d1640 1 -- 172.21.15.84:0/1566809851 wait complete. 2023-12-12T09:20:16.461 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:16.461 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:16.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.676+0000 7fc9c066b640 1 Processor -- start 2023-12-12T09:20:16.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.676+0000 7fc9c066b640 1 -- start start 2023-12-12T09:20:16.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.677+0000 7fc9c066b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9b806d430 0x7fc9b806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.677+0000 7fc9c066b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 0x7fc9b80b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.677+0000 7fc9c066b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b8071c00 con 0x7fc9b8143860 2023-12-12T09:20:16.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.677+0000 7fc9c066b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b806ddb0 con 0x7fc9b806d430 2023-12-12T09:20:16.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.677+0000 7fc9c066b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8143c40 con 0x7fc9b80b1dc0 2023-12-12T09:20:16.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9be407640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc9b8143860 0x7fc9b80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39410/0 (socket says 172.21.15.84:39410) 2023-12-12T09:20:16.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9be407640 1 -- 172.21.15.84:0/1902671445 learned_addr learned my addr 172.21.15.84:0/1902671445 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:16.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9bdc06640 1 --2- 172.21.15.84:0/1902671445 >> v2:172.21.15.84:3300/0 conn(0x7fc9b806d430 0x7fc9b806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9bd405640 1 -- 172.21.15.84:0/1902671445 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266335229 0 0) 0x7fc9b8071c00 con 0x7fc9b8143860 2023-12-12T09:20:16.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9bd405640 1 -- 172.21.15.84:0/1902671445 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a4003520 con 0x7fc9b8143860 2023-12-12T09:20:16.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9bec08640 1 --2- 172.21.15.84:0/1902671445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 0x7fc9b80b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9bdc06640 1 -- 172.21.15.84:0/1902671445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 msgr2=0x7fc9b80b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:16.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9bdc06640 1 --2- 172.21.15.84:0/1902671445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 0x7fc9b80b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9bdc06640 1 -- 172.21.15.84:0/1902671445 >> v1:172.21.15.84:6789/0 conn(0x7fc9b8143860 legacy=0x7fc9b80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.678+0000 7fc9bd405640 1 -- 172.21.15.84:0/1902671445 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486681271 0 0) 0x7fc9a4003520 con 0x7fc9b8143860 2023-12-12T09:20:16.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.679+0000 7fc9bdc06640 1 -- 172.21.15.84:0/1902671445 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80b4780 con 0x7fc9b806d430 2023-12-12T09:20:16.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.680+0000 7fc9bdc06640 1 --2- 172.21.15.84:0/1902671445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b806d430 0x7fc9b806d870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0097a0 tx=0x7fc9ac02b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a1046f65d217a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:16.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.680+0000 7fc9bd405640 1 -- 172.21.15.84:0/1902671445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4001670 con 0x7fc9b806d430 2023-12-12T09:20:16.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.680+0000 7fc9bd405640 1 -- 172.21.15.84:0/1902671445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac02e050 con 0x7fc9b806d430 2023-12-12T09:20:16.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.680+0000 7fc9bd405640 1 -- 172.21.15.84:0/1902671445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac030730 con 0x7fc9b806d430 2023-12-12T09:20:16.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.680+0000 7fc9c066b640 1 -- 172.21.15.84:0/1902671445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b806d430 msgr2=0x7fc9b806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.680+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1902671445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b806d430 0x7fc9b806d870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0097a0 tx=0x7fc9ac02b660 comp rx=0 tx=0).stop 2023-12-12T09:20:16.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.681+0000 7fc9c066b640 1 -- 172.21.15.84:0/1902671445 shutdown_connections 2023-12-12T09:20:16.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.681+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1902671445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 0x7fc9b80b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.681+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1902671445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b806d430 0x7fc9b806d870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.681+0000 7fc9c066b640 1 -- 172.21.15.84:0/1902671445 >> 172.21.15.84:0/1902671445 conn(0x7fc9b80b0ac0 msgr2=0x7fc9b80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:16.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.681+0000 7fc9c066b640 1 -- 172.21.15.84:0/1902671445 shutdown_connections 2023-12-12T09:20:16.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.681+0000 7fc9c066b640 1 -- 172.21.15.84:0/1902671445 wait complete. 2023-12-12T09:20:16.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.682+0000 7fc9c066b640 1 Processor -- start 2023-12-12T09:20:16.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.683+0000 7fc9c066b640 1 -- start start 2023-12-12T09:20:16.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.683+0000 7fc9c066b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9b806d430 0x7fc9b8159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9c066b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 0x7fc9b81f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9c066b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b8143860 0x7fc9b813bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9c066b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b813aeb0 con 0x7fc9b8143860 2023-12-12T09:20:16.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9c066b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b81f3a30 con 0x7fc9b806d430 2023-12-12T09:20:16.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9c066b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8139700 con 0x7fc9b80b1dc0 2023-12-12T09:20:16.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b8143860 0x7fc9b813bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b8143860 0x7fc9b813bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41090/0 (socket says 172.21.15.84:41090) 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 -- 172.21.15.84:0/1400245095 learned_addr learned my addr 172.21.15.84:0/1400245095 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bdc06640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 0x7fc9b81f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 -- 172.21.15.84:0/1400245095 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 msgr2=0x7fc9b81f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9be407640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9b806d430 0x7fc9b8159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 0x7fc9b81f34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 -- 172.21.15.84:0/1400245095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9b806d430 msgr2=0x7fc9b8159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9b806d430 0x7fc9b8159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 -- 172.21.15.84:0/1400245095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac009400 con 0x7fc9b8143860 2023-12-12T09:20:16.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.684+0000 7fc9bec08640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b8143860 0x7fc9b813bbc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0007e60 tx=0x7fc9b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:16.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.685+0000 7fc9aaffd640 1 -- 172.21.15.84:0/1400245095 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0014420 con 0x7fc9b8143860 2023-12-12T09:20:16.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.685+0000 7fc9aaffd640 1 -- 172.21.15.84:0/1400245095 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b00145a0 con 0x7fc9b8143860 2023-12-12T09:20:16.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.685+0000 7fc9aaffd640 1 -- 172.21.15.84:0/1400245095 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0014950 con 0x7fc9b8143860 2023-12-12T09:20:16.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.685+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b813b0e0 con 0x7fc9b8143860 2023-12-12T09:20:16.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.685+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b813b6a0 con 0x7fc9b8143860 2023-12-12T09:20:16.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.686+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b813b8c0 con 0x7fc9b8143860 2023-12-12T09:20:16.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.687+0000 7fc9aaffd640 1 -- 172.21.15.84:0/1400245095 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9b0014ab0 con 0x7fc9b8143860 2023-12-12T09:20:16.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.688+0000 7fc9aaffd640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc99c06ae40 0x7fc99c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:16.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.689+0000 7fc9aaffd640 1 -- 172.21.15.84:0/1400245095 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9b008a250 con 0x7fc9b8143860 2023-12-12T09:20:16.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.689+0000 7fc9be407640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc99c06ae40 0x7fc99c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:16.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.689+0000 7fc9be407640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc99c06ae40 0x7fc99c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001eb0 tx=0x7fc9b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:16.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.693+0000 7fc9aaffd640 1 -- 172.21.15.84:0/1400245095 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9b0055010 con 0x7fc9b8143860 2023-12-12T09:20:16.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.880+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9b80673c0 con 0x7fc9b8143860 2023-12-12T09:20:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.881+0000 7fc9aaffd640 1 -- 172.21.15.84:0/1400245095 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9b0058630 con 0x7fc9b8143860 2023-12-12T09:20:16.882 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc99c06ae40 msgr2=0x7fc99c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc99c06ae40 0x7fc99c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4001eb0 tx=0x7fc9b4009040 comp rx=0 tx=0).stop 2023-12-12T09:20:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b8143860 msgr2=0x7fc9b813bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b8143860 0x7fc9b813bbc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0007e60 tx=0x7fc9b000e4b0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 shutdown_connections 2023-12-12T09:20:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc99c06ae40 0x7fc99c06d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9b8143860 0x7fc9b813bbc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9b80b1dc0 0x7fc9b81f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 --2- 172.21.15.84:0/1400245095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9b806d430 0x7fc9b8159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.883+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 >> 172.21.15.84:0/1400245095 conn(0x7fc9b80b0ac0 msgr2=0x7fc9b815ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.884+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 shutdown_connections 2023-12-12T09:20:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:16.884+0000 7fc9c066b640 1 -- 172.21.15.84:0/1400245095 wait complete. 2023-12-12T09:20:16.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:17.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.118+0000 7fa24dbb0640 1 Processor -- start 2023-12-12T09:20:17.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.119+0000 7fa24dbb0640 1 -- start start 2023-12-12T09:20:17.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.120+0000 7fa24dbb0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa248146ac0 0x7fa2480b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.120+0000 7fa24dbb0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2480b3280 0x7fa24815e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.120+0000 7fa24dbb0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa24806beb0 0x7fa24806c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.120+0000 7fa24dbb0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24806c880 con 0x7fa2480b3280 2023-12-12T09:20:17.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.120+0000 7fa24dbb0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480b3700 con 0x7fa24806beb0 2023-12-12T09:20:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.120+0000 7fa24dbb0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24815e670 con 0x7fa248146ac0 2023-12-12T09:20:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa246ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2480b3280 0x7fa24815e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa246ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa2480b3280 0x7fa24815e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41098/0 (socket says 172.21.15.84:41098) 2023-12-12T09:20:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa246ffd640 1 -- 172.21.15.84:0/1497589823 learned_addr learned my addr 172.21.15.84:0/1497589823 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa2477fe640 1 --2- 172.21.15.84:0/1497589823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa248146ac0 0x7fa2480b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa247fff640 1 --2- 172.21.15.84:0/1497589823 >> v2:172.21.15.99:3300/0 conn(0x7fa24806beb0 0x7fa24806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa246ffd640 1 -- 172.21.15.84:0/1497589823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa248146ac0 msgr2=0x7fa2480b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:17.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa246ffd640 1 --2- 172.21.15.84:0/1497589823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa248146ac0 0x7fa2480b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa246ffd640 1 -- 172.21.15.84:0/1497589823 >> v2:172.21.15.99:3300/0 conn(0x7fa24806beb0 msgr2=0x7fa24806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:17.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa246ffd640 1 --2- 172.21.15.84:0/1497589823 >> v2:172.21.15.99:3300/0 conn(0x7fa24806beb0 0x7fa24806c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.121+0000 7fa246ffd640 1 -- 172.21.15.84:0/1497589823 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480b21e0 con 0x7fa2480b3280 2023-12-12T09:20:17.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.122+0000 7fa246ffd640 1 --2- 172.21.15.84:0/1497589823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2480b3280 0x7fa24815e130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa2480ae390 tx=0x7fa23002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6065ae426591d033 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:17.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa2467fc640 1 -- 172.21.15.84:0/1497589823 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23002ca70 con 0x7fa2480b3280 2023-12-12T09:20:17.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa2467fc640 1 -- 172.21.15.84:0/1497589823 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23002cbd0 con 0x7fa2480b3280 2023-12-12T09:20:17.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa2467fc640 1 -- 172.21.15.84:0/1497589823 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300343f0 con 0x7fa2480b3280 2023-12-12T09:20:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa24dbb0640 1 -- 172.21.15.84:0/1497589823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2480b3280 msgr2=0x7fa24815e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/1497589823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2480b3280 0x7fa24815e130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa2480ae390 tx=0x7fa23002bed0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa24dbb0640 1 -- 172.21.15.84:0/1497589823 shutdown_connections 2023-12-12T09:20:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/1497589823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2480b3280 0x7fa24815e130 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/1497589823 >> v2:172.21.15.99:3300/0 conn(0x7fa24806beb0 0x7fa24806c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/1497589823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa248146ac0 0x7fa2480b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.123+0000 7fa24dbb0640 1 -- 172.21.15.84:0/1497589823 >> 172.21.15.84:0/1497589823 conn(0x7fa2480b0900 msgr2=0x7fa2480b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.124+0000 7fa24dbb0640 1 -- 172.21.15.84:0/1497589823 shutdown_connections 2023-12-12T09:20:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.124+0000 7fa24dbb0640 1 -- 172.21.15.84:0/1497589823 wait complete. 2023-12-12T09:20:17.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.125+0000 7fa24dbb0640 1 Processor -- start 2023-12-12T09:20:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.125+0000 7fa24dbb0640 1 -- start start 2023-12-12T09:20:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.126+0000 7fa24dbb0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa24806beb0 0x7fa248142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.126+0000 7fa24dbb0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2480b3280 0x7fa24809c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.126+0000 7fa24dbb0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa248146ac0 0x7fa248144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.126+0000 7fa24dbb0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248144090 con 0x7fa24806beb0 2023-12-12T09:20:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.126+0000 7fa24dbb0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24809c850 con 0x7fa248146ac0 2023-12-12T09:20:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.126+0000 7fa24dbb0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa248143480 con 0x7fa2480b3280 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa24806beb0 0x7fa248142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa24806beb0 0x7fa248142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41114/0 (socket says 172.21.15.84:41114) 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 -- 172.21.15.84:0/2604268753 learned_addr learned my addr 172.21.15.84:0/2604268753 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa246ffd640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2480b3280 0x7fa24809c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa247fff640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa248146ac0 0x7fa248144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 -- 172.21.15.84:0/2604268753 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2480b3280 msgr2=0x7fa24809c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2480b3280 0x7fa24809c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 -- 172.21.15.84:0/2604268753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa248146ac0 msgr2=0x7fa248144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa248146ac0 0x7fa248144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 -- 172.21.15.84:0/2604268753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230009b30 con 0x7fa24806beb0 2023-12-12T09:20:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.127+0000 7fa2477fe640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa24806beb0 0x7fa248142df0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa23800d5f0 tx=0x7fa23800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.128+0000 7fa23ffff640 1 -- 172.21.15.84:0/2604268753 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380125f0 con 0x7fa24806beb0 2023-12-12T09:20:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.128+0000 7fa23ffff640 1 -- 172.21.15.84:0/2604268753 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa238012750 con 0x7fa24806beb0 2023-12-12T09:20:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.128+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248143760 con 0x7fa24806beb0 2023-12-12T09:20:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.128+0000 7fa23ffff640 1 -- 172.21.15.84:0/2604268753 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238012b00 con 0x7fa24806beb0 2023-12-12T09:20:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.128+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248143d20 con 0x7fa24806beb0 2023-12-12T09:20:17.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.129+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2480673c0 con 0x7fa24806beb0 2023-12-12T09:20:17.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.130+0000 7fa23ffff640 1 -- 172.21.15.84:0/2604268753 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa238012c60 con 0x7fa24806beb0 2023-12-12T09:20:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.131+0000 7fa23ffff640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa22806ae70 0x7fa22806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.131+0000 7fa23ffff640 1 -- 172.21.15.84:0/2604268753 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa238089f60 con 0x7fa24806beb0 2023-12-12T09:20:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.131+0000 7fa246ffd640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa22806ae70 0x7fa22806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.132+0000 7fa246ffd640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa22806ae70 0x7fa22806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa230035000 tx=0x7fa230030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:17.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.136+0000 7fa23ffff640 1 -- 172.21.15.84:0/2604268753 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa238054bf0 con 0x7fa24806beb0 2023-12-12T09:20:17.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.318+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2480b3d70 con 0x7fa24806beb0 2023-12-12T09:20:17.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.318+0000 7fa23ffff640 1 -- 172.21.15.84:0/2604268753 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa238058210 con 0x7fa24806beb0 2023-12-12T09:20:17.320 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:17.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa22806ae70 msgr2=0x7fa22806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa22806ae70 0x7fa22806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa230035000 tx=0x7fa230030000 comp rx=0 tx=0).stop 2023-12-12T09:20:17.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa24806beb0 msgr2=0x7fa248142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa24806beb0 0x7fa248142df0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa23800d5f0 tx=0x7fa23800dab0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 shutdown_connections 2023-12-12T09:20:17.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa248146ac0 0x7fa248144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa2480b3280 0x7fa24809c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa22806ae70 0x7fa22806d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 --2- 172.21.15.84:0/2604268753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa24806beb0 0x7fa248142df0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 >> 172.21.15.84:0/2604268753 conn(0x7fa2480b0900 msgr2=0x7fa248160180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:17.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 shutdown_connections 2023-12-12T09:20:17.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.321+0000 7fa24dbb0640 1 -- 172.21.15.84:0/2604268753 wait complete. 2023-12-12T09:20:17.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:17.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.545+0000 7fa6e90b4640 1 Processor -- start 2023-12-12T09:20:17.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.545+0000 7fa6e90b4640 1 -- start start 2023-12-12T09:20:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.546+0000 7fa6e90b4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa6e414af70 0x7fa6e40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.546+0000 7fa6e90b4640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e4070730 con 0x7fa6e406db40 2023-12-12T09:20:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.546+0000 7fa6e90b4640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e40b1f60 con 0x7fa6e414a4a0 2023-12-12T09:20:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.547+0000 7fa6e90b4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e414a880 con 0x7fa6e414af70 2023-12-12T09:20:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.547+0000 7fa6dbfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa6e406db40 0x7fa6e4070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39416/0 (socket says 172.21.15.84:39416) 2023-12-12T09:20:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.547+0000 7fa6dbfff640 1 -- 172.21.15.84:0/3343222865 learned_addr learned my addr 172.21.15.84:0/3343222865 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.547+0000 7fa6e359e640 1 --2- 172.21.15.84:0/3343222865 >> v2:172.21.15.99:3300/0 conn(0x7fa6e414af70 0x7fa6e40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.547+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668021311 0 0) 0x7fa6e4070730 con 0x7fa6e406db40 2023-12-12T09:20:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.547+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d0003520 con 0x7fa6e406db40 2023-12-12T09:20:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568276131 0 0) 0x7fa6d0003520 con 0x7fa6e406db40 2023-12-12T09:20:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 >> v2:172.21.15.99:3300/0 conn(0x7fa6e414af70 msgr2=0x7fa6e40712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 --2- 172.21.15.84:0/3343222865 >> v2:172.21.15.99:3300/0 conn(0x7fa6e414af70 0x7fa6e40712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 >> v1:172.21.15.99:6789/0 conn(0x7fa6e414a4a0 legacy=0x7fa6e406d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e40700e0 con 0x7fa6e406db40 2023-12-12T09:20:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa6cc001670 con 0x7fa6e406db40 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 >> v1:172.21.15.84:6789/0 conn(0x7fa6e406db40 legacy=0x7fa6e4070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d0003970 0x7fa6d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6d00047c0 0x7fa6d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d00052a0 0x7fa6d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e414a880 con 0x7fa6d00052a0 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d000c170 con 0x7fa6d00047c0 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d000c330 con 0x7fa6d0003970 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e359e640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d00052a0 0x7fa6d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.548+0000 7fa6e2d9d640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d0003970 0x7fa6d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.549+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6d00047c0 0x7fa6d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.549+0000 7fa6e359e640 1 -- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d0003970 msgr2=0x7fa6d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.549+0000 7fa6e359e640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d0003970 0x7fa6d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.549+0000 7fa6e359e640 1 -- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6d00047c0 msgr2=0x7fa6d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.549+0000 7fa6e359e640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6d00047c0 0x7fa6d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.549+0000 7fa6e359e640 1 -- 172.21.15.84:0/3343222865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d0003520 con 0x7fa6d00052a0 2023-12-12T09:20:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.549+0000 7fa6e2d9d640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d0003970 0x7fa6d0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.549+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6d00047c0 0x7fa6d0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.550+0000 7fa6e359e640 1 -- 172.21.15.84:0/3343222865 reap_dead start 2023-12-12T09:20:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.550+0000 7fa6e359e640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d00052a0 0x7fa6d000b980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009f90 tx=0x7fa6d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa5835be6106994 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.550+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc02cc20 con 0x7fa6d00052a0 2023-12-12T09:20:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.550+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc00f040 con 0x7fa6d00052a0 2023-12-12T09:20:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.550+0000 7fa6e259c640 1 -- 172.21.15.84:0/3343222865 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc003990 con 0x7fa6d00052a0 2023-12-12T09:20:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.550+0000 7fa6e90b4640 1 -- 172.21.15.84:0/3343222865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d00052a0 msgr2=0x7fa6d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.550+0000 7fa6e90b4640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d00052a0 0x7fa6d000b980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009f90 tx=0x7fa6d00057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.551+0000 7fa6e90b4640 1 -- 172.21.15.84:0/3343222865 shutdown_connections 2023-12-12T09:20:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.551+0000 7fa6e90b4640 1 --2- 172.21.15.84:0/3343222865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6d00052a0 0x7fa6d000b980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.551+0000 7fa6e90b4640 1 -- 172.21.15.84:0/3343222865 >> 172.21.15.84:0/3343222865 conn(0x7fa6e40b0ac0 msgr2=0x7fa6e40b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.551+0000 7fa6e90b4640 1 -- 172.21.15.84:0/3343222865 shutdown_connections 2023-12-12T09:20:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.551+0000 7fa6e90b4640 1 -- 172.21.15.84:0/3343222865 wait complete. 2023-12-12T09:20:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.552+0000 7fa6e90b4640 1 Processor -- start 2023-12-12T09:20:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.553+0000 7fa6e90b4640 1 -- start start 2023-12-12T09:20:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.553+0000 7fa6e90b4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d00052a0 0x7fa6e415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.553+0000 7fa6e90b4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6e415d960 0x7fa6e4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e90b4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e41593d0 0x7fa6e41fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e90b4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4159850 con 0x7fa6e41593d0 2023-12-12T09:20:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e90b4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e415aec0 con 0x7fa6e415d960 2023-12-12T09:20:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e90b4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e415b1a0 con 0x7fa6d00052a0 2023-12-12T09:20:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e41593d0 0x7fa6e41fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e41593d0 0x7fa6e41fa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41128/0 (socket says 172.21.15.84:41128) 2023-12-12T09:20:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e359e640 1 -- 172.21.15.84:0/2218961571 learned_addr learned my addr 172.21.15.84:0/2218961571 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e2d9d640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d00052a0 0x7fa6e415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6e415d960 0x7fa6e4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e359e640 1 -- 172.21.15.84:0/2218961571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d00052a0 msgr2=0x7fa6e415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e359e640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d00052a0 0x7fa6e415cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e359e640 1 -- 172.21.15.84:0/2218961571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6e415d960 msgr2=0x7fa6e4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e359e640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6e415d960 0x7fa6e4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.554+0000 7fa6e359e640 1 -- 172.21.15.84:0/2218961571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e413a4b0 con 0x7fa6e41593d0 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.555+0000 7fa6e359e640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e41593d0 0x7fa6e41fa1d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc02c690 tx=0x7fa6dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.555+0000 7fa6db7fe640 1 -- 172.21.15.84:0/2218961571 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc035ee0 con 0x7fa6e41593d0 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.555+0000 7fa6db7fe640 1 -- 172.21.15.84:0/2218961571 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc02de20 con 0x7fa6e41593d0 2023-12-12T09:20:17.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.555+0000 7fa6db7fe640 1 -- 172.21.15.84:0/2218961571 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc040690 con 0x7fa6e41593d0 2023-12-12T09:20:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.555+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e4158630 con 0x7fa6e41593d0 2023-12-12T09:20:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.555+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e4158300 con 0x7fa6e41593d0 2023-12-12T09:20:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.556+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e415b310 con 0x7fa6e41593d0 2023-12-12T09:20:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.557+0000 7fa6db7fe640 1 -- 172.21.15.84:0/2218961571 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6dc0407f0 con 0x7fa6e41593d0 2023-12-12T09:20:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.558+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa6c406ae40 0x7fa6c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.559+0000 7fa6db7fe640 1 -- 172.21.15.84:0/2218961571 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa6dc0ac640 con 0x7fa6e41593d0 2023-12-12T09:20:17.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.559+0000 7fa6e2d9d640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa6c406ae40 0x7fa6c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.559+0000 7fa6e2d9d640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa6c406ae40 0x7fa6c406d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4000f60 tx=0x7fa6d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:17.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.563+0000 7fa6db7fe640 1 -- 172.21.15.84:0/2218961571 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6dc077480 con 0x7fa6e41593d0 2023-12-12T09:20:17.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.749+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6e40673c0 con 0x7fa6e41593d0 2023-12-12T09:20:17.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.750+0000 7fa6db7fe640 1 -- 172.21.15.84:0/2218961571 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6dc07aaa0 con 0x7fa6e41593d0 2023-12-12T09:20:17.752 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:17.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.752+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa6c406ae40 msgr2=0x7fa6c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.752+0000 7fa6e90b4640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa6c406ae40 0x7fa6c406d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4000f60 tx=0x7fa6d4009040 comp rx=0 tx=0).stop 2023-12-12T09:20:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.752+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e41593d0 msgr2=0x7fa6e41fa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.752+0000 7fa6e90b4640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e41593d0 0x7fa6e41fa1d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc02c690 tx=0x7fa6dc009750 comp rx=0 tx=0).stop 2023-12-12T09:20:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.753+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 shutdown_connections 2023-12-12T09:20:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.753+0000 7fa6e90b4640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa6c406ae40 0x7fa6c406d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.753+0000 7fa6e90b4640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6e41593d0 0x7fa6e41fa1d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.753+0000 7fa6e90b4640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6e415d960 0x7fa6e4158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.753+0000 7fa6e90b4640 1 --2- 172.21.15.84:0/2218961571 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6d00052a0 0x7fa6e415cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.753+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 >> 172.21.15.84:0/2218961571 conn(0x7fa6e40b0ac0 msgr2=0x7fa6e40cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.753+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 shutdown_connections 2023-12-12T09:20:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.753+0000 7fa6e90b4640 1 -- 172.21.15.84:0/2218961571 wait complete. 2023-12-12T09:20:17.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.990+0000 7f341759e640 1 Processor -- start 2023-12-12T09:20:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.990+0000 7f341759e640 1 -- start start 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341759e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34180b88e0 0x7f34180d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341759e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f34180d1920 0x7f34180cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341759e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3418160cb0 con 0x7f34180cfed0 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341759e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34180cef60 con 0x7f34180b88e0 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341759e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34180d1db0 con 0x7f34180d1920 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34180b88e0 0x7f34180d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f34180b88e0 0x7f34180d13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41134/0 (socket says 172.21.15.84:41134) 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341659c640 1 -- 172.21.15.84:0/1836800932 learned_addr learned my addr 172.21.15.84:0/1836800932 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f3416d9d640 1 --2- 172.21.15.84:0/1836800932 >> v2:172.21.15.99:3300/0 conn(0x7f34180d1920 0x7f34180cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:17.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341659c640 1 -- 172.21.15.84:0/1836800932 >> v2:172.21.15.99:3300/0 conn(0x7f34180d1920 msgr2=0x7f34180cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341659c640 1 --2- 172.21.15.84:0/1836800932 >> v2:172.21.15.99:3300/0 conn(0x7f34180d1920 0x7f34180cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341659c640 1 -- 172.21.15.84:0/1836800932 >> v1:172.21.15.99:6789/0 conn(0x7f34180cfed0 legacy=0x7f34180b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.992+0000 7f341659c640 1 -- 172.21.15.84:0/1836800932 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180b8cc0 con 0x7f34180b88e0 2023-12-12T09:20:17.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.993+0000 7f3416d9d640 1 --2- 172.21.15.84:0/1836800932 >> v2:172.21.15.99:3300/0 conn(0x7f34180d1920 0x7f34180cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.994+0000 7f341659c640 1 --2- 172.21.15.84:0/1836800932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f34180d13e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f34180d10c0 tx=0x7f340802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0bbff5aaa2d914 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.994+0000 7f3415d9b640 1 -- 172.21.15.84:0/1836800932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408030860 con 0x7f34180b88e0 2023-12-12T09:20:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.994+0000 7f3415d9b640 1 -- 172.21.15.84:0/1836800932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34080309c0 con 0x7f34180b88e0 2023-12-12T09:20:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.994+0000 7f3415d9b640 1 -- 172.21.15.84:0/1836800932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408030d50 con 0x7f34180b88e0 2023-12-12T09:20:17.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.995+0000 7f341759e640 1 -- 172.21.15.84:0/1836800932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 msgr2=0x7f34180d13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.995+0000 7f341759e640 1 --2- 172.21.15.84:0/1836800932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f34180d13e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f34180d10c0 tx=0x7f340802b9a0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.995+0000 7f341759e640 1 -- 172.21.15.84:0/1836800932 shutdown_connections 2023-12-12T09:20:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.995+0000 7f341759e640 1 --2- 172.21.15.84:0/1836800932 >> v2:172.21.15.99:3300/0 conn(0x7f34180d1920 0x7f34180cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.995+0000 7f341759e640 1 --2- 172.21.15.84:0/1836800932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f34180d13e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.995+0000 7f341759e640 1 -- 172.21.15.84:0/1836800932 >> 172.21.15.84:0/1836800932 conn(0x7f34180d2e00 msgr2=0x7f34180d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.995+0000 7f341759e640 1 -- 172.21.15.84:0/1836800932 shutdown_connections 2023-12-12T09:20:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.995+0000 7f341759e640 1 -- 172.21.15.84:0/1836800932 wait complete. 2023-12-12T09:20:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.997+0000 7f341759e640 1 Processor -- start 2023-12-12T09:20:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.997+0000 7f341759e640 1 -- start start 2023-12-12T09:20:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f341814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34180cfed0 0x7f34180b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341759e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34180d1920 0x7f34180b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341759e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180b0a70 con 0x7f34180b88e0 2023-12-12T09:20:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341759e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34180b2050 con 0x7f34180cfed0 2023-12-12T09:20:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341759e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34180b1840 con 0x7f34180d1920 2023-12-12T09:20:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f341814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f341814e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41148/0 (socket says 172.21.15.84:41148) 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341659c640 1 -- 172.21.15.84:0/1070231514 learned_addr learned my addr 172.21.15.84:0/1070231514 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f340ffff640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34180cfed0 0x7f34180b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f3416d9d640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34180d1920 0x7f34180b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341659c640 1 -- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34180d1920 msgr2=0x7f34180b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341659c640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34180d1920 0x7f34180b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341659c640 1 -- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34180cfed0 msgr2=0x7f34180b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341659c640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34180cfed0 0x7f34180b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f341659c640 1 -- 172.21.15.84:0/1070231514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080094d0 con 0x7f34180b88e0 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.998+0000 7f3416d9d640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34180d1920 0x7f34180b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.999+0000 7f341659c640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f341814e3e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3408000c00 tx=0x7f3408004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.999+0000 7f340effd640 1 -- 172.21.15.84:0/1070231514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408039b40 con 0x7f34180b88e0 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.999+0000 7f340effd640 1 -- 172.21.15.84:0/1070231514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408039ca0 con 0x7f34180b88e0 2023-12-12T09:20:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.999+0000 7f340effd640 1 -- 172.21.15.84:0/1070231514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408043630 con 0x7f34180b88e0 2023-12-12T09:20:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.999+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34180afe60 con 0x7f34180b88e0 2023-12-12T09:20:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:17.999+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34180b0420 con 0x7f34180b88e0 2023-12-12T09:20:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.000+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341804e840 con 0x7f34180b88e0 2023-12-12T09:20:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.001+0000 7f340effd640 1 -- 172.21.15.84:0/1070231514 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f340802f3b0 con 0x7f34180b88e0 2023-12-12T09:20:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.002+0000 7f340effd640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f33f806ae40 0x7f33f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.002+0000 7f340effd640 1 -- 172.21.15.84:0/1070231514 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f34080abbe0 con 0x7f34180b88e0 2023-12-12T09:20:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.002+0000 7f340ffff640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f33f806ae40 0x7f33f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.003+0000 7f340ffff640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f33f806ae40 0x7f33f806d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3400007fd0 tx=0x7f3400009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.006+0000 7f340effd640 1 -- 172.21.15.84:0/1070231514 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3408076a30 con 0x7f34180b88e0 2023-12-12T09:20:18.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.199+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f34180720e0 con 0x7f34180b88e0 2023-12-12T09:20:18.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.200+0000 7f340effd640 1 -- 172.21.15.84:0/1070231514 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3408048020 con 0x7f34180b88e0 2023-12-12T09:20:18.201 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:18.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f33f806ae40 msgr2=0x7f33f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f33f806ae40 0x7f33f806d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3400007fd0 tx=0x7f3400009040 comp rx=0 tx=0).stop 2023-12-12T09:20:18.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 msgr2=0x7f341814e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f341814e3e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3408000c00 tx=0x7f3408004730 comp rx=0 tx=0).stop 2023-12-12T09:20:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 shutdown_connections 2023-12-12T09:20:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f34180d1920 0x7f34180b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34180cfed0 0x7f34180b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f33f806ae40 0x7f33f806d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 --2- 172.21.15.84:0/1070231514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34180b88e0 0x7f341814e3e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.202+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 >> 172.21.15.84:0/1070231514 conn(0x7f34180d2e00 msgr2=0x7f341815f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.203+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 shutdown_connections 2023-12-12T09:20:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.203+0000 7f341759e640 1 -- 172.21.15.84:0/1070231514 wait complete. 2023-12-12T09:20:18.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:20:18.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.418+0000 7f6e1359e640 1 Processor -- start 2023-12-12T09:20:18.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.419+0000 7f6e1359e640 1 -- start start 2023-12-12T09:20:18.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.420+0000 7f6e1359e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e1415d160 0x7f6e1406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.420+0000 7f6e1359e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 0x7f6e1406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.420+0000 7f6e1359e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1415d870 con 0x7f6e140b3140 2023-12-12T09:20:18.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.420+0000 7f6e1359e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1415e1d0 con 0x7f6e1415d160 2023-12-12T09:20:18.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.420+0000 7f6e1359e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140cd000 con 0x7f6e140706b0 2023-12-12T09:20:18.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.421+0000 7f6e0bfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6e140b3140 0x7f6e14070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39428/0 (socket says 172.21.15.84:39428) 2023-12-12T09:20:18.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.421+0000 7f6e0bfff640 1 -- 172.21.15.84:0/3741145107 learned_addr learned my addr 172.21.15.84:0/3741145107 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:18.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.421+0000 7f6e1259c640 1 --2- 172.21.15.84:0/3741145107 >> v2:172.21.15.99:3300/0 conn(0x7f6e1415d160 0x7f6e1406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.421+0000 7f6e12d9d640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 0x7f6e1406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.421+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068490805 0 0) 0x7f6e1415d870 con 0x7f6e140b3140 2023-12-12T09:20:18.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.421+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e00003520 con 0x7f6e140b3140 2023-12-12T09:20:18.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 760733169 0 0) 0x7f6e00003520 con 0x7f6e140b3140 2023-12-12T09:20:18.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 msgr2=0x7f6e1406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:18.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 0x7f6e1406dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 >> v2:172.21.15.99:3300/0 conn(0x7f6e1415d160 msgr2=0x7f6e1406d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 --2- 172.21.15.84:0/3741145107 >> v2:172.21.15.99:3300/0 conn(0x7f6e1415d160 0x7f6e1406d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140b28e0 con 0x7f6e140b3140 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f6dfc001670 con 0x7f6e140b3140 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 >> v1:172.21.15.84:6789/0 conn(0x7f6e140b3140 legacy=0x7f6e14070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 0x7f6e000039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e00004d00 0x7f6e00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1415e1d0 con 0x7f6e00003f20 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140cd000 con 0x7f6e00004d00 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0000dc10 con 0x7f6e140706b0 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e0bfff640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.422+0000 7f6e1259c640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 0x7f6e000039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.423+0000 7f6e0bfff640 1 -- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 msgr2=0x7f6e000039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:18.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.423+0000 7f6e0bfff640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 0x7f6e000039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.423+0000 7f6e0bfff640 1 -- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e00004d00 msgr2=0x7f6e00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:18.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.423+0000 7f6e0bfff640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e00004d00 0x7f6e00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.423+0000 7f6e0bfff640 1 -- 172.21.15.84:0/3741145107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00003520 con 0x7f6e00003f20 2023-12-12T09:20:18.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.423+0000 7f6e1259c640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e140706b0 0x7f6e000039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.424+0000 7f6e0bfff640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e000047c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007fd0 tx=0x7f6e000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc7c025d3115d2f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.424+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc005ad0 con 0x7f6e00003f20 2023-12-12T09:20:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.424+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc005c30 con 0x7f6e00003f20 2023-12-12T09:20:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.424+0000 7f6e11d9b640 1 -- 172.21.15.84:0/3741145107 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc02c870 con 0x7f6e00003f20 2023-12-12T09:20:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.425+0000 7f6e1359e640 1 -- 172.21.15.84:0/3741145107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 msgr2=0x7f6e000047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.425+0000 7f6e1359e640 1 --2- 172.21.15.84:0/3741145107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e000047c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007fd0 tx=0x7f6e000057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.425+0000 7f6e12d9d640 1 -- 172.21.15.84:0/3741145107 reap_dead start 2023-12-12T09:20:18.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.425+0000 7f6e1359e640 1 -- 172.21.15.84:0/3741145107 shutdown_connections 2023-12-12T09:20:18.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.425+0000 7f6e1359e640 1 -- 172.21.15.84:0/3741145107 >> 172.21.15.84:0/3741145107 conn(0x7f6e140b07f0 msgr2=0x7f6e140b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:18.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.425+0000 7f6e1359e640 1 -- 172.21.15.84:0/3741145107 shutdown_connections 2023-12-12T09:20:18.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.425+0000 7f6e1359e640 1 -- 172.21.15.84:0/3741145107 wait complete. 2023-12-12T09:20:18.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.427+0000 7f6e1359e640 1 Processor -- start 2023-12-12T09:20:18.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.427+0000 7f6e1359e640 1 -- start start 2023-12-12T09:20:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e1414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1359e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e14154250 0x7f6e141556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14155be0 0x7f6e140afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1359e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14153e30 con 0x7f6e00003f20 2023-12-12T09:20:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1359e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1414c8d0 con 0x7f6e14155be0 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1359e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e141531d0 con 0x7f6e14154250 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e1414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e1414c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41166/0 (socket says 172.21.15.84:41166) 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1259c640 1 -- 172.21.15.84:0/1377500207 learned_addr learned my addr 172.21.15.84:0/1377500207 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e0bfff640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e14154250 0x7f6e141556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e12d9d640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14155be0 0x7f6e140afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1259c640 1 -- 172.21.15.84:0/1377500207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e14154250 msgr2=0x7f6e141556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1259c640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e14154250 0x7f6e141556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1259c640 1 -- 172.21.15.84:0/1377500207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14155be0 msgr2=0x7f6e140afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1259c640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14155be0 0x7f6e140afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.428+0000 7f6e1259c640 1 -- 172.21.15.84:0/1377500207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14153490 con 0x7f6e00003f20 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.429+0000 7f6e1259c640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e1414c390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6e04011540 tx=0x7f6e04011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.429+0000 7f6e0affd640 1 -- 172.21.15.84:0/1377500207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04015870 con 0x7f6e00003f20 2023-12-12T09:20:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.429+0000 7f6e0affd640 1 -- 172.21.15.84:0/1377500207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e040159d0 con 0x7f6e00003f20 2023-12-12T09:20:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.429+0000 7f6e0affd640 1 -- 172.21.15.84:0/1377500207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04015d40 con 0x7f6e00003f20 2023-12-12T09:20:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.429+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e14153770 con 0x7f6e00003f20 2023-12-12T09:20:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.429+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1414ccb0 con 0x7f6e00003f20 2023-12-12T09:20:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.430+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e140673c0 con 0x7f6e00003f20 2023-12-12T09:20:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.431+0000 7f6e0affd640 1 -- 172.21.15.84:0/1377500207 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e0400f460 con 0x7f6e00003f20 2023-12-12T09:20:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.432+0000 7f6e0affd640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6df406ae70 0x7f6df406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.432+0000 7f6e0affd640 1 -- 172.21.15.84:0/1377500207 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e0408a0b0 con 0x7f6e00003f20 2023-12-12T09:20:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.432+0000 7f6e0bfff640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6df406ae70 0x7f6df406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.433+0000 7f6e0bfff640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6df406ae70 0x7f6df406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007fd0 tx=0x7f6dfc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:18.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.437+0000 7f6e0affd640 1 -- 172.21.15.84:0/1377500207 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e04054e70 con 0x7f6e00003f20 2023-12-12T09:20:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.665+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e140ce500 con 0x7f6e00003f20 2023-12-12T09:20:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.666+0000 7f6e0affd640 1 -- 172.21.15.84:0/1377500207 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f6e04059e60 con 0x7f6e00003f20 2023-12-12T09:20:18.667 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:18.667 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:20:07.638154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:20:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-12-12T09:20:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6df406ae70 msgr2=0x7f6df406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6df406ae70 0x7f6df406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc007fd0 tx=0x7f6dfc009030 comp rx=0 tx=0).stop 2023-12-12T09:20:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 msgr2=0x7f6e1414c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e1414c390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6e04011540 tx=0x7f6e04011a00 comp rx=0 tx=0).stop 2023-12-12T09:20:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 shutdown_connections 2023-12-12T09:20:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e14155be0 0x7f6e140afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e14154250 0x7f6e141556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6df406ae70 0x7f6df406d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 --2- 172.21.15.84:0/1377500207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e00003f20 0x7f6e1414c390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 >> 172.21.15.84:0/1377500207 conn(0x7f6e140b07f0 msgr2=0x7f6e140cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.668+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 shutdown_connections 2023-12-12T09:20:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.669+0000 7f6e1359e640 1 -- 172.21.15.84:0/1377500207 wait complete. 2023-12-12T09:20:18.689 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.884+0000 7f3954e48640 1 Processor -- start 2023-12-12T09:20:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.885+0000 7f3954e48640 1 -- start start 2023-12-12T09:20:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.886+0000 7f3954e48640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f39500ce330 0x7f395013d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.886+0000 7f3954e48640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3950140270 con 0x7f3950071bb0 2023-12-12T09:20:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.886+0000 7f3954e48640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39500cd850 con 0x7f39500ce7c0 2023-12-12T09:20:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.886+0000 7f3954e48640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39500cdb30 con 0x7f39500ce330 2023-12-12T09:20:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.887+0000 7f394e59c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3950071bb0 0x7f3950071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39436/0 (socket says 172.21.15.84:39436) 2023-12-12T09:20:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.887+0000 7f394e59c640 1 -- 172.21.15.84:0/105071186 learned_addr learned my addr 172.21.15.84:0/105071186 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.887+0000 7f3945d9b640 1 --2- 172.21.15.84:0/105071186 >> v2:172.21.15.84:3300/0 conn(0x7f39500ce330 0x7f395013d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.887+0000 7f394dd9b640 1 -- 172.21.15.84:0/105071186 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955350185 0 0) 0x7f3950140270 con 0x7f3950071bb0 2023-12-12T09:20:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.887+0000 7f394dd9b640 1 -- 172.21.15.84:0/105071186 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f393c003520 con 0x7f3950071bb0 2023-12-12T09:20:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.887+0000 7f3945d9b640 1 -- 172.21.15.84:0/105071186 >> v1:172.21.15.99:6789/0 conn(0x7f39500ce7c0 legacy=0x7f395013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.887+0000 7f3945d9b640 1 -- 172.21.15.84:0/105071186 >> v1:172.21.15.84:6789/0 conn(0x7f3950071bb0 legacy=0x7f3950071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.887+0000 7f3945d9b640 1 -- 172.21.15.84:0/105071186 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500cde10 con 0x7f39500ce330 2023-12-12T09:20:18.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.888+0000 7f3945d9b640 1 --2- 172.21.15.84:0/105071186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39500ce330 0x7f395013d3d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f39380097d0 tx=0x7f393802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3951adfb5da4bb4b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:18.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.889+0000 7f394dd9b640 1 -- 172.21.15.84:0/105071186 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938030800 con 0x7f39500ce330 2023-12-12T09:20:18.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.889+0000 7f394dd9b640 1 -- 172.21.15.84:0/105071186 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938030960 con 0x7f39500ce330 2023-12-12T09:20:18.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.889+0000 7f394dd9b640 1 -- 172.21.15.84:0/105071186 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938030cf0 con 0x7f39500ce330 2023-12-12T09:20:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.889+0000 7f3954e48640 1 -- 172.21.15.84:0/105071186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39500ce330 msgr2=0x7f395013d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.889+0000 7f3954e48640 1 --2- 172.21.15.84:0/105071186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39500ce330 0x7f395013d3d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f39380097d0 tx=0x7f393802b940 comp rx=0 tx=0).stop 2023-12-12T09:20:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.889+0000 7f3954e48640 1 -- 172.21.15.84:0/105071186 shutdown_connections 2023-12-12T09:20:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.889+0000 7f3954e48640 1 --2- 172.21.15.84:0/105071186 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39500ce330 0x7f395013d3d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.889+0000 7f3954e48640 1 -- 172.21.15.84:0/105071186 >> 172.21.15.84:0/105071186 conn(0x7f395006c3d0 msgr2=0x7f395006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.890+0000 7f3954e48640 1 -- 172.21.15.84:0/105071186 shutdown_connections 2023-12-12T09:20:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.890+0000 7f3954e48640 1 -- 172.21.15.84:0/105071186 wait complete. 2023-12-12T09:20:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.891+0000 7f3954e48640 1 Processor -- start 2023-12-12T09:20:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.891+0000 7f3954e48640 1 -- start start 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.892+0000 7f3954e48640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3950071bb0 0x7f395014a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.892+0000 7f3954e48640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39500ce330 0x7f3950137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.892+0000 7f3954e48640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39500ce7c0 0x7f39500b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.892+0000 7f3954e48640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395014d9b0 con 0x7f3950071bb0 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.892+0000 7f3954e48640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39500b1bc0 con 0x7f39500ce330 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.892+0000 7f3954e48640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39500b1ea0 con 0x7f39500ce7c0 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3950071bb0 0x7f395014a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3950071bb0 0x7f395014a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41194/0 (socket says 172.21.15.84:41194) 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 -- 172.21.15.84:0/1225925634 learned_addr learned my addr 172.21.15.84:0/1225925634 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f3945d9b640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39500ce330 0x7f3950137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 -- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39500ce7c0 msgr2=0x7f39500b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394ed9d640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39500ce7c0 0x7f39500b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39500ce7c0 0x7f39500b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 -- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39500ce330 msgr2=0x7f3950137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39500ce330 0x7f3950137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 -- 172.21.15.84:0/1225925634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3938009400 con 0x7f3950071bb0 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f3945d9b640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39500ce330 0x7f3950137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394ed9d640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39500ce7c0 0x7f39500b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.893+0000 7f394e59c640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3950071bb0 0x7f395014a9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f394000c500 tx=0x7f394000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.894+0000 7f39477fe640 1 -- 172.21.15.84:0/1225925634 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940005ce0 con 0x7f3950071bb0 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.894+0000 7f39477fe640 1 -- 172.21.15.84:0/1225925634 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940005e40 con 0x7f3950071bb0 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.894+0000 7f39477fe640 1 -- 172.21.15.84:0/1225925634 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940007330 con 0x7f3950071bb0 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.894+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39500b2180 con 0x7f3950071bb0 2023-12-12T09:20:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.894+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395014af30 con 0x7f3950071bb0 2023-12-12T09:20:18.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.895+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39500673c0 con 0x7f3950071bb0 2023-12-12T09:20:18.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.896+0000 7f39477fe640 1 -- 172.21.15.84:0/1225925634 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3940007550 con 0x7f3950071bb0 2023-12-12T09:20:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.897+0000 7f39477fe640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f393006ae40 0x7f393006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.897+0000 7f39477fe640 1 -- 172.21.15.84:0/1225925634 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3940088f10 con 0x7f3950071bb0 2023-12-12T09:20:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.897+0000 7f3945d9b640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f393006ae40 0x7f393006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.898+0000 7f3945d9b640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f393006ae40 0x7f393006d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3938036000 tx=0x7f393803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:18.901+0000 7f39477fe640 1 -- 172.21.15.84:0/1225925634 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3940053e20 con 0x7f3950071bb0 2023-12-12T09:20:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.094+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39500ae710 con 0x7f3950071bb0 2023-12-12T09:20:19.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.097+0000 7f39477fe640 1 -- 172.21.15.84:0/1225925634 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7f3940017020 con 0x7f3950071bb0 2023-12-12T09:20:19.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:19.098 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f393006ae40 msgr2=0x7f393006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f393006ae40 0x7f393006d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3938036000 tx=0x7f393803b040 comp rx=0 tx=0).stop 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3950071bb0 msgr2=0x7f395014a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3950071bb0 0x7f395014a9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f394000c500 tx=0x7f394000c9c0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 shutdown_connections 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39500ce7c0 0x7f39500b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39500ce330 0x7f3950137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f393006ae40 0x7f393006d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 --2- 172.21.15.84:0/1225925634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3950071bb0 0x7f395014a9f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.099+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 >> 172.21.15.84:0/1225925634 conn(0x7f395006c3d0 msgr2=0x7f3950159230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:19.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.100+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 shutdown_connections 2023-12-12T09:20:19.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.100+0000 7f3954e48640 1 -- 172.21.15.84:0/1225925634 wait complete. 2023-12-12T09:20:19.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:19.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:19.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.327+0000 7f2cb10b4640 1 Processor -- start 2023-12-12T09:20:19.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.327+0000 7f2cb10b4640 1 -- start start 2023-12-12T09:20:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cb10b4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2cac0b4560 0x7f2cac0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cb10b4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cb10b4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cac06d5e0 0x7f2cac06da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cb10b4640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac15e8a0 con 0x7f2cac06d5e0 2023-12-12T09:20:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cb10b4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cac0b30a0 con 0x7f2cac0b4560 2023-12-12T09:20:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cb10b4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac0b4e80 con 0x7f2cac15d810 2023-12-12T09:20:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cab59e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cac06d5e0 0x7f2cac06da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cab59e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cac06d5e0 0x7f2cac06da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41198/0 (socket says 172.21.15.84:41198) 2023-12-12T09:20:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.329+0000 7f2cab59e640 1 -- 172.21.15.84:0/1979680428 learned_addr learned my addr 172.21.15.84:0/1979680428 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:19.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.330+0000 7f2ca3fff640 1 --2- 172.21.15.84:0/1979680428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.330+0000 7f2caad9d640 1 --2- 172.21.15.84:0/1979680428 >> v2:172.21.15.99:3300/0 conn(0x7f2cac0b4560 0x7f2cac0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.330+0000 7f2cab59e640 1 -- 172.21.15.84:0/1979680428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 msgr2=0x7f2cac0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:19.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.330+0000 7f2cab59e640 1 --2- 172.21.15.84:0/1979680428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.330+0000 7f2cab59e640 1 -- 172.21.15.84:0/1979680428 >> v2:172.21.15.99:3300/0 conn(0x7f2cac0b4560 msgr2=0x7f2cac0b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:19.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.330+0000 7f2cab59e640 1 --2- 172.21.15.84:0/1979680428 >> v2:172.21.15.99:3300/0 conn(0x7f2cac0b4560 0x7f2cac0b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.330+0000 7f2cab59e640 1 -- 172.21.15.84:0/1979680428 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac15dc90 con 0x7f2cac06d5e0 2023-12-12T09:20:19.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.330+0000 7f2caad9d640 1 --2- 172.21.15.84:0/1979680428 >> v2:172.21.15.99:3300/0 conn(0x7f2cac0b4560 0x7f2cac0b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:19.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.331+0000 7f2cab59e640 1 --2- 172.21.15.84:0/1979680428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06d5e0 0x7f2cac06da50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0748b0 tx=0x7f2ca402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8f761fcaebfb34 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:19.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.332+0000 7f2caa59c640 1 -- 172.21.15.84:0/1979680428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca402c9e0 con 0x7f2cac06d5e0 2023-12-12T09:20:19.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.332+0000 7f2caa59c640 1 -- 172.21.15.84:0/1979680428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca402cb40 con 0x7f2cac06d5e0 2023-12-12T09:20:19.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.332+0000 7f2caa59c640 1 -- 172.21.15.84:0/1979680428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40343f0 con 0x7f2cac06d5e0 2023-12-12T09:20:19.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.332+0000 7f2cb10b4640 1 -- 172.21.15.84:0/1979680428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06d5e0 msgr2=0x7f2cac06da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.332+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/1979680428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06d5e0 0x7f2cac06da50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0748b0 tx=0x7f2ca402be40 comp rx=0 tx=0).stop 2023-12-12T09:20:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.333+0000 7f2cb10b4640 1 -- 172.21.15.84:0/1979680428 shutdown_connections 2023-12-12T09:20:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.333+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/1979680428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac06d5e0 0x7f2cac06da50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.333+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/1979680428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.333+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/1979680428 >> v2:172.21.15.99:3300/0 conn(0x7f2cac0b4560 0x7f2cac0b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.333+0000 7f2cb10b4640 1 -- 172.21.15.84:0/1979680428 >> 172.21.15.84:0/1979680428 conn(0x7f2cac0b0ac0 msgr2=0x7f2cac0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.333+0000 7f2cb10b4640 1 -- 172.21.15.84:0/1979680428 shutdown_connections 2023-12-12T09:20:19.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.333+0000 7f2cb10b4640 1 -- 172.21.15.84:0/1979680428 wait complete. 2023-12-12T09:20:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.335+0000 7f2cb10b4640 1 Processor -- start 2023-12-12T09:20:19.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.335+0000 7f2cb10b4640 1 -- start start 2023-12-12T09:20:19.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2cb10b4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cac06d5e0 0x7f2cac1f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2cb10b4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac0b4560 0x7f2cac158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2cb10b4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac1f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2cb10b4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac1f0720 con 0x7f2cac0b4560 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2cb10b4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac14e7f0 con 0x7f2cac06d5e0 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2cb10b4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cac157f40 con 0x7f2cac15d810 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac0b4560 0x7f2cac158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac0b4560 0x7f2cac158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41208/0 (socket says 172.21.15.84:41208) 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.336+0000 7f2ca3fff640 1 -- 172.21.15.84:0/281171398 learned_addr learned my addr 172.21.15.84:0/281171398 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2caad9d640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cac06d5e0 0x7f2cac1f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2cab59e640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac1f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca3fff640 1 -- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 msgr2=0x7f2cac1f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca3fff640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac1f01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca3fff640 1 -- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cac06d5e0 msgr2=0x7f2cac1f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca3fff640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cac06d5e0 0x7f2cac1f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca3fff640 1 -- 172.21.15.84:0/281171398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca4009b30 con 0x7f2cac0b4560 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2cab59e640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac1f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca3fff640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac0b4560 0x7f2cac158a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400e840 tx=0x7f2c9400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca37fe640 1 -- 172.21.15.84:0/281171398 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940094f0 con 0x7f2cac0b4560 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca37fe640 1 -- 172.21.15.84:0/281171398 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9400c940 con 0x7f2cac0b4560 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2ca37fe640 1 -- 172.21.15.84:0/281171398 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400ccd0 con 0x7f2cac0b4560 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cac158220 con 0x7f2cac0b4560 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.337+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cac14ead0 con 0x7f2cac0b4560 2023-12-12T09:20:19.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.339+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cac0673c0 con 0x7f2cac0b4560 2023-12-12T09:20:19.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.339+0000 7f2ca37fe640 1 -- 172.21.15.84:0/281171398 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c94013470 con 0x7f2cac0b4560 2023-12-12T09:20:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.341+0000 7f2ca37fe640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c8c06ae40 0x7f2c8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.341+0000 7f2ca37fe640 1 -- 172.21.15.84:0/281171398 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c94089a70 con 0x7f2cac0b4560 2023-12-12T09:20:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.341+0000 7f2caad9d640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c8c06ae40 0x7f2c8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.342+0000 7f2caad9d640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c8c06ae40 0x7f2c8c06d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c006fd0 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:19.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.345+0000 7f2ca37fe640 1 -- 172.21.15.84:0/281171398 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c94054790 con 0x7f2cac0b4560 2023-12-12T09:20:19.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.534+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2cac0aefb0 con 0x7f2cac0b4560 2023-12-12T09:20:19.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.535+0000 7f2ca37fe640 1 -- 172.21.15.84:0/281171398 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c940170a0 con 0x7f2cac0b4560 2023-12-12T09:20:19.536 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.537+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c8c06ae40 msgr2=0x7f2c8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.537+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c8c06ae40 0x7f2c8c06d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c006fd0 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2023-12-12T09:20:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.537+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac0b4560 msgr2=0x7f2cac158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.537+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac0b4560 0x7f2cac158a20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400e840 tx=0x7f2c9400ed00 comp rx=0 tx=0).stop 2023-12-12T09:20:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.538+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 shutdown_connections 2023-12-12T09:20:19.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.538+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cac15d810 0x7f2cac1f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.538+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c8c06ae40 0x7f2c8c06d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.538+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cac0b4560 0x7f2cac158a20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.538+0000 7f2cb10b4640 1 --2- 172.21.15.84:0/281171398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cac06d5e0 0x7f2cac1f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.538+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 >> 172.21.15.84:0/281171398 conn(0x7f2cac0b0ac0 msgr2=0x7f2cac0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.538+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 shutdown_connections 2023-12-12T09:20:19.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.538+0000 7f2cb10b4640 1 -- 172.21.15.84:0/281171398 wait complete. 2023-12-12T09:20:19.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:19.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.770+0000 7f7225f2c640 1 Processor -- start 2023-12-12T09:20:19.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.770+0000 7f7225f2c640 1 -- start start 2023-12-12T09:20:19.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f7225f2c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7220155690 0x7f722006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f7225f2c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f72200cde40 0x7f72200ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f7225f2c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7220155a70 con 0x7f722015b4f0 2023-12-12T09:20:19.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f7225f2c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72200ce800 con 0x7f72200cde40 2023-12-12T09:20:19.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f7225f2c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722015c120 con 0x7f7220155690 2023-12-12T09:20:19.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f721ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f722015b4f0 0x7f722015b940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39452/0 (socket says 172.21.15.84:39452) 2023-12-12T09:20:19.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f721ffff640 1 -- 172.21.15.84:0/1065969167 learned_addr learned my addr 172.21.15.84:0/1065969167 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:19.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f721effd640 1 --2- 172.21.15.84:0/1065969167 >> v2:172.21.15.99:3300/0 conn(0x7f72200cde40 0x7f72200ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.772+0000 7f721f7fe640 1 --2- 172.21.15.84:0/1065969167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7220155690 0x7f722006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.773+0000 7f721e7fc640 1 -- 172.21.15.84:0/1065969167 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654114076 0 0) 0x7f7220155a70 con 0x7f722015b4f0 2023-12-12T09:20:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.773+0000 7f721e7fc640 1 -- 172.21.15.84:0/1065969167 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7208003520 con 0x7f722015b4f0 2023-12-12T09:20:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.773+0000 7f721e7fc640 1 -- 172.21.15.84:0/1065969167 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 493073422 0 0) 0x7f7208003520 con 0x7f722015b4f0 2023-12-12T09:20:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.773+0000 7f721f7fe640 1 -- 172.21.15.84:0/1065969167 >> v2:172.21.15.99:3300/0 conn(0x7f72200cde40 msgr2=0x7f72200ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.773+0000 7f721f7fe640 1 --2- 172.21.15.84:0/1065969167 >> v2:172.21.15.99:3300/0 conn(0x7f72200cde40 0x7f72200ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.773+0000 7f721f7fe640 1 -- 172.21.15.84:0/1065969167 >> v1:172.21.15.84:6789/0 conn(0x7f722015b4f0 legacy=0x7f722015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.773+0000 7f721f7fe640 1 -- 172.21.15.84:0/1065969167 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722015c400 con 0x7f7220155690 2023-12-12T09:20:19.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.775+0000 7f721f7fe640 1 --2- 172.21.15.84:0/1065969167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7220155690 0x7f722006ce60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72100097a0 tx=0x7f721002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a19466eda5b8249 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:19.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.775+0000 7f721e7fc640 1 -- 172.21.15.84:0/1065969167 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180019f0 con 0x7f7220155690 2023-12-12T09:20:19.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.775+0000 7f721e7fc640 1 -- 172.21.15.84:0/1065969167 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721002e050 con 0x7f7220155690 2023-12-12T09:20:19.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.775+0000 7f721e7fc640 1 -- 172.21.15.84:0/1065969167 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210030710 con 0x7f7220155690 2023-12-12T09:20:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.776+0000 7f7225f2c640 1 -- 172.21.15.84:0/1065969167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7220155690 msgr2=0x7f722006ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.776+0000 7f7225f2c640 1 --2- 172.21.15.84:0/1065969167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7220155690 0x7f722006ce60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72100097a0 tx=0x7f721002b790 comp rx=0 tx=0).stop 2023-12-12T09:20:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.776+0000 7f7225f2c640 1 -- 172.21.15.84:0/1065969167 shutdown_connections 2023-12-12T09:20:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.776+0000 7f7225f2c640 1 --2- 172.21.15.84:0/1065969167 >> v2:172.21.15.99:3300/0 conn(0x7f72200cde40 0x7f72200ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.776+0000 7f7225f2c640 1 --2- 172.21.15.84:0/1065969167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7220155690 0x7f722006ce60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.776+0000 7f7225f2c640 1 -- 172.21.15.84:0/1065969167 >> 172.21.15.84:0/1065969167 conn(0x7f72200b0900 msgr2=0x7f72200b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.776+0000 7f7225f2c640 1 -- 172.21.15.84:0/1065969167 shutdown_connections 2023-12-12T09:20:19.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.776+0000 7f7225f2c640 1 -- 172.21.15.84:0/1065969167 wait complete. 2023-12-12T09:20:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.777+0000 7f7225f2c640 1 Processor -- start 2023-12-12T09:20:19.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.778+0000 7f7225f2c640 1 -- start start 2023-12-12T09:20:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.778+0000 7f7225f2c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72200cde40 0x7f72201576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f7225f2c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7220155690 0x7f7220070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f7225f2c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722015b4f0 0x7f7220070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f7225f2c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220158970 con 0x7f7220155690 2023-12-12T09:20:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f7225f2c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722009b170 con 0x7f722015b4f0 2023-12-12T09:20:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f7225f2c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72201580d0 con 0x7f72200cde40 2023-12-12T09:20:19.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7220155690 0x7f7220070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7220155690 0x7f7220070130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41220/0 (socket says 172.21.15.84:41220) 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721effd640 1 -- 172.21.15.84:0/2797165467 learned_addr learned my addr 172.21.15.84:0/2797165467 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721f7fe640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72200cde40 0x7f72201576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721ffff640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722015b4f0 0x7f7220070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721effd640 1 -- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72200cde40 msgr2=0x7f72201576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721effd640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72200cde40 0x7f72201576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721effd640 1 -- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722015b4f0 msgr2=0x7f7220070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721effd640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722015b4f0 0x7f7220070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721effd640 1 -- 172.21.15.84:0/2797165467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210009400 con 0x7f7220155690 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.779+0000 7f721ffff640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722015b4f0 0x7f7220070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.780+0000 7f721effd640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7220155690 0x7f7220070130 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f721400e9b0 tx=0x7f721400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.780+0000 7f7207fff640 1 -- 172.21.15.84:0/2797165467 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214009670 con 0x7f7220155690 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.780+0000 7f7207fff640 1 -- 172.21.15.84:0/2797165467 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400c9a0 con 0x7f7220155690 2023-12-12T09:20:19.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.780+0000 7f7207fff640 1 -- 172.21.15.84:0/2797165467 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400cd50 con 0x7f7220155690 2023-12-12T09:20:19.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.780+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72201583b0 con 0x7f7220155690 2023-12-12T09:20:19.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.780+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7220155ba0 con 0x7f7220155690 2023-12-12T09:20:19.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.781+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7220155d60 con 0x7f7220155690 2023-12-12T09:20:19.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.782+0000 7f7207fff640 1 -- 172.21.15.84:0/2797165467 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7214013470 con 0x7f7220155690 2023-12-12T09:20:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.783+0000 7f7207fff640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f720c06ae40 0x7f720c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.783+0000 7f7207fff640 1 -- 172.21.15.84:0/2797165467 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7214089ac0 con 0x7f7220155690 2023-12-12T09:20:19.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.783+0000 7f721f7fe640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f720c06ae40 0x7f720c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:19.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.784+0000 7f721f7fe640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f720c06ae40 0x7f720c06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7210034000 tx=0x7f721002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:19.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.787+0000 7f7207fff640 1 -- 172.21.15.84:0/2797165467 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7214054910 con 0x7f7220155690 2023-12-12T09:20:19.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.977+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72200673c0 con 0x7f7220155690 2023-12-12T09:20:19.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.978+0000 7f7207fff640 1 -- 172.21.15.84:0/2797165467 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7214017020 con 0x7f7220155690 2023-12-12T09:20:19.980 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.980+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f720c06ae40 msgr2=0x7f720c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.980+0000 7f7225f2c640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f720c06ae40 0x7f720c06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7210034000 tx=0x7f721002f000 comp rx=0 tx=0).stop 2023-12-12T09:20:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.980+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7220155690 msgr2=0x7f7220070130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.980+0000 7f7225f2c640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7220155690 0x7f7220070130 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f721400e9b0 tx=0x7f721400ee70 comp rx=0 tx=0).stop 2023-12-12T09:20:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.981+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 shutdown_connections 2023-12-12T09:20:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.981+0000 7f7225f2c640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f722015b4f0 0x7f7220070670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.981+0000 7f7225f2c640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f720c06ae40 0x7f720c06d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.981+0000 7f7225f2c640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7220155690 0x7f7220070130 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.981+0000 7f7225f2c640 1 --2- 172.21.15.84:0/2797165467 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72200cde40 0x7f72201576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.981+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 >> 172.21.15.84:0/2797165467 conn(0x7f72200b0900 msgr2=0x7f7220071390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.981+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 shutdown_connections 2023-12-12T09:20:19.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:19.981+0000 7f7225f2c640 1 -- 172.21.15.84:0/2797165467 wait complete. 2023-12-12T09:20:20.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:20.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.213+0000 7f1ed11a9640 1 Processor -- start 2023-12-12T09:20:20.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.214+0000 7f1ed11a9640 1 -- start start 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.215+0000 7f1ed11a9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.215+0000 7f1ed11a9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1ecc0cfbc0 0x7f1ecc099a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.215+0000 7f1ed11a9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc0cbb10 con 0x7f1ecc099f60 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.215+0000 7f1ed11a9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc09a410 con 0x7f1ecc0cfbc0 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.215+0000 7f1ed11a9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0d00c0 con 0x7f1ecc15d460 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.216+0000 7f1ecad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.216+0000 7f1ec259c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1ecc0cfbc0 0x7f1ecc099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.216+0000 7f1ecad9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:47576/0 (socket says 172.21.15.84:47576) 2023-12-12T09:20:20.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.216+0000 7f1ecad9d640 1 -- 172.21.15.84:0/3732825500 learned_addr learned my addr 172.21.15.84:0/3732825500 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:20.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.216+0000 7f1ecad9d640 1 -- 172.21.15.84:0/3732825500 >> v2:172.21.15.99:3300/0 conn(0x7f1ecc0cfbc0 msgr2=0x7f1ecc099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:20.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.216+0000 7f1ecad9d640 1 --2- 172.21.15.84:0/3732825500 >> v2:172.21.15.99:3300/0 conn(0x7f1ecc0cfbc0 0x7f1ecc099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.216+0000 7f1ecad9d640 1 -- 172.21.15.84:0/3732825500 >> v1:172.21.15.99:6789/0 conn(0x7f1ecc099f60 legacy=0x7f1ecc06b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.216+0000 7f1ecad9d640 1 -- 172.21.15.84:0/3732825500 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0d03a0 con 0x7f1ecc15d460 2023-12-12T09:20:20.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.218+0000 7f1ecad9d640 1 --2- 172.21.15.84:0/3732825500 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b3480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009870 tx=0x7f1ebc02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894e1102234748f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:20.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.218+0000 7f1eca59c640 1 -- 172.21.15.84:0/3732825500 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc02f830 con 0x7f1ecc15d460 2023-12-12T09:20:20.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.218+0000 7f1eca59c640 1 -- 172.21.15.84:0/3732825500 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc02f990 con 0x7f1ecc15d460 2023-12-12T09:20:20.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.218+0000 7f1eca59c640 1 -- 172.21.15.84:0/3732825500 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc02fd20 con 0x7f1ecc15d460 2023-12-12T09:20:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.219+0000 7f1ed11a9640 1 -- 172.21.15.84:0/3732825500 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 msgr2=0x7f1ecc0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.219+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/3732825500 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b3480 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009870 tx=0x7f1ebc02ba10 comp rx=0 tx=0).stop 2023-12-12T09:20:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.219+0000 7f1ed11a9640 1 -- 172.21.15.84:0/3732825500 shutdown_connections 2023-12-12T09:20:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.219+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/3732825500 >> v2:172.21.15.99:3300/0 conn(0x7f1ecc0cfbc0 0x7f1ecc099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.219+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/3732825500 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b3480 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.219+0000 7f1ed11a9640 1 -- 172.21.15.84:0/3732825500 >> 172.21.15.84:0/3732825500 conn(0x7f1ecc0b2960 msgr2=0x7f1ecc0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.219+0000 7f1ed11a9640 1 -- 172.21.15.84:0/3732825500 shutdown_connections 2023-12-12T09:20:20.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.219+0000 7f1ed11a9640 1 -- 172.21.15.84:0/3732825500 wait complete. 2023-12-12T09:20:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.221+0000 7f1ed11a9640 1 Processor -- start 2023-12-12T09:20:20.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.221+0000 7f1ed11a9640 1 -- start start 2023-12-12T09:20:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ed11a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc099f60 0x7f1ecc0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ed11a9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ecc0cfbc0 0x7f1ecc1f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ed11a9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ed11a9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1f3c10 con 0x7f1ecc099f60 2023-12-12T09:20:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ed11a9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1f7110 con 0x7f1ecc0cfbc0 2023-12-12T09:20:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ed11a9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1f3090 con 0x7f1ecc15d460 2023-12-12T09:20:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ecad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc099f60 0x7f1ecc0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ecad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc099f60 0x7f1ecc0c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41224/0 (socket says 172.21.15.84:41224) 2023-12-12T09:20:20.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.222+0000 7f1ecad9d640 1 -- 172.21.15.84:0/673617229 learned_addr learned my addr 172.21.15.84:0/673617229 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:20.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ecad9d640 1 -- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 msgr2=0x7f1ecc0b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ec259c640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ecc0cfbc0 0x7f1ecc1f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ecb59e640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ecad9d640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ecad9d640 1 -- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ecc0cfbc0 msgr2=0x7f1ecc1f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ecad9d640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ecc0cfbc0 0x7f1ecc1f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ecad9d640 1 -- 172.21.15.84:0/673617229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc0094d0 con 0x7f1ecc099f60 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ecb59e640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ecad9d640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc099f60 0x7f1ecc0c99b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009870 tx=0x7f1ebc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ec3fff640 1 -- 172.21.15.84:0/673617229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc037c40 con 0x7f1ecc099f60 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ec3fff640 1 -- 172.21.15.84:0/673617229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc037dc0 con 0x7f1ecc099f60 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ec3fff640 1 -- 172.21.15.84:0/673617229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc041640 con 0x7f1ecc099f60 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc1f3370 con 0x7f1ecc099f60 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.223+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc1f3930 con 0x7f1ecc099f60 2023-12-12T09:20:20.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.224+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc0673c0 con 0x7f1ecc099f60 2023-12-12T09:20:20.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.225+0000 7f1ec3fff640 1 -- 172.21.15.84:0/673617229 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ebc0417a0 con 0x7f1ecc099f60 2023-12-12T09:20:20.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.226+0000 7f1ec3fff640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1eac06ae40 0x7f1eac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.226+0000 7f1ec3fff640 1 -- 172.21.15.84:0/673617229 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ebc03c070 con 0x7f1ecc099f60 2023-12-12T09:20:20.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.226+0000 7f1ec259c640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1eac06ae40 0x7f1eac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.227+0000 7f1ec259c640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1eac06ae40 0x7f1eac06d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0c7c70 tx=0x7f1eb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:20.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.230+0000 7f1ec3fff640 1 -- 172.21.15.84:0/673617229 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ebc077320 con 0x7f1ecc099f60 2023-12-12T09:20:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.414+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ecc0c79a0 con 0x7f1ecc099f60 2023-12-12T09:20:20.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.415+0000 7f1ec3fff640 1 -- 172.21.15.84:0/673617229 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ebc07a940 con 0x7f1ecc099f60 2023-12-12T09:20:20.416 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1eac06ae40 msgr2=0x7f1eac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1eac06ae40 0x7f1eac06d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0c7c70 tx=0x7f1eb4008040 comp rx=0 tx=0).stop 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc099f60 msgr2=0x7f1ecc0c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc099f60 0x7f1ecc0c99b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009870 tx=0x7f1ebc004730 comp rx=0 tx=0).stop 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 shutdown_connections 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1ecc15d460 0x7f1ecc0b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ecc0cfbc0 0x7f1ecc1f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1eac06ae40 0x7f1eac06d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.417+0000 7f1ed11a9640 1 --2- 172.21.15.84:0/673617229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc099f60 0x7f1ecc0c99b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.418+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 >> 172.21.15.84:0/673617229 conn(0x7f1ecc0b2960 msgr2=0x7f1ecc0b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:20.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.418+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 shutdown_connections 2023-12-12T09:20:20.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.418+0000 7f1ed11a9640 1 -- 172.21.15.84:0/673617229 wait complete. 2023-12-12T09:20:20.437 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:20.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.643+0000 7f06c44da640 1 Processor -- start 2023-12-12T09:20:20.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.643+0000 7f06c44da640 1 -- start start 2023-12-12T09:20:20.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.644+0000 7f06c44da640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f06bc0b1c00 0x7f06bc0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.644+0000 7f06c44da640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f06bc06beb0 0x7f06bc06c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.644+0000 7f06c44da640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06bc0b21e0 con 0x7f06bc146ac0 2023-12-12T09:20:20.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.644+0000 7f06c44da640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06bc06c860 con 0x7f06bc06beb0 2023-12-12T09:20:20.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.644+0000 7f06c44da640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06bc0b24c0 con 0x7f06bc0b1c00 2023-12-12T09:20:20.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.645+0000 7f06c2a77640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f06bc06beb0 0x7f06bc06c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.645+0000 7f06c2a77640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f06bc06beb0 0x7f06bc06c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41238/0 (socket says 172.21.15.84:41238) 2023-12-12T09:20:20.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.645+0000 7f06c2a77640 1 -- 172.21.15.84:0/1384451882 learned_addr learned my addr 172.21.15.84:0/1384451882 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:20.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.645+0000 7f06c1a75640 1 --2- 172.21.15.84:0/1384451882 >> v2:172.21.15.99:3300/0 conn(0x7f06bc0b1c00 0x7f06bc0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.645+0000 7f06c2a77640 1 -- 172.21.15.84:0/1384451882 >> v2:172.21.15.99:3300/0 conn(0x7f06bc0b1c00 msgr2=0x7f06bc0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:20.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.645+0000 7f06c2a77640 1 --2- 172.21.15.84:0/1384451882 >> v2:172.21.15.99:3300/0 conn(0x7f06bc0b1c00 0x7f06bc0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.645+0000 7f06c2a77640 1 -- 172.21.15.84:0/1384451882 >> v1:172.21.15.99:6789/0 conn(0x7f06bc146ac0 legacy=0x7f06bc15e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:20.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.645+0000 7f06c2a77640 1 -- 172.21.15.84:0/1384451882 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc0b27a0 con 0x7f06bc06beb0 2023-12-12T09:20:20.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.646+0000 7f06c2a77640 1 --2- 172.21.15.84:0/1384451882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc06beb0 0x7f06bc06c320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0b14a0 tx=0x7f06b402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a67696f0ceeb1a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:20.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c1274640 1 -- 172.21.15.84:0/1384451882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b402c9f0 con 0x7f06bc06beb0 2023-12-12T09:20:20.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c1274640 1 -- 172.21.15.84:0/1384451882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b402cb50 con 0x7f06bc06beb0 2023-12-12T09:20:20.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c1274640 1 -- 172.21.15.84:0/1384451882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b40343f0 con 0x7f06bc06beb0 2023-12-12T09:20:20.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c44da640 1 -- 172.21.15.84:0/1384451882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc06beb0 msgr2=0x7f06bc06c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c44da640 1 --2- 172.21.15.84:0/1384451882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc06beb0 0x7f06bc06c320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0b14a0 tx=0x7f06b402be50 comp rx=0 tx=0).stop 2023-12-12T09:20:20.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c44da640 1 -- 172.21.15.84:0/1384451882 shutdown_connections 2023-12-12T09:20:20.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c44da640 1 --2- 172.21.15.84:0/1384451882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc06beb0 0x7f06bc06c320 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c44da640 1 --2- 172.21.15.84:0/1384451882 >> v2:172.21.15.99:3300/0 conn(0x7f06bc0b1c00 0x7f06bc0b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c44da640 1 -- 172.21.15.84:0/1384451882 >> 172.21.15.84:0/1384451882 conn(0x7f06bc0b0900 msgr2=0x7f06bc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:20.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c44da640 1 -- 172.21.15.84:0/1384451882 shutdown_connections 2023-12-12T09:20:20.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.647+0000 7f06c44da640 1 -- 172.21.15.84:0/1384451882 wait complete. 2023-12-12T09:20:20.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.649+0000 7f06c44da640 1 Processor -- start 2023-12-12T09:20:20.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.650+0000 7f06c44da640 1 -- start start 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c44da640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06bc06beb0 0x7f06bc1e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c44da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc0b1c00 0x7f06bc15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c44da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc146ac0 0x7f06bc15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c44da640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc09ae90 con 0x7f06bc0b1c00 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c44da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc099fa0 con 0x7f06bc146ac0 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c44da640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc09a280 con 0x7f06bc06beb0 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c1a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc0b1c00 0x7f06bc15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c1a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc0b1c00 0x7f06bc15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41252/0 (socket says 172.21.15.84:41252) 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c1a75640 1 -- 172.21.15.84:0/3926669976 learned_addr learned my addr 172.21.15.84:0/3926669976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c2276640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06bc06beb0 0x7f06bc1e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.651+0000 7f06c2a77640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc146ac0 0x7f06bc15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c1a75640 1 -- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06bc06beb0 msgr2=0x7f06bc1e58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c1a75640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06bc06beb0 0x7f06bc1e58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c1a75640 1 -- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc146ac0 msgr2=0x7f06bc15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c1a75640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc146ac0 0x7f06bc15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c1a75640 1 -- 172.21.15.84:0/3926669976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b4009b30 con 0x7f06bc0b1c00 2023-12-12T09:20:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c2276640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06bc06beb0 0x7f06bc1e58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:20.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c1a75640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc0b1c00 0x7f06bc15c440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06b000d800 tx=0x7f06b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06aeffd640 1 -- 172.21.15.84:0/3926669976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b000b6c0 con 0x7f06bc0b1c00 2023-12-12T09:20:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06aeffd640 1 -- 172.21.15.84:0/3926669976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b000b840 con 0x7f06bc0b1c00 2023-12-12T09:20:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06bc09a560 con 0x7f06bc0b1c00 2023-12-12T09:20:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06aeffd640 1 -- 172.21.15.84:0/3926669976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b000bbf0 con 0x7f06bc0b1c00 2023-12-12T09:20:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.652+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06bc09ab20 con 0x7f06bc0b1c00 2023-12-12T09:20:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.653+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06bc09b000 con 0x7f06bc0b1c00 2023-12-12T09:20:20.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.654+0000 7f06aeffd640 1 -- 172.21.15.84:0/3926669976 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06b000bd50 con 0x7f06bc0b1c00 2023-12-12T09:20:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.656+0000 7f06aeffd640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f06a006ae40 0x7f06a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.656+0000 7f06aeffd640 1 -- 172.21.15.84:0/3926669976 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f06b0089e40 con 0x7f06bc0b1c00 2023-12-12T09:20:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.656+0000 7f06c2276640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f06a006ae40 0x7f06a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:20.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.657+0000 7f06c2276640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f06a006ae40 0x7f06a006d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f06b800a830 tx=0x7f06b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:20.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.660+0000 7f06aeffd640 1 -- 172.21.15.84:0/3926669976 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06b0054c90 con 0x7f06bc0b1c00 2023-12-12T09:20:20.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.851+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06bc0673c0 con 0x7f06bc0b1c00 2023-12-12T09:20:20.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.852+0000 7f06aeffd640 1 -- 172.21.15.84:0/3926669976 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f06b00582b0 con 0x7f06bc0b1c00 2023-12-12T09:20:20.854 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:20.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f06a006ae40 msgr2=0x7f06a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f06a006ae40 0x7f06a006d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f06b800a830 tx=0x7f06b8008040 comp rx=0 tx=0).stop 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc0b1c00 msgr2=0x7f06bc15c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc0b1c00 0x7f06bc15c440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06b000d800 tx=0x7f06b000dcc0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 shutdown_connections 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06bc146ac0 0x7f06bc15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f06a006ae40 0x7f06a006d300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06bc0b1c00 0x7f06bc15c440 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 --2- 172.21.15.84:0/3926669976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f06bc06beb0 0x7f06bc1e58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 >> 172.21.15.84:0/3926669976 conn(0x7f06bc0b0900 msgr2=0x7f06bc0b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 shutdown_connections 2023-12-12T09:20:20.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:20.855+0000 7f06c44da640 1 -- 172.21.15.84:0/3926669976 wait complete. 2023-12-12T09:20:20.876 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:20:21.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.084+0000 7fb9b2bc4640 1 Processor -- start 2023-12-12T09:20:21.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.084+0000 7fb9b2bc4640 1 -- start start 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.086+0000 7fb9b2bc4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9ac0d16f0 0x7fb9ac0d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.086+0000 7fb9b2bc4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb9ac0b04b0 0x7fb9ac0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.086+0000 7fb9b2bc4640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac0afd40 con 0x7fb9ac15d490 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.086+0000 7fb9b2bc4640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac0b0090 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.086+0000 7fb9b2bc4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac0d20c0 con 0x7fb9ac0b04b0 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.086+0000 7fb9abfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9ac0d16f0 0x7fb9ac0d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.086+0000 7fb9abfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb9ac0d16f0 0x7fb9ac0d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41268/0 (socket says 172.21.15.84:41268) 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.086+0000 7fb9abfff640 1 -- 172.21.15.84:0/3222299183 learned_addr learned my addr 172.21.15.84:0/3222299183 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.087+0000 7fb9b1161640 1 --2- 172.21.15.84:0/3222299183 >> v2:172.21.15.99:3300/0 conn(0x7fb9ac0b04b0 0x7fb9ac0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.087+0000 7fb9abfff640 1 -- 172.21.15.84:0/3222299183 >> v2:172.21.15.99:3300/0 conn(0x7fb9ac0b04b0 msgr2=0x7fb9ac0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.087+0000 7fb9abfff640 1 --2- 172.21.15.84:0/3222299183 >> v2:172.21.15.99:3300/0 conn(0x7fb9ac0b04b0 0x7fb9ac0b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.087+0000 7fb9abfff640 1 -- 172.21.15.84:0/3222299183 >> v1:172.21.15.99:6789/0 conn(0x7fb9ac15d490 legacy=0x7fb9ac0d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:21.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.087+0000 7fb9abfff640 1 -- 172.21.15.84:0/3222299183 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0ce860 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.088+0000 7fb9abfff640 1 --2- 172.21.15.84:0/3222299183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0d1b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac06b030 tx=0x7fb99802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a962835061d783 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.088+0000 7fb9ab7fe640 1 -- 172.21.15.84:0/3222299183 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9980317e0 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.088+0000 7fb9ab7fe640 1 -- 172.21.15.84:0/3222299183 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998031940 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.088+0000 7fb9ab7fe640 1 -- 172.21.15.84:0/3222299183 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998031cd0 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.089+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/3222299183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 msgr2=0x7fb9ac0d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.089+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/3222299183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0d1b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac06b030 tx=0x7fb99802b880 comp rx=0 tx=0).stop 2023-12-12T09:20:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.089+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/3222299183 shutdown_connections 2023-12-12T09:20:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.089+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/3222299183 >> v2:172.21.15.99:3300/0 conn(0x7fb9ac0b04b0 0x7fb9ac0b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.089+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/3222299183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0d1b80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.089+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/3222299183 >> 172.21.15.84:0/3222299183 conn(0x7fb9ac09c450 msgr2=0x7fb9ac0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.089+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/3222299183 shutdown_connections 2023-12-12T09:20:21.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.089+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/3222299183 wait complete. 2023-12-12T09:20:21.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.091+0000 7fb9b2bc4640 1 Processor -- start 2023-12-12T09:20:21.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.091+0000 7fb9b2bc4640 1 -- start start 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9b2bc4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac0b04b0 0x7fb9ac0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9b2bc4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9b2bc4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9ac15d490 0x7fb9ac0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9b2bc4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac1f3ea0 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9b2bc4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0c7aa0 con 0x7fb9ac0b04b0 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9b2bc4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0c7d00 con 0x7fb9ac15d490 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9abfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9abfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41272/0 (socket says 172.21.15.84:41272) 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.092+0000 7fb9abfff640 1 -- 172.21.15.84:0/2389486528 learned_addr learned my addr 172.21.15.84:0/2389486528 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9b0960640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac0b04b0 0x7fb9ac0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9b1161640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9ac15d490 0x7fb9ac0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9abfff640 1 -- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9ac15d490 msgr2=0x7fb9ac0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9abfff640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9ac15d490 0x7fb9ac0c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9abfff640 1 -- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac0b04b0 msgr2=0x7fb9ac0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9abfff640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac0b04b0 0x7fb9ac0c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9abfff640 1 -- 172.21.15.84:0/2389486528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980094d0 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9b1161640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9ac15d490 0x7fb9ac0c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9abfff640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0c9280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb99802b8c0 tx=0x7fb9980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9a97fa640 1 -- 172.21.15.84:0/2389486528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998032880 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9a97fa640 1 -- 172.21.15.84:0/2389486528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9980329e0 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.093+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac1f3bc0 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.094+0000 7fb9a97fa640 1 -- 172.21.15.84:0/2389486528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998032d90 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.094+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac0c82a0 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.095+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac072b80 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.096+0000 7fb9a97fa640 1 -- 172.21.15.84:0/2389486528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9980453f0 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.097+0000 7fb9a97fa640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb99006ae40 0x7fb99006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.097+0000 7fb9a97fa640 1 -- 172.21.15.84:0/2389486528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9980aba90 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.097+0000 7fb9b0960640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb99006ae40 0x7fb99006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.097+0000 7fb9b0960640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb99006ae40 0x7fb99006d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0006fd0 tx=0x7fb9a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.101+0000 7fb9a97fa640 1 -- 172.21.15.84:0/2389486528 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb998076830 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.339+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9ac0c8490 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.340+0000 7fb9a97fa640 1 -- 172.21.15.84:0/2389486528 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fb998079e50 con 0x7fb9ac0d16f0 2023-12-12T09:20:21.341 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:21.341 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:20:07.638154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:20:21.342 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-12-12T09:20:21.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.342+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb99006ae40 msgr2=0x7fb99006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.342+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb99006ae40 0x7fb99006d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0006fd0 tx=0x7fb9a0008040 comp rx=0 tx=0).stop 2023-12-12T09:20:21.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.342+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 msgr2=0x7fb9ac0c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.342+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0c9280 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb99802b8c0 tx=0x7fb9980046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.343+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 shutdown_connections 2023-12-12T09:20:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.343+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb9ac15d490 0x7fb9ac0c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.343+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb99006ae40 0x7fb99006d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.343+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9ac0d16f0 0x7fb9ac0c9280 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.343+0000 7fb9b2bc4640 1 --2- 172.21.15.84:0/2389486528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9ac0b04b0 0x7fb9ac0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.343+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 >> 172.21.15.84:0/2389486528 conn(0x7fb9ac09c450 msgr2=0x7fb9ac0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.343+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 shutdown_connections 2023-12-12T09:20:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.343+0000 7fb9b2bc4640 1 -- 172.21.15.84:0/2389486528 wait complete. 2023-12-12T09:20:21.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:21.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.573+0000 7fe844ebb640 1 Processor -- start 2023-12-12T09:20:21.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.573+0000 7fe844ebb640 1 -- start start 2023-12-12T09:20:21.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe844ebb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe84015d050 0x7fe84006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe844ebb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe84006d1f0 0x7fe84006de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe844ebb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84006c430 con 0x7fe840070800 2023-12-12T09:20:21.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe844ebb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe840071430 con 0x7fe84006d1f0 2023-12-12T09:20:21.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe844ebb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84006c710 con 0x7fe84015d050 2023-12-12T09:20:21.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe837fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe84006d1f0 0x7fe84006de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe837fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe84006d1f0 0x7fe84006de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41276/0 (socket says 172.21.15.84:41276) 2023-12-12T09:20:21.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe837fff640 1 -- 172.21.15.84:0/3009715360 learned_addr learned my addr 172.21.15.84:0/3009715360 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:21.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.575+0000 7fe83f7fe640 1 --2- 172.21.15.84:0/3009715360 >> v2:172.21.15.99:3300/0 conn(0x7fe84015d050 0x7fe84006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.576+0000 7fe837fff640 1 -- 172.21.15.84:0/3009715360 >> v2:172.21.15.99:3300/0 conn(0x7fe84015d050 msgr2=0x7fe84006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:21.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.576+0000 7fe837fff640 1 --2- 172.21.15.84:0/3009715360 >> v2:172.21.15.99:3300/0 conn(0x7fe84015d050 0x7fe84006d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.576+0000 7fe837fff640 1 -- 172.21.15.84:0/3009715360 >> v1:172.21.15.99:6789/0 conn(0x7fe840070800 legacy=0x7fe840070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:21.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.576+0000 7fe837fff640 1 -- 172.21.15.84:0/3009715360 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84006c9f0 con 0x7fe84006d1f0 2023-12-12T09:20:21.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.576+0000 7fe83f7fe640 1 --2- 172.21.15.84:0/3009715360 >> v2:172.21.15.99:3300/0 conn(0x7fe84015d050 0x7fe84006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:21.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.577+0000 7fe837fff640 1 --2- 172.21.15.84:0/3009715360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84006d1f0 0x7fe84006de20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe84006b730 tx=0x7fe82802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5476dceb3da1619 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:21.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.577+0000 7fe83effd640 1 -- 172.21.15.84:0/3009715360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828031870 con 0x7fe84006d1f0 2023-12-12T09:20:21.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.577+0000 7fe83effd640 1 -- 172.21.15.84:0/3009715360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8280319d0 con 0x7fe84006d1f0 2023-12-12T09:20:21.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.577+0000 7fe83effd640 1 -- 172.21.15.84:0/3009715360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828031d60 con 0x7fe84006d1f0 2023-12-12T09:20:21.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.578+0000 7fe844ebb640 1 -- 172.21.15.84:0/3009715360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84006d1f0 msgr2=0x7fe84006de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.578+0000 7fe844ebb640 1 --2- 172.21.15.84:0/3009715360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84006d1f0 0x7fe84006de20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe84006b730 tx=0x7fe82802b910 comp rx=0 tx=0).stop 2023-12-12T09:20:21.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.578+0000 7fe844ebb640 1 -- 172.21.15.84:0/3009715360 shutdown_connections 2023-12-12T09:20:21.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.578+0000 7fe844ebb640 1 --2- 172.21.15.84:0/3009715360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84006d1f0 0x7fe84006de20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.578+0000 7fe844ebb640 1 --2- 172.21.15.84:0/3009715360 >> v2:172.21.15.99:3300/0 conn(0x7fe84015d050 0x7fe84006d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.578+0000 7fe844ebb640 1 -- 172.21.15.84:0/3009715360 >> 172.21.15.84:0/3009715360 conn(0x7fe8400b07f0 msgr2=0x7fe8400b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:21.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.578+0000 7fe844ebb640 1 -- 172.21.15.84:0/3009715360 shutdown_connections 2023-12-12T09:20:21.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.578+0000 7fe844ebb640 1 -- 172.21.15.84:0/3009715360 wait complete. 2023-12-12T09:20:21.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.580+0000 7fe844ebb640 1 Processor -- start 2023-12-12T09:20:21.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.580+0000 7fe844ebb640 1 -- start start 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe844ebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe84006d1f0 0x7fe8401595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe844ebb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe840070800 0x7fe8401e5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe844ebb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84015d050 0x7fe8400c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe844ebb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe840159b20 con 0x7fe84015d050 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe844ebb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401e6200 con 0x7fe84006d1f0 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe844ebb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401e64e0 con 0x7fe840070800 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe83ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84015d050 0x7fe8400c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe83ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84015d050 0x7fe8400c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41280/0 (socket says 172.21.15.84:41280) 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe83ffff640 1 -- 172.21.15.84:0/40594250 learned_addr learned my addr 172.21.15.84:0/40594250 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.581+0000 7fe83f7fe640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe84006d1f0 0x7fe8401595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe837fff640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe840070800 0x7fe8401e5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83ffff640 1 -- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe840070800 msgr2=0x7fe8401e5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83ffff640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe840070800 0x7fe8401e5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83ffff640 1 -- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe84006d1f0 msgr2=0x7fe8401595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83ffff640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe84006d1f0 0x7fe8401595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83ffff640 1 -- 172.21.15.84:0/40594250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280094d0 con 0x7fe84015d050 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe837fff640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe840070800 0x7fe8401e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83ffff640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84015d050 0x7fe8400c4620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe83800c780 tx=0x7fe83800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83cff9640 1 -- 172.21.15.84:0/40594250 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838003d80 con 0x7fe84015d050 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83cff9640 1 -- 172.21.15.84:0/40594250 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83800ce30 con 0x7fe84015d050 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8401e67c0 con 0x7fe84015d050 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe83cff9640 1 -- 172.21.15.84:0/40594250 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838005290 con 0x7fe84015d050 2023-12-12T09:20:21.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.582+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8401e6d80 con 0x7fe84015d050 2023-12-12T09:20:21.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.583+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8400b2440 con 0x7fe84015d050 2023-12-12T09:20:21.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.585+0000 7fe83cff9640 1 -- 172.21.15.84:0/40594250 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8380053f0 con 0x7fe84015d050 2023-12-12T09:20:21.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.585+0000 7fe83cff9640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe82006ae70 0x7fe82006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:21.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.585+0000 7fe83cff9640 1 -- 172.21.15.84:0/40594250 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe838089220 con 0x7fe84015d050 2023-12-12T09:20:21.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.586+0000 7fe83f7fe640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe82006ae70 0x7fe82006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:21.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.586+0000 7fe83f7fe640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe82006ae70 0x7fe82006d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe83000a950 tx=0x7fe830008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.590+0000 7fe83cff9640 1 -- 172.21.15.84:0/40594250 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe838053f40 con 0x7fe84015d050 2023-12-12T09:20:21.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.781+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe84015e2e0 con 0x7fe84015d050 2023-12-12T09:20:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.782+0000 7fe83cff9640 1 -- 172.21.15.84:0/40594250 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18262 (secure 0 0 0) 0x7fe838017090 con 0x7fe84015d050 2023-12-12T09:20:21.784 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:21.784 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:19:48.120386+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe82006ae70 msgr2=0x7fe82006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe82006ae70 0x7fe82006d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe83000a950 tx=0x7fe830008040 comp rx=0 tx=0).stop 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84015d050 msgr2=0x7fe8400c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84015d050 0x7fe8400c4620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe83800c780 tx=0x7fe83800cc40 comp rx=0 tx=0).stop 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 shutdown_connections 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe82006ae70 0x7fe82006d330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe84015d050 0x7fe8400c4620 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe840070800 0x7fe8401e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 --2- 172.21.15.84:0/40594250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe84006d1f0 0x7fe8401595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 >> 172.21.15.84:0/40594250 conn(0x7fe8400b07f0 msgr2=0x7fe840070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 shutdown_connections 2023-12-12T09:20:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:21.785+0000 7fe844ebb640 1 -- 172.21.15.84:0/40594250 wait complete. 2023-12-12T09:20:21.806 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:20:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.024+0000 7fb46b961640 1 Processor -- start 2023-12-12T09:20:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.024+0000 7fb46b961640 1 -- start start 2023-12-12T09:20:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.025+0000 7fb46b961640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb464071bb0 0x7fb464071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.025+0000 7fb46b961640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb46413dae0 0x7fb46413f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.025+0000 7fb46b961640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640724d0 con 0x7fb4640ce330 2023-12-12T09:20:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.025+0000 7fb46b961640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb464140270 con 0x7fb464071bb0 2023-12-12T09:20:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.025+0000 7fb46b961640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640cd850 con 0x7fb46413dae0 2023-12-12T09:20:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.026+0000 7fb4696fd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb464071bb0 0x7fb464071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.026+0000 7fb4696fd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb464071bb0 0x7fb464071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41282/0 (socket says 172.21.15.84:41282) 2023-12-12T09:20:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.026+0000 7fb4696fd640 1 -- 172.21.15.84:0/3560736179 learned_addr learned my addr 172.21.15.84:0/3560736179 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.026+0000 7fb469efe640 1 --2- 172.21.15.84:0/3560736179 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb46413dae0 0x7fb46413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.026+0000 7fb4696fd640 1 -- 172.21.15.84:0/3560736179 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb46413dae0 msgr2=0x7fb46413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.026+0000 7fb4696fd640 1 --2- 172.21.15.84:0/3560736179 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb46413dae0 0x7fb46413f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.026+0000 7fb4696fd640 1 -- 172.21.15.84:0/3560736179 >> v1:172.21.15.99:6789/0 conn(0x7fb4640ce330 legacy=0x7fb46413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.026+0000 7fb4696fd640 1 -- 172.21.15.84:0/3560736179 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640cdb30 con 0x7fb464071bb0 2023-12-12T09:20:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.027+0000 7fb4696fd640 1 --2- 172.21.15.84:0/3560736179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb464071f90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb460009870 tx=0x7fb46002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758f8f1a71bbadfe server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb45bfff640 1 -- 172.21.15.84:0/3560736179 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460031640 con 0x7fb464071bb0 2023-12-12T09:20:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb45bfff640 1 -- 172.21.15.84:0/3560736179 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4600317a0 con 0x7fb464071bb0 2023-12-12T09:20:22.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb45bfff640 1 -- 172.21.15.84:0/3560736179 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460031b30 con 0x7fb464071bb0 2023-12-12T09:20:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb46b961640 1 -- 172.21.15.84:0/3560736179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 msgr2=0x7fb464071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb46b961640 1 --2- 172.21.15.84:0/3560736179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb464071f90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb460009870 tx=0x7fb46002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb46b961640 1 -- 172.21.15.84:0/3560736179 shutdown_connections 2023-12-12T09:20:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb46b961640 1 --2- 172.21.15.84:0/3560736179 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb46413dae0 0x7fb46413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb46b961640 1 --2- 172.21.15.84:0/3560736179 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb464071f90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb46b961640 1 -- 172.21.15.84:0/3560736179 >> 172.21.15.84:0/3560736179 conn(0x7fb46406c3d0 msgr2=0x7fb46406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb46b961640 1 -- 172.21.15.84:0/3560736179 shutdown_connections 2023-12-12T09:20:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.028+0000 7fb46b961640 1 -- 172.21.15.84:0/3560736179 wait complete. 2023-12-12T09:20:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.030+0000 7fb46b961640 1 Processor -- start 2023-12-12T09:20:22.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.031+0000 7fb46b961640 1 -- start start 2023-12-12T09:20:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb46b961640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb46413b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb46b961640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4640ce330 0x7fb4640c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb46b961640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb464158e30 0x7fb4641592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb46b961640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464159800 con 0x7fb464071bb0 2023-12-12T09:20:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb46b961640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46413f570 con 0x7fb4640ce330 2023-12-12T09:20:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb46b961640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640ae190 con 0x7fb464158e30 2023-12-12T09:20:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb4696fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb46413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb4696fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb46413b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41284/0 (socket says 172.21.15.84:41284) 2023-12-12T09:20:22.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb4696fd640 1 -- 172.21.15.84:0/967928161 learned_addr learned my addr 172.21.15.84:0/967928161 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb469efe640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb464158e30 0x7fb4641592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.032+0000 7fb468efc640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4640ce330 0x7fb4640c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb4696fd640 1 -- 172.21.15.84:0/967928161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb464158e30 msgr2=0x7fb4641592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb4696fd640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb464158e30 0x7fb4641592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb4696fd640 1 -- 172.21.15.84:0/967928161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4640ce330 msgr2=0x7fb4640c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb4696fd640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4640ce330 0x7fb4640c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb4696fd640 1 -- 172.21.15.84:0/967928161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600094d0 con 0x7fb464071bb0 2023-12-12T09:20:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb4696fd640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb46413b760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb460000c00 tx=0x7fb4600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb459ffb640 1 -- 172.21.15.84:0/967928161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46003ac60 con 0x7fb464071bb0 2023-12-12T09:20:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb459ffb640 1 -- 172.21.15.84:0/967928161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46003ade0 con 0x7fb464071bb0 2023-12-12T09:20:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb459ffb640 1 -- 172.21.15.84:0/967928161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460044630 con 0x7fb464071bb0 2023-12-12T09:20:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.033+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4640ad3d0 con 0x7fb464071bb0 2023-12-12T09:20:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.034+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4640ad990 con 0x7fb464071bb0 2023-12-12T09:20:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.035+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4640673c0 con 0x7fb464071bb0 2023-12-12T09:20:22.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.036+0000 7fb459ffb640 1 -- 172.21.15.84:0/967928161 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb46002f050 con 0x7fb464071bb0 2023-12-12T09:20:22.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.036+0000 7fb459ffb640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb44806ae70 0x7fb44806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.036+0000 7fb459ffb640 1 -- 172.21.15.84:0/967928161 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb4600aba10 con 0x7fb464071bb0 2023-12-12T09:20:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.037+0000 7fb468efc640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb44806ae70 0x7fb44806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.037+0000 7fb468efc640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb44806ae70 0x7fb44806d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb4640b34e0 tx=0x7fb454009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.041+0000 7fb459ffb640 1 -- 172.21.15.84:0/967928161 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4600767d0 con 0x7fb464071bb0 2023-12-12T09:20:22.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.275+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4640ae710 con 0x7fb464071bb0 2023-12-12T09:20:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.276+0000 7fb459ffb640 1 -- 172.21.15.84:0/967928161 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fb460079df0 con 0x7fb464071bb0 2023-12-12T09:20:22.278 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:22.278 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:20:07.638154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:20:22.278 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-12-12T09:20:22.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb44806ae70 msgr2=0x7fb44806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb44806ae70 0x7fb44806d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb4640b34e0 tx=0x7fb454009040 comp rx=0 tx=0).stop 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 msgr2=0x7fb46413b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb46413b760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb460000c00 tx=0x7fb4600046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 shutdown_connections 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb464158e30 0x7fb4641592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4640ce330 0x7fb4640c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb44806ae70 0x7fb44806d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 --2- 172.21.15.84:0/967928161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb464071bb0 0x7fb46413b760 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 >> 172.21.15.84:0/967928161 conn(0x7fb46406c3d0 msgr2=0x7fb464070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 shutdown_connections 2023-12-12T09:20:22.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.279+0000 7fb46b961640 1 -- 172.21.15.84:0/967928161 wait complete. 2023-12-12T09:20:22.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T09:19:41.565378+0000', 'modified': '2023-12-12T09:20:07.638154+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6833/3738121458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6832', 'nonce': 3738121458}, {'type': 'v1', 'addr': '172.21.15.99:6833', 'nonce': 3738121458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T09:20:22.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T09:20:22.701 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-12T09:20:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.917+0000 7f91aad16640 1 Processor -- start 2023-12-12T09:20:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.917+0000 7f91aad16640 1 -- start start 2023-12-12T09:20:22.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.919+0000 7f91aad16640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91a4144740 0x7f91a406de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.919+0000 7f91aad16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 0x7f91a415edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.919+0000 7f91aad16640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a4144b20 con 0x7f91a415f2f0 2023-12-12T09:20:22.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.919+0000 7f91aad16640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a415f760 con 0x7f91a4144740 2023-12-12T09:20:22.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.919+0000 7f91aad16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a406d670 con 0x7f91a415e950 2023-12-12T09:20:22.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.919+0000 7f91a9d14640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91a4144740 0x7f91a406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.919+0000 7f91aa515640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f91a415f2f0 0x7f91a40cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39468/0 (socket says 172.21.15.84:39468) 2023-12-12T09:20:22.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.919+0000 7f91aa515640 1 -- 172.21.15.84:0/4289832336 learned_addr learned my addr 172.21.15.84:0/4289832336 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:22.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.920+0000 7f91a9513640 1 --2- 172.21.15.84:0/4289832336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 0x7f91a415edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.920+0000 7f91a9d14640 1 -- 172.21.15.84:0/4289832336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 msgr2=0x7f91a415edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.920+0000 7f91a9d14640 1 --2- 172.21.15.84:0/4289832336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 0x7f91a415edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.920+0000 7f91a9d14640 1 -- 172.21.15.84:0/4289832336 >> v1:172.21.15.84:6789/0 conn(0x7f91a415f2f0 legacy=0x7f91a40cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.920+0000 7f91a9d14640 1 -- 172.21.15.84:0/4289832336 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a406cdd0 con 0x7f91a4144740 2023-12-12T09:20:22.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.920+0000 7f91a8d12640 1 -- 172.21.15.84:0/4289832336 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981728835 0 0) 0x7f91a4144b20 con 0x7f91a415f2f0 2023-12-12T09:20:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.921+0000 7f91a9d14640 1 --2- 172.21.15.84:0/4289832336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a406de80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097a0 tx=0x7f91a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfffb6ca1a77ec4b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91a8d12640 1 -- 172.21.15.84:0/4289832336 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0031830 con 0x7f91a4144740 2023-12-12T09:20:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91a8d12640 1 -- 172.21.15.84:0/4289832336 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0031990 con 0x7f91a4144740 2023-12-12T09:20:22.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91a8d12640 1 -- 172.21.15.84:0/4289832336 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0031d20 con 0x7f91a4144740 2023-12-12T09:20:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91aad16640 1 -- 172.21.15.84:0/4289832336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 msgr2=0x7f91a406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91aad16640 1 --2- 172.21.15.84:0/4289832336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a406de80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f91a00097a0 tx=0x7f91a002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91aad16640 1 -- 172.21.15.84:0/4289832336 shutdown_connections 2023-12-12T09:20:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91aad16640 1 --2- 172.21.15.84:0/4289832336 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 0x7f91a415edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91aad16640 1 --2- 172.21.15.84:0/4289832336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a406de80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91aad16640 1 -- 172.21.15.84:0/4289832336 >> 172.21.15.84:0/4289832336 conn(0x7f91a40b07f0 msgr2=0x7f91a40b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:22.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.922+0000 7f91aad16640 1 -- 172.21.15.84:0/4289832336 shutdown_connections 2023-12-12T09:20:22.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.923+0000 7f91aad16640 1 -- 172.21.15.84:0/4289832336 wait complete. 2023-12-12T09:20:22.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.924+0000 7f91aad16640 1 Processor -- start 2023-12-12T09:20:22.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.924+0000 7f91aad16640 1 -- start start 2023-12-12T09:20:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.925+0000 7f91aad16640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.925+0000 7f91aad16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 0x7f91a414ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.925+0000 7f91aad16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91a415f2f0 0x7f91a4150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.925+0000 7f91aad16640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a415c890 con 0x7f91a4144740 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.925+0000 7f91aad16640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a415c2d0 con 0x7f91a415f2f0 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.925+0000 7f91aad16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a415c5b0 con 0x7f91a415e950 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a415b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41296/0 (socket says 172.21.15.84:41296) 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 -- 172.21.15.84:0/1895673634 learned_addr learned my addr 172.21.15.84:0/1895673634 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9513640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 0x7f91a414ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91aa515640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91a415f2f0 0x7f91a4150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 -- 172.21.15.84:0/1895673634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 msgr2=0x7f91a414ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 0x7f91a414ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 -- 172.21.15.84:0/1895673634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91a415f2f0 msgr2=0x7f91a4150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91a415f2f0 0x7f91a4150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 -- 172.21.15.84:0/1895673634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0009400 con 0x7f91a4144740 2023-12-12T09:20:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.926+0000 7f91a9d14640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a415b8c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91a002bee0 tx=0x7f91a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.927+0000 7f91967fc640 1 -- 172.21.15.84:0/1895673634 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a003a6f0 con 0x7f91a4144740 2023-12-12T09:20:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.927+0000 7f91967fc640 1 -- 172.21.15.84:0/1895673634 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a003a870 con 0x7f91a4144740 2023-12-12T09:20:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.927+0000 7f91967fc640 1 -- 172.21.15.84:0/1895673634 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a003ac20 con 0x7f91a4144740 2023-12-12T09:20:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.927+0000 7f91aad16640 1 -- 172.21.15.84:0/1895673634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a414b920 con 0x7f91a4144740 2023-12-12T09:20:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.927+0000 7f91aad16640 1 -- 172.21.15.84:0/1895673634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a4159af0 con 0x7f91a4144740 2023-12-12T09:20:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.929+0000 7f91967fc640 1 -- 172.21.15.84:0/1895673634 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91a0030380 con 0x7f91a4144740 2023-12-12T09:20:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.930+0000 7f91967fc640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f918806ae40 0x7f918806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.930+0000 7f91967fc640 1 -- 172.21.15.84:0/1895673634 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91a00ab400 con 0x7f91a4144740 2023-12-12T09:20:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.930+0000 7f91a9513640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f918806ae40 0x7f918806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.931+0000 7f91aebe6740 1 Processor -- start 2023-12-12T09:20:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.931+0000 7f91a9513640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f918806ae40 0x7f918806d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f91a4142840 tx=0x7f9198008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.931+0000 7f91aebe6740 1 -- start start 2023-12-12T09:20:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edfb1e0 0x56291edfb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edcb490 0x56291edf8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 0x56291edf8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91aebe6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291ed3df40 con 0x56291edcb490 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91aebe6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291ed3b630 con 0x56291edced60 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91aebe6740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56291ed36f20 con 0x56291edfb1e0 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91a9513640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edcb490 0x56291edf8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91a9513640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edcb490 0x56291edf8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41308/0 (socket says 172.21.15.84:41308) 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91a9513640 1 -- 172.21.15.84:0/1810582519 learned_addr learned my addr 172.21.15.84:0/1810582519 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91a9513640 1 -- 172.21.15.84:0/1810582519 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edfb1e0 msgr2=0x56291edfb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91a9513640 1 --2- 172.21.15.84:0/1810582519 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edfb1e0 0x56291edfb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91a9513640 1 -- 172.21.15.84:0/1810582519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 msgr2=0x56291edf8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91a9513640 1 --2- 172.21.15.84:0/1810582519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 0x56291edf8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.932+0000 7f91a9513640 1 -- 172.21.15.84:0/1810582519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56291ecf9910 con 0x56291edcb490 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.933+0000 7f91a9513640 1 --2- 172.21.15.84:0/1810582519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edcb490 0x56291edf8450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f919800b630 tx=0x7f9198012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43627d4f6098f18d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.933+0000 7f91877fe640 1 -- 172.21.15.84:0/1810582519 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198014be0 con 0x56291edcb490 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.933+0000 7f91877fe640 1 -- 172.21.15.84:0/1810582519 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9198019070 con 0x56291edcb490 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.933+0000 7f91877fe640 1 -- 172.21.15.84:0/1810582519 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198020440 con 0x56291edcb490 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 -- 172.21.15.84:0/1810582519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edcb490 msgr2=0x56291edf8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 --2- 172.21.15.84:0/1810582519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edcb490 0x56291edf8450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f919800b630 tx=0x7f9198012000 comp rx=0 tx=0).stop 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 -- 172.21.15.84:0/1810582519 shutdown_connections 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 --2- 172.21.15.84:0/1810582519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 0x56291edf8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 --2- 172.21.15.84:0/1810582519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edcb490 0x56291edf8450 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 --2- 172.21.15.84:0/1810582519 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edfb1e0 0x56291edfb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 -- 172.21.15.84:0/1810582519 >> 172.21.15.84:0/1810582519 conn(0x56291edcd700 msgr2=0x56291ee15ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:22.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 -- 172.21.15.84:0/1810582519 shutdown_connections 2023-12-12T09:20:22.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.934+0000 7f91aebe6740 1 -- 172.21.15.84:0/1810582519 wait complete. 2023-12-12T09:20:22.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.935+0000 7f91aebe6740 1 -- start start 2023-12-12T09:20:22.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.935+0000 7f91aebe6740 1 Processor -- start 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 0x56291edf4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edfb1e0 0x56291edf12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291eddf9f0 0x56291eddfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91aebe6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291ecd32f0 con 0x56291edfb1e0 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91aebe6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291ecf0c70 con 0x56291eddf9f0 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91aebe6740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56291ea99f20 con 0x56291edced60 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91aebe6740 10 client.0 _ll_register_callbacks cb 0x56291ecf53b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91a9513640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edfb1e0 0x56291edf12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91a9513640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edfb1e0 0x56291edf12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41310/0 (socket says 172.21.15.84:41310) 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.936+0000 7f91a9513640 1 -- 172.21.15.84:0/682967080 learned_addr learned my addr 172.21.15.84:0/682967080 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91a9d14640 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 0x56291edf4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91a9513640 1 -- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 msgr2=0x56291edf4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91a9513640 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 0x56291edf4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91aa515640 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291eddf9f0 0x56291eddfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91a9513640 1 -- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291eddf9f0 msgr2=0x56291eddfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91a9513640 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291eddf9f0 0x56291eddfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91a9513640 1 -- 172.21.15.84:0/682967080 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919800e040 con 0x56291edfb1e0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91a9513640 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edfb1e0 0x56291edf12d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9198007010 tx=0x7f9198004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e50087bb77a4897 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f9184ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f9184ff9640 1 -- 172.21.15.84:0/682967080 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198020c80 con 0x56291edfb1e0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f91aebe6740 1 -- 172.21.15.84:0/682967080 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56291ed2fdb0 con 0x56291edfb1e0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.937+0000 7f9184ff9640 1 -- 172.21.15.84:0/682967080 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9198020de0 con 0x56291edfb1e0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f9184ff9640 1 -- 172.21.15.84:0/682967080 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9198015410 con 0x56291edfb1e0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f91aebe6740 10 client.4848 fetch_fsmap learned FSMap version 9 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f91aebe6740 1 -- 172.21.15.84:0/682967080 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56291ed355a0 con 0x56291edfb1e0 2023-12-12T09:20:22.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f9184ff9640 1 -- 172.21.15.84:0/682967080 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56291ed2fdb0 con 0x56291edfb1e0 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f9184ff9640 1 -- 172.21.15.84:0/682967080 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9198015570 con 0x56291edfb1e0 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f91aebe6740 10 client.4848 fetch_fsmap finished waiting for FSMap version 9 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f91aebe6740 10 client.4848 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f91aebe6740 20 client.4848 populate_metadata read hostname 'smithi084' 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f91aebe6740 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x56291ee316d0 0x56291ee33ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f91aebe6740 4 client.4848 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.938+0000 7f91aebe6740 1 -- 172.21.15.84:0/682967080 --> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56291ed2fad0 con 0x56291ee316d0 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.939+0000 7f91a9d14640 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x56291ee316d0 0x56291ee33ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.940+0000 7f91a9d14640 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x56291ee316d0 0x56291ee33ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d2cd2c85ee6ee4 server_cookie=8c6271ebf4c30dc3 in_seq=0 out_seq=0 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.940+0000 7f9184ff9640 10 client.4848 ms_handle_connect on v2:172.21.15.99:6832/3738121458 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.941+0000 7f9184ff9640 1 -- 172.21.15.84:0/682967080 <== mds.0 v2:172.21.15.99:6832/3738121458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56291ed2fad0 con 0x56291ee316d0 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.941+0000 7f9184ff9640 10 client.4848 handle_command_reply: tid=0 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.941+0000 7f91aebe6740 1 client.4848 shutdown 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 -- 172.21.15.84:0/682967080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edfb1e0 msgr2=0x56291edf12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edfb1e0 0x56291edf12d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9198007010 tx=0x7f9198004730 comp rx=0 tx=0).stop 2023-12-12T09:20:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 -- 172.21.15.84:0/682967080 shutdown_connections 2023-12-12T09:20:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x56291ee316d0 0x56291ee33ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291eddf9f0 0x56291eddfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291edfb1e0 0x56291edf12d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f9184ff9640 0 client.4848 ms_handle_reset on v2:172.21.15.99:6832/3738121458 2023-12-12T09:20:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 --2- 172.21.15.84:0/682967080 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 0x56291edf4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 -- 172.21.15.84:0/682967080 >> 172.21.15.84:0/682967080 conn(0x56291edcb490 msgr2=0x56291edcf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:22.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 -- 172.21.15.84:0/682967080 shutdown_connections 2023-12-12T09:20:22.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 1 -- 172.21.15.84:0/682967080 wait complete. 2023-12-12T09:20:22.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.942+0000 7f91aebe6740 20 client.4848 trim_cache size 0 max 16384 2023-12-12T09:20:22.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.959+0000 7f91aebe6740 1 Processor -- start 2023-12-12T09:20:22.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.959+0000 7f91aebe6740 1 -- start start 2023-12-12T09:20:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 0x56291edefa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edfb1e0 0x56291edcf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91aebe6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291edc71e0 con 0x56291eddf9f0 2023-12-12T09:20:22.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91aebe6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291ed360c0 con 0x56291edced60 2023-12-12T09:20:22.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91aebe6740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56291edf8d00 con 0x56291edfb1e0 2023-12-12T09:20:22.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91a9513640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91a9513640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41318/0 (socket says 172.21.15.84:41318) 2023-12-12T09:20:22.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.960+0000 7f91a9513640 1 -- 172.21.15.84:0/3718482053 learned_addr learned my addr 172.21.15.84:0/3718482053 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:22.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f91a9513640 1 -- 172.21.15.84:0/3718482053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edfb1e0 msgr2=0x56291edcf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f91a9513640 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edfb1e0 0x56291edcf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f91a9513640 1 -- 172.21.15.84:0/3718482053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 msgr2=0x56291edefa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f91a9d14640 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 0x56291edefa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f91a9513640 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 0x56291edefa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f91a9513640 1 -- 172.21.15.84:0/3718482053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56291ecd2b80 con 0x56291eddf9f0 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f91a9d14640 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 0x56291edefa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f91a9513640 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f919800f620 tx=0x7f919802d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4ec7a9e8f4741a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f9187fff640 1 -- 172.21.15.84:0/3718482053 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198014830 con 0x56291eddf9f0 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f9187fff640 1 -- 172.21.15.84:0/3718482053 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9198015d90 con 0x56291eddf9f0 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.961+0000 7f9187fff640 1 -- 172.21.15.84:0/3718482053 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198015610 con 0x56291eddf9f0 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 -- 172.21.15.84:0/3718482053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 msgr2=0x56291edcf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f919800f620 tx=0x7f919802d040 comp rx=0 tx=0).stop 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 -- 172.21.15.84:0/3718482053 shutdown_connections 2023-12-12T09:20:22.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edfb1e0 0x56291edcf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 --2- 172.21.15.84:0/3718482053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edced60 0x56291edefa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 -- 172.21.15.84:0/3718482053 >> 172.21.15.84:0/3718482053 conn(0x56291edcb490 msgr2=0x56291edd1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 -- 172.21.15.84:0/3718482053 shutdown_connections 2023-12-12T09:20:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.962+0000 7f91aebe6740 1 -- 172.21.15.84:0/3718482053 wait complete. 2023-12-12T09:20:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.963+0000 7f91aebe6740 1 -- start start 2023-12-12T09:20:22.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.963+0000 7f91aebe6740 1 Processor -- start 2023-12-12T09:20:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 0x56291ee80180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91aebe6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edfb1e0 0x56291edcf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91aebe6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291edf5de0 con 0x56291eddf9f0 2023-12-12T09:20:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91aebe6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56291ee352c0 con 0x56291edfb1e0 2023-12-12T09:20:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91aebe6740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x56291edf7280 con 0x56291edced60 2023-12-12T09:20:22.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91aebe6740 10 client.0 _ll_register_callbacks cb 0x7f919800f900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91a9513640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91a9513640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41330/0 (socket says 172.21.15.84:41330) 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.964+0000 7f91a9513640 1 -- 172.21.15.84:0/2480427604 learned_addr learned my addr 172.21.15.84:0/2480427604 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91a9d14640 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 0x56291ee80180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91aa515640 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edfb1e0 0x56291edcf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91a9513640 1 -- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 msgr2=0x56291ee80180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91a9513640 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 0x56291ee80180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91a9513640 1 -- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edfb1e0 msgr2=0x56291edcf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:22.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91a9513640 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edfb1e0 0x56291edcf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91a9513640 1 -- 172.21.15.84:0/2480427604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56291ed355a0 con 0x56291eddf9f0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91a9513640 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f919800b390 tx=0x7f919801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979caf84011daf37 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f9184ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f9184ff9640 1 -- 172.21.15.84:0/2480427604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198020e90 con 0x56291eddf9f0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f9184ff9640 1 -- 172.21.15.84:0/2480427604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9198043070 con 0x56291eddf9f0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.965+0000 7f91aebe6740 1 -- 172.21.15.84:0/2480427604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9198019070 con 0x56291eddf9f0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f9184ff9640 1 -- 172.21.15.84:0/2480427604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9198005990 con 0x56291eddf9f0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f91aebe6740 10 client.4854 fetch_fsmap learned FSMap version 9 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f91aebe6740 1 -- 172.21.15.84:0/2480427604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56291ecf8170 con 0x56291eddf9f0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f9184ff9640 1 -- 172.21.15.84:0/2480427604 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9198019070 con 0x56291eddf9f0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f9184ff9640 1 -- 172.21.15.84:0/2480427604 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9198005af0 con 0x56291eddf9f0 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f91aebe6740 10 client.4854 fetch_fsmap finished waiting for FSMap version 9 2023-12-12T09:20:22.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f91aebe6740 10 client.4854 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f91aebe6740 20 client.4854 populate_metadata read hostname 'smithi084' 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f91aebe6740 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x56291ee28f20 0x56291edf6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f91aebe6740 4 client.4854 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.966+0000 7f91aebe6740 1 -- 172.21.15.84:0/2480427604 --> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56291ea376c0 con 0x56291ee28f20 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.967+0000 7f91a9d14640 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x56291ee28f20 0x56291edf6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.967+0000 7f91a9d14640 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x56291ee28f20 0x56291edf6200 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=179c2e2c3ec6783c server_cookie=66055216368cad40 in_seq=0 out_seq=0 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.967+0000 7f9184ff9640 10 client.4854 ms_handle_connect on v2:172.21.15.99:6832/3738121458 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f9184ff9640 1 -- 172.21.15.84:0/2480427604 <== mds.0 v2:172.21.15.99:6832/3738121458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x56291ea376c0 con 0x56291ee28f20 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f9184ff9640 10 client.4854 handle_command_reply: tid=0 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 client.4854 shutdown 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 -- 172.21.15.84:0/2480427604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 msgr2=0x56291edcf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f919800b390 tx=0x7f919801f000 comp rx=0 tx=0).stop 2023-12-12T09:20:22.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 -- 172.21.15.84:0/2480427604 shutdown_connections 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:6832/3738121458,v1:172.21.15.99:6833/3738121458] conn(0x56291ee28f20 0x56291edf6200 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56291edfb1e0 0x56291edcf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56291eddf9f0 0x56291edcf300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f9184ff9640 0 client.4854 ms_handle_reset on v2:172.21.15.99:6832/3738121458 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 --2- 172.21.15.84:0/2480427604 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x56291edced60 0x56291ee80180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 -- 172.21.15.84:0/2480427604 >> 172.21.15.84:0/2480427604 conn(0x56291edcb490 msgr2=0x56291ee19500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 -- 172.21.15.84:0/2480427604 shutdown_connections 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.968+0000 7f91aebe6740 1 -- 172.21.15.84:0/2480427604 wait complete. 2023-12-12T09:20:22.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aebe6740 20 client.4854 trim_cache size 0 max 16384 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "6cf288f4-52d2-4b85-a338-100a1ef88319", 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4255, 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 40.860646146999997, 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 9, 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 26, 2023-12-12T09:20:22.975 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 26, 2023-12-12T09:20:22.976 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 48.527042242 2023-12-12T09:20:22.976 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:20:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 -- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f918806ae40 msgr2=0x7f918806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f918806ae40 0x7f918806d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f91a4142840 tx=0x7f9198008040 comp rx=0 tx=0).stop 2023-12-12T09:20:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 -- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 msgr2=0x7f91a415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a415b8c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91a002bee0 tx=0x7f91a00046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 -- 172.21.15.84:0/1895673634 shutdown_connections 2023-12-12T09:20:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91a415f2f0 0x7f91a4150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f91a415e950 0x7f91a414ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f918806ae40 0x7f918806d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 --2- 172.21.15.84:0/1895673634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91a4144740 0x7f91a415b8c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:22.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 -- 172.21.15.84:0/1895673634 >> 172.21.15.84:0/1895673634 conn(0x7f91a40b07f0 msgr2=0x7f91a4141710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:22.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 -- 172.21.15.84:0/1895673634 shutdown_connections 2023-12-12T09:20:22.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:22.969+0000 7f91aad16640 1 -- 172.21.15.84:0/1895673634 wait complete. 2023-12-12T09:20:22.987 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-12T09:20:22.998 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-12T09:20:22.999 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-12T09:20:22.999 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-12T09:20:22.999 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T09:20:22.999 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:23.000 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-12T09:20:23.001 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T09:20:23.001 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-12T09:20:23.001 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-12T09:20:23.001 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T09:20:23.001 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:23.001 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-12T09:20:23.001 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T09:20:23.001 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-12T09:20:23.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:23.001 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:20:23.051 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-12T09:20:23.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:23.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T09:20:23.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:23.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-12-12T09:20:23.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:23.279 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2023-12-12T09:20:23.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:23.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2023-12-12T09:20:23.437 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2023-12-12T09:20:23.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:20:23.441 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-12T09:20:23.441 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:20:23.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.663+0000 7f5a1d87c640 1 Processor -- start 2023-12-12T09:20:23.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.663+0000 7f5a1d87c640 1 -- start start 2023-12-12T09:20:23.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a1d87c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a180cb2d0 0x7f5a18162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:23.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a1d87c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5a180b3f80 0x7f5a180703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:23.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a1d87c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a180723a0 con 0x7f5a180b1dc0 2023-12-12T09:20:23.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a1d87c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a18162ab0 con 0x7f5a180cb2d0 2023-12-12T09:20:23.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a1d87c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a180b2360 con 0x7f5a180b3f80 2023-12-12T09:20:23.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a16ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a180cb2d0 0x7f5a18162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:23.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a16ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a180cb2d0 0x7f5a18162570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41342/0 (socket says 172.21.15.84:41342) 2023-12-12T09:20:23.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a16ffd640 1 -- 172.21.15.84:0/1743870680 learned_addr learned my addr 172.21.15.84:0/1743870680 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:23.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a177fe640 1 --2- 172.21.15.84:0/1743870680 >> v2:172.21.15.99:3300/0 conn(0x7f5a180b3f80 0x7f5a180703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:23.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a16ffd640 1 -- 172.21.15.84:0/1743870680 >> v2:172.21.15.99:3300/0 conn(0x7f5a180b3f80 msgr2=0x7f5a180703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:23.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a16ffd640 1 --2- 172.21.15.84:0/1743870680 >> v2:172.21.15.99:3300/0 conn(0x7f5a180b3f80 0x7f5a180703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a16ffd640 1 -- 172.21.15.84:0/1743870680 >> v1:172.21.15.84:6789/0 conn(0x7f5a180b1dc0 legacy=0x7f5a180b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:23.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.666+0000 7f5a16ffd640 1 -- 172.21.15.84:0/1743870680 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a180b2640 con 0x7f5a180cb2d0 2023-12-12T09:20:23.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.667+0000 7f5a16ffd640 1 --2- 172.21.15.84:0/1743870680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180cb2d0 0x7f5a18162570 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5a180b3250 tx=0x7f5a0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a163b24eab3714b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:23.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.667+0000 7f5a15ffb640 1 -- 172.21.15.84:0/1743870680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08031870 con 0x7f5a180cb2d0 2023-12-12T09:20:23.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.667+0000 7f5a15ffb640 1 -- 172.21.15.84:0/1743870680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a080319d0 con 0x7f5a180cb2d0 2023-12-12T09:20:23.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.667+0000 7f5a15ffb640 1 -- 172.21.15.84:0/1743870680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08031d60 con 0x7f5a180cb2d0 2023-12-12T09:20:23.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.668+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1743870680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180cb2d0 msgr2=0x7f5a18162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:23.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.668+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1743870680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180cb2d0 0x7f5a18162570 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5a180b3250 tx=0x7f5a0802b910 comp rx=0 tx=0).stop 2023-12-12T09:20:23.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.668+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1743870680 shutdown_connections 2023-12-12T09:20:23.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.668+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1743870680 >> v2:172.21.15.99:3300/0 conn(0x7f5a180b3f80 0x7f5a180703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.668+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1743870680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180cb2d0 0x7f5a18162570 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.668+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1743870680 >> 172.21.15.84:0/1743870680 conn(0x7f5a1806c3d0 msgr2=0x7f5a1806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:23.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.668+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1743870680 shutdown_connections 2023-12-12T09:20:23.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.668+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1743870680 wait complete. 2023-12-12T09:20:23.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.670+0000 7f5a1d87c640 1 Processor -- start 2023-12-12T09:20:23.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.670+0000 7f5a1d87c640 1 -- start start 2023-12-12T09:20:23.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a1d87c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180b1dc0 0x7f5a1815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:23.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a1d87c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a180b3f80 0x7f5a18156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:23.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a1d87c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a180cb2d0 0x7f5a1815f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:23.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a1d87c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1815daf0 con 0x7f5a180b1dc0 2023-12-12T09:20:23.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a1d87c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1815cee0 con 0x7f5a180b3f80 2023-12-12T09:20:23.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a1d87c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1815d1c0 con 0x7f5a180cb2d0 2023-12-12T09:20:23.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a16ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180b1dc0 0x7f5a1815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a16ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180b1dc0 0x7f5a1815c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41346/0 (socket says 172.21.15.84:41346) 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a16ffd640 1 -- 172.21.15.84:0/1013222452 learned_addr learned my addr 172.21.15.84:0/1013222452 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.671+0000 7f5a177fe640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a180cb2d0 0x7f5a1815f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a167fc640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a180b3f80 0x7f5a18156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a16ffd640 1 -- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a180cb2d0 msgr2=0x7f5a1815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a16ffd640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a180cb2d0 0x7f5a1815f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a16ffd640 1 -- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a180b3f80 msgr2=0x7f5a18156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a16ffd640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a180b3f80 0x7f5a18156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a16ffd640 1 -- 172.21.15.84:0/1013222452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a080094d0 con 0x7f5a180b1dc0 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a177fe640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a180cb2d0 0x7f5a1815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a167fc640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a180b3f80 0x7f5a18156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:23.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a16ffd640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180b1dc0 0x7f5a1815c870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5a0802b950 tx=0x7f5a080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:23.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f59fffff640 1 -- 172.21.15.84:0/1013222452 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0803ad30 con 0x7f5a180b1dc0 2023-12-12T09:20:23.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f59fffff640 1 -- 172.21.15.84:0/1013222452 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a080443f0 con 0x7f5a180b1dc0 2023-12-12T09:20:23.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1815d4a0 con 0x7f5a180b1dc0 2023-12-12T09:20:23.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f59fffff640 1 -- 172.21.15.84:0/1013222452 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080447a0 con 0x7f5a180b1dc0 2023-12-12T09:20:23.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.672+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a18157420 con 0x7f5a180b1dc0 2023-12-12T09:20:23.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.673+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a180673c0 con 0x7f5a180b1dc0 2023-12-12T09:20:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.674+0000 7f59fffff640 1 -- 172.21.15.84:0/1013222452 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a0804d450 con 0x7f5a180b1dc0 2023-12-12T09:20:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.675+0000 7f59fffff640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a0406ae70 0x7f5a0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.675+0000 7f59fffff640 1 -- 172.21.15.84:0/1013222452 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a0802d040 con 0x7f5a180b1dc0 2023-12-12T09:20:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.676+0000 7f5a167fc640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a0406ae70 0x7f5a0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.676+0000 7f5a167fc640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a0406ae70 0x7f5a0406d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a181581b0 tx=0x7f5a0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.680+0000 7f59fffff640 1 -- 172.21.15.84:0/1013222452 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a080b1020 con 0x7f5a180b1dc0 2023-12-12T09:20:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.909+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a18071e50 con 0x7f5a180b1dc0 2023-12-12T09:20:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.910+0000 7f59fffff640 1 -- 172.21.15.84:0/1013222452 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5a08035020 con 0x7f5a180b1dc0 2023-12-12T09:20:23.911 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.912+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a0406ae70 msgr2=0x7f5a0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.912+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a0406ae70 0x7f5a0406d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a181581b0 tx=0x7f5a0c009040 comp rx=0 tx=0).stop 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.912+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180b1dc0 msgr2=0x7f5a1815c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.912+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180b1dc0 0x7f5a1815c870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5a0802b950 tx=0x7f5a080046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.912+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 shutdown_connections 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.912+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a180cb2d0 0x7f5a1815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.912+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a180b3f80 0x7f5a18156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.912+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a0406ae70 0x7f5a0406d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.913+0000 7f5a1d87c640 1 --2- 172.21.15.84:0/1013222452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a180b1dc0 0x7f5a1815c870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.913+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 >> 172.21.15.84:0/1013222452 conn(0x7f5a1806c3d0 msgr2=0x7f5a180aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.913+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 shutdown_connections 2023-12-12T09:20:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:23.913+0000 7f5a1d87c640 1 -- 172.21.15.84:0/1013222452 wait complete. 2023-12-12T09:20:23.933 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:20:23.933 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:20:23.934 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:20:23.934 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:20:23.934 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:23.934 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:20:23.934 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:20:23.934 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:20:23.934 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:20:23.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:23.934 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:20:23.986 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42180sec preferred_lft 42180sec 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:23.987 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T09:20:23.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:23.988 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:23.988 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:23.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-12-12T09:20:23.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-12-12T09:20:23.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-12-12T09:20:23.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T09:20:23.988 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:24.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:24.220 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:20:24.296 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:20:24.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:24.299 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:20:24.352 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:20:24.352 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:20:24.352 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:20:24.352 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:20:24.352 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:20:24.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:24.353 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:24.353 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:24.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:20:24.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:20:24.354 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:20:24.354 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:24.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:24.533 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:20:24.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:24.584 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-12-12T09:20:24.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:24.638 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:24.638 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:24.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:24.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-12T09:20:24.638 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:24.775 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-12T09:20:24.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:24.776 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:24.776 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:24.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-12T09:20:24.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T09:20:24.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-12T09:20:24.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-12T09:20:24.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-12T09:20:24.776 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:25.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:25.049 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:25.049 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:25.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-12-12T09:20:25.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T09:20:25.049 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:25.201 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T09:20:25.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:20:25.201 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:25.247 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:20:25.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:20:25.247 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:25.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:20:25.428 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:20:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:20:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:20:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:20:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:20:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:20:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:20:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:20:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:25.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:25.482 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:20:25.523 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:20:25.523 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T09:20:25.571 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:20:25.654 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:20:25.696 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:20:25.696 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:20:25.696 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:20:25.696 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:20:25.696 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:20:25.697 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:25.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:25.699 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:20:25.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-12-12T09:20:25.759+0000 7f98721f6480 -1 init, newargv = 0x5599d4af39a0 newargc=15 2023-12-12T09:20:25.760 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[98345]: starting ceph client 2023-12-12T09:20:25.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[98345]: starting fuse 2023-12-12T09:20:25.785 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:20:25.786 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T09:20:25.786 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-12-12T09:20:25.787 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:20:25.983 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.98345.asok 2023-12-12T09:20:25.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:20:26.000 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.98345.asok 2023-12-12T09:20:26.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:26.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.98345.asok status 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "98345", 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:20:26.223 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4872, 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4872 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2158038788 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2158038788 2023-12-12T09:20:26.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4872 192.168.0.1:0/2158038788", 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2158038788", 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 9, 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 26, 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:20:26.225 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:20:26.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:20:26.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.430+0000 7f9d88cec640 1 Processor -- start 2023-12-12T09:20:26.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.431+0000 7f9d88cec640 1 -- start start 2023-12-12T09:20:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.432+0000 7f9d88cec640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9d84071bb0 0x7f9d84071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.432+0000 7f9d88cec640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9d8413dae0 0x7f9d8413f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.432+0000 7f9d88cec640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840724d0 con 0x7f9d840ce330 2023-12-12T09:20:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.432+0000 7f9d88cec640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d84140270 con 0x7f9d84071bb0 2023-12-12T09:20:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.432+0000 7f9d88cec640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d840cd850 con 0x7f9d8413dae0 2023-12-12T09:20:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d8259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9d84071bb0 0x7f9d84071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d8259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9d84071bb0 0x7f9d84071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52674/0 (socket says 172.21.15.84:52674) 2023-12-12T09:20:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d8259c640 1 -- 172.21.15.84:0/404460362 learned_addr learned my addr 172.21.15.84:0/404460362 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d82d9d640 1 --2- 172.21.15.84:0/404460362 >> v2:172.21.15.99:3300/0 conn(0x7f9d8413dae0 0x7f9d8413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d8259c640 1 -- 172.21.15.84:0/404460362 >> v2:172.21.15.99:3300/0 conn(0x7f9d8413dae0 msgr2=0x7f9d8413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d8259c640 1 --2- 172.21.15.84:0/404460362 >> v2:172.21.15.99:3300/0 conn(0x7f9d8413dae0 0x7f9d8413f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d8259c640 1 -- 172.21.15.84:0/404460362 >> v1:172.21.15.99:6789/0 conn(0x7f9d840ce330 legacy=0x7f9d8413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d8259c640 1 -- 172.21.15.84:0/404460362 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840cdb30 con 0x7f9d84071bb0 2023-12-12T09:20:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.433+0000 7f9d82d9d640 1 --2- 172.21.15.84:0/404460362 >> v2:172.21.15.99:3300/0 conn(0x7f9d8413dae0 0x7f9d8413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.434+0000 7f9d8259c640 1 --2- 172.21.15.84:0/404460362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d84071bb0 0x7f9d84071f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d840701a0 tx=0x7f9d7402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c18767b43b3e115 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.434+0000 7f9d8159a640 1 -- 172.21.15.84:0/404460362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7402ee90 con 0x7f9d84071bb0 2023-12-12T09:20:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d8159a640 1 -- 172.21.15.84:0/404460362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d74036440 con 0x7f9d84071bb0 2023-12-12T09:20:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d8159a640 1 -- 172.21.15.84:0/404460362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740367d0 con 0x7f9d84071bb0 2023-12-12T09:20:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d88cec640 1 -- 172.21.15.84:0/404460362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d84071bb0 msgr2=0x7f9d84071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d88cec640 1 --2- 172.21.15.84:0/404460362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d84071bb0 0x7f9d84071f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9d840701a0 tx=0x7f9d7402e0e0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d88cec640 1 -- 172.21.15.84:0/404460362 shutdown_connections 2023-12-12T09:20:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d88cec640 1 --2- 172.21.15.84:0/404460362 >> v2:172.21.15.99:3300/0 conn(0x7f9d8413dae0 0x7f9d8413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d88cec640 1 --2- 172.21.15.84:0/404460362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d84071bb0 0x7f9d84071f90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d88cec640 1 -- 172.21.15.84:0/404460362 >> 172.21.15.84:0/404460362 conn(0x7f9d8406c3d0 msgr2=0x7f9d8406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d88cec640 1 -- 172.21.15.84:0/404460362 shutdown_connections 2023-12-12T09:20:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.435+0000 7f9d88cec640 1 -- 172.21.15.84:0/404460362 wait complete. 2023-12-12T09:20:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.437+0000 7f9d88cec640 1 Processor -- start 2023-12-12T09:20:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.437+0000 7f9d88cec640 1 -- start start 2023-12-12T09:20:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d88cec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d84071bb0 0x7f9d84154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d88cec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d840ce330 0x7f9d841f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d88cec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d841f3b60 0x7f9d8406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d88cec640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d841f4010 con 0x7f9d841f3b60 2023-12-12T09:20:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d88cec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8406df20 con 0x7f9d840ce330 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d88cec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8406e150 con 0x7f9d84071bb0 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d82d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d841f3b60 0x7f9d8406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d82d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d841f3b60 0x7f9d8406d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52682/0 (socket says 172.21.15.84:52682) 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.438+0000 7f9d82d9d640 1 -- 172.21.15.84:0/3506667137 learned_addr learned my addr 172.21.15.84:0/3506667137 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d8259c640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d84071bb0 0x7f9d84154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d81d9b640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d840ce330 0x7f9d841f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d82d9d640 1 -- 172.21.15.84:0/3506667137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d84071bb0 msgr2=0x7f9d84154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d82d9d640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d84071bb0 0x7f9d84154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d82d9d640 1 -- 172.21.15.84:0/3506667137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d840ce330 msgr2=0x7f9d841f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d82d9d640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d840ce330 0x7f9d841f41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d82d9d640 1 -- 172.21.15.84:0/3506667137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7400b770 con 0x7f9d841f3b60 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d82d9d640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d841f3b60 0x7f9d8406d9e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00cd80 tx=0x7f9d7c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d72ffd640 1 -- 172.21.15.84:0/3506667137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00f680 con 0x7f9d841f3b60 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d72ffd640 1 -- 172.21.15.84:0/3506667137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c00f800 con 0x7f9d841f3b60 2023-12-12T09:20:26.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d72ffd640 1 -- 172.21.15.84:0/3506667137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c00fbb0 con 0x7f9d841f3b60 2023-12-12T09:20:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d84137eb0 con 0x7f9d841f3b60 2023-12-12T09:20:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.439+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d84138470 con 0x7f9d841f3b60 2023-12-12T09:20:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.441+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d840673c0 con 0x7f9d841f3b60 2023-12-12T09:20:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.441+0000 7f9d72ffd640 1 -- 172.21.15.84:0/3506667137 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d7c00b040 con 0x7f9d841f3b60 2023-12-12T09:20:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.442+0000 7f9d72ffd640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9d6406ae40 0x7f9d6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.442+0000 7f9d72ffd640 1 -- 172.21.15.84:0/3506667137 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d7c08a200 con 0x7f9d841f3b60 2023-12-12T09:20:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.442+0000 7f9d8259c640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9d6406ae40 0x7f9d6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.443+0000 7f9d8259c640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9d6406ae40 0x7f9d6406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d74038000 tx=0x7f9d74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:26.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.446+0000 7f9d72ffd640 1 -- 172.21.15.84:0/3506667137 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d7c055050 con 0x7f9d841f3b60 2023-12-12T09:20:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.690+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d840ae710 con 0x7f9d841f3b60 2023-12-12T09:20:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.691+0000 7f9d72ffd640 1 -- 172.21.15.84:0/3506667137 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9d7c058670 con 0x7f9d841f3b60 2023-12-12T09:20:26.691 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T09:20:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9d6406ae40 msgr2=0x7f9d6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9d6406ae40 0x7f9d6406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d74038000 tx=0x7f9d74008040 comp rx=0 tx=0).stop 2023-12-12T09:20:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d841f3b60 msgr2=0x7f9d8406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d841f3b60 0x7f9d8406d9e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00cd80 tx=0x7f9d7c00a650 comp rx=0 tx=0).stop 2023-12-12T09:20:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 shutdown_connections 2023-12-12T09:20:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9d6406ae40 0x7f9d6406d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d841f3b60 0x7f9d8406d9e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d840ce330 0x7f9d841f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 --2- 172.21.15.84:0/3506667137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9d84071bb0 0x7f9d84154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 >> 172.21.15.84:0/3506667137 conn(0x7f9d8406c3d0 msgr2=0x7f9d840b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 shutdown_connections 2023-12-12T09:20:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:26.694+0000 7f9d88cec640 1 -- 172.21.15.84:0/3506667137 wait complete. 2023-12-12T09:20:26.711 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:20:26.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:20:26.712 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:20:26.712 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-12T09:20:26.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-12T09:20:26.712 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:20:26.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:20:26.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:20:26.712 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-12T09:20:26.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:26.712 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:20:26.766 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:20:26.766 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:20:26.766 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:20:26.766 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:26.766 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42177sec preferred_lft 42177sec 2023-12-12T09:20:26.767 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c2:ab:b4:6c:14:99 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c8b:52ff:fef6:cd60/64 scope link 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c2:ab:b4:6c:14:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c0ab:b4ff:fe6c:1499/64 scope link tentative 2023-12-12T09:20:26.768 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:26.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:26.769 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:20:26.852 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:20:26.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:26.856 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:20:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:20:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:20:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:20:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:20:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:20:26.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:26.906 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:26.906 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:26.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:20:26.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:20:26.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:20:26.906 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:27.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:27.090 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:20:27.140 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:20:27.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:27.141 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-12-12T09:20:27.185 INFO:teuthology.orchestra.run.smithi084.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-12T09:20:27.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:27.186 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:27.187 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:27.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:20:27.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-12T09:20:27.187 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:27.340 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:20:27.346 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:20:27.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:27.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-12T09:20:27.503 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:20:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:20:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:20:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:20:27.503 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:27.504 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:20:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether d2:22:3f:96:f1:15 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-12T09:20:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-12T09:20:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::d022:3fff:fe96:f115/64 scope link 2023-12-12T09:20:27.504 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:27.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:27.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-12T09:20:27.599 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:20:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:20:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:20:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:20:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:27.599 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:20:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether d2:22:3f:96:f1:15 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-12T09:20:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-12T09:20:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::d022:3fff:fe96:f115/64 scope link 2023-12-12T09:20:27.600 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:27.603 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-12T09:20:27.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:27.603 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:27.603 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:27.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-12T09:20:27.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-12T09:20:27.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-12T09:20:27.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-12T09:20:27.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-12T09:20:27.604 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:27.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:27.874 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:20:27.874 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:20:27.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.1 up 2023-12-12T09:20:27.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.1 master ceph-brx 2023-12-12T09:20:27.874 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:20:28.040 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-12T09:20:28.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:20:28.040 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-12T09:20:28.090 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-12T09:20:28.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:20:28.091 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-12T09:20:28.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:20:28.233 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:20:28.289 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:20:28.290 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:20:28.291 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:20:28.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:28.292 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:20:28.343 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:20:28.343 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [39] 2023-12-12T09:20:28.344 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-12T09:20:28.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:20:28.427 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:20:28.469 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:20:28.470 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:20:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:20:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:20:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:20:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:20:28.471 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:20:28.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:28.472 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:20:28.532 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:2023-12-12T09:20:28.533+0000 7f9a5d4fa480 -1 init, newargv = 0x55a9d63fbd70 newargc=15 2023-12-12T09:20:28.533 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:ceph-fuse[98860]: starting ceph client 2023-12-12T09:20:28.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:ceph-fuse[98860]: starting fuse 2023-12-12T09:20:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:20:28.558 INFO:teuthology.orchestra.run.smithi084.stdout:42 2023-12-12T09:20:28.558 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39, 42] 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:20:28.559 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.2")) 2023-12-12T09:20:28.560 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:20:28.770 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.2.98860.asok 2023-12-12T09:20:28.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:20:28.788 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.98860.asok 2023-12-12T09:20:28.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:28.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.98860.asok status 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "2", 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "98860", 2023-12-12T09:20:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4884, 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4884 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.2:0", 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2349821607 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:20:29.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.2:0", 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2349821607 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4884 192.168.0.2:0/2349821607", 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.2:0/2349821607", 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 9, 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 27, 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:20:29.031 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:20:29.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:20:29.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.248+0000 7fe2113d7640 1 Processor -- start 2023-12-12T09:20:29.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.248+0000 7fe2113d7640 1 -- start start 2023-12-12T09:20:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.250+0000 7fe2113d7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe20c142f40 0x7fe20c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.250+0000 7fe2113d7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c0b4ba0 0x7fe20c15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.250+0000 7fe2113d7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c0b3b60 con 0x7fe20c13ff90 2023-12-12T09:20:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.250+0000 7fe2113d7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c15e6d0 con 0x7fe20c142f40 2023-12-12T09:20:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.250+0000 7fe2113d7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c15e420 con 0x7fe20c0b4ba0 2023-12-12T09:20:29.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.251+0000 7fe203fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe20c142f40 0x7fe20c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:29.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.251+0000 7fe20b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c0b4ba0 0x7fe20c15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:29.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.251+0000 7fe203fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe20c142f40 0x7fe20c15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:35080/0 (socket says 172.21.15.84:35080) 2023-12-12T09:20:29.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.251+0000 7fe20b7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c0b4ba0 0x7fe20c15dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:53824/0 (socket says 172.21.15.84:53824) 2023-12-12T09:20:29.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.251+0000 7fe203fff640 1 -- 172.21.15.84:0/1481452339 learned_addr learned my addr 172.21.15.84:0/1481452339 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.252+0000 7fe20a7fc640 1 -- 172.21.15.84:0/1481452339 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001752424 0 0) 0x7fe20c0b3b60 con 0x7fe20c13ff90 2023-12-12T09:20:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.252+0000 7fe203fff640 1 -- 172.21.15.84:0/1481452339 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c0b4ba0 msgr2=0x7fe20c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.252+0000 7fe203fff640 1 --2- 172.21.15.84:0/1481452339 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c0b4ba0 0x7fe20c15dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.252+0000 7fe203fff640 1 -- 172.21.15.84:0/1481452339 >> v1:172.21.15.99:6789/0 conn(0x7fe20c13ff90 legacy=0x7fe20c142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.252+0000 7fe203fff640 1 -- 172.21.15.84:0/1481452339 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0b3de0 con 0x7fe20c142f40 2023-12-12T09:20:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.252+0000 7fe20b7fe640 1 --2- 172.21.15.84:0/1481452339 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c0b4ba0 0x7fe20c15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:20:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.253+0000 7fe203fff640 1 --2- 172.21.15.84:0/1481452339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c142f40 0x7fe20c15d9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009870 tx=0x7fe1f402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a529fb6839e438f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe20a7fc640 1 -- 172.21.15.84:0/1481452339 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4030840 con 0x7fe20c142f40 2023-12-12T09:20:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe20a7fc640 1 -- 172.21.15.84:0/1481452339 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f40309a0 con 0x7fe20c142f40 2023-12-12T09:20:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe20a7fc640 1 -- 172.21.15.84:0/1481452339 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4030d30 con 0x7fe20c142f40 2023-12-12T09:20:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe2113d7640 1 -- 172.21.15.84:0/1481452339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c142f40 msgr2=0x7fe20c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1481452339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c142f40 0x7fe20c15d9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009870 tx=0x7fe1f402b980 comp rx=0 tx=0).stop 2023-12-12T09:20:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe2113d7640 1 -- 172.21.15.84:0/1481452339 shutdown_connections 2023-12-12T09:20:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1481452339 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c0b4ba0 0x7fe20c15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1481452339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c142f40 0x7fe20c15d9a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe2113d7640 1 -- 172.21.15.84:0/1481452339 >> 172.21.15.84:0/1481452339 conn(0x7fe20c06c3d0 msgr2=0x7fe20c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe2113d7640 1 -- 172.21.15.84:0/1481452339 shutdown_connections 2023-12-12T09:20:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.254+0000 7fe2113d7640 1 -- 172.21.15.84:0/1481452339 wait complete. 2023-12-12T09:20:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.256+0000 7fe2113d7640 1 Processor -- start 2023-12-12T09:20:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.256+0000 7fe2113d7640 1 -- start start 2023-12-12T09:20:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe2113d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c0b4ba0 0x7fe20c13e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe2113d7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c13ff90 0x7fe20c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe2113d7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe20c142f40 0x7fe20c154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe2113d7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c15adc0 con 0x7fe20c142f40 2023-12-12T09:20:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe2113d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c13e100 con 0x7fe20c0b4ba0 2023-12-12T09:20:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe2113d7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c13d4f0 con 0x7fe20c13ff90 2023-12-12T09:20:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe20b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe20c142f40 0x7fe20c154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe20b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe20c142f40 0x7fe20c154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52694/0 (socket says 172.21.15.84:52694) 2023-12-12T09:20:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.257+0000 7fe20b7fe640 1 -- 172.21.15.84:0/1177003738 learned_addr learned my addr 172.21.15.84:0/1177003738 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe20affd640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c0b4ba0 0x7fe20c13e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe203fff640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c13ff90 0x7fe20c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe20b7fe640 1 -- 172.21.15.84:0/1177003738 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c13ff90 msgr2=0x7fe20c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe20b7fe640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c13ff90 0x7fe20c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe20b7fe640 1 -- 172.21.15.84:0/1177003738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c0b4ba0 msgr2=0x7fe20c13e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe20b7fe640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c0b4ba0 0x7fe20c13e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe20b7fe640 1 -- 172.21.15.84:0/1177003738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009a70 con 0x7fe20c142f40 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe20b7fe640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe20c142f40 0x7fe20c154970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe20400efc0 tx=0x7fe20400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe2037fe640 1 -- 172.21.15.84:0/1177003738 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204009cd0 con 0x7fe20c142f40 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe2037fe640 1 -- 172.21.15.84:0/1177003738 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20400f040 con 0x7fe20c142f40 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.258+0000 7fe2037fe640 1 -- 172.21.15.84:0/1177003738 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204003990 con 0x7fe20c142f40 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.259+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f40094d0 con 0x7fe20c142f40 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.259+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c13dab0 con 0x7fe20c142f40 2023-12-12T09:20:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.260+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c0673c0 con 0x7fe20c142f40 2023-12-12T09:20:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.261+0000 7fe2037fe640 1 -- 172.21.15.84:0/1177003738 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe204014480 con 0x7fe20c142f40 2023-12-12T09:20:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.262+0000 7fe2037fe640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1ec06ae70 0x7fe1ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.262+0000 7fe2037fe640 1 -- 172.21.15.84:0/1177003738 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe20408a6e0 con 0x7fe20c142f40 2023-12-12T09:20:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.262+0000 7fe20affd640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1ec06ae70 0x7fe1ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.262+0000 7fe20affd640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1ec06ae70 0x7fe1ec06d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007fd0 tx=0x7fe1fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:29.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.267+0000 7fe2037fe640 1 -- 172.21.15.84:0/1177003738 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2040552a0 con 0x7fe20c142f40 2023-12-12T09:20:29.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.493+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe20c13e240 con 0x7fe20c142f40 2023-12-12T09:20:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.494+0000 7fe2037fe640 1 -- 172.21.15.84:0/1177003738 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe2040588c0 con 0x7fe20c142f40 2023-12-12T09:20:29.494 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T09:20:29.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1ec06ae70 msgr2=0x7fe1ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:29.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1ec06ae70 0x7fe1ec06d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007fd0 tx=0x7fe1fc009040 comp rx=0 tx=0).stop 2023-12-12T09:20:29.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe20c142f40 msgr2=0x7fe20c154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:29.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe20c142f40 0x7fe20c154970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe20400efc0 tx=0x7fe20400c490 comp rx=0 tx=0).stop 2023-12-12T09:20:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 shutdown_connections 2023-12-12T09:20:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1ec06ae70 0x7fe1ec06d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe20c142f40 0x7fe20c154970 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe20c13ff90 0x7fe20c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 --2- 172.21.15.84:0/1177003738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe20c0b4ba0 0x7fe20c13e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.496+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 >> 172.21.15.84:0/1177003738 conn(0x7fe20c06c3d0 msgr2=0x7fe20c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.497+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 shutdown_connections 2023-12-12T09:20:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:29.497+0000 7fe2113d7640 1 -- 172.21.15.84:0/1177003738 wait complete. 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:20:29.515 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:20:29.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:29.516 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2023-12-12T09:20:29.575 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:20:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:20:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:20:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2023-12-12T09:20:29.575 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42141sec preferred_lft 42141sec 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2023-12-12T09:20:29.576 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:29.577 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T09:20:29.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:29.578 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:29.578 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:29.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2023-12-12T09:20:29.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2023-12-12T09:20:29.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2023-12-12T09:20:29.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T09:20:29.578 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:30.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:30.049 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:20:30.127 INFO:teuthology.orchestra.run.smithi099.stdout:1 2023-12-12T09:20:30.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:30.131 DEBUG:teuthology.orchestra.run.smithi099:> route 2023-12-12T09:20:30.185 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2023-12-12T09:20:30.185 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:20:30.186 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:20:30.186 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:20:30.186 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:20:30.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:30.187 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:30.187 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:30.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:20:30.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:20:30.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:20:30.187 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:30.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:30.881 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2023-12-12T09:20:30.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:30.938 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2023-12-12T09:20:30.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:30.992 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:30.992 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:30.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:30.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-12T09:20:30.992 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:31.131 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-12T09:20:31.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:31.131 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:31.131 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:31.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-12T09:20:31.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T09:20:31.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-12T09:20:31.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-12T09:20:31.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-12T09:20:31.132 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:31.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:31.412 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:31.412 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:31.412 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2023-12-12T09:20:31.412 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T09:20:31.412 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:31.577 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-12T09:20:31.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:20:31.577 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:31.624 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T09:20:31.625 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:20:31.625 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:31.721 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2023-12-12T09:20:31.815 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:20:31.868 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2023-12-12T09:20:31.868 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2023-12-12T09:20:31.868 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2023-12-12T09:20:31.868 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2023-12-12T09:20:31.868 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2023-12-12T09:20:31.868 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2023-12-12T09:20:31.868 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/selinux 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:20:31.869 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:31.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:31.871 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2023-12-12T09:20:31.919 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:20:31.919 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-12T09:20:31.924 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2023-12-12T09:20:31.997 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:20:32.038 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/selinux 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2023-12-12T09:20:32.039 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T09:20:32.040 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2023-12-12T09:20:32.041 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:32.041 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:32.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:32.042 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2023-12-12T09:20:32.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:2023-12-12T09:20:32.107+0000 7f47f480b480 -1 init, newargv = 0x55afd61c7c80 newargc=15 2023-12-12T09:20:32.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[94334]: starting ceph client 2023-12-12T09:20:32.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi099.stderr:ceph-fuse[94334]: starting fuse 2023-12-12T09:20:32.130 INFO:teuthology.orchestra.run.smithi099.stdout:40 2023-12-12T09:20:32.131 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> import re 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> import os 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2023-12-12T09:20:32.131 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> return f 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.1")) 2023-12-12T09:20:32.132 DEBUG:teuthology.orchestra.run.smithi099:> ' 2023-12-12T09:20:32.333 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.1.94334.asok 2023-12-12T09:20:32.338 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:20:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:20:32.351 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.94334.asok 2023-12-12T09:20:32.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:32.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.94334.asok status 2023-12-12T09:20:32.587 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-12-12T09:20:32.587 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "1", 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "94334", 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4639, 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2023-12-12T09:20:32.588 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 4639 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4091803817 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4091803817 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.4639 192.168.0.1:0/4091803817", 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "192.168.0.1:0/4091803817", 2023-12-12T09:20:32.589 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2023-12-12T09:20:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 9, 2023-12-12T09:20:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 28, 2023-12-12T09:20:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:20:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2023-12-12T09:20:32.590 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2023-12-12T09:20:32.590 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-12-12T09:20:32.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:20:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.824+0000 7f8c2bc9b640 1 Processor -- start 2023-12-12T09:20:32.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.824+0000 7f8c2bc9b640 1 -- start start 2023-12-12T09:20:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.826+0000 7f8c2bc9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8c240b4af0 0x7f8c2406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.826+0000 7f8c2bc9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c240b4f80 0x7f8c2406aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.826+0000 7f8c2bc9b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2415d810 con 0x7f8c2415d0a0 2023-12-12T09:20:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.826+0000 7f8c2bc9b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240b2f90 con 0x7f8c240b4f80 2023-12-12T09:20:32.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.826+0000 7f8c2bc9b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240b3270 con 0x7f8c240b4af0 2023-12-12T09:20:32.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.826+0000 7f8c29a37640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8c2415d0a0 0x7f8c2415dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52562/0 (socket says 172.21.15.84:52562) 2023-12-12T09:20:32.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.826+0000 7f8c2a238640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8c240b4f80 0x7f8c2406aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:32.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.826+0000 7f8c29a37640 1 -- 172.21.15.84:0/84377383 learned_addr learned my addr 172.21.15.84:0/84377383 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:32.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.827+0000 7f8c29236640 1 --2- 172.21.15.84:0/84377383 >> v2:172.21.15.99:3300/0 conn(0x7f8c240b4af0 0x7f8c2406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:32.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.827+0000 7f8c2a238640 1 -- 172.21.15.84:0/84377383 >> v2:172.21.15.99:3300/0 conn(0x7f8c240b4af0 msgr2=0x7f8c2406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:32.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.827+0000 7f8c2a238640 1 --2- 172.21.15.84:0/84377383 >> v2:172.21.15.99:3300/0 conn(0x7f8c240b4af0 0x7f8c2406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:32.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.827+0000 7f8c2a238640 1 -- 172.21.15.84:0/84377383 >> v1:172.21.15.84:6789/0 conn(0x7f8c2415d0a0 legacy=0x7f8c2415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:32.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.827+0000 7f8c2a238640 1 -- 172.21.15.84:0/84377383 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2415dab0 con 0x7f8c240b4f80 2023-12-12T09:20:32.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.827+0000 7f8c28a35640 1 -- 172.21.15.84:0/84377383 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786641546 0 0) 0x7f8c2415d810 con 0x7f8c2415d0a0 2023-12-12T09:20:32.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.828+0000 7f8c2a238640 1 --2- 172.21.15.84:0/84377383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c240b4f80 0x7f8c2406aa40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8c2409de30 tx=0x7f8c1c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc08ed9dec305e55 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:32.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.828+0000 7f8c28a35640 1 -- 172.21.15.84:0/84377383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c02cc80 con 0x7f8c240b4f80 2023-12-12T09:20:32.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.828+0000 7f8c28a35640 1 -- 172.21.15.84:0/84377383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c02cde0 con 0x7f8c240b4f80 2023-12-12T09:20:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.828+0000 7f8c28a35640 1 -- 172.21.15.84:0/84377383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c034660 con 0x7f8c240b4f80 2023-12-12T09:20:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.829+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/84377383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c240b4f80 msgr2=0x7f8c2406aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:32.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.829+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/84377383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c240b4f80 0x7f8c2406aa40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8c2409de30 tx=0x7f8c1c02bed0 comp rx=0 tx=0).stop 2023-12-12T09:20:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.829+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/84377383 shutdown_connections 2023-12-12T09:20:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.829+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/84377383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c240b4f80 0x7f8c2406aa40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.829+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/84377383 >> v2:172.21.15.99:3300/0 conn(0x7f8c240b4af0 0x7f8c2406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.829+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/84377383 >> 172.21.15.84:0/84377383 conn(0x7f8c240b1af0 msgr2=0x7f8c240b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.829+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/84377383 shutdown_connections 2023-12-12T09:20:32.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.829+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/84377383 wait complete. 2023-12-12T09:20:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.831+0000 7f8c2bc9b640 1 Processor -- start 2023-12-12T09:20:32.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.831+0000 7f8c2bc9b640 1 -- start start 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2bc9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c240b4af0 0x7f8c241f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2bc9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8c240b4f80 0x7f8c2414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2bc9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2415d0a0 0x7f8c241f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2bc9b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2414bd80 con 0x7f8c2415d0a0 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2bc9b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24149620 con 0x7f8c240b4af0 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2bc9b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241f6d50 con 0x7f8c240b4f80 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2a238640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2415d0a0 0x7f8c241f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2a238640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2415d0a0 0x7f8c241f1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52706/0 (socket says 172.21.15.84:52706) 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.832+0000 7f8c2a238640 1 -- 172.21.15.84:0/2387219067 learned_addr learned my addr 172.21.15.84:0/2387219067 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:32.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c29a37640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c240b4af0 0x7f8c241f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c29236640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8c240b4f80 0x7f8c2414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c2a238640 1 -- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8c240b4f80 msgr2=0x7f8c2414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c2a238640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8c240b4f80 0x7f8c2414c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c2a238640 1 -- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c240b4af0 msgr2=0x7f8c241f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c2a238640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c240b4af0 0x7f8c241f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c2a238640 1 -- 172.21.15.84:0/2387219067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c009a70 con 0x7f8c2415d0a0 2023-12-12T09:20:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c29a37640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c240b4af0 0x7f8c241f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:32.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c2a238640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2415d0a0 0x7f8c241f1f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009e80 tx=0x7f8c1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c1a7fc640 1 -- 172.21.15.84:0/2387219067 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c040650 con 0x7f8c2415d0a0 2023-12-12T09:20:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c1a7fc640 1 -- 172.21.15.84:0/2387219067 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c0407b0 con 0x7f8c2415d0a0 2023-12-12T09:20:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c241f6790 con 0x7f8c2415d0a0 2023-12-12T09:20:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.833+0000 7f8c1a7fc640 1 -- 172.21.15.84:0/2387219067 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c040b60 con 0x7f8c2415d0a0 2023-12-12T09:20:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.834+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2414b9a0 con 0x7f8c2415d0a0 2023-12-12T09:20:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.835+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2414bec0 con 0x7f8c2415d0a0 2023-12-12T09:20:32.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.836+0000 7f8c1a7fc640 1 -- 172.21.15.84:0/2387219067 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c1c040cc0 con 0x7f8c2415d0a0 2023-12-12T09:20:32.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.836+0000 7f8c1a7fc640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8c0806ae70 0x7f8c0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:32.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.837+0000 7f8c1a7fc640 1 -- 172.21.15.84:0/2387219067 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8c1c0ac760 con 0x7f8c2415d0a0 2023-12-12T09:20:32.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.837+0000 7f8c29a37640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8c0806ae70 0x7f8c0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:32.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.837+0000 7f8c29a37640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8c0806ae70 0x7f8c0806d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8c20000f60 tx=0x7f8c20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:32.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:32.842+0000 7f8c1a7fc640 1 -- 172.21.15.84:0/2387219067 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c2414bec0 con 0x7f8c2415d0a0 2023-12-12T09:20:33.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.068+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8c2414bec0 con 0x7f8c2415d0a0 2023-12-12T09:20:33.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.069+0000 7f8c1a7fc640 1 -- 172.21.15.84:0/2387219067 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8c2414bec0 con 0x7f8c2415d0a0 2023-12-12T09:20:33.069 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8c0806ae70 msgr2=0x7f8c0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8c0806ae70 0x7f8c0806d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8c20000f60 tx=0x7f8c20009040 comp rx=0 tx=0).stop 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2415d0a0 msgr2=0x7f8c241f1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2415d0a0 0x7f8c241f1f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009e80 tx=0x7f8c1c004a40 comp rx=0 tx=0).stop 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 shutdown_connections 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8c0806ae70 0x7f8c0806d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c2415d0a0 0x7f8c241f1f80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8c240b4f80 0x7f8c2414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 --2- 172.21.15.84:0/2387219067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c240b4af0 0x7f8c241f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.071+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 >> 172.21.15.84:0/2387219067 conn(0x7f8c240b1af0 msgr2=0x7f8c24071940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.072+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 shutdown_connections 2023-12-12T09:20:33.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:33.072+0000 7f8c2bc9b640 1 -- 172.21.15.84:0/2387219067 wait complete. 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:20:33.091 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-12T09:20:33.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.092 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2023-12-12T09:20:33.153 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:20:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:20:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:20:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2023-12-12T09:20:33.154 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.154 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2023-12-12T09:20:33.155 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:33.155 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2023-12-12T09:20:33.155 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:20:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:33.156 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:20:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:20:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42138sec preferred_lft 42138sec 2023-12-12T09:20:33.156 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2023-12-12T09:20:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.157 INFO:teuthology.orchestra.run.smithi099.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:20:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 8e:36:3a:d6:d6:0a brd ff:ff:ff:ff:ff:ff 2023-12-12T09:20:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:20:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::64bd:e6ff:feb0:eb20/64 scope link 2023-12-12T09:20:33.157 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.158 INFO:teuthology.orchestra.run.smithi099.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:20:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 8e:36:3a:d6:d6:0a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::8c36:3aff:fed6:d60a/64 scope link tentative 2023-12-12T09:20:33.158 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.159 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:20:33.251 INFO:teuthology.orchestra.run.smithi099.stdout:1 2023-12-12T09:20:33.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.255 DEBUG:teuthology.orchestra.run.smithi099:> route 2023-12-12T09:20:33.305 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2023-12-12T09:20:33.305 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:20:33.305 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:20:33.305 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:20:33.305 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:20:33.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.307 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:33.307 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:33.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:20:33.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:20:33.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:20:33.307 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:33.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.488 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2023-12-12T09:20:33.539 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:20:33.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.541 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2023-12-12T09:20:33.592 INFO:teuthology.orchestra.run.smithi099.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-12T09:20:33.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.594 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:33.594 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:33.594 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T09:20:33.594 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-12T09:20:33.594 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:33.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-12T09:20:33.821 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:20:33.821 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:20:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:20:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2023-12-12T09:20:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.822 INFO:teuthology.orchestra.run.smithi099.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:20:33.822 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:35:76:f0:5c:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-12T09:20:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-12T09:20:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::4035:76ff:fef0:5c12/64 scope link 2023-12-12T09:20:33.823 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.825 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-12T09:20:33.913 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:20:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:20:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:20:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.913 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2023-12-12T09:20:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.914 INFO:teuthology.orchestra.run.smithi099.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:20:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 42:35:76:f0:5c:12 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-12T09:20:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-12T09:20:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.914 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::4035:76ff:fef0:5c12/64 scope link 2023-12-12T09:20:33.915 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:20:33.916 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-12T09:20:33.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:33.917 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:33.917 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:33.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-12T09:20:33.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-12T09:20:33.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-12T09:20:33.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-12T09:20:33.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-12T09:20:33.918 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:34.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:34.183 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2023-12-12T09:20:34.183 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2023-12-12T09:20:34.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.1 up 2023-12-12T09:20:34.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.1 master ceph-brx 2023-12-12T09:20:34.183 DEBUG:teuthology.orchestra.run.smithi099:> ') 2023-12-12T09:20:34.347 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-12T09:20:34.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:20:34.348 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-12T09:20:34.395 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-12T09:20:34.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:20:34.395 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-12T09:20:34.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2023-12-12T09:20:34.587 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2023-12-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2023-12-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2023-12-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2023-12-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2023-12-12T09:20:34.644 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2023-12-12T09:20:34.645 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2023-12-12T09:20:34.645 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2023-12-12T09:20:34.645 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2023-12-12T09:20:34.645 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2023-12-12T09:20:34.645 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/selinux 2023-12-12T09:20:34.645 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:20:34.645 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2023-12-12T09:20:34.646 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2023-12-12T09:20:34.646 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2023-12-12T09:20:34.646 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2023-12-12T09:20:34.646 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2023-12-12T09:20:34.646 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2023-12-12T09:20:34.646 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:20:34.646 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:20:34.647 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:20:34.647 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:20:34.647 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2023-12-12T09:20:34.647 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2023-12-12T09:20:34.647 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T09:20:34.647 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T09:20:34.647 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T09:20:34.647 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T09:20:34.648 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2023-12-12T09:20:34.648 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:34.648 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:34.648 INFO:teuthology.orchestra.run.smithi099.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:34.648 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T09:20:34.648 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T09:20:34.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:34.649 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2023-12-12T09:20:34.705 INFO:teuthology.orchestra.run.smithi099.stdout:40 2023-12-12T09:20:34.705 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2023-12-12T09:20:34.705 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-12T09:20:34.711 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2023-12-12T09:20:34.790 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:20:34.835 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2023-12-12T09:20:34.836 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2023-12-12T09:20:34.836 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2023-12-12T09:20:34.836 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2023-12-12T09:20:34.836 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2023-12-12T09:20:34.836 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2023-12-12T09:20:34.836 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2023-12-12T09:20:34.836 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2023-12-12T09:20:34.836 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2023-12-12T09:20:34.837 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2023-12-12T09:20:34.837 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/selinux 2023-12-12T09:20:34.837 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:20:34.837 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2023-12-12T09:20:34.837 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2023-12-12T09:20:34.837 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2023-12-12T09:20:34.837 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2023-12-12T09:20:34.837 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2023-12-12T09:20:34.838 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2023-12-12T09:20:34.838 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:20:34.838 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:20:34.838 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:20:34.838 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:20:34.838 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2023-12-12T09:20:34.838 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:34.839 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T09:20:34.840 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T09:20:34.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:34.841 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2023-12-12T09:20:34.895 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi099.stderr:2023-12-12T09:20:34.894+0000 7f9a2c647480 -1 init, newargv = 0x55eb0a22c9b0 newargc=15 2023-12-12T09:20:34.896 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi099.stderr:ceph-fuse[94786]: starting ceph client 2023-12-12T09:20:34.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi099.stderr:ceph-fuse[94786]: starting fuse 2023-12-12T09:20:34.926 INFO:teuthology.orchestra.run.smithi099.stdout:40 2023-12-12T09:20:34.926 INFO:teuthology.orchestra.run.smithi099.stdout:42 2023-12-12T09:20:34.926 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 42] 2023-12-12T09:20:34.926 DEBUG:teuthology.orchestra.run.smithi099:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> import re 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> import os 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2023-12-12T09:20:34.927 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> return f 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.3")) 2023-12-12T09:20:34.928 DEBUG:teuthology.orchestra.run.smithi099:> ' 2023-12-12T09:20:35.134 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.3.94786.asok 2023-12-12T09:20:35.138 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-12T09:20:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:20:35.151 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94786.asok 2023-12-12T09:20:35.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.94786.asok status 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "3", 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "94786", 2023-12-12T09:20:35.383 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4478, 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 4478 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.2:0", 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2056509713 2023-12-12T09:20:35.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.2:0", 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2056509713 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.4478 192.168.0.2:0/2056509713", 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "192.168.0.2:0/2056509713", 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 9, 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 28, 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2023-12-12T09:20:35.385 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-12-12T09:20:35.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.397 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:20:35.397 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:35.460 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:20:35.460 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:35.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:35.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.558 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:20:35.558 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-12T09:20:35.610 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:20:35.611 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-12T09:20:35.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-12T09:20:35.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.708 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2023-12-12T09:20:35.709 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:35.770 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2023-12-12T09:20:35.770 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:35.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.770 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T09:20:35.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.867 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2023-12-12T09:20:35.867 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-12T09:20:35.921 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2023-12-12T09:20:35.921 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-12T09:20:35.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:35.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-12T09:20:36.003 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-12T09:20:36.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:36.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.234+0000 7fad9a9b6640 1 Processor -- start 2023-12-12T09:20:36.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.235+0000 7fad9a9b6640 1 -- start start 2023-12-12T09:20:36.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.236+0000 7fad9a9b6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad940b47e0 0x7fad94071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.236+0000 7fad9a9b6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad940cea30 con 0x7fad94143d20 2023-12-12T09:20:36.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.236+0000 7fad9a9b6640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad940702b0 con 0x7fad940ce550 2023-12-12T09:20:36.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.236+0000 7fad9a9b6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad94070590 con 0x7fad940b47e0 2023-12-12T09:20:36.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.236+0000 7fad93fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fad94143d20 0x7fad940b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50306/0 (socket says 172.21.15.84:50306) 2023-12-12T09:20:36.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad93fff640 1 -- 172.21.15.84:0/314005509 learned_addr learned my addr 172.21.15.84:0/314005509 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad8bfff640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad940b47e0 0x7fad94071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488252146 0 0) 0x7fad940cea30 con 0x7fad94143d20 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad80003520 con 0x7fad94143d20 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460805129 0 0) 0x7fad80003520 con 0x7fad94143d20 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad940b47e0 msgr2=0x7fad94071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad937fe640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad940b47e0 0x7fad94071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 >> v1:172.21.15.99:6789/0 conn(0x7fad940ce550 legacy=0x7fad940715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94070870 con 0x7fad94143d20 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.237+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fad84001670 con 0x7fad94143d20 2023-12-12T09:20:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 >> v1:172.21.15.84:6789/0 conn(0x7fad94143d20 legacy=0x7fad940b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad937fe640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800039a0 0x7fad80003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad937fe640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad800047c0 0x7fad80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad937fe640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad940b47e0 0x7fad80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94070590 con 0x7fad800047c0 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8000ba30 con 0x7fad800039a0 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8000bbf0 con 0x7fad940b47e0 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad8bfff640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad800047c0 0x7fad80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad8bfff640 1 -- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad940b47e0 msgr2=0x7fad80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad8bfff640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad940b47e0 0x7fad80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad93fff640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800039a0 0x7fad80003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad8bfff640 1 -- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800039a0 msgr2=0x7fad80003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad8bfff640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad800039a0 0x7fad80003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.238+0000 7fad8bfff640 1 -- 172.21.15.84:0/314005509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80003520 con 0x7fad800047c0 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.239+0000 7fad8bfff640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad800047c0 0x7fad80004c40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009a90 tx=0x7fad800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f155abbc99abf78 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c02c6b0 con 0x7fad800047c0 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c02c810 con 0x7fad800047c0 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad937fe640 1 -- 172.21.15.84:0/314005509 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c02cba0 con 0x7fad800047c0 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad9a9b6640 1 -- 172.21.15.84:0/314005509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad800047c0 msgr2=0x7fad80004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad9a9b6640 1 --2- 172.21.15.84:0/314005509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad800047c0 0x7fad80004c40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009a90 tx=0x7fad800057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad98f53640 1 -- 172.21.15.84:0/314005509 reap_dead start 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad9a9b6640 1 -- 172.21.15.84:0/314005509 shutdown_connections 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad9a9b6640 1 -- 172.21.15.84:0/314005509 >> 172.21.15.84:0/314005509 conn(0x7fad9406c3d0 msgr2=0x7fad9406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad9a9b6640 1 -- 172.21.15.84:0/314005509 shutdown_connections 2023-12-12T09:20:36.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.240+0000 7fad9a9b6640 1 -- 172.21.15.84:0/314005509 wait complete. 2023-12-12T09:20:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.242+0000 7fad9a9b6640 1 Processor -- start 2023-12-12T09:20:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.242+0000 7fad9a9b6640 1 -- start start 2023-12-12T09:20:36.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.243+0000 7fad9a9b6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad800047c0 0x7fad941389b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.243+0000 7fad9a9b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad9415f0a0 0x7fad94142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.243+0000 7fad9a9b6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad94143260 0x7fad9413ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.243+0000 7fad9a9b6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94138ef0 con 0x7fad9415f0a0 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.243+0000 7fad9a9b6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9415e000 con 0x7fad94143260 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.243+0000 7fad9a9b6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9415e2e0 con 0x7fad800047c0 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad9415f0a0 0x7fad94142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad9415f0a0 0x7fad94142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53914/0 (socket says 172.21.15.84:53914) 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 -- 172.21.15.84:0/93104343 learned_addr learned my addr 172.21.15.84:0/93104343 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad98f53640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad94143260 0x7fad9413ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad93fff640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad800047c0 0x7fad941389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 -- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad800047c0 msgr2=0x7fad941389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad800047c0 0x7fad941389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 -- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad94143260 msgr2=0x7fad9413ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad94143260 0x7fad9413ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 -- 172.21.15.84:0/93104343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9415e5c0 con 0x7fad9415f0a0 2023-12-12T09:20:36.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad98f53640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad94143260 0x7fad9413ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:36.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad93fff640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad800047c0 0x7fad941389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:36.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.244+0000 7fad8bfff640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad9415f0a0 0x7fad94142d20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fad7c02c250 tx=0x7fad7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:36.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.245+0000 7fad917fa640 1 -- 172.21.15.84:0/93104343 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003810 con 0x7fad9415f0a0 2023-12-12T09:20:36.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.245+0000 7fad917fa640 1 -- 172.21.15.84:0/93104343 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c003970 con 0x7fad9415f0a0 2023-12-12T09:20:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.245+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9415e8a0 con 0x7fad9415f0a0 2023-12-12T09:20:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.245+0000 7fad917fa640 1 -- 172.21.15.84:0/93104343 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003d00 con 0x7fad9415f0a0 2023-12-12T09:20:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.245+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9415f520 con 0x7fad9415f0a0 2023-12-12T09:20:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.246+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad940b0930 con 0x7fad9415f0a0 2023-12-12T09:20:36.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.247+0000 7fad917fa640 1 -- 172.21.15.84:0/93104343 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad7c040450 con 0x7fad9415f0a0 2023-12-12T09:20:36.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.248+0000 7fad917fa640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad7406ae70 0x7fad7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.248+0000 7fad917fa640 1 -- 172.21.15.84:0/93104343 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fad7c0ab800 con 0x7fad9415f0a0 2023-12-12T09:20:36.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.248+0000 7fad93fff640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad7406ae70 0x7fad7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.249+0000 7fad93fff640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad7406ae70 0x7fad7406d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fad840017a0 tx=0x7fad84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:36.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.252+0000 7fad917fa640 1 -- 172.21.15.84:0/93104343 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad7c0764f0 con 0x7fad9415f0a0 2023-12-12T09:20:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.448+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad940673c0 con 0x7fad9415f0a0 2023-12-12T09:20:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.449+0000 7fad917fa640 1 -- 172.21.15.84:0/93104343 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7fad7c003e60 con 0x7fad9415f0a0 2023-12-12T09:20:36.450 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:36.450 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad7406ae70 msgr2=0x7fad7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad7406ae70 0x7fad7406d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fad840017a0 tx=0x7fad84009040 comp rx=0 tx=0).stop 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad9415f0a0 msgr2=0x7fad94142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad9415f0a0 0x7fad94142d20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fad7c02c250 tx=0x7fad7c004730 comp rx=0 tx=0).stop 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 shutdown_connections 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad94143260 0x7fad9413ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad7406ae70 0x7fad7406d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad9415f0a0 0x7fad94142d20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 --2- 172.21.15.84:0/93104343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad800047c0 0x7fad941389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 >> 172.21.15.84:0/93104343 conn(0x7fad9406c3d0 msgr2=0x7fad94071730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.452+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 shutdown_connections 2023-12-12T09:20:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.453+0000 7fad9a9b6640 1 -- 172.21.15.84:0/93104343 wait complete. 2023-12-12T09:20:36.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:36.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.681+0000 7ff0c606e640 1 Processor -- start 2023-12-12T09:20:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.681+0000 7ff0c606e640 1 -- start start 2023-12-12T09:20:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.682+0000 7ff0c606e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff0c00cec60 0x7ff0c00d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.682+0000 7ff0c606e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0c00d3590 0x7ff0c00b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.682+0000 7ff0c606e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00cdc30 con 0x7ff0c00cf890 2023-12-12T09:20:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.682+0000 7ff0c606e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00cdea0 con 0x7ff0c00cec60 2023-12-12T09:20:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.682+0000 7ff0c606e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c00ce180 con 0x7ff0c00d3590 2023-12-12T09:20:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.682+0000 7ff0c506c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff0c00cf890 0x7ff0c00cfc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50310/0 (socket says 172.21.15.84:50310) 2023-12-12T09:20:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.682+0000 7ff0c506c640 1 -- 172.21.15.84:0/291470470 learned_addr learned my addr 172.21.15.84:0/291470470 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.683+0000 7ff0c486b640 1 --2- 172.21.15.84:0/291470470 >> v2:172.21.15.84:3300/0 conn(0x7ff0c00cec60 0x7ff0c00d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.683+0000 7ff0c586d640 1 --2- 172.21.15.84:0/291470470 >> v2:172.21.15.99:3300/0 conn(0x7ff0c00d3590 0x7ff0c00b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.683+0000 7ff0b7fff640 1 -- 172.21.15.84:0/291470470 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175030871 0 0) 0x7ff0c00cdc30 con 0x7ff0c00cf890 2023-12-12T09:20:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.683+0000 7ff0b7fff640 1 -- 172.21.15.84:0/291470470 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0ac003520 con 0x7ff0c00cf890 2023-12-12T09:20:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.683+0000 7ff0c486b640 1 -- 172.21.15.84:0/291470470 >> v2:172.21.15.99:3300/0 conn(0x7ff0c00d3590 msgr2=0x7ff0c00b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.683+0000 7ff0c486b640 1 --2- 172.21.15.84:0/291470470 >> v2:172.21.15.99:3300/0 conn(0x7ff0c00d3590 0x7ff0c00b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.683+0000 7ff0c486b640 1 -- 172.21.15.84:0/291470470 >> v1:172.21.15.84:6789/0 conn(0x7ff0c00cf890 legacy=0x7ff0c00cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.683+0000 7ff0c486b640 1 -- 172.21.15.84:0/291470470 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00ce460 con 0x7ff0c00cec60 2023-12-12T09:20:36.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.684+0000 7ff0c486b640 1 --2- 172.21.15.84:0/291470470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00d18c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0c006add0 tx=0x7ff0b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a158710ce577ccb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.684+0000 7ff0b7fff640 1 -- 172.21.15.84:0/291470470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0031830 con 0x7ff0c00cec60 2023-12-12T09:20:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.684+0000 7ff0b7fff640 1 -- 172.21.15.84:0/291470470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b0031990 con 0x7ff0c00cec60 2023-12-12T09:20:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.684+0000 7ff0b7fff640 1 -- 172.21.15.84:0/291470470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0031d20 con 0x7ff0c00cec60 2023-12-12T09:20:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.685+0000 7ff0c606e640 1 -- 172.21.15.84:0/291470470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 msgr2=0x7ff0c00d18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.685+0000 7ff0c606e640 1 --2- 172.21.15.84:0/291470470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00d18c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0c006add0 tx=0x7ff0b002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.685+0000 7ff0c606e640 1 -- 172.21.15.84:0/291470470 shutdown_connections 2023-12-12T09:20:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.685+0000 7ff0c606e640 1 --2- 172.21.15.84:0/291470470 >> v2:172.21.15.99:3300/0 conn(0x7ff0c00d3590 0x7ff0c00b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.685+0000 7ff0c606e640 1 --2- 172.21.15.84:0/291470470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00d18c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.685+0000 7ff0c606e640 1 -- 172.21.15.84:0/291470470 >> 172.21.15.84:0/291470470 conn(0x7ff0c009c1f0 msgr2=0x7ff0c00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.685+0000 7ff0c606e640 1 -- 172.21.15.84:0/291470470 shutdown_connections 2023-12-12T09:20:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.685+0000 7ff0c606e640 1 -- 172.21.15.84:0/291470470 wait complete. 2023-12-12T09:20:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.687+0000 7ff0c606e640 1 Processor -- start 2023-12-12T09:20:36.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.687+0000 7ff0c606e640 1 -- start start 2023-12-12T09:20:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c606e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c606e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c00cf890 0x7ff0c00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c606e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c00d3590 0x7ff0c00cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c606e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00b8d60 con 0x7ff0c00cec60 2023-12-12T09:20:36.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c606e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00c6a50 con 0x7ff0c00d3590 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c606e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c00c6d30 con 0x7ff0c00cf890 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c506c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c506c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00b8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53928/0 (socket says 172.21.15.84:53928) 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.688+0000 7ff0c506c640 1 -- 172.21.15.84:0/3948437629 learned_addr learned my addr 172.21.15.84:0/3948437629 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0c506c640 1 -- 172.21.15.84:0/3948437629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c00cf890 msgr2=0x7ff0c00cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0c506c640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c00cf890 0x7ff0c00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0c506c640 1 -- 172.21.15.84:0/3948437629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c00d3590 msgr2=0x7ff0c00cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0c506c640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c00d3590 0x7ff0c00cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0c506c640 1 -- 172.21.15.84:0/3948437629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0009400 con 0x7ff0c00cec60 2023-12-12T09:20:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0c506c640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00b8820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00c500 tx=0x7ff0bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0b5ffb640 1 -- 172.21.15.84:0/3948437629 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc005ce0 con 0x7ff0c00cec60 2023-12-12T09:20:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0b5ffb640 1 -- 172.21.15.84:0/3948437629 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc005e40 con 0x7ff0c00cec60 2023-12-12T09:20:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0b5ffb640 1 -- 172.21.15.84:0/3948437629 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc007330 con 0x7ff0c00cec60 2023-12-12T09:20:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c00c7010 con 0x7ff0c00cec60 2023-12-12T09:20:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.689+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c00c75d0 con 0x7ff0c00cec60 2023-12-12T09:20:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.691+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c00730e0 con 0x7ff0c00cec60 2023-12-12T09:20:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.691+0000 7ff0b5ffb640 1 -- 172.21.15.84:0/3948437629 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0bc007490 con 0x7ff0c00cec60 2023-12-12T09:20:36.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.692+0000 7ff0b5ffb640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:36.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.692+0000 7ff0b5ffb640 1 -- 172.21.15.84:0/3948437629 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0bc0890d0 con 0x7ff0c00cec60 2023-12-12T09:20:36.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.693+0000 7ff0c486b640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:36.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.693+0000 7ff0c486b640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0036000 tx=0x7ff0b0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.697+0000 7ff0b5ffb640 1 -- 172.21.15.84:0/3948437629 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0bc057900 con 0x7ff0c00cec60 2023-12-12T09:20:36.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.886+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0c00c77c0 con 0x7ff0c00cec60 2023-12-12T09:20:36.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.887+0000 7ff0b5ffb640 1 -- 172.21.15.84:0/3948437629 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0bc0170a0 con 0x7ff0c00cec60 2023-12-12T09:20:36.888 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:36.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.889+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 msgr2=0x7ff0a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.889+0000 7ff0c606e640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0036000 tx=0x7ff0b0030000 comp rx=0 tx=0).stop 2023-12-12T09:20:36.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.889+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 msgr2=0x7ff0c00b8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:36.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.889+0000 7ff0c606e640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00b8820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00c500 tx=0x7ff0bc00c9c0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.890+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 shutdown_connections 2023-12-12T09:20:36.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.890+0000 7ff0c606e640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c00d3590 0x7ff0c00cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.890+0000 7ff0c606e640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c00cf890 0x7ff0c00cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.890+0000 7ff0c606e640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.890+0000 7ff0c606e640 1 --2- 172.21.15.84:0/3948437629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c00cec60 0x7ff0c00b8820 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:36.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.890+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 >> 172.21.15.84:0/3948437629 conn(0x7ff0c009c1f0 msgr2=0x7ff0c006c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:36.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.890+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 shutdown_connections 2023-12-12T09:20:36.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:36.890+0000 7ff0c606e640 1 -- 172.21.15.84:0/3948437629 wait complete. 2023-12-12T09:20:36.909 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:37.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.129+0000 7fc010b5c640 1 Processor -- start 2023-12-12T09:20:37.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.129+0000 7fc010b5c640 1 -- start start 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.130+0000 7fc010b5c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc00c13de10 0x7fc00c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.130+0000 7fc010b5c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc00c1412c0 0x7fc00c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.130+0000 7fc010b5c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0cdb80 con 0x7fc00c0cd670 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.130+0000 7fc010b5c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0cde60 con 0x7fc00c1412c0 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.130+0000 7fc010b5c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0ce140 con 0x7fc00c13de10 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.131+0000 7fc003fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc00c1412c0 0x7fc00c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.131+0000 7fc003fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc00c1412c0 0x7fc00c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53938/0 (socket says 172.21.15.84:53938) 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.131+0000 7fc003fff640 1 -- 172.21.15.84:0/4143389611 learned_addr learned my addr 172.21.15.84:0/4143389611 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:37.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.131+0000 7fc00b7fe640 1 --2- 172.21.15.84:0/4143389611 >> v2:172.21.15.99:3300/0 conn(0x7fc00c13de10 0x7fc00c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.131+0000 7fc003fff640 1 -- 172.21.15.84:0/4143389611 >> v2:172.21.15.99:3300/0 conn(0x7fc00c13de10 msgr2=0x7fc00c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:37.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.131+0000 7fc003fff640 1 --2- 172.21.15.84:0/4143389611 >> v2:172.21.15.99:3300/0 conn(0x7fc00c13de10 0x7fc00c0cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.131+0000 7fc003fff640 1 -- 172.21.15.84:0/4143389611 >> v1:172.21.15.99:6789/0 conn(0x7fc00c0cd670 legacy=0x7fc00c15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:37.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.131+0000 7fc003fff640 1 -- 172.21.15.84:0/4143389611 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0ce420 con 0x7fc00c1412c0 2023-12-12T09:20:37.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.132+0000 7fc003fff640 1 --2- 172.21.15.84:0/4143389611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c1412c0 0x7fc00c15eac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc00c06fd00 tx=0x7fbff402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade0661b972055fe server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:37.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc00affd640 1 -- 172.21.15.84:0/4143389611 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4031870 con 0x7fc00c1412c0 2023-12-12T09:20:37.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc00affd640 1 -- 172.21.15.84:0/4143389611 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff40319d0 con 0x7fc00c1412c0 2023-12-12T09:20:37.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc00affd640 1 -- 172.21.15.84:0/4143389611 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4031d60 con 0x7fc00c1412c0 2023-12-12T09:20:37.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc010b5c640 1 -- 172.21.15.84:0/4143389611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c1412c0 msgr2=0x7fc00c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc010b5c640 1 --2- 172.21.15.84:0/4143389611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c1412c0 0x7fc00c15eac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc00c06fd00 tx=0x7fbff402b910 comp rx=0 tx=0).stop 2023-12-12T09:20:37.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc010b5c640 1 -- 172.21.15.84:0/4143389611 shutdown_connections 2023-12-12T09:20:37.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc010b5c640 1 --2- 172.21.15.84:0/4143389611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c1412c0 0x7fc00c15eac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc010b5c640 1 --2- 172.21.15.84:0/4143389611 >> v2:172.21.15.99:3300/0 conn(0x7fc00c13de10 0x7fc00c0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.133+0000 7fc010b5c640 1 -- 172.21.15.84:0/4143389611 >> 172.21.15.84:0/4143389611 conn(0x7fc00c0b0780 msgr2=0x7fc00c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:37.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.134+0000 7fc010b5c640 1 -- 172.21.15.84:0/4143389611 shutdown_connections 2023-12-12T09:20:37.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.134+0000 7fc010b5c640 1 -- 172.21.15.84:0/4143389611 wait complete. 2023-12-12T09:20:37.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.135+0000 7fc010b5c640 1 Processor -- start 2023-12-12T09:20:37.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.136+0000 7fc010b5c640 1 -- start start 2023-12-12T09:20:37.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.136+0000 7fc010b5c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc00c0cd670 0x7fc00c13f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.136+0000 7fc010b5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c13de10 0x7fc00c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.136+0000 7fc010b5c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc00c156aa0 0x7fc00c13cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.136+0000 7fc010b5c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c15cbc0 con 0x7fc00c13de10 2023-12-12T09:20:37.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.136+0000 7fc010b5c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0b3030 con 0x7fc00c0cd670 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.136+0000 7fc010b5c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c157110 con 0x7fc00c156aa0 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c13de10 0x7fc00c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c13de10 0x7fc00c156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53940/0 (socket says 172.21.15.84:53940) 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 -- 172.21.15.84:0/1907836278 learned_addr learned my addr 172.21.15.84:0/1907836278 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc00b7fe640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc00c0cd670 0x7fc00c13f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 -- 172.21.15.84:0/1907836278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc00c156aa0 msgr2=0x7fc00c13cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc00c156aa0 0x7fc00c13cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 -- 172.21.15.84:0/1907836278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc00c0cd670 msgr2=0x7fc00c13f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc00c0cd670 0x7fc00c13f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 -- 172.21.15.84:0/1907836278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff40094d0 con 0x7fc00c13de10 2023-12-12T09:20:37.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.137+0000 7fc003fff640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c13de10 0x7fc00c156560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbff4000c00 tx=0x7fbff40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:37.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.138+0000 7fc008ff9640 1 -- 172.21.15.84:0/1907836278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff403abe0 con 0x7fc00c13de10 2023-12-12T09:20:37.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.138+0000 7fc008ff9640 1 -- 172.21.15.84:0/1907836278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff403ad40 con 0x7fc00c13de10 2023-12-12T09:20:37.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.138+0000 7fc008ff9640 1 -- 172.21.15.84:0/1907836278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4044610 con 0x7fc00c13de10 2023-12-12T09:20:37.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.138+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c1573f0 con 0x7fc00c13de10 2023-12-12T09:20:37.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.138+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c1579b0 con 0x7fc00c13de10 2023-12-12T09:20:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.139+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c15ca20 con 0x7fc00c13de10 2023-12-12T09:20:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.140+0000 7fc008ff9640 1 -- 172.21.15.84:0/1907836278 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbff404d450 con 0x7fc00c13de10 2023-12-12T09:20:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.142+0000 7fc008ff9640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbfec06ae40 0x7fbfec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.142+0000 7fc008ff9640 1 -- 172.21.15.84:0/1907836278 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbff402d040 con 0x7fc00c13de10 2023-12-12T09:20:37.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.142+0000 7fc00b7fe640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbfec06ae40 0x7fbfec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.143+0000 7fc00b7fe640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbfec06ae40 0x7fbfec06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbffc006fd0 tx=0x7fbffc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:37.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.147+0000 7fc008ff9640 1 -- 172.21.15.84:0/1907836278 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc00c15ca20 con 0x7fc00c13de10 2023-12-12T09:20:37.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.348+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc00c15cd90 con 0x7fc00c13de10 2023-12-12T09:20:37.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.348+0000 7fc008ff9640 1 -- 172.21.15.84:0/1907836278 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc00c15cd90 con 0x7fc00c13de10 2023-12-12T09:20:37.349 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.351+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbfec06ae40 msgr2=0x7fbfec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.351+0000 7fc010b5c640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbfec06ae40 0x7fbfec06d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbffc006fd0 tx=0x7fbffc008040 comp rx=0 tx=0).stop 2023-12-12T09:20:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.351+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c13de10 msgr2=0x7fc00c156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.351+0000 7fc010b5c640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c13de10 0x7fc00c156560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbff4000c00 tx=0x7fbff40046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.352+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 shutdown_connections 2023-12-12T09:20:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.352+0000 7fc010b5c640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc00c156aa0 0x7fc00c13cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.352+0000 7fc010b5c640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbfec06ae40 0x7fbfec06d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.352+0000 7fc010b5c640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc00c13de10 0x7fc00c156560 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.352+0000 7fc010b5c640 1 --2- 172.21.15.84:0/1907836278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc00c0cd670 0x7fc00c13f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.352+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 >> 172.21.15.84:0/1907836278 conn(0x7fc00c0b0780 msgr2=0x7fc00c15b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.352+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 shutdown_connections 2023-12-12T09:20:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.352+0000 7fc010b5c640 1 -- 172.21.15.84:0/1907836278 wait complete. 2023-12-12T09:20:37.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:37.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.588+0000 7efdc3b25640 1 Processor -- start 2023-12-12T09:20:37.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.588+0000 7efdc3b25640 1 -- start start 2023-12-12T09:20:37.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.589+0000 7efdc3b25640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efdbc0b40d0 0x7efdbc06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.589+0000 7efdc3b25640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efdbc0ce6f0 0x7efdbc0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.589+0000 7efdc3b25640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 0x7efdbc13e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc3b25640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc0ceb80 con 0x7efdbc0ce6f0 2023-12-12T09:20:37.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc3b25640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc0ce260 con 0x7efdbc0b40d0 2023-12-12T09:20:37.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc3b25640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0b49f0 con 0x7efdbc15be60 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc10c0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efdbc0ce6f0 0x7efdbc0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc10c0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efdbc0ce6f0 0x7efdbc0b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53950/0 (socket says 172.21.15.84:53950) 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc10c0640 1 -- 172.21.15.84:0/375746958 learned_addr learned my addr 172.21.15.84:0/375746958 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc18c1640 1 --2- 172.21.15.84:0/375746958 >> v2:172.21.15.99:3300/0 conn(0x7efdbc0b40d0 0x7efdbc06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc10c0640 1 -- 172.21.15.84:0/375746958 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 msgr2=0x7efdbc13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc20c2640 1 --2- 172.21.15.84:0/375746958 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 0x7efdbc13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc10c0640 1 --2- 172.21.15.84:0/375746958 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 0x7efdbc13e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc10c0640 1 -- 172.21.15.84:0/375746958 >> v2:172.21.15.99:3300/0 conn(0x7efdbc0b40d0 msgr2=0x7efdbc06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:37.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc10c0640 1 --2- 172.21.15.84:0/375746958 >> v2:172.21.15.99:3300/0 conn(0x7efdbc0b40d0 0x7efdbc06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc10c0640 1 -- 172.21.15.84:0/375746958 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc0cd930 con 0x7efdbc0ce6f0 2023-12-12T09:20:37.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.590+0000 7efdc18c1640 1 --2- 172.21.15.84:0/375746958 >> v2:172.21.15.99:3300/0 conn(0x7efdbc0b40d0 0x7efdbc06dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:37.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.591+0000 7efdc10c0640 1 --2- 172.21.15.84:0/375746958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0ce6f0 0x7efdbc0b44b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0b4d90 tx=0x7efdb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9befb27d3ba23c46 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:37.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc08bf640 1 -- 172.21.15.84:0/375746958 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0031870 con 0x7efdbc0ce6f0 2023-12-12T09:20:37.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc08bf640 1 -- 172.21.15.84:0/375746958 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb00319d0 con 0x7efdbc0ce6f0 2023-12-12T09:20:37.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc08bf640 1 -- 172.21.15.84:0/375746958 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0031d60 con 0x7efdbc0ce6f0 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc3b25640 1 -- 172.21.15.84:0/375746958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0ce6f0 msgr2=0x7efdbc0b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc3b25640 1 --2- 172.21.15.84:0/375746958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0ce6f0 0x7efdbc0b44b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0b4d90 tx=0x7efdb002b910 comp rx=0 tx=0).stop 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc3b25640 1 -- 172.21.15.84:0/375746958 shutdown_connections 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc3b25640 1 --2- 172.21.15.84:0/375746958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0ce6f0 0x7efdbc0b44b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc3b25640 1 --2- 172.21.15.84:0/375746958 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 0x7efdbc13e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc3b25640 1 --2- 172.21.15.84:0/375746958 >> v2:172.21.15.99:3300/0 conn(0x7efdbc0b40d0 0x7efdbc06dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.592+0000 7efdc3b25640 1 -- 172.21.15.84:0/375746958 >> 172.21.15.84:0/375746958 conn(0x7efdbc0b0ac0 msgr2=0x7efdbc0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.593+0000 7efdc3b25640 1 -- 172.21.15.84:0/375746958 shutdown_connections 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.593+0000 7efdc3b25640 1 -- 172.21.15.84:0/375746958 wait complete. 2023-12-12T09:20:37.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.594+0000 7efdc3b25640 1 Processor -- start 2023-12-12T09:20:37.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.595+0000 7efdc3b25640 1 -- start start 2023-12-12T09:20:37.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.595+0000 7efdc3b25640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0b40d0 0x7efdbc152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.595+0000 7efdc3b25640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc0ce6f0 0x7efdbc140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc3b25640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 0x7efdbc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc3b25640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc1304e0 con 0x7efdbc0b40d0 2023-12-12T09:20:37.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc3b25640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0712e0 con 0x7efdbc0ce6f0 2023-12-12T09:20:37.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc3b25640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0715c0 con 0x7efdbc15be60 2023-12-12T09:20:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc18c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0b40d0 0x7efdbc152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc18c1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0b40d0 0x7efdbc152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53960/0 (socket says 172.21.15.84:53960) 2023-12-12T09:20:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc18c1640 1 -- 172.21.15.84:0/1974067410 learned_addr learned my addr 172.21.15.84:0/1974067410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc18c1640 1 -- 172.21.15.84:0/1974067410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 msgr2=0x7efdbc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc18c1640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 0x7efdbc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc18c1640 1 -- 172.21.15.84:0/1974067410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc0ce6f0 msgr2=0x7efdbc140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc18c1640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc0ce6f0 0x7efdbc140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.596+0000 7efdc18c1640 1 -- 172.21.15.84:0/1974067410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00094d0 con 0x7efdbc0b40d0 2023-12-12T09:20:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.597+0000 7efdc18c1640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0b40d0 0x7efdbc152900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efdac00ce30 tx=0x7efdac00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.597+0000 7efdba7fc640 1 -- 172.21.15.84:0/1974067410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00f680 con 0x7efdbc0b40d0 2023-12-12T09:20:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.597+0000 7efdba7fc640 1 -- 172.21.15.84:0/1974067410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac00f7e0 con 0x7efdbc0b40d0 2023-12-12T09:20:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.597+0000 7efdba7fc640 1 -- 172.21.15.84:0/1974067410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00fb90 con 0x7efdbc0b40d0 2023-12-12T09:20:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.597+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc0718a0 con 0x7efdbc0b40d0 2023-12-12T09:20:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.597+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc070f90 con 0x7efdbc0b40d0 2023-12-12T09:20:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.598+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc0673c0 con 0x7efdbc0b40d0 2023-12-12T09:20:37.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.599+0000 7efdba7fc640 1 -- 172.21.15.84:0/1974067410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdac00b040 con 0x7efdbc0b40d0 2023-12-12T09:20:37.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.600+0000 7efdba7fc640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efda806ae40 0x7efda806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:37.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.601+0000 7efdba7fc640 1 -- 172.21.15.84:0/1974067410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efdac08a4b0 con 0x7efdbc0b40d0 2023-12-12T09:20:37.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.601+0000 7efdc10c0640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efda806ae40 0x7efda806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:37.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.601+0000 7efdc10c0640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efda806ae40 0x7efda806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efdb0036000 tx=0x7efdb0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:37.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.605+0000 7efdba7fc640 1 -- 172.21.15.84:0/1974067410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdac055080 con 0x7efdbc0b40d0 2023-12-12T09:20:37.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.798+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efdbc155a40 con 0x7efdbc0b40d0 2023-12-12T09:20:37.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.799+0000 7efdba7fc640 1 -- 172.21.15.84:0/1974067410 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdac01d0a0 con 0x7efdbc0b40d0 2023-12-12T09:20:37.800 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:37.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.801+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efda806ae40 msgr2=0x7efda806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.801+0000 7efdc3b25640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efda806ae40 0x7efda806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efdb0036000 tx=0x7efdb0030000 comp rx=0 tx=0).stop 2023-12-12T09:20:37.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0b40d0 msgr2=0x7efdbc152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:37.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0b40d0 0x7efdbc152900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efdac00ce30 tx=0x7efdac00a650 comp rx=0 tx=0).stop 2023-12-12T09:20:37.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 shutdown_connections 2023-12-12T09:20:37.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efdbc15be60 0x7efdbc070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdbc0ce6f0 0x7efdbc140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efda806ae40 0x7efda806d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 --2- 172.21.15.84:0/1974067410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdbc0b40d0 0x7efdbc152900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:37.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 >> 172.21.15.84:0/1974067410 conn(0x7efdbc0b0ac0 msgr2=0x7efdbc15c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:37.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 shutdown_connections 2023-12-12T09:20:37.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:37.802+0000 7efdc3b25640 1 -- 172.21.15.84:0/1974067410 wait complete. 2023-12-12T09:20:37.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:38.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.028+0000 7fa6b94da640 1 Processor -- start 2023-12-12T09:20:38.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.028+0000 7fa6b94da640 1 -- start start 2023-12-12T09:20:38.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.029+0000 7fa6b94da640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6b41607d0 0x7fa6b40cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b94da640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b40b28c0 con 0x7fa6b40b4090 2023-12-12T09:20:38.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b94da640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b40d1a60 con 0x7fa6b4160bb0 2023-12-12T09:20:38.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b94da640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b40d1d40 con 0x7fa6b41607d0 2023-12-12T09:20:38.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b2ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa6b41607d0 0x7fa6b40cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b37fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa6b40b4090 0x7fa6b40cdc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50318/0 (socket says 172.21.15.84:50318) 2023-12-12T09:20:38.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b37fe640 1 -- 172.21.15.84:0/4088965063 learned_addr learned my addr 172.21.15.84:0/4088965063 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:38.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b2ffd640 1 -- 172.21.15.84:0/4088965063 >> v1:172.21.15.99:6789/0 conn(0x7fa6b4160bb0 legacy=0x7fa6b40cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:38.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b2ffd640 1 -- 172.21.15.84:0/4088965063 >> v1:172.21.15.84:6789/0 conn(0x7fa6b40b4090 legacy=0x7fa6b40cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b2ffd640 1 -- 172.21.15.84:0/4088965063 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b40b2b60 con 0x7fa6b41607d0 2023-12-12T09:20:38.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.030+0000 7fa6b1ffb640 1 -- 172.21.15.84:0/4088965063 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779637880 0 0) 0x7fa6b40b28c0 con 0x7fa6b40b4090 2023-12-12T09:20:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b2ffd640 1 --2- 172.21.15.84:0/4088965063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b41607d0 0x7fa6b40cf9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009d90 tx=0x7fa6a402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ff3186501f9374 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b1ffb640 1 -- 172.21.15.84:0/4088965063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a402cc60 con 0x7fa6b41607d0 2023-12-12T09:20:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b1ffb640 1 -- 172.21.15.84:0/4088965063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a402cdc0 con 0x7fa6b41607d0 2023-12-12T09:20:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b1ffb640 1 -- 172.21.15.84:0/4088965063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4034660 con 0x7fa6b41607d0 2023-12-12T09:20:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b94da640 1 -- 172.21.15.84:0/4088965063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b41607d0 msgr2=0x7fa6b40cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b94da640 1 --2- 172.21.15.84:0/4088965063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b41607d0 0x7fa6b40cf9c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009d90 tx=0x7fa6a402beb0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b94da640 1 -- 172.21.15.84:0/4088965063 shutdown_connections 2023-12-12T09:20:38.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b94da640 1 --2- 172.21.15.84:0/4088965063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b41607d0 0x7fa6b40cf9c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.032+0000 7fa6b94da640 1 -- 172.21.15.84:0/4088965063 >> 172.21.15.84:0/4088965063 conn(0x7fa6b409c400 msgr2=0x7fa6b40d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:38.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.033+0000 7fa6b94da640 1 -- 172.21.15.84:0/4088965063 shutdown_connections 2023-12-12T09:20:38.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.033+0000 7fa6b94da640 1 -- 172.21.15.84:0/4088965063 wait complete. 2023-12-12T09:20:38.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.034+0000 7fa6b94da640 1 Processor -- start 2023-12-12T09:20:38.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.034+0000 7fa6b94da640 1 -- start start 2023-12-12T09:20:38.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.035+0000 7fa6b94da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b40b4090 0x7fa6b40ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.035+0000 7fa6b94da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6b41607d0 0x7fa6b40b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.035+0000 7fa6b94da640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6b4160bb0 0x7fa6b4155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.035+0000 7fa6b94da640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40b8310 con 0x7fa6b40b4090 2023-12-12T09:20:38.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.035+0000 7fa6b94da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40ca8a0 con 0x7fa6b41607d0 2023-12-12T09:20:38.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.035+0000 7fa6b94da640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b40cab80 con 0x7fa6b4160bb0 2023-12-12T09:20:38.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b40b4090 0x7fa6b40ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b40b4090 0x7fa6b40ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53976/0 (socket says 172.21.15.84:53976) 2023-12-12T09:20:38.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 -- 172.21.15.84:0/3447856675 learned_addr learned my addr 172.21.15.84:0/3447856675 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:38.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 -- 172.21.15.84:0/3447856675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6b4160bb0 msgr2=0x7fa6b4155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6b4160bb0 0x7fa6b4155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 -- 172.21.15.84:0/3447856675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6b41607d0 msgr2=0x7fa6b40b7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b27fc640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6b41607d0 0x7fa6b40b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6b41607d0 0x7fa6b40b7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 -- 172.21.15.84:0/3447856675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a4009a70 con 0x7fa6b40b4090 2023-12-12T09:20:38.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.036+0000 7fa6b2ffd640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b40b4090 0x7fa6b40ca1a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009d90 tx=0x7fa6a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.037+0000 7fa6ab7fe640 1 -- 172.21.15.84:0/3447856675 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a403e610 con 0x7fa6b40b4090 2023-12-12T09:20:38.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.037+0000 7fa6ab7fe640 1 -- 172.21.15.84:0/3447856675 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a403e770 con 0x7fa6b40b4090 2023-12-12T09:20:38.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.037+0000 7fa6ab7fe640 1 -- 172.21.15.84:0/3447856675 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a403eb20 con 0x7fa6b40b4090 2023-12-12T09:20:38.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.037+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b40cae60 con 0x7fa6b40b4090 2023-12-12T09:20:38.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.037+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b40cb420 con 0x7fa6b40b4090 2023-12-12T09:20:38.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.038+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b4072b80 con 0x7fa6b40b4090 2023-12-12T09:20:38.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.039+0000 7fa6ab7fe640 1 -- 172.21.15.84:0/3447856675 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6a403b050 con 0x7fa6b40b4090 2023-12-12T09:20:38.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.040+0000 7fa6ab7fe640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa69406ae40 0x7fa69406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.040+0000 7fa6ab7fe640 1 -- 172.21.15.84:0/3447856675 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6a40ac4e0 con 0x7fa6b40b4090 2023-12-12T09:20:38.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.040+0000 7fa6b27fc640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa69406ae40 0x7fa69406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.041+0000 7fa6b27fc640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa69406ae40 0x7fa69406d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4159950 tx=0x7fa69c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.044+0000 7fa6ab7fe640 1 -- 172.21.15.84:0/3447856675 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6a40772e0 con 0x7fa6b40b4090 2023-12-12T09:20:38.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.236+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa6b40cb610 con 0x7fa6b40b4090 2023-12-12T09:20:38.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.237+0000 7fa6ab7fe640 1 -- 172.21.15.84:0/3447856675 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa6a407a900 con 0x7fa6b40b4090 2023-12-12T09:20:38.238 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa69406ae40 msgr2=0x7fa69406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa69406ae40 0x7fa69406d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4159950 tx=0x7fa69c009040 comp rx=0 tx=0).stop 2023-12-12T09:20:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b40b4090 msgr2=0x7fa6b40ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b40b4090 0x7fa6b40ca1a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009d90 tx=0x7fa6a4004a40 comp rx=0 tx=0).stop 2023-12-12T09:20:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 shutdown_connections 2023-12-12T09:20:38.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa6b4160bb0 0x7fa6b4155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6b41607d0 0x7fa6b40b7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa69406ae40 0x7fa69406d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 --2- 172.21.15.84:0/3447856675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6b40b4090 0x7fa6b40ca1a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 >> 172.21.15.84:0/3447856675 conn(0x7fa6b409c400 msgr2=0x7fa6b406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:38.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 shutdown_connections 2023-12-12T09:20:38.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.240+0000 7fa6b94da640 1 -- 172.21.15.84:0/3447856675 wait complete. 2023-12-12T09:20:38.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:38.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.471+0000 7f836a6f3640 1 Processor -- start 2023-12-12T09:20:38.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.471+0000 7f836a6f3640 1 -- start start 2023-12-12T09:20:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.472+0000 7f836a6f3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83640d16f0 0x7f83640d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.472+0000 7f836a6f3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 0x7f83640b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.472+0000 7f836a6f3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83640afd40 con 0x7f836415d490 2023-12-12T09:20:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.472+0000 7f836a6f3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83640b0090 con 0x7f83640d16f0 2023-12-12T09:20:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.472+0000 7f836a6f3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83640d20c0 con 0x7f83640b04b0 2023-12-12T09:20:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f8363fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f836415d490 0x7f83640d3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50320/0 (socket says 172.21.15.84:50320) 2023-12-12T09:20:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f8363fff640 1 -- 172.21.15.84:0/657042372 learned_addr learned my addr 172.21.15.84:0/657042372 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:38.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f835bfff640 1 --2- 172.21.15.84:0/657042372 >> v2:172.21.15.84:3300/0 conn(0x7f83640d16f0 0x7f83640d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f8368c90640 1 --2- 172.21.15.84:0/657042372 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 0x7f83640b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f83637fe640 1 -- 172.21.15.84:0/657042372 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201073953 0 0) 0x7f83640afd40 con 0x7f836415d490 2023-12-12T09:20:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f83637fe640 1 -- 172.21.15.84:0/657042372 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8350003520 con 0x7f836415d490 2023-12-12T09:20:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f835bfff640 1 -- 172.21.15.84:0/657042372 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 msgr2=0x7f83640b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f835bfff640 1 --2- 172.21.15.84:0/657042372 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 0x7f83640b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f835bfff640 1 -- 172.21.15.84:0/657042372 >> v1:172.21.15.84:6789/0 conn(0x7f836415d490 legacy=0x7f83640d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.473+0000 7f835bfff640 1 -- 172.21.15.84:0/657042372 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83640ce860 con 0x7f83640d16f0 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.474+0000 7f835bfff640 1 --2- 172.21.15.84:0/657042372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83640d16f0 0x7f83640d1b80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f834c0097a0 tx=0x7f834c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f8c0636c5d848 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f83637fe640 1 -- 172.21.15.84:0/657042372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c031780 con 0x7f83640d16f0 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f83637fe640 1 -- 172.21.15.84:0/657042372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c0318e0 con 0x7f83640d16f0 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f83637fe640 1 -- 172.21.15.84:0/657042372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c031c50 con 0x7f83640d16f0 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f836a6f3640 1 -- 172.21.15.84:0/657042372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83640d16f0 msgr2=0x7f83640d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f836a6f3640 1 --2- 172.21.15.84:0/657042372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83640d16f0 0x7f83640d1b80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f834c0097a0 tx=0x7f834c02b820 comp rx=0 tx=0).stop 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f836a6f3640 1 -- 172.21.15.84:0/657042372 shutdown_connections 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f836a6f3640 1 --2- 172.21.15.84:0/657042372 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 0x7f83640b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f836a6f3640 1 --2- 172.21.15.84:0/657042372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83640d16f0 0x7f83640d1b80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.475+0000 7f836a6f3640 1 -- 172.21.15.84:0/657042372 >> 172.21.15.84:0/657042372 conn(0x7f836409c450 msgr2=0x7f83640d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.476+0000 7f836a6f3640 1 -- 172.21.15.84:0/657042372 shutdown_connections 2023-12-12T09:20:38.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.476+0000 7f836a6f3640 1 -- 172.21.15.84:0/657042372 wait complete. 2023-12-12T09:20:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.477+0000 7f836a6f3640 1 Processor -- start 2023-12-12T09:20:38.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.477+0000 7f836a6f3640 1 -- start start 2023-12-12T09:20:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.478+0000 7f836a6f3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 0x7f83640cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.478+0000 7f836a6f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83640d16f0 0x7f83640cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.478+0000 7f836a6f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836415d490 0x7f83640ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.478+0000 7f836a6f3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83640c7850 con 0x7f836415d490 2023-12-12T09:20:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.478+0000 7f836a6f3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83640c6c40 con 0x7f83640d16f0 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.478+0000 7f836a6f3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83640c6f20 con 0x7f83640b04b0 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836415d490 0x7f83640ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836415d490 0x7f83640ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54002/0 (socket says 172.21.15.84:54002) 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 -- 172.21.15.84:0/4154172871 learned_addr learned my addr 172.21.15.84:0/4154172871 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 -- 172.21.15.84:0/4154172871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 msgr2=0x7f83640cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 0x7f83640cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 -- 172.21.15.84:0/4154172871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83640d16f0 msgr2=0x7f83640cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83640d16f0 0x7f83640cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 -- 172.21.15.84:0/4154172871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c009400 con 0x7f836415d490 2023-12-12T09:20:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.479+0000 7f8368c90640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836415d490 0x7f83640ca1e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f835c007e60 tx=0x7f835c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.480+0000 7f83617fa640 1 -- 172.21.15.84:0/4154172871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c014420 con 0x7f836415d490 2023-12-12T09:20:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.480+0000 7f83617fa640 1 -- 172.21.15.84:0/4154172871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0145a0 con 0x7f836415d490 2023-12-12T09:20:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.480+0000 7f83617fa640 1 -- 172.21.15.84:0/4154172871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c014950 con 0x7f836415d490 2023-12-12T09:20:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.480+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83640c7200 con 0x7f836415d490 2023-12-12T09:20:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.480+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83640cbf00 con 0x7f836415d490 2023-12-12T09:20:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.481+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8364072b80 con 0x7f836415d490 2023-12-12T09:20:38.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.482+0000 7f83617fa640 1 -- 172.21.15.84:0/4154172871 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f835c014ab0 con 0x7f836415d490 2023-12-12T09:20:38.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.483+0000 7f83617fa640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f834406ae70 0x7f834406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.483+0000 7f83617fa640 1 -- 172.21.15.84:0/4154172871 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f835c08a2d0 con 0x7f836415d490 2023-12-12T09:20:38.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.483+0000 7f8363fff640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f834406ae70 0x7f834406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.484+0000 7f8363fff640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f834406ae70 0x7f834406d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8354000f60 tx=0x7f83540078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.487+0000 7f83617fa640 1 -- 172.21.15.84:0/4154172871 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f835c054fc0 con 0x7f836415d490 2023-12-12T09:20:38.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.678+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83640673c0 con 0x7f836415d490 2023-12-12T09:20:38.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.682+0000 7f83617fa640 1 -- 172.21.15.84:0/4154172871 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f835c0585e0 con 0x7f836415d490 2023-12-12T09:20:38.683 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:38.683 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:38.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f834406ae70 msgr2=0x7f834406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f834406ae70 0x7f834406d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8354000f60 tx=0x7f83540078f0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836415d490 msgr2=0x7f83640ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836415d490 0x7f83640ca1e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f835c007e60 tx=0x7f835c00e4b0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 shutdown_connections 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f834406ae70 0x7f834406d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f836415d490 0x7f83640ca1e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83640d16f0 0x7f83640cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 --2- 172.21.15.84:0/4154172871 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83640b04b0 0x7f83640cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 >> 172.21.15.84:0/4154172871 conn(0x7f836409c450 msgr2=0x7f836406b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 shutdown_connections 2023-12-12T09:20:38.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.685+0000 7f836a6f3640 1 -- 172.21.15.84:0/4154172871 wait complete. 2023-12-12T09:20:38.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:38.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:38.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.918+0000 7f55b54e7640 1 Processor -- start 2023-12-12T09:20:38.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.918+0000 7f55b54e7640 1 -- start start 2023-12-12T09:20:38.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.919+0000 7f55b54e7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55b006dff0 0x7f55b00ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.919+0000 7f55b54e7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b015be60 0x7f55b013e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.919+0000 7f55b54e7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b00ce260 con 0x7f55b00b40d0 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.919+0000 7f55b54e7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b006e480 con 0x7f55b006dff0 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55b54e7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00cd930 con 0x7f55b015be60 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55ae7fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55b006dff0 0x7f55b00ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55ae7fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55b006dff0 0x7f55b00ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54006/0 (socket says 172.21.15.84:54006) 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55ae7fc640 1 -- 172.21.15.84:0/364536199 learned_addr learned my addr 172.21.15.84:0/364536199 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55af7fe640 1 --2- 172.21.15.84:0/364536199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b015be60 0x7f55b013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55ae7fc640 1 -- 172.21.15.84:0/364536199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b015be60 msgr2=0x7f55b013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55ae7fc640 1 --2- 172.21.15.84:0/364536199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b015be60 0x7f55b013e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55ae7fc640 1 -- 172.21.15.84:0/364536199 >> v1:172.21.15.99:6789/0 conn(0x7f55b00b40d0 legacy=0x7f55b00b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55ae7fc640 1 -- 172.21.15.84:0/364536199 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00cdc10 con 0x7f55b006dff0 2023-12-12T09:20:38.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.920+0000 7f55af7fe640 1 --2- 172.21.15.84:0/364536199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b015be60 0x7f55b013e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.921+0000 7f55ae7fc640 1 --2- 172.21.15.84:0/364536199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b006dff0 0x7f55b00ce6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0159025cf1693f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55adffb640 1 -- 172.21.15.84:0/364536199 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4031640 con 0x7f55b006dff0 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55adffb640 1 -- 172.21.15.84:0/364536199 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a40317a0 con 0x7f55b006dff0 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55adffb640 1 -- 172.21.15.84:0/364536199 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4031b30 con 0x7f55b006dff0 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55b54e7640 1 -- 172.21.15.84:0/364536199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b006dff0 msgr2=0x7f55b00ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55b54e7640 1 --2- 172.21.15.84:0/364536199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b006dff0 0x7f55b00ce6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009870 tx=0x7f55a402b8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55b54e7640 1 -- 172.21.15.84:0/364536199 shutdown_connections 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55b54e7640 1 --2- 172.21.15.84:0/364536199 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b015be60 0x7f55b013e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55b54e7640 1 --2- 172.21.15.84:0/364536199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b006dff0 0x7f55b00ce6f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.922+0000 7f55b54e7640 1 -- 172.21.15.84:0/364536199 >> 172.21.15.84:0/364536199 conn(0x7f55b00b0ac0 msgr2=0x7f55b00b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.923+0000 7f55b54e7640 1 -- 172.21.15.84:0/364536199 shutdown_connections 2023-12-12T09:20:38.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.923+0000 7f55b54e7640 1 -- 172.21.15.84:0/364536199 wait complete. 2023-12-12T09:20:38.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.924+0000 7f55b54e7640 1 Processor -- start 2023-12-12T09:20:38.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.924+0000 7f55b54e7640 1 -- start start 2023-12-12T09:20:38.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.925+0000 7f55b54e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55b006dff0 0x7f55b0152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.925+0000 7f55b54e7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b00b40d0 0x7f55b0150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.925+0000 7f55b54e7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b015be60 0x7f55b0155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.925+0000 7f55b54e7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b01401e0 con 0x7f55b015be60 2023-12-12T09:20:38.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.925+0000 7f55b54e7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0140480 con 0x7f55b006dff0 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.925+0000 7f55b54e7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b0140760 con 0x7f55b00b40d0 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b015be60 0x7f55b0155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b015be60 0x7f55b0155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54022/0 (socket says 172.21.15.84:54022) 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 -- 172.21.15.84:0/3405774010 learned_addr learned my addr 172.21.15.84:0/3405774010 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 -- 172.21.15.84:0/3405774010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b00b40d0 msgr2=0x7f55b0150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b00b40d0 0x7f55b0150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 -- 172.21.15.84:0/3405774010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55b006dff0 msgr2=0x7f55b0152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55b006dff0 0x7f55b0152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 -- 172.21.15.84:0/3405774010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40094d0 con 0x7f55b015be60 2023-12-12T09:20:38.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55af7fe640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b015be60 0x7f55b0155da0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f55a800cd50 tx=0x7f55a800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.926+0000 7f55977fe640 1 -- 172.21.15.84:0/3405774010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800f680 con 0x7f55b015be60 2023-12-12T09:20:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.927+0000 7f55977fe640 1 -- 172.21.15.84:0/3405774010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a800f800 con 0x7f55b015be60 2023-12-12T09:20:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.927+0000 7f55977fe640 1 -- 172.21.15.84:0/3405774010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800fbb0 con 0x7f55b015be60 2023-12-12T09:20:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.927+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b0140a40 con 0x7f55b015be60 2023-12-12T09:20:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.927+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b0153510 con 0x7f55b015be60 2023-12-12T09:20:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.928+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b0140f60 con 0x7f55b015be60 2023-12-12T09:20:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.929+0000 7f55977fe640 1 -- 172.21.15.84:0/3405774010 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55a800b040 con 0x7f55b015be60 2023-12-12T09:20:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.930+0000 7f55977fe640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f559c06ae40 0x7f559c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.930+0000 7f55977fe640 1 -- 172.21.15.84:0/3405774010 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f55a808a3d0 con 0x7f55b015be60 2023-12-12T09:20:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.930+0000 7f55aeffd640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f559c06ae40 0x7f559c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.931+0000 7f55aeffd640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f559c06ae40 0x7f559c06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55a0003cc0 tx=0x7f55a00079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:38.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:38.934+0000 7f55977fe640 1 -- 172.21.15.84:0/3405774010 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55b0140f60 con 0x7f55b015be60 2023-12-12T09:20:39.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.125+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55b0140f60 con 0x7f55b015be60 2023-12-12T09:20:39.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.126+0000 7f55977fe640 1 -- 172.21.15.84:0/3405774010 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55b0140f60 con 0x7f55b015be60 2023-12-12T09:20:39.127 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f559c06ae40 msgr2=0x7f559c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f559c06ae40 0x7f559c06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f55a0003cc0 tx=0x7f55a00079b0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b015be60 msgr2=0x7f55b0155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b015be60 0x7f55b0155da0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f55a800cd50 tx=0x7f55a800a650 comp rx=0 tx=0).stop 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 shutdown_connections 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f559c06ae40 0x7f559c06d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55b015be60 0x7f55b0155da0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55b00b40d0 0x7f55b0150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.129+0000 7f55b54e7640 1 --2- 172.21.15.84:0/3405774010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55b006dff0 0x7f55b0152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.130+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 >> 172.21.15.84:0/3405774010 conn(0x7f55b00b0ac0 msgr2=0x7f55b00b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:39.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.130+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 shutdown_connections 2023-12-12T09:20:39.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.130+0000 7f55b54e7640 1 -- 172.21.15.84:0/3405774010 wait complete. 2023-12-12T09:20:39.149 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.364+0000 7f718593c640 1 Processor -- start 2023-12-12T09:20:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.364+0000 7f718593c640 1 -- start start 2023-12-12T09:20:39.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.366+0000 7f718593c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7180070130 0x7f7180070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.366+0000 7f718593c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7180070ad0 con 0x7f7180070f30 2023-12-12T09:20:39.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.366+0000 7f718593c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71800b2fc0 con 0x7f71800ad610 2023-12-12T09:20:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.366+0000 7f718593c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71800b3c40 con 0x7f7180070130 2023-12-12T09:20:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.366+0000 7f717f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7180070f30 0x7f71800713a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50326/0 (socket says 172.21.15.84:50326) 2023-12-12T09:20:39.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.366+0000 7f717f7fe640 1 -- 172.21.15.84:0/284189696 learned_addr learned my addr 172.21.15.84:0/284189696 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:39.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717e7fc640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7180070130 0x7f7180070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154262580 0 0) 0x7f7180070ad0 con 0x7f7180070f30 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7168005730 con 0x7f7180070f30 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2088327446 0 0) 0x7f7168005730 con 0x7f7180070f30 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7180070130 msgr2=0x7f7180070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7180070130 0x7f7180070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 >> v1:172.21.15.99:6789/0 conn(0x7f71800ad610 legacy=0x7f71800ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800b32a0 con 0x7f7180070f30 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f7178001a10 con 0x7f7180070f30 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 >> v1:172.21.15.84:6789/0 conn(0x7f7180070f30 legacy=0x7f71800713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7168005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7180070130 0x7f71680069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7168006f10 0x7f7168007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.367+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800b3c40 con 0x7f7168005bb0 2023-12-12T09:20:39.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716800dd20 con 0x7f7168006f10 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716800dee0 con 0x7f7180070130 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717effd640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7168005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717e7fc640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7180070130 0x7f71680069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717effd640 1 -- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7180070130 msgr2=0x7f71680069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717effd640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7180070130 0x7f71680069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717effd640 1 -- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7168006f10 msgr2=0x7f7168007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717f7fe640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7168006f10 0x7f7168007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717effd640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7168006f10 0x7f7168007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717effd640 1 -- 172.21.15.84:0/284189696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168005730 con 0x7f7168005bb0 2023-12-12T09:20:39.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.368+0000 7f717f7fe640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7168006f10 0x7f7168007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:39.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.369+0000 7f717effd640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7168005fd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7170001750 tx=0x7f7168007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b30329805fdda7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:39.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700052d0 con 0x7f7168005bb0 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717002e050 con 0x7f7168005bb0 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f717dffb640 1 -- 172.21.15.84:0/284189696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700035f0 con 0x7f7168005bb0 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f718593c640 1 -- 172.21.15.84:0/284189696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 msgr2=0x7f7168005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f718593c640 1 --2- 172.21.15.84:0/284189696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7168005fd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7170001750 tx=0x7f7168007a00 comp rx=0 tx=0).stop 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f717f7fe640 1 -- 172.21.15.84:0/284189696 reap_dead start 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f718593c640 1 -- 172.21.15.84:0/284189696 shutdown_connections 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f718593c640 1 -- 172.21.15.84:0/284189696 >> 172.21.15.84:0/284189696 conn(0x7f71800b0900 msgr2=0x7f71800b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f718593c640 1 -- 172.21.15.84:0/284189696 shutdown_connections 2023-12-12T09:20:39.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.370+0000 7f718593c640 1 -- 172.21.15.84:0/284189696 wait complete. 2023-12-12T09:20:39.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.372+0000 7f718593c640 1 Processor -- start 2023-12-12T09:20:39.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.372+0000 7f718593c640 1 -- start start 2023-12-12T09:20:39.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.373+0000 7f718593c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7180154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.373+0000 7f718593c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f718009b220 0x7f71801f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.373+0000 7f718593c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71801f3770 0x7f7180154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.373+0000 7f718593c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7180071ab0 con 0x7f7168005bb0 2023-12-12T09:20:39.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.373+0000 7f718593c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718009b680 con 0x7f718009b220 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.373+0000 7f718593c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71801f6a50 con 0x7f71801f3770 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.373+0000 7f717effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7180154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7180154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54046/0 (socket says 172.21.15.84:54046) 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717effd640 1 -- 172.21.15.84:0/546610446 learned_addr learned my addr 172.21.15.84:0/546610446 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717e7fc640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f718009b220 0x7f71801f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717f7fe640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71801f3770 0x7f7180154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717effd640 1 -- 172.21.15.84:0/546610446 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71801f3770 msgr2=0x7f7180154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717effd640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71801f3770 0x7f7180154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717effd640 1 -- 172.21.15.84:0/546610446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f718009b220 msgr2=0x7f71801f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717effd640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f718009b220 0x7f71801f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717effd640 1 -- 172.21.15.84:0/546610446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71801f6cf0 con 0x7f7168005bb0 2023-12-12T09:20:39.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.374+0000 7f717effd640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7180154220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7170005040 tx=0x7f7170001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:39.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.375+0000 7f7167fff640 1 -- 172.21.15.84:0/546610446 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71700076c0 con 0x7f7168005bb0 2023-12-12T09:20:39.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.375+0000 7f7167fff640 1 -- 172.21.15.84:0/546610446 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7170007a30 con 0x7f7168005bb0 2023-12-12T09:20:39.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.375+0000 7f7167fff640 1 -- 172.21.15.84:0/546610446 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170006c00 con 0x7f7168005bb0 2023-12-12T09:20:39.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.375+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71801f6fd0 con 0x7f7168005bb0 2023-12-12T09:20:39.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.375+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71801f3250 con 0x7f7168005bb0 2023-12-12T09:20:39.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.376+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71800673c0 con 0x7f7168005bb0 2023-12-12T09:20:39.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.377+0000 7f7167fff640 1 -- 172.21.15.84:0/546610446 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71700035f0 con 0x7f7168005bb0 2023-12-12T09:20:39.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.378+0000 7f7167fff640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f716c06ae70 0x7f716c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.378+0000 7f7167fff640 1 -- 172.21.15.84:0/546610446 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f71700ab650 con 0x7f7168005bb0 2023-12-12T09:20:39.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.378+0000 7f717e7fc640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f716c06ae70 0x7f716c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.378+0000 7f717e7fc640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f716c06ae70 0x7f716c06d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71800cf4a0 tx=0x7f7174008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:39.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.382+0000 7f7167fff640 1 -- 172.21.15.84:0/546610446 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7170076460 con 0x7f7168005bb0 2023-12-12T09:20:39.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.571+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f718006c0d0 con 0x7f7168005bb0 2023-12-12T09:20:39.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.572+0000 7f7167fff640 1 -- 172.21.15.84:0/546610446 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7170079a80 con 0x7f7168005bb0 2023-12-12T09:20:39.572 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f716c06ae70 msgr2=0x7f716c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f716c06ae70 0x7f716c06d330 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71800cf4a0 tx=0x7f7174008040 comp rx=0 tx=0).stop 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 msgr2=0x7f7180154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7180154220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7170005040 tx=0x7f7170001120 comp rx=0 tx=0).stop 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 shutdown_connections 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71801f3770 0x7f7180154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f718009b220 0x7f71801f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f716c06ae70 0x7f716c06d330 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 --2- 172.21.15.84:0/546610446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168005bb0 0x7f7180154220 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.574+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 >> 172.21.15.84:0/546610446 conn(0x7f71800b0900 msgr2=0x7f7180158560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.575+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 shutdown_connections 2023-12-12T09:20:39.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.575+0000 7f718593c640 1 -- 172.21.15.84:0/546610446 wait complete. 2023-12-12T09:20:39.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:39.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.808+0000 7f9c5ab25640 1 Processor -- start 2023-12-12T09:20:39.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.808+0000 7f9c5ab25640 1 -- start start 2023-12-12T09:20:39.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c5ab25640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c540b40d0 0x7f9c5406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c5ab25640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c540ce6f0 0x7f9c540b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c5ab25640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540ceb80 con 0x7f9c5415be60 2023-12-12T09:20:39.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c5ab25640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c540ce260 con 0x7f9c540b40d0 2023-12-12T09:20:39.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c5ab25640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c540b49f0 con 0x7f9c540ce6f0 2023-12-12T09:20:39.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c588c1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9c540b40d0 0x7f9c5406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c590c2640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9c5415be60 0x7f9c5413e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50332/0 (socket says 172.21.15.84:50332) 2023-12-12T09:20:39.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c590c2640 1 -- 172.21.15.84:0/86817978 learned_addr learned my addr 172.21.15.84:0/86817978 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:39.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c53fff640 1 --2- 172.21.15.84:0/86817978 >> v2:172.21.15.99:3300/0 conn(0x7f9c540ce6f0 0x7f9c540b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c588c1640 1 -- 172.21.15.84:0/86817978 >> v2:172.21.15.99:3300/0 conn(0x7f9c540ce6f0 msgr2=0x7f9c540b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:39.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.810+0000 7f9c588c1640 1 --2- 172.21.15.84:0/86817978 >> v2:172.21.15.99:3300/0 conn(0x7f9c540ce6f0 0x7f9c540b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.811+0000 7f9c588c1640 1 -- 172.21.15.84:0/86817978 >> v1:172.21.15.84:6789/0 conn(0x7f9c5415be60 legacy=0x7f9c5413e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.811+0000 7f9c588c1640 1 -- 172.21.15.84:0/86817978 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540cd930 con 0x7f9c540b40d0 2023-12-12T09:20:39.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.811+0000 7f9c537fe640 1 -- 172.21.15.84:0/86817978 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563723544 0 0) 0x7f9c540ceb80 con 0x7f9c5415be60 2023-12-12T09:20:39.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.812+0000 7f9c588c1640 1 --2- 172.21.15.84:0/86817978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c540b40d0 0x7f9c5406dff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9c54141880 tx=0x7f9c4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8f184f50d13798 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.812+0000 7f9c537fe640 1 -- 172.21.15.84:0/86817978 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48031830 con 0x7f9c540b40d0 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.812+0000 7f9c537fe640 1 -- 172.21.15.84:0/86817978 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48031990 con 0x7f9c540b40d0 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.812+0000 7f9c537fe640 1 -- 172.21.15.84:0/86817978 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48031d20 con 0x7f9c540b40d0 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.813+0000 7f9c5ab25640 1 -- 172.21.15.84:0/86817978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c540b40d0 msgr2=0x7f9c5406dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.813+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/86817978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c540b40d0 0x7f9c5406dff0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9c54141880 tx=0x7f9c4802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.813+0000 7f9c5ab25640 1 -- 172.21.15.84:0/86817978 shutdown_connections 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.813+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/86817978 >> v2:172.21.15.99:3300/0 conn(0x7f9c540ce6f0 0x7f9c540b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.813+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/86817978 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c540b40d0 0x7f9c5406dff0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.813+0000 7f9c5ab25640 1 -- 172.21.15.84:0/86817978 >> 172.21.15.84:0/86817978 conn(0x7f9c540b0ac0 msgr2=0x7f9c540b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:39.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.813+0000 7f9c5ab25640 1 -- 172.21.15.84:0/86817978 shutdown_connections 2023-12-12T09:20:39.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.813+0000 7f9c5ab25640 1 -- 172.21.15.84:0/86817978 wait complete. 2023-12-12T09:20:39.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.815+0000 7f9c5ab25640 1 Processor -- start 2023-12-12T09:20:39.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.815+0000 7f9c5ab25640 1 -- start start 2023-12-12T09:20:39.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c5ab25640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c540b40d0 0x7f9c54151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c5ab25640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c540ce6f0 0x7f9c54135540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c5ab25640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5415be60 0x7f9c54140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c5ab25640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5413fde0 con 0x7f9c5415be60 2023-12-12T09:20:39.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c5ab25640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541400c0 con 0x7f9c540b40d0 2023-12-12T09:20:39.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c5ab25640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541403a0 con 0x7f9c540ce6f0 2023-12-12T09:20:39.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c590c2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5415be60 0x7f9c54140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c590c2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5415be60 0x7f9c54140e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54052/0 (socket says 172.21.15.84:54052) 2023-12-12T09:20:39.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c590c2640 1 -- 172.21.15.84:0/1514790678 learned_addr learned my addr 172.21.15.84:0/1514790678 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c53fff640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c540ce6f0 0x7f9c54135540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c588c1640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c540b40d0 0x7f9c54151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c590c2640 1 -- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c540ce6f0 msgr2=0x7f9c54135540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c590c2640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c540ce6f0 0x7f9c54135540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c590c2640 1 -- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c540b40d0 msgr2=0x7f9c54151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c590c2640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c540b40d0 0x7f9c54151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c590c2640 1 -- 172.21.15.84:0/1514790678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48009400 con 0x7f9c5415be60 2023-12-12T09:20:39.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.816+0000 7f9c53fff640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c540ce6f0 0x7f9c54135540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.817+0000 7f9c590c2640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5415be60 0x7f9c54140e80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00c7e0 tx=0x7f9c4c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.817+0000 7f9c517fa640 1 -- 172.21.15.84:0/1514790678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00a640 con 0x7f9c5415be60 2023-12-12T09:20:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.817+0000 7f9c517fa640 1 -- 172.21.15.84:0/1514790678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c00a7c0 con 0x7f9c5415be60 2023-12-12T09:20:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.817+0000 7f9c517fa640 1 -- 172.21.15.84:0/1514790678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c00ab70 con 0x7f9c5415be60 2023-12-12T09:20:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.817+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c54140680 con 0x7f9c5415be60 2023-12-12T09:20:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.817+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c54151860 con 0x7f9c5415be60 2023-12-12T09:20:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.818+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c54140ba0 con 0x7f9c5415be60 2023-12-12T09:20:39.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.820+0000 7f9c517fa640 1 -- 172.21.15.84:0/1514790678 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c4c00acd0 con 0x7f9c5415be60 2023-12-12T09:20:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.821+0000 7f9c517fa640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9c3806ae40 0x7f9c3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.821+0000 7f9c517fa640 1 -- 172.21.15.84:0/1514790678 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9c4c088fc0 con 0x7f9c5415be60 2023-12-12T09:20:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.821+0000 7f9c588c1640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9c3806ae40 0x7f9c3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.822+0000 7f9c588c1640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9c3806ae40 0x7f9c3806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c48036000 tx=0x7f9c4803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:39.825+0000 7f9c517fa640 1 -- 172.21.15.84:0/1514790678 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c54140ba0 con 0x7f9c5415be60 2023-12-12T09:20:40.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.017+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c54140ba0 con 0x7f9c5415be60 2023-12-12T09:20:40.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.019+0000 7f9c517fa640 1 -- 172.21.15.84:0/1514790678 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c54140ba0 con 0x7f9c5415be60 2023-12-12T09:20:40.019 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9c3806ae40 msgr2=0x7f9c3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9c3806ae40 0x7f9c3806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c48036000 tx=0x7f9c4803c040 comp rx=0 tx=0).stop 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5415be60 msgr2=0x7f9c54140e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5415be60 0x7f9c54140e80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c00c7e0 tx=0x7f9c4c00cca0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 shutdown_connections 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9c3806ae40 0x7f9c3806d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c5415be60 0x7f9c54140e80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9c540ce6f0 0x7f9c54135540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 --2- 172.21.15.84:0/1514790678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c540b40d0 0x7f9c54151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 >> 172.21.15.84:0/1514790678 conn(0x7f9c540b0ac0 msgr2=0x7f9c541592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:40.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.021+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 shutdown_connections 2023-12-12T09:20:40.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.022+0000 7f9c5ab25640 1 -- 172.21.15.84:0/1514790678 wait complete. 2023-12-12T09:20:40.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.257+0000 7f6f55543640 1 Processor -- start 2023-12-12T09:20:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.258+0000 7f6f55543640 1 -- start start 2023-12-12T09:20:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.260+0000 7f6f55543640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f50155690 0x7f6f5006ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.260+0000 7f6f55543640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f50155a70 con 0x7f6f5015bc00 2023-12-12T09:20:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.260+0000 7f6f55543640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5015c120 con 0x7f6f500cde40 2023-12-12T09:20:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.260+0000 7f6f55543640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5015c400 con 0x7f6f50155690 2023-12-12T09:20:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.260+0000 7f6f4f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6f5015bc00 0x7f6f50070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50344/0 (socket says 172.21.15.84:50344) 2023-12-12T09:20:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.260+0000 7f6f4f7fe640 1 -- 172.21.15.84:0/243795132 learned_addr learned my addr 172.21.15.84:0/243795132 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:40.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.260+0000 7f6f4effd640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f50155690 0x7f6f5006ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147357394 0 0) 0x7f6f50155a70 con 0x7f6f5015bc00 2023-12-12T09:20:40.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f3c003520 con 0x7f6f5015bc00 2023-12-12T09:20:40.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1280381273 0 0) 0x7f6f3c003520 con 0x7f6f5015bc00 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f50155690 msgr2=0x7f6f5006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f50155690 0x7f6f5006ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 >> v1:172.21.15.99:6789/0 conn(0x7f6f500cde40 legacy=0x7f6f5015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5006c380 con 0x7f6f5015bc00 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f6f480019f0 con 0x7f6f5015bc00 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 >> v1:172.21.15.84:6789/0 conn(0x7f6f5015bc00 legacy=0x7f6f50070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3c0039a0 0x7f6f3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f50155690 0x7f6f3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f3c004d00 0x7f6f3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5015c400 con 0x7f6f3c0039a0 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c00ba60 con 0x7f6f3c004d00 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.261+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c00bc20 con 0x7f6f50155690 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.262+0000 7f6f4effd640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3c0039a0 0x7f6f3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.262+0000 7f6f4effd640 1 -- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f50155690 msgr2=0x7f6f3c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.262+0000 7f6f4effd640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f50155690 0x7f6f3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.262+0000 7f6f4effd640 1 -- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f3c004d00 msgr2=0x7f6f3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:40.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.262+0000 7f6f4effd640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f3c004d00 0x7f6f3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.262+0000 7f6f4effd640 1 -- 172.21.15.84:0/243795132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c003520 con 0x7f6f3c0039a0 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.263+0000 7f6f4effd640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3c0039a0 0x7f6f3c003dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009a90 tx=0x7f6f3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea58bc54a6097071 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.263+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4002c6b0 con 0x7f6f3c0039a0 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.263+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4002c810 con 0x7f6f3c0039a0 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.263+0000 7f6f4e7fc640 1 -- 172.21.15.84:0/243795132 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4002cba0 con 0x7f6f3c0039a0 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.264+0000 7f6f55543640 1 -- 172.21.15.84:0/243795132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3c0039a0 msgr2=0x7f6f3c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.264+0000 7f6f55543640 1 --2- 172.21.15.84:0/243795132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3c0039a0 0x7f6f3c003dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009a90 tx=0x7f6f3c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.264+0000 7f6f4f7fe640 1 -- 172.21.15.84:0/243795132 reap_dead start 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.264+0000 7f6f55543640 1 -- 172.21.15.84:0/243795132 shutdown_connections 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.264+0000 7f6f55543640 1 -- 172.21.15.84:0/243795132 >> 172.21.15.84:0/243795132 conn(0x7f6f500b0900 msgr2=0x7f6f500b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.264+0000 7f6f55543640 1 -- 172.21.15.84:0/243795132 shutdown_connections 2023-12-12T09:20:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.264+0000 7f6f55543640 1 -- 172.21.15.84:0/243795132 wait complete. 2023-12-12T09:20:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.266+0000 7f6f55543640 1 Processor -- start 2023-12-12T09:20:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.266+0000 7f6f55543640 1 -- start start 2023-12-12T09:20:40.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f55543640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f3c0039a0 0x7f6f50148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f55543640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f50149460 0x7f6f50099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f55543640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50099f60 0x7f6f50157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f55543640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f501540b0 con 0x7f6f50149460 2023-12-12T09:20:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f55543640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500b2fa0 con 0x7f6f50099f60 2023-12-12T09:20:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f55543640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500b2390 con 0x7f6f3c0039a0 2023-12-12T09:20:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f50149460 0x7f6f50099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f50149460 0x7f6f50099a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54058/0 (socket says 172.21.15.84:54058) 2023-12-12T09:20:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.267+0000 7f6f467fc640 1 -- 172.21.15.84:0/3143900517 learned_addr learned my addr 172.21.15.84:0/3143900517 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f467fc640 1 -- 172.21.15.84:0/3143900517 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f3c0039a0 msgr2=0x7f6f50148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f467fc640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f3c0039a0 0x7f6f50148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f467fc640 1 -- 172.21.15.84:0/3143900517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50099f60 msgr2=0x7f6f50157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f467fc640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50099f60 0x7f6f50157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f467fc640 1 -- 172.21.15.84:0/3143900517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500b2670 con 0x7f6f50149460 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f467fc640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f50149460 0x7f6f50099a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c500 tx=0x7f6f3800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f47fff640 1 -- 172.21.15.84:0/3143900517 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f380052d0 con 0x7f6f50149460 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f47fff640 1 -- 172.21.15.84:0/3143900517 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38005430 con 0x7f6f50149460 2023-12-12T09:20:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f47fff640 1 -- 172.21.15.84:0/3143900517 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38012870 con 0x7f6f50149460 2023-12-12T09:20:40.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f500b2950 con 0x7f6f50149460 2023-12-12T09:20:40.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.268+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f500b2080 con 0x7f6f50149460 2023-12-12T09:20:40.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.270+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f500ac000 con 0x7f6f50149460 2023-12-12T09:20:40.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.270+0000 7f6f47fff640 1 -- 172.21.15.84:0/3143900517 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f380129d0 con 0x7f6f50149460 2023-12-12T09:20:40.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.271+0000 7f6f47fff640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6f3006ae40 0x7f6f3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.271+0000 7f6f47fff640 1 -- 172.21.15.84:0/3143900517 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6f380895d0 con 0x7f6f50149460 2023-12-12T09:20:40.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.272+0000 7f6f4effd640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6f3006ae40 0x7f6f3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.272+0000 7f6f4effd640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6f3006ae40 0x7f6f3006d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f40036000 tx=0x7f6f4002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:40.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.276+0000 7f6f47fff640 1 -- 172.21.15.84:0/3143900517 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f380542b0 con 0x7f6f50149460 2023-12-12T09:20:40.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.465+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6f500673c0 con 0x7f6f50149460 2023-12-12T09:20:40.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.465+0000 7f6f47fff640 1 -- 172.21.15.84:0/3143900517 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6f380578d0 con 0x7f6f50149460 2023-12-12T09:20:40.466 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6f3006ae40 msgr2=0x7f6f3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6f3006ae40 0x7f6f3006d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f40036000 tx=0x7f6f4002e000 comp rx=0 tx=0).stop 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f50149460 msgr2=0x7f6f50099a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f50149460 0x7f6f50099a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c500 tx=0x7f6f3800c9c0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 shutdown_connections 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f50099f60 0x7f6f50157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6f3006ae40 0x7f6f3006d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f50149460 0x7f6f50099a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 --2- 172.21.15.84:0/3143900517 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6f3c0039a0 0x7f6f50148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.468+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 >> 172.21.15.84:0/3143900517 conn(0x7f6f500b0900 msgr2=0x7f6f50070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.469+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 shutdown_connections 2023-12-12T09:20:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.469+0000 7f6f55543640 1 -- 172.21.15.84:0/3143900517 wait complete. 2023-12-12T09:20:40.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:40.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.702+0000 7f0394c7e640 1 Processor -- start 2023-12-12T09:20:40.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.702+0000 7f0394c7e640 1 -- start start 2023-12-12T09:20:40.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.703+0000 7f0394c7e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0390144740 0x7f039006de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.703+0000 7f0394c7e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f039015f4f0 0x7f03900705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.703+0000 7f0394c7e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0390144b20 con 0x7f039015e950 2023-12-12T09:20:40.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.703+0000 7f0394c7e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039006d670 con 0x7f0390144740 2023-12-12T09:20:40.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.703+0000 7f0394c7e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f039006cdd0 con 0x7f039015f4f0 2023-12-12T09:20:40.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f038f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0390144740 0x7f039006de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f0387fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f039015e950 0x7f039015ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50352/0 (socket says 172.21.15.84:50352) 2023-12-12T09:20:40.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f0387fff640 1 -- 172.21.15.84:0/39734607 learned_addr learned my addr 172.21.15.84:0/39734607 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:40.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f038f7fe640 1 -- 172.21.15.84:0/39734607 >> v2:172.21.15.99:3300/0 conn(0x7f039015f4f0 msgr2=0x7f03900705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:40.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f038ffff640 1 --2- 172.21.15.84:0/39734607 >> v2:172.21.15.99:3300/0 conn(0x7f039015f4f0 0x7f03900705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f038f7fe640 1 --2- 172.21.15.84:0/39734607 >> v2:172.21.15.99:3300/0 conn(0x7f039015f4f0 0x7f03900705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f038f7fe640 1 -- 172.21.15.84:0/39734607 >> v1:172.21.15.84:6789/0 conn(0x7f039015e950 legacy=0x7f039015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f038effd640 1 -- 172.21.15.84:0/39734607 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760027354 0 0) 0x7f0390144b20 con 0x7f039015e950 2023-12-12T09:20:40.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f038f7fe640 1 -- 172.21.15.84:0/39734607 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039006d0b0 con 0x7f0390144740 2023-12-12T09:20:40.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.704+0000 7f038ffff640 1 --2- 172.21.15.84:0/39734607 >> v2:172.21.15.99:3300/0 conn(0x7f039015f4f0 0x7f03900705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:40.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.705+0000 7f038f7fe640 1 --2- 172.21.15.84:0/39734607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0390144740 0x7f039006de80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f039006ba20 tx=0x7f038002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6644ff965ebd5481 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f038effd640 1 -- 172.21.15.84:0/39734607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380031830 con 0x7f0390144740 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f038effd640 1 -- 172.21.15.84:0/39734607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0380031990 con 0x7f0390144740 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f038effd640 1 -- 172.21.15.84:0/39734607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380031d20 con 0x7f0390144740 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f0394c7e640 1 -- 172.21.15.84:0/39734607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0390144740 msgr2=0x7f039006de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f0394c7e640 1 --2- 172.21.15.84:0/39734607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0390144740 0x7f039006de80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f039006ba20 tx=0x7f038002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f0394c7e640 1 -- 172.21.15.84:0/39734607 shutdown_connections 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f0394c7e640 1 --2- 172.21.15.84:0/39734607 >> v2:172.21.15.99:3300/0 conn(0x7f039015f4f0 0x7f03900705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f0394c7e640 1 --2- 172.21.15.84:0/39734607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0390144740 0x7f039006de80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f0394c7e640 1 -- 172.21.15.84:0/39734607 >> 172.21.15.84:0/39734607 conn(0x7f03900b07f0 msgr2=0x7f03900b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f0394c7e640 1 -- 172.21.15.84:0/39734607 shutdown_connections 2023-12-12T09:20:40.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.706+0000 7f0394c7e640 1 -- 172.21.15.84:0/39734607 wait complete. 2023-12-12T09:20:40.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.708+0000 7f0394c7e640 1 Processor -- start 2023-12-12T09:20:40.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.708+0000 7f0394c7e640 1 -- start start 2023-12-12T09:20:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.709+0000 7f0394c7e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0390144740 0x7f03900b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.709+0000 7f0394c7e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039015e950 0x7f03901586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0394c7e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f039015f4f0 0x7f03900c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0394c7e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900c5840 con 0x7f039015e950 2023-12-12T09:20:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0394c7e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390158c30 con 0x7f039015f4f0 2023-12-12T09:20:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0394c7e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03901f2860 con 0x7f0390144740 2023-12-12T09:20:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0387fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039015e950 0x7f03901586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0387fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039015e950 0x7f03901586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54086/0 (socket says 172.21.15.84:54086) 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0387fff640 1 -- 172.21.15.84:0/2176082513 learned_addr learned my addr 172.21.15.84:0/2176082513 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f038f7fe640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0390144740 0x7f03900b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f038ffff640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f039015f4f0 0x7f03900c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0387fff640 1 -- 172.21.15.84:0/2176082513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0390144740 msgr2=0x7f03900b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0387fff640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0390144740 0x7f03900b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0387fff640 1 -- 172.21.15.84:0/2176082513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f039015f4f0 msgr2=0x7f03900c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0387fff640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f039015f4f0 0x7f03900c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.710+0000 7f0387fff640 1 -- 172.21.15.84:0/2176082513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0380009400 con 0x7f039015e950 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.711+0000 7f0387fff640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039015e950 0x7f03901586f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f037800c4d0 tx=0x7f037800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.711+0000 7f038cff9640 1 -- 172.21.15.84:0/2176082513 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780074e0 con 0x7f039015e950 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.711+0000 7f038cff9640 1 -- 172.21.15.84:0/2176082513 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0378007660 con 0x7f039015e950 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.711+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03900c4cc0 con 0x7f039015e950 2023-12-12T09:20:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.711+0000 7f038cff9640 1 -- 172.21.15.84:0/2176082513 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378004a20 con 0x7f039015e950 2023-12-12T09:20:40.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.711+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03900c5280 con 0x7f039015e950 2023-12-12T09:20:40.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.712+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03900673c0 con 0x7f039015e950 2023-12-12T09:20:40.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.713+0000 7f038cff9640 1 -- 172.21.15.84:0/2176082513 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0378004b80 con 0x7f039015e950 2023-12-12T09:20:40.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.714+0000 7f038cff9640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f037006ae40 0x7f037006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:40.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.714+0000 7f038cff9640 1 -- 172.21.15.84:0/2176082513 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0378088f10 con 0x7f039015e950 2023-12-12T09:20:40.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.714+0000 7f038f7fe640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f037006ae40 0x7f037006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:40.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.715+0000 7f038f7fe640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f037006ae40 0x7f037006d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0380036000 tx=0x7f0380008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:40.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.718+0000 7f038cff9640 1 -- 172.21.15.84:0/2176082513 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0378053bf0 con 0x7f039015e950 2023-12-12T09:20:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.909+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0390071f60 con 0x7f039015e950 2023-12-12T09:20:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.912+0000 7f038cff9640 1 -- 172.21.15.84:0/2176082513 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f0378018020 con 0x7f039015e950 2023-12-12T09:20:40.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:40.913 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f037006ae40 msgr2=0x7f037006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f037006ae40 0x7f037006d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0380036000 tx=0x7f0380008030 comp rx=0 tx=0).stop 2023-12-12T09:20:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039015e950 msgr2=0x7f03901586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039015e950 0x7f03901586f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f037800c4d0 tx=0x7f037800c990 comp rx=0 tx=0).stop 2023-12-12T09:20:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 shutdown_connections 2023-12-12T09:20:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f039015f4f0 0x7f03900c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f037006ae40 0x7f037006d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f039015e950 0x7f03901586f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 --2- 172.21.15.84:0/2176082513 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0390144740 0x7f03900b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 >> 172.21.15.84:0/2176082513 conn(0x7f03900b07f0 msgr2=0x7f0390142360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 shutdown_connections 2023-12-12T09:20:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:40.915+0000 7f0394c7e640 1 -- 172.21.15.84:0/2176082513 wait complete. 2023-12-12T09:20:40.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:40.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.144+0000 7f6926c56640 1 Processor -- start 2023-12-12T09:20:41.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.145+0000 7f6926c56640 1 -- start start 2023-12-12T09:20:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.146+0000 7f6926c56640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69200b40d0 0x7f692006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.146+0000 7f6926c56640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f69200ce6f0 0x7f69200b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.146+0000 7f6926c56640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69200ceb80 con 0x7f692015be60 2023-12-12T09:20:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.146+0000 7f6926c56640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69200ce260 con 0x7f69200ce6f0 2023-12-12T09:20:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.146+0000 7f6926c56640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69200b49f0 con 0x7f69200b40d0 2023-12-12T09:20:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.147+0000 7f691ffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f69200ce6f0 0x7f69200b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.147+0000 7f69249f2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69200b40d0 0x7f692006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.147+0000 7f691ffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f69200ce6f0 0x7f69200b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:41122/0 (socket says 172.21.15.84:41122) 2023-12-12T09:20:41.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.147+0000 7f691ffff640 1 -- 172.21.15.84:0/114221116 learned_addr learned my addr 172.21.15.84:0/114221116 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.148+0000 7f69249f2640 1 -- 172.21.15.84:0/114221116 >> v2:172.21.15.99:3300/0 conn(0x7f69200ce6f0 msgr2=0x7f69200b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.148+0000 7f69249f2640 1 --2- 172.21.15.84:0/114221116 >> v2:172.21.15.99:3300/0 conn(0x7f69200ce6f0 0x7f69200b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.148+0000 7f69249f2640 1 -- 172.21.15.84:0/114221116 >> v1:172.21.15.99:6789/0 conn(0x7f692015be60 legacy=0x7f692013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.148+0000 7f69249f2640 1 -- 172.21.15.84:0/114221116 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69200cd930 con 0x7f69200b40d0 2023-12-12T09:20:41.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.149+0000 7f69249f2640 1 --2- 172.21.15.84:0/114221116 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69200b40d0 0x7f692006dff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69140097a0 tx=0x7f691402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca37e965909bc7c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:41.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.150+0000 7f691f7fe640 1 -- 172.21.15.84:0/114221116 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691402d040 con 0x7f69200b40d0 2023-12-12T09:20:41.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.150+0000 7f691f7fe640 1 -- 172.21.15.84:0/114221116 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6914031810 con 0x7f69200b40d0 2023-12-12T09:20:41.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.150+0000 7f691f7fe640 1 -- 172.21.15.84:0/114221116 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914031ba0 con 0x7f69200b40d0 2023-12-12T09:20:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.150+0000 7f6926c56640 1 -- 172.21.15.84:0/114221116 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69200b40d0 msgr2=0x7f692006dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.150+0000 7f6926c56640 1 --2- 172.21.15.84:0/114221116 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69200b40d0 0x7f692006dff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f69140097a0 tx=0x7f691402b8b0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.150+0000 7f6926c56640 1 -- 172.21.15.84:0/114221116 shutdown_connections 2023-12-12T09:20:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.150+0000 7f6926c56640 1 --2- 172.21.15.84:0/114221116 >> v2:172.21.15.99:3300/0 conn(0x7f69200ce6f0 0x7f69200b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.150+0000 7f6926c56640 1 --2- 172.21.15.84:0/114221116 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69200b40d0 0x7f692006dff0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.151+0000 7f6926c56640 1 -- 172.21.15.84:0/114221116 >> 172.21.15.84:0/114221116 conn(0x7f69200b0ac0 msgr2=0x7f69200b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.151+0000 7f6926c56640 1 -- 172.21.15.84:0/114221116 shutdown_connections 2023-12-12T09:20:41.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.151+0000 7f6926c56640 1 -- 172.21.15.84:0/114221116 wait complete. 2023-12-12T09:20:41.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.152+0000 7f6926c56640 1 Processor -- start 2023-12-12T09:20:41.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.153+0000 7f6926c56640 1 -- start start 2023-12-12T09:20:41.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.153+0000 7f6926c56640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69200b40d0 0x7f69201584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.153+0000 7f6926c56640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69200ce6f0 0x7f6920151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f6926c56640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f692015be60 0x7f6920153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f6926c56640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69201557e0 con 0x7f69200b40d0 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f6926c56640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920158ab0 con 0x7f69200ce6f0 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f6926c56640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6920154d00 con 0x7f692015be60 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69249f2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69200b40d0 0x7f69201584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69249f2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69200b40d0 0x7f69201584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54100/0 (socket says 172.21.15.84:54100) 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69249f2640 1 -- 172.21.15.84:0/861250354 learned_addr learned my addr 172.21.15.84:0/861250354 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f691ffff640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69200ce6f0 0x7f6920151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69251f3640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f692015be60 0x7f6920153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69249f2640 1 -- 172.21.15.84:0/861250354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f692015be60 msgr2=0x7f6920153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69249f2640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f692015be60 0x7f6920153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69249f2640 1 -- 172.21.15.84:0/861250354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69200ce6f0 msgr2=0x7f6920151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69249f2640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69200ce6f0 0x7f6920151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.154+0000 7f69249f2640 1 -- 172.21.15.84:0/861250354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914009400 con 0x7f69200b40d0 2023-12-12T09:20:41.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.155+0000 7f69249f2640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69200b40d0 0x7f69201584d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6914000c00 tx=0x7f69140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:41.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.155+0000 7f691d7fa640 1 -- 172.21.15.84:0/861250354 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914006e10 con 0x7f69200b40d0 2023-12-12T09:20:41.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.155+0000 7f691d7fa640 1 -- 172.21.15.84:0/861250354 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691403ad60 con 0x7f69200b40d0 2023-12-12T09:20:41.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.155+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6920154fe0 con 0x7f69200b40d0 2023-12-12T09:20:41.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.155+0000 7f691d7fa640 1 -- 172.21.15.84:0/861250354 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914044630 con 0x7f69200b40d0 2023-12-12T09:20:41.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.155+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692013cda0 con 0x7f69200b40d0 2023-12-12T09:20:41.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.156+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6920155500 con 0x7f69200b40d0 2023-12-12T09:20:41.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.157+0000 7f691d7fa640 1 -- 172.21.15.84:0/861250354 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f691404d450 con 0x7f69200b40d0 2023-12-12T09:20:41.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.158+0000 7f691d7fa640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f690406ae70 0x7f690406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.158+0000 7f691d7fa640 1 -- 172.21.15.84:0/861250354 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f69140abc60 con 0x7f69200b40d0 2023-12-12T09:20:41.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.159+0000 7f691ffff640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f690406ae70 0x7f690406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.159+0000 7f691ffff640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f690406ae70 0x7f690406d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6920152150 tx=0x7f690c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:41.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.163+0000 7f691d7fa640 1 -- 172.21.15.84:0/861250354 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6920155500 con 0x7f69200b40d0 2023-12-12T09:20:41.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.356+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6920155500 con 0x7f69200b40d0 2023-12-12T09:20:41.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.357+0000 7f691d7fa640 1 -- 172.21.15.84:0/861250354 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6920155500 con 0x7f69200b40d0 2023-12-12T09:20:41.358 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:41.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f690406ae70 msgr2=0x7f690406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f690406ae70 0x7f690406d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6920152150 tx=0x7f690c008040 comp rx=0 tx=0).stop 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69200b40d0 msgr2=0x7f69201584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69200b40d0 0x7f69201584d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6914000c00 tx=0x7f69140046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 shutdown_connections 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f692015be60 0x7f6920153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69200ce6f0 0x7f6920151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f690406ae70 0x7f690406d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 --2- 172.21.15.84:0/861250354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69200b40d0 0x7f69201584d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 >> 172.21.15.84:0/861250354 conn(0x7f69200b0ac0 msgr2=0x7f692015aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 shutdown_connections 2023-12-12T09:20:41.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.360+0000 7f6926c56640 1 -- 172.21.15.84:0/861250354 wait complete. 2023-12-12T09:20:41.378 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:41.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.593+0000 7ffbd34bb640 1 Processor -- start 2023-12-12T09:20:41.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.593+0000 7ffbd34bb640 1 -- start start 2023-12-12T09:20:41.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.595+0000 7ffbd34bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc155690 0x7ffbcc06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.595+0000 7ffbd34bb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffbcc0cde40 0x7ffbcc0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.595+0000 7ffbd34bb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc155a70 con 0x7ffbcc15b4f0 2023-12-12T09:20:41.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.595+0000 7ffbd34bb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0ce800 con 0x7ffbcc0cde40 2023-12-12T09:20:41.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.595+0000 7ffbd34bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc15c120 con 0x7ffbcc155690 2023-12-12T09:20:41.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.595+0000 7ffbd1a58640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ffbcc15b4f0 0x7ffbcc15b940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50356/0 (socket says 172.21.15.84:50356) 2023-12-12T09:20:41.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.595+0000 7ffbd1a58640 1 -- 172.21.15.84:0/54830863 learned_addr learned my addr 172.21.15.84:0/54830863 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbd0a56640 1 --2- 172.21.15.84:0/54830863 >> v2:172.21.15.99:3300/0 conn(0x7ffbcc0cde40 0x7ffbcc0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbd1257640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc155690 0x7ffbcc06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362735194 0 0) 0x7ffbcc155a70 con 0x7ffbcc15b4f0 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb8003520 con 0x7ffbcc15b4f0 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018203033 0 0) 0x7ffbb8003520 con 0x7ffbcc15b4f0 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc155690 msgr2=0x7ffbcc06ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc155690 0x7ffbcc06ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 >> v2:172.21.15.99:3300/0 conn(0x7ffbcc0cde40 msgr2=0x7ffbcc0ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 --2- 172.21.15.84:0/54830863 >> v2:172.21.15.99:3300/0 conn(0x7ffbcc0cde40 0x7ffbcc0ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc15c400 con 0x7ffbcc15b4f0 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7ffbc40019f0 con 0x7ffbcc15b4f0 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 >> v1:172.21.15.84:6789/0 conn(0x7ffbcc15b4f0 legacy=0x7ffbcc15b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbb8003970 0x7ffbb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc155690 0x7ffbb80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8004d00 0x7ffbb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0ce800 con 0x7ffbb8003970 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.596+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc15c120 con 0x7ffbb8004d00 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb800b980 con 0x7ffbcc155690 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbd1257640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbb8003970 0x7ffbb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbd1a58640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8004d00 0x7ffbb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbd1257640 1 -- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc155690 msgr2=0x7ffbb80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbd1257640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc155690 0x7ffbb80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbd1257640 1 -- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8004d00 msgr2=0x7ffbb8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbd1257640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8004d00 0x7ffbb8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbd1257640 1 -- 172.21.15.84:0/54830863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb8003520 con 0x7ffbb8003970 2023-12-12T09:20:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.597+0000 7ffbd1a58640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8004d00 0x7ffbb8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:41.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.599+0000 7ffbd1257640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbb8003970 0x7ffbb8003d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009ac0 tx=0x7ffbb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4ac288a32ad4ed server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:41.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.599+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc802c710 con 0x7ffbb8003970 2023-12-12T09:20:41.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.599+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc802c870 con 0x7ffbb8003970 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.599+0000 7ffbc3fff640 1 -- 172.21.15.84:0/54830863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc802cc00 con 0x7ffbb8003970 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.599+0000 7ffbd34bb640 1 -- 172.21.15.84:0/54830863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbb8003970 msgr2=0x7ffbb8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.599+0000 7ffbd34bb640 1 --2- 172.21.15.84:0/54830863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbb8003970 0x7ffbb8003d90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009ac0 tx=0x7ffbb80057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.599+0000 7ffbd1a58640 1 -- 172.21.15.84:0/54830863 reap_dead start 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.600+0000 7ffbd34bb640 1 -- 172.21.15.84:0/54830863 shutdown_connections 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.600+0000 7ffbd34bb640 1 -- 172.21.15.84:0/54830863 >> 172.21.15.84:0/54830863 conn(0x7ffbcc0b0900 msgr2=0x7ffbcc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.600+0000 7ffbd34bb640 1 -- 172.21.15.84:0/54830863 shutdown_connections 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.600+0000 7ffbd34bb640 1 -- 172.21.15.84:0/54830863 wait complete. 2023-12-12T09:20:41.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.601+0000 7ffbd34bb640 1 Processor -- start 2023-12-12T09:20:41.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.602+0000 7ffbd34bb640 1 -- start start 2023-12-12T09:20:41.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd34bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8003970 0x7ffbcc1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd34bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc151530 0x7ffbcc14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd34bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbcc151a80 0x7ffbcc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd34bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc14aaf0 con 0x7ffbcc151a80 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd34bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc157450 con 0x7ffbb8003970 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd34bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc157730 con 0x7ffbcc151530 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1a58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbcc151a80 0x7ffbcc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1a58640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbcc151a80 0x7ffbcc0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54122/0 (socket says 172.21.15.84:54122) 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1a58640 1 -- 172.21.15.84:0/2941440126 learned_addr learned my addr 172.21.15.84:0/2941440126 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1257640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8003970 0x7ffbcc1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd0a56640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc151530 0x7ffbcc14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1a58640 1 -- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc151530 msgr2=0x7ffbcc14a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1a58640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc151530 0x7ffbcc14a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1a58640 1 -- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8003970 msgr2=0x7ffbcc1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1a58640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8003970 0x7ffbcc1584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1a58640 1 -- 172.21.15.84:0/2941440126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc157a10 con 0x7ffbcc151a80 2023-12-12T09:20:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.603+0000 7ffbd1257640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8003970 0x7ffbcc1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.604+0000 7ffbd1a58640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbcc151a80 0x7ffbcc0b2760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc159110 tx=0x7ffbc400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:41.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.604+0000 7ffbc1ffb640 1 -- 172.21.15.84:0/2941440126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400bb80 con 0x7ffbcc151a80 2023-12-12T09:20:41.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.604+0000 7ffbc1ffb640 1 -- 172.21.15.84:0/2941440126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc400bce0 con 0x7ffbcc151a80 2023-12-12T09:20:41.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.604+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc157cf0 con 0x7ffbcc151a80 2023-12-12T09:20:41.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.604+0000 7ffbc1ffb640 1 -- 172.21.15.84:0/2941440126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4007290 con 0x7ffbcc151a80 2023-12-12T09:20:41.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.604+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc1570e0 con 0x7ffbcc151a80 2023-12-12T09:20:41.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.605+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc0673c0 con 0x7ffbcc151a80 2023-12-12T09:20:41.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.606+0000 7ffbc1ffb640 1 -- 172.21.15.84:0/2941440126 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbc40073f0 con 0x7ffbcc151a80 2023-12-12T09:20:41.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.607+0000 7ffbc1ffb640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffbb006ae70 0x7ffbb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:41.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.607+0000 7ffbc1ffb640 1 -- 172.21.15.84:0/2941440126 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffbc4089e70 con 0x7ffbcc151a80 2023-12-12T09:20:41.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.607+0000 7ffbd1257640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffbb006ae70 0x7ffbb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:41.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.608+0000 7ffbd1257640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffbb006ae70 0x7ffbb006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8036000 tx=0x7ffbc8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:41.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.611+0000 7ffbc1ffb640 1 -- 172.21.15.84:0/2941440126 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffbc4054ac0 con 0x7ffbcc151a80 2023-12-12T09:20:41.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.803+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffbcc158210 con 0x7ffbcc151a80 2023-12-12T09:20:41.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.804+0000 7ffbc1ffb640 1 -- 172.21.15.84:0/2941440126 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffbcc158210 con 0x7ffbcc151a80 2023-12-12T09:20:41.804 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffbb006ae70 msgr2=0x7ffbb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffbb006ae70 0x7ffbb006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8036000 tx=0x7ffbc8030000 comp rx=0 tx=0).stop 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbcc151a80 msgr2=0x7ffbcc0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbcc151a80 0x7ffbcc0b2760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc159110 tx=0x7ffbc400b4a0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 shutdown_connections 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffbb006ae70 0x7ffbb006d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbcc151a80 0x7ffbcc0b2760 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffbcc151530 0x7ffbcc14a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 --2- 172.21.15.84:0/2941440126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb8003970 0x7ffbcc1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.806+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 >> 172.21.15.84:0/2941440126 conn(0x7ffbcc0b0900 msgr2=0x7ffbcc15dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.807+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 shutdown_connections 2023-12-12T09:20:41.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:41.807+0000 7ffbd34bb640 1 -- 172.21.15.84:0/2941440126 wait complete. 2023-12-12T09:20:41.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:42.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.036+0000 7feb4a18e640 1 Processor -- start 2023-12-12T09:20:42.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.036+0000 7feb4a18e640 1 -- start start 2023-12-12T09:20:42.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.037+0000 7feb4a18e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feb440b40d0 0x7feb4406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.037+0000 7feb4a18e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb440ce6f0 0x7feb440b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.037+0000 7feb4a18e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb440ceb80 con 0x7feb4415be60 2023-12-12T09:20:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.037+0000 7feb4a18e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb440ce260 con 0x7feb440ce6f0 2023-12-12T09:20:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.037+0000 7feb4a18e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb440b49f0 con 0x7feb440b40d0 2023-12-12T09:20:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.038+0000 7feb43fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feb4415be60 0x7feb4413e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50366/0 (socket says 172.21.15.84:50366) 2023-12-12T09:20:42.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.038+0000 7feb42ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb440ce6f0 0x7feb440b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.038+0000 7feb43fff640 1 -- 172.21.15.84:0/513487580 learned_addr learned my addr 172.21.15.84:0/513487580 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.038+0000 7feb437fe640 1 --2- 172.21.15.84:0/513487580 >> v2:172.21.15.99:3300/0 conn(0x7feb440b40d0 0x7feb4406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.038+0000 7feb42ffd640 1 -- 172.21.15.84:0/513487580 >> v2:172.21.15.99:3300/0 conn(0x7feb440b40d0 msgr2=0x7feb4406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.038+0000 7feb42ffd640 1 --2- 172.21.15.84:0/513487580 >> v2:172.21.15.99:3300/0 conn(0x7feb440b40d0 0x7feb4406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.038+0000 7feb42ffd640 1 -- 172.21.15.84:0/513487580 >> v1:172.21.15.84:6789/0 conn(0x7feb4415be60 legacy=0x7feb4413e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.038+0000 7feb42ffd640 1 -- 172.21.15.84:0/513487580 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440cd930 con 0x7feb440ce6f0 2023-12-12T09:20:42.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.039+0000 7feb42ffd640 1 --2- 172.21.15.84:0/513487580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb440ce6f0 0x7feb440b44b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feb440b4d90 tx=0x7feb3802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba604b9ea68b0554 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb427fc640 1 -- 172.21.15.84:0/513487580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38031830 con 0x7feb440ce6f0 2023-12-12T09:20:42.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb427fc640 1 -- 172.21.15.84:0/513487580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38031990 con 0x7feb440ce6f0 2023-12-12T09:20:42.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb427fc640 1 -- 172.21.15.84:0/513487580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38031d20 con 0x7feb440ce6f0 2023-12-12T09:20:42.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb4a18e640 1 -- 172.21.15.84:0/513487580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb440ce6f0 msgr2=0x7feb440b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb4a18e640 1 --2- 172.21.15.84:0/513487580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb440ce6f0 0x7feb440b44b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feb440b4d90 tx=0x7feb3802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb4a18e640 1 -- 172.21.15.84:0/513487580 shutdown_connections 2023-12-12T09:20:42.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb4a18e640 1 --2- 172.21.15.84:0/513487580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb440ce6f0 0x7feb440b44b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb4a18e640 1 --2- 172.21.15.84:0/513487580 >> v2:172.21.15.99:3300/0 conn(0x7feb440b40d0 0x7feb4406dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb4a18e640 1 -- 172.21.15.84:0/513487580 >> 172.21.15.84:0/513487580 conn(0x7feb440b0ac0 msgr2=0x7feb440b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:42.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.040+0000 7feb4a18e640 1 -- 172.21.15.84:0/513487580 shutdown_connections 2023-12-12T09:20:42.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.041+0000 7feb4a18e640 1 -- 172.21.15.84:0/513487580 wait complete. 2023-12-12T09:20:42.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.042+0000 7feb4a18e640 1 Processor -- start 2023-12-12T09:20:42.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.042+0000 7feb4a18e640 1 -- start start 2023-12-12T09:20:42.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.043+0000 7feb4a18e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb440b40d0 0x7feb44155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.043+0000 7feb4a18e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb440ce6f0 0x7feb44158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.043+0000 7feb4a18e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb4415be60 0x7feb440b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.043+0000 7feb4a18e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44156380 con 0x7feb4415be60 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.043+0000 7feb4a18e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44158700 con 0x7feb440b40d0 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.043+0000 7feb4a18e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb441590d0 con 0x7feb440ce6f0 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb4415be60 0x7feb440b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb4415be60 0x7feb440b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54148/0 (socket says 172.21.15.84:54148) 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 -- 172.21.15.84:0/1389755007 learned_addr learned my addr 172.21.15.84:0/1389755007 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb42ffd640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb440ce6f0 0x7feb44158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb437fe640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb440b40d0 0x7feb44155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 -- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb440ce6f0 msgr2=0x7feb44158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb440ce6f0 0x7feb44158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 -- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb440b40d0 msgr2=0x7feb44155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb440b40d0 0x7feb44155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 -- 172.21.15.84:0/1389755007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38009400 con 0x7feb4415be60 2023-12-12T09:20:42.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb42ffd640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb440ce6f0 0x7feb44158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:42.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.044+0000 7feb43fff640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb4415be60 0x7feb440b3290 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00cbf0 tx=0x7feb3c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.045+0000 7feb2bfff640 1 -- 172.21.15.84:0/1389755007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c00ad40 con 0x7feb4415be60 2023-12-12T09:20:42.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.045+0000 7feb2bfff640 1 -- 172.21.15.84:0/1389755007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c012400 con 0x7feb4415be60 2023-12-12T09:20:42.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.045+0000 7feb2bfff640 1 -- 172.21.15.84:0/1389755007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c00aea0 con 0x7feb4415be60 2023-12-12T09:20:42.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.045+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb441553e0 con 0x7feb4415be60 2023-12-12T09:20:42.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.045+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb44155950 con 0x7feb4415be60 2023-12-12T09:20:42.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.046+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb44158890 con 0x7feb4415be60 2023-12-12T09:20:42.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.047+0000 7feb2bfff640 1 -- 172.21.15.84:0/1389755007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb3c007070 con 0x7feb4415be60 2023-12-12T09:20:42.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.048+0000 7feb2bfff640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb3006ae40 0x7feb3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.048+0000 7feb2bfff640 1 -- 172.21.15.84:0/1389755007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb3c089840 con 0x7feb4415be60 2023-12-12T09:20:42.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.048+0000 7feb437fe640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb3006ae40 0x7feb3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.049+0000 7feb437fe640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb3006ae40 0x7feb3006d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb34006fd0 tx=0x7feb34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.052+0000 7feb2bfff640 1 -- 172.21.15.84:0/1389755007 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb3c0545d0 con 0x7feb4415be60 2023-12-12T09:20:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.250+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb440673c0 con 0x7feb4415be60 2023-12-12T09:20:42.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.250+0000 7feb2bfff640 1 -- 172.21.15.84:0/1389755007 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb3c057bf0 con 0x7feb4415be60 2023-12-12T09:20:42.250 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb3006ae40 msgr2=0x7feb3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb3006ae40 0x7feb3006d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feb34006fd0 tx=0x7feb34008040 comp rx=0 tx=0).stop 2023-12-12T09:20:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb4415be60 msgr2=0x7feb440b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb4415be60 0x7feb440b3290 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00cbf0 tx=0x7feb3c00a430 comp rx=0 tx=0).stop 2023-12-12T09:20:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 shutdown_connections 2023-12-12T09:20:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb3006ae40 0x7feb3006d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb4415be60 0x7feb440b3290 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb440ce6f0 0x7feb44158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 --2- 172.21.15.84:0/1389755007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb440b40d0 0x7feb44155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 >> 172.21.15.84:0/1389755007 conn(0x7feb440b0ac0 msgr2=0x7feb4415a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 shutdown_connections 2023-12-12T09:20:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.253+0000 7feb4a18e640 1 -- 172.21.15.84:0/1389755007 wait complete. 2023-12-12T09:20:42.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:42.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.488+0000 7f1c0825d640 1 Processor -- start 2023-12-12T09:20:42.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.488+0000 7f1c0825d640 1 -- start start 2023-12-12T09:20:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.490+0000 7f1c0825d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 0x7f1c00070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.490+0000 7f1c0825d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c00070ad0 con 0x7f1c000ad610 2023-12-12T09:20:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.490+0000 7f1c0825d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c000b2fc0 con 0x7f1c00070130 2023-12-12T09:20:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.490+0000 7f1c0825d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000b3c40 con 0x7f1c00071640 2023-12-12T09:20:42.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.490+0000 7f1c05ff9640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1c000ad610 0x7f1c000ac6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50380/0 (socket says 172.21.15.84:50380) 2023-12-12T09:20:42.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.490+0000 7f1c05ff9640 1 -- 172.21.15.84:0/4176387676 learned_addr learned my addr 172.21.15.84:0/4176387676 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c067fa640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 0x7f1c00070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928719801 0 0) 0x7f1c00070ad0 con 0x7f1c000ad610 2023-12-12T09:20:42.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bec003520 con 0x7f1c000ad610 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2363141910 0 0) 0x7f1bec003520 con 0x7f1c000ad610 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 msgr2=0x7f1c00070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 0x7f1c00070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 >> v1:172.21.15.99:6789/0 conn(0x7f1c00070130 legacy=0x7f1c00070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c000b32a0 con 0x7f1c000ad610 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f1bfc001690 con 0x7f1c000ad610 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 >> v1:172.21.15.84:6789/0 conn(0x7f1c000ad610 legacy=0x7f1c000ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bec0039a0 0x7f1bec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 0x7f1bec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bec004d00 0x7f1bec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000b3c40 con 0x7f1bec004d00 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec00bb90 con 0x7f1bec0039a0 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.491+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec00df60 con 0x7f1c00071640 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c067fa640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bec004d00 0x7f1bec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c057f8640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 0x7f1bec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c05ff9640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bec0039a0 0x7f1bec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c067fa640 1 -- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 msgr2=0x7f1bec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c067fa640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 0x7f1bec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c067fa640 1 -- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bec0039a0 msgr2=0x7f1bec003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c067fa640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bec0039a0 0x7f1bec003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c067fa640 1 -- 172.21.15.84:0/4176387676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec003520 con 0x7f1bec004d00 2023-12-12T09:20:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.492+0000 7f1c057f8640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c00071640 0x7f1bec0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.493+0000 7f1c067fa640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bec004d00 0x7f1bec005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8007360 tx=0x7f1bec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2d2a9241dab82f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf802ccd0 con 0x7f1bec004d00 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf802ce30 con 0x7f1bec004d00 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c04ff7640 1 -- 172.21.15.84:0/4176387676 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8034660 con 0x7f1bec004d00 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c0825d640 1 -- 172.21.15.84:0/4176387676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bec004d00 msgr2=0x7f1bec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c0825d640 1 --2- 172.21.15.84:0/4176387676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1bec004d00 0x7f1bec005180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8007360 tx=0x7f1bec0057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c067fa640 1 -- 172.21.15.84:0/4176387676 reap_dead start 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c0825d640 1 -- 172.21.15.84:0/4176387676 shutdown_connections 2023-12-12T09:20:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c0825d640 1 -- 172.21.15.84:0/4176387676 >> 172.21.15.84:0/4176387676 conn(0x7f1c000b0900 msgr2=0x7f1c000b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c0825d640 1 -- 172.21.15.84:0/4176387676 shutdown_connections 2023-12-12T09:20:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.494+0000 7f1c0825d640 1 -- 172.21.15.84:0/4176387676 wait complete. 2023-12-12T09:20:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.496+0000 7f1c0825d640 1 Processor -- start 2023-12-12T09:20:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.496+0000 7f1c0825d640 1 -- start start 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.497+0000 7f1c0825d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c0014e460 0x7f1c00151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.497+0000 7f1c0825d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c001f4070 0x7f1c00151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.497+0000 7f1c0825d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c0014e840 0x7f1c0015c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.497+0000 7f1c0825d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00152410 con 0x7f1c001f4070 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.497+0000 7f1c0825d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c001f3380 con 0x7f1c0014e460 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.497+0000 7f1c0825d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000cf7e0 con 0x7f1c0014e840 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c001f4070 0x7f1c00151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c001f4070 0x7f1c00151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54162/0 (socket says 172.21.15.84:54162) 2023-12-12T09:20:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 -- 172.21.15.84:0/3152682459 learned_addr learned my addr 172.21.15.84:0/3152682459 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 -- 172.21.15.84:0/3152682459 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c0014e840 msgr2=0x7f1c0015c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c05ff9640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c0014e460 0x7f1c00151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c0014e840 0x7f1c0015c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 -- 172.21.15.84:0/3152682459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c0014e460 msgr2=0x7f1c00151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c0014e460 0x7f1c00151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 -- 172.21.15.84:0/3152682459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00152130 con 0x7f1c001f4070 2023-12-12T09:20:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.498+0000 7f1c057f8640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c001f4070 0x7f1c00151ad0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000d720 tx=0x7f1bf000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.499+0000 7f1bf67fc640 1 -- 172.21.15.84:0/3152682459 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0017070 con 0x7f1c001f4070 2023-12-12T09:20:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.499+0000 7f1bf67fc640 1 -- 172.21.15.84:0/3152682459 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf0005070 con 0x7f1c001f4070 2023-12-12T09:20:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.499+0000 7f1bf67fc640 1 -- 172.21.15.84:0/3152682459 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0005420 con 0x7f1c001f4070 2023-12-12T09:20:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.499+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c001f3590 con 0x7f1c001f4070 2023-12-12T09:20:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.499+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c001f3b50 con 0x7f1c001f4070 2023-12-12T09:20:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.500+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c000673c0 con 0x7f1c001f4070 2023-12-12T09:20:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.501+0000 7f1bf67fc640 1 -- 172.21.15.84:0/3152682459 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1bf0007030 con 0x7f1c001f4070 2023-12-12T09:20:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.502+0000 7f1bf67fc640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1be406ae40 0x7f1be406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.503+0000 7f1bf67fc640 1 -- 172.21.15.84:0/3152682459 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1bf0089260 con 0x7f1c001f4070 2023-12-12T09:20:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.503+0000 7f1c05ff9640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1be406ae40 0x7f1be406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.503+0000 7f1c05ff9640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1be406ae40 0x7f1be406d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc000f60 tx=0x7f1bfc000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.507+0000 7f1bf67fc640 1 -- 172.21.15.84:0/3152682459 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1bf0053f50 con 0x7f1c001f4070 2023-12-12T09:20:42.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.696+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1c0006c0d0 con 0x7f1c001f4070 2023-12-12T09:20:42.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.697+0000 7f1bf67fc640 1 -- 172.21.15.84:0/3152682459 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1bf0057570 con 0x7f1c001f4070 2023-12-12T09:20:42.697 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:42.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1be406ae40 msgr2=0x7f1be406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1be406ae40 0x7f1be406d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc000f60 tx=0x7f1bfc000ed0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c001f4070 msgr2=0x7f1c00151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c001f4070 0x7f1c00151ad0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000d720 tx=0x7f1bf000dbe0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 shutdown_connections 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c0014e840 0x7f1c0015c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1be406ae40 0x7f1be406d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c001f4070 0x7f1c00151ad0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 --2- 172.21.15.84:0/3152682459 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c0014e460 0x7f1c00151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.699+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 >> 172.21.15.84:0/3152682459 conn(0x7f1c000b0900 msgr2=0x7f1c0015a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.700+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 shutdown_connections 2023-12-12T09:20:42.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.700+0000 7f1c0825d640 1 -- 172.21.15.84:0/3152682459 wait complete. 2023-12-12T09:20:42.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.929+0000 7fa56db8e640 1 Processor -- start 2023-12-12T09:20:42.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.930+0000 7fa56db8e640 1 -- start start 2023-12-12T09:20:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.931+0000 7fa56db8e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa568143d20 0x7fa5680b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.931+0000 7fa56db8e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa5681447f0 0x7fa5680b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.931+0000 7fa56db8e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680cea30 con 0x7fa5680ce550 2023-12-12T09:20:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.931+0000 7fa56db8e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5680702b0 con 0x7fa5681447f0 2023-12-12T09:20:42.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.931+0000 7fa56db8e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa568070590 con 0x7fa568143d20 2023-12-12T09:20:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa55ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa5680ce550 0x7fa56815eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50390/0 (socket says 172.21.15.84:50390) 2023-12-12T09:20:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa55ffff640 1 -- 172.21.15.84:0/24822320 learned_addr learned my addr 172.21.15.84:0/24822320 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:42.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa567fff640 1 --2- 172.21.15.84:0/24822320 >> v2:172.21.15.84:3300/0 conn(0x7fa5681447f0 0x7fa5680b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa5677fe640 1 --2- 172.21.15.84:0/24822320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa568143d20 0x7fa5680b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa566ffd640 1 -- 172.21.15.84:0/24822320 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510555101 0 0) 0x7fa5680cea30 con 0x7fa5680ce550 2023-12-12T09:20:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa566ffd640 1 -- 172.21.15.84:0/24822320 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa554003520 con 0x7fa5680ce550 2023-12-12T09:20:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa567fff640 1 -- 172.21.15.84:0/24822320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa568143d20 msgr2=0x7fa5680b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa567fff640 1 --2- 172.21.15.84:0/24822320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa568143d20 0x7fa5680b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa567fff640 1 -- 172.21.15.84:0/24822320 >> v1:172.21.15.84:6789/0 conn(0x7fa5680ce550 legacy=0x7fa56815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.932+0000 7fa567fff640 1 -- 172.21.15.84:0/24822320 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568070870 con 0x7fa5681447f0 2023-12-12T09:20:42.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.933+0000 7fa567fff640 1 --2- 172.21.15.84:0/24822320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5681447f0 0x7fa5680b4610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa560009d90 tx=0x7fa56002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd3a8c6848fbf78 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa566ffd640 1 -- 172.21.15.84:0/24822320 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56002cc50 con 0x7fa5681447f0 2023-12-12T09:20:42.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa566ffd640 1 -- 172.21.15.84:0/24822320 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56002cdb0 con 0x7fa5681447f0 2023-12-12T09:20:42.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa566ffd640 1 -- 172.21.15.84:0/24822320 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560034660 con 0x7fa5681447f0 2023-12-12T09:20:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa56db8e640 1 -- 172.21.15.84:0/24822320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5681447f0 msgr2=0x7fa5680b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa56db8e640 1 --2- 172.21.15.84:0/24822320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5681447f0 0x7fa5680b4610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa560009d90 tx=0x7fa56002bea0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa56db8e640 1 -- 172.21.15.84:0/24822320 shutdown_connections 2023-12-12T09:20:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa56db8e640 1 --2- 172.21.15.84:0/24822320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5681447f0 0x7fa5680b4610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa56db8e640 1 --2- 172.21.15.84:0/24822320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa568143d20 0x7fa5680b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa56db8e640 1 -- 172.21.15.84:0/24822320 >> 172.21.15.84:0/24822320 conn(0x7fa56806c3d0 msgr2=0x7fa56806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa56db8e640 1 -- 172.21.15.84:0/24822320 shutdown_connections 2023-12-12T09:20:42.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.934+0000 7fa56db8e640 1 -- 172.21.15.84:0/24822320 wait complete. 2023-12-12T09:20:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.936+0000 7fa56db8e640 1 Processor -- start 2023-12-12T09:20:42.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.936+0000 7fa56db8e640 1 -- start start 2023-12-12T09:20:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.937+0000 7fa56db8e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5680ce550 0x7fa568135e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.937+0000 7fa56db8e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa568143d20 0x7fa568151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.937+0000 7fa56db8e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5681447f0 0x7fa5681342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.937+0000 7fa56db8e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568134dd0 con 0x7fa568143d20 2023-12-12T09:20:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.937+0000 7fa56db8e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5681350b0 con 0x7fa5680ce550 2023-12-12T09:20:42.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.937+0000 7fa56db8e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa568135390 con 0x7fa5681447f0 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.937+0000 7fa55ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa568143d20 0x7fa568151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa55ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa568143d20 0x7fa568151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54172/0 (socket says 172.21.15.84:54172) 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa55ffff640 1 -- 172.21.15.84:0/694070178 learned_addr learned my addr 172.21.15.84:0/694070178 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa55ffff640 1 -- 172.21.15.84:0/694070178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5681447f0 msgr2=0x7fa5681342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa55ffff640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5681447f0 0x7fa5681342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa55ffff640 1 -- 172.21.15.84:0/694070178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5680ce550 msgr2=0x7fa568135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa5677fe640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5680ce550 0x7fa568135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa55ffff640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5680ce550 0x7fa568135e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:42.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa55ffff640 1 -- 172.21.15.84:0/694070178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560009a70 con 0x7fa568143d20 2023-12-12T09:20:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.938+0000 7fa55ffff640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa568143d20 0x7fa568151310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c500 tx=0x7fa55000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.939+0000 7fa564ff9640 1 -- 172.21.15.84:0/694070178 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550005ce0 con 0x7fa568143d20 2023-12-12T09:20:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.939+0000 7fa564ff9640 1 -- 172.21.15.84:0/694070178 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550005e40 con 0x7fa568143d20 2023-12-12T09:20:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.939+0000 7fa564ff9640 1 -- 172.21.15.84:0/694070178 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550007330 con 0x7fa568143d20 2023-12-12T09:20:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.939+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa568135670 con 0x7fa568143d20 2023-12-12T09:20:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.939+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56815a900 con 0x7fa568143d20 2023-12-12T09:20:42.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.940+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa568135b90 con 0x7fa568143d20 2023-12-12T09:20:42.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.941+0000 7fa564ff9640 1 -- 172.21.15.84:0/694070178 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa550007550 con 0x7fa568143d20 2023-12-12T09:20:42.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.942+0000 7fa564ff9640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa54806ae40 0x7fa54806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:42.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.942+0000 7fa564ff9640 1 -- 172.21.15.84:0/694070178 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa550089070 con 0x7fa568143d20 2023-12-12T09:20:42.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.942+0000 7fa5677fe640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa54806ae40 0x7fa54806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:42.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.943+0000 7fa5677fe640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa54806ae40 0x7fa54806d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa558009a10 tx=0x7fa558008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:42.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:42.947+0000 7fa564ff9640 1 -- 172.21.15.84:0/694070178 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa568135b90 con 0x7fa568143d20 2023-12-12T09:20:43.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.137+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa568135b90 con 0x7fa568143d20 2023-12-12T09:20:43.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.140+0000 7fa564ff9640 1 -- 172.21.15.84:0/694070178 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7fa568135b90 con 0x7fa568143d20 2023-12-12T09:20:43.140 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:43.141 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:43.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.142+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa54806ae40 msgr2=0x7fa54806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.142+0000 7fa56db8e640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa54806ae40 0x7fa54806d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa558009a10 tx=0x7fa558008040 comp rx=0 tx=0).stop 2023-12-12T09:20:43.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa568143d20 msgr2=0x7fa568151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa568143d20 0x7fa568151310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa55000c500 tx=0x7fa55000c9c0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 shutdown_connections 2023-12-12T09:20:43.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa5681447f0 0x7fa5681342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa54806ae40 0x7fa54806d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa568143d20 0x7fa568151310 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 --2- 172.21.15.84:0/694070178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5680ce550 0x7fa568135e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 >> 172.21.15.84:0/694070178 conn(0x7fa56806c3d0 msgr2=0x7fa568141310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:43.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 shutdown_connections 2023-12-12T09:20:43.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.143+0000 7fa56db8e640 1 -- 172.21.15.84:0/694070178 wait complete. 2023-12-12T09:20:43.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:43.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:43.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.365+0000 7f21c3bc9640 1 Processor -- start 2023-12-12T09:20:43.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.365+0000 7f21c3bc9640 1 -- start start 2023-12-12T09:20:43.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.367+0000 7f21c3bc9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21bc0cfd80 0x7f21bc15d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.367+0000 7f21c3bc9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21bc15d7c0 0x7f21bc0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.367+0000 7f21c3bc9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc0b0460 con 0x7f21bc0d0160 2023-12-12T09:20:43.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.367+0000 7f21c3bc9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc0afe80 con 0x7f21bc0cfd80 2023-12-12T09:20:43.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.367+0000 7f21c3bc9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc15dc50 con 0x7f21bc15d7c0 2023-12-12T09:20:43.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.367+0000 7f21c1164640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f21bc0d0160 0x7f21bc0b08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50392/0 (socket says 172.21.15.84:50392) 2023-12-12T09:20:43.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.367+0000 7f21c1965640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f21bc0cfd80 0x7f21bc15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.367+0000 7f21c1164640 1 -- 172.21.15.84:0/3924847 learned_addr learned my addr 172.21.15.84:0/3924847 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.368+0000 7f21c2166640 1 --2- 172.21.15.84:0/3924847 >> v2:172.21.15.99:3300/0 conn(0x7f21bc15d7c0 0x7f21bc0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.368+0000 7f21c1965640 1 -- 172.21.15.84:0/3924847 >> v2:172.21.15.99:3300/0 conn(0x7f21bc15d7c0 msgr2=0x7f21bc0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.368+0000 7f21c1965640 1 --2- 172.21.15.84:0/3924847 >> v2:172.21.15.99:3300/0 conn(0x7f21bc15d7c0 0x7f21bc0ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.368+0000 7f21c1965640 1 -- 172.21.15.84:0/3924847 >> v1:172.21.15.84:6789/0 conn(0x7f21bc0d0160 legacy=0x7f21bc0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.368+0000 7f21c1965640 1 -- 172.21.15.84:0/3924847 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0d1e20 con 0x7f21bc0cfd80 2023-12-12T09:20:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.368+0000 7f21c2166640 1 --2- 172.21.15.84:0/3924847 >> v2:172.21.15.99:3300/0 conn(0x7f21bc15d7c0 0x7f21bc0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.369+0000 7f21c1965640 1 --2- 172.21.15.84:0/3924847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc15d280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0d1970 tx=0x7f21b002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0c57dcd6882e64 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.369+0000 7f21c0963640 1 -- 172.21.15.84:0/3924847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b002cc70 con 0x7f21bc0cfd80 2023-12-12T09:20:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.369+0000 7f21c0963640 1 -- 172.21.15.84:0/3924847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b002cdd0 con 0x7f21bc0cfd80 2023-12-12T09:20:43.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.369+0000 7f21c0963640 1 -- 172.21.15.84:0/3924847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0034660 con 0x7f21bc0cfd80 2023-12-12T09:20:43.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.370+0000 7f21c3bc9640 1 -- 172.21.15.84:0/3924847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 msgr2=0x7f21bc15d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.370+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/3924847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc15d280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0d1970 tx=0x7f21b002bec0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.370+0000 7f21c3bc9640 1 -- 172.21.15.84:0/3924847 shutdown_connections 2023-12-12T09:20:43.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.370+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/3924847 >> v2:172.21.15.99:3300/0 conn(0x7f21bc15d7c0 0x7f21bc0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.370+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/3924847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc15d280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.370+0000 7f21c3bc9640 1 -- 172.21.15.84:0/3924847 >> 172.21.15.84:0/3924847 conn(0x7f21bc09c480 msgr2=0x7f21bc0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:43.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.370+0000 7f21c3bc9640 1 -- 172.21.15.84:0/3924847 shutdown_connections 2023-12-12T09:20:43.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.370+0000 7f21c3bc9640 1 -- 172.21.15.84:0/3924847 wait complete. 2023-12-12T09:20:43.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.372+0000 7f21c3bc9640 1 Processor -- start 2023-12-12T09:20:43.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.372+0000 7f21c3bc9640 1 -- start start 2023-12-12T09:20:43.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c3bc9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc1f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c3bc9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0d0160 0x7f21bc0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c3bc9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc15d7c0 0x7f21bc15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c3bc9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0b4970 con 0x7f21bc0cfd80 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c3bc9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0b54b0 con 0x7f21bc15d7c0 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c3bc9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc1f2d90 con 0x7f21bc0d0160 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c1965640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc1f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c1965640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc1f2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54196/0 (socket says 172.21.15.84:54196) 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c1965640 1 -- 172.21.15.84:0/1655260149 learned_addr learned my addr 172.21.15.84:0/1655260149 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c1965640 1 -- 172.21.15.84:0/1655260149 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0d0160 msgr2=0x7f21bc0c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c1965640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0d0160 0x7f21bc0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c1965640 1 -- 172.21.15.84:0/1655260149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc15d7c0 msgr2=0x7f21bc15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c2166640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc15d7c0 0x7f21bc15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c1965640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc15d7c0 0x7f21bc15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c1965640 1 -- 172.21.15.84:0/1655260149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009a70 con 0x7f21bc0cfd80 2023-12-12T09:20:43.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.373+0000 7f21c2166640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc15d7c0 0x7f21bc15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:43.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.374+0000 7f21c1965640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc1f2850 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f21b002c4d0 tx=0x7f21b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:43.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.374+0000 7f21ba7fc640 1 -- 172.21.15.84:0/1655260149 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0040650 con 0x7f21bc0cfd80 2023-12-12T09:20:43.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.374+0000 7f21ba7fc640 1 -- 172.21.15.84:0/1655260149 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b00407b0 con 0x7f21bc0cfd80 2023-12-12T09:20:43.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.374+0000 7f21ba7fc640 1 -- 172.21.15.84:0/1655260149 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0040b60 con 0x7f21bc0cfd80 2023-12-12T09:20:43.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.374+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc0b4b80 con 0x7f21bc0cfd80 2023-12-12T09:20:43.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.374+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc0b5140 con 0x7f21bc0cfd80 2023-12-12T09:20:43.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.375+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc072b80 con 0x7f21bc0cfd80 2023-12-12T09:20:43.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.376+0000 7f21ba7fc640 1 -- 172.21.15.84:0/1655260149 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21b0040cc0 con 0x7f21bc0cfd80 2023-12-12T09:20:43.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.377+0000 7f21ba7fc640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21a006ae40 0x7f21a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.377+0000 7f21ba7fc640 1 -- 172.21.15.84:0/1655260149 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21b00ac7c0 con 0x7f21bc0cfd80 2023-12-12T09:20:43.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.377+0000 7f21c1164640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21a006ae40 0x7f21a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.378+0000 7f21c1164640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21a006ae40 0x7f21a006d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21bc06cb40 tx=0x7f21a8007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:43.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.381+0000 7f21ba7fc640 1 -- 172.21.15.84:0/1655260149 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21b0077540 con 0x7f21bc0cfd80 2023-12-12T09:20:43.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.570+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21bc0b1be0 con 0x7f21bc0cfd80 2023-12-12T09:20:43.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.571+0000 7f21ba7fc640 1 -- 172.21.15.84:0/1655260149 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21b007ab60 con 0x7f21bc0cfd80 2023-12-12T09:20:43.571 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:43.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21a006ae40 msgr2=0x7f21a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21a006ae40 0x7f21a006d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21bc06cb40 tx=0x7f21a8007a40 comp rx=0 tx=0).stop 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 msgr2=0x7f21bc1f2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc1f2850 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f21b002c4d0 tx=0x7f21b0004a40 comp rx=0 tx=0).stop 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 shutdown_connections 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc15d7c0 0x7f21bc15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0d0160 0x7f21bc0c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21a006ae40 0x7f21a006d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 --2- 172.21.15.84:0/1655260149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc0cfd80 0x7f21bc1f2850 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 >> 172.21.15.84:0/1655260149 conn(0x7f21bc09c480 msgr2=0x7f21bc15ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.574+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 shutdown_connections 2023-12-12T09:20:43.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.575+0000 7f21c3bc9640 1 -- 172.21.15.84:0/1655260149 wait complete. 2023-12-12T09:20:43.593 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:43.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.796+0000 7f26ae2c9640 1 Processor -- start 2023-12-12T09:20:43.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.796+0000 7f26ae2c9640 1 -- start start 2023-12-12T09:20:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.798+0000 7f26ae2c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 0x7f26a80ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.798+0000 7f26ae2c9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a8155a70 con 0x7f26a815b4f0 2023-12-12T09:20:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.798+0000 7f26ae2c9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a815c120 con 0x7f26a8155690 2023-12-12T09:20:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.798+0000 7f26ae2c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80ce800 con 0x7f26a80cde40 2023-12-12T09:20:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.798+0000 7f26ac866640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f26a815b4f0 0x7f26a815b940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50394/0 (socket says 172.21.15.84:50394) 2023-12-12T09:20:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.798+0000 7f26ac866640 1 -- 172.21.15.84:0/2108389914 learned_addr learned my addr 172.21.15.84:0/2108389914 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.798+0000 7f26a77fe640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 0x7f26a80ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491678205 0 0) 0x7f26a8155a70 con 0x7f26a815b4f0 2023-12-12T09:20:43.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2690003520 con 0x7f26a815b4f0 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2103248237 0 0) 0x7f2690003520 con 0x7f26a815b4f0 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 msgr2=0x7f26a80ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 0x7f26a80ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 >> v1:172.21.15.99:6789/0 conn(0x7f26a8155690 legacy=0x7f26a806ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a815c400 con 0x7f26a815b4f0 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f26a00019f0 con 0x7f26a815b4f0 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 >> v1:172.21.15.84:6789/0 conn(0x7f26a815b4f0 legacy=0x7f26a815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 0x7f26900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2690003f70 0x7f26900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2690004d00 0x7f2690005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80ce800 con 0x7f2690003f70 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269000bac0 con 0x7f2690004d00 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.799+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269000bc80 con 0x7f26a80cde40 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26a77fe640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2690003f70 0x7f26900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26a7fff640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 0x7f26900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26a77fe640 1 -- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 msgr2=0x7f26900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:43.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26a77fe640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 0x7f26900039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26ac866640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2690004d00 0x7f2690005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26a77fe640 1 -- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2690004d00 msgr2=0x7f2690005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:43.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26a77fe640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2690004d00 0x7f2690005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26a77fe640 1 -- 172.21.15.84:0/2108389914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2690003520 con 0x7f2690003f70 2023-12-12T09:20:43.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26ac866640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2690004d00 0x7f2690005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:43.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.800+0000 7f26a7fff640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f26a80cde40 0x7f26900039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.801+0000 7f26a77fe640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2690003f70 0x7f26900047c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f269c009ac0 tx=0x7f26900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d41dbdba8ae618 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.801+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c02c600 con 0x7f2690003f70 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.801+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c02c760 con 0x7f2690003f70 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.801+0000 7f26a6ffd640 1 -- 172.21.15.84:0/2108389914 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c02caf0 con 0x7f2690003f70 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.802+0000 7f26ae2c9640 1 -- 172.21.15.84:0/2108389914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2690003f70 msgr2=0x7f26900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.802+0000 7f26ae2c9640 1 --2- 172.21.15.84:0/2108389914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2690003f70 0x7f26900047c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f269c009ac0 tx=0x7f26900057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.802+0000 7f26ac866640 1 -- 172.21.15.84:0/2108389914 reap_dead start 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.802+0000 7f26ae2c9640 1 -- 172.21.15.84:0/2108389914 shutdown_connections 2023-12-12T09:20:43.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.802+0000 7f26ae2c9640 1 -- 172.21.15.84:0/2108389914 >> 172.21.15.84:0/2108389914 conn(0x7f26a80b0900 msgr2=0x7f26a80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.802+0000 7f26ae2c9640 1 -- 172.21.15.84:0/2108389914 shutdown_connections 2023-12-12T09:20:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.802+0000 7f26ae2c9640 1 -- 172.21.15.84:0/2108389914 wait complete. 2023-12-12T09:20:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.804+0000 7f26ae2c9640 1 Processor -- start 2023-12-12T09:20:43.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.804+0000 7f26ae2c9640 1 -- start start 2023-12-12T09:20:43.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26ae2c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2690003f70 0x7f26a8151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26ae2c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26a8150220 0x7f26a813d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26ae2c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26a813d720 0x7f26a80b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26ae2c9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a813dba0 con 0x7f26a8150220 2023-12-12T09:20:43.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26ae2c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a81509e0 con 0x7f26a813d720 2023-12-12T09:20:43.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26ae2c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8150cc0 con 0x7f2690003f70 2023-12-12T09:20:43.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26a77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26a8150220 0x7f26a813d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26a77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26a8150220 0x7f26a813d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54214/0 (socket says 172.21.15.84:54214) 2023-12-12T09:20:43.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.805+0000 7f26a77fe640 1 -- 172.21.15.84:0/1652526796 learned_addr learned my addr 172.21.15.84:0/1652526796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:43.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26ac866640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26a813d720 0x7f26a80b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a7fff640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2690003f70 0x7f26a8151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a77fe640 1 -- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2690003f70 msgr2=0x7f26a8151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a77fe640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2690003f70 0x7f26a8151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a77fe640 1 -- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26a813d720 msgr2=0x7f26a80b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a77fe640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26a813d720 0x7f26a80b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a77fe640 1 -- 172.21.15.84:0/1652526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a8150fa0 con 0x7f26a8150220 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26ac866640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26a813d720 0x7f26a80b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a77fe640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26a8150220 0x7f26a813d1e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f269c02c1a0 tx=0x7f269c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a4ff9640 1 -- 172.21.15.84:0/1652526796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c003810 con 0x7f26a8150220 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a4ff9640 1 -- 172.21.15.84:0/1652526796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c003970 con 0x7f26a8150220 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26a4ff9640 1 -- 172.21.15.84:0/1652526796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c003ce0 con 0x7f26a8150220 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.806+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a8151280 con 0x7f26a8150220 2023-12-12T09:20:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.807+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a81506a0 con 0x7f26a8150220 2023-12-12T09:20:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.807+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a80673c0 con 0x7f26a8150220 2023-12-12T09:20:43.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.809+0000 7f26a4ff9640 1 -- 172.21.15.84:0/1652526796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f269c034440 con 0x7f26a8150220 2023-12-12T09:20:43.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.810+0000 7f26a4ff9640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f269406ae40 0x7f269406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:43.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.810+0000 7f26a4ff9640 1 -- 172.21.15.84:0/1652526796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f269c0ab960 con 0x7f26a8150220 2023-12-12T09:20:43.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.810+0000 7f26a7fff640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f269406ae40 0x7f269406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:43.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.811+0000 7f26a7fff640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f269406ae40 0x7f269406d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2698007fd0 tx=0x7f2698009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:43.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:43.814+0000 7f26a4ff9640 1 -- 172.21.15.84:0/1652526796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f269c076750 con 0x7f26a8150220 2023-12-12T09:20:44.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.004+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26a8158ef0 con 0x7f26a8150220 2023-12-12T09:20:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.005+0000 7f26a4ff9640 1 -- 172.21.15.84:0/1652526796 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f269c0044e0 con 0x7f26a8150220 2023-12-12T09:20:44.006 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f269406ae40 msgr2=0x7f269406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f269406ae40 0x7f269406d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2698007fd0 tx=0x7f2698009040 comp rx=0 tx=0).stop 2023-12-12T09:20:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26a8150220 msgr2=0x7f26a813d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26a8150220 0x7f26a813d1e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f269c02c1a0 tx=0x7f269c004730 comp rx=0 tx=0).stop 2023-12-12T09:20:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 shutdown_connections 2023-12-12T09:20:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26a813d720 0x7f26a80b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f269406ae40 0x7f269406d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26a8150220 0x7f26a813d1e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 --2- 172.21.15.84:0/1652526796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2690003f70 0x7f26a8151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 >> 172.21.15.84:0/1652526796 conn(0x7f26a80b0900 msgr2=0x7f26a80ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 shutdown_connections 2023-12-12T09:20:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.008+0000 7f26ae2c9640 1 -- 172.21.15.84:0/1652526796 wait complete. 2023-12-12T09:20:44.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.227+0000 7ff3ef1c5640 1 Processor -- start 2023-12-12T09:20:44.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.227+0000 7ff3ef1c5640 1 -- start start 2023-12-12T09:20:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.228+0000 7ff3ef1c5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e815cc80 0x7ff3e815d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.228+0000 7ff3ef1c5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff3e806dfd0 0x7ff3e80b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ef1c5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e80725c0 con 0x7ff3e8072130 2023-12-12T09:20:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ef1c5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e80b1ef0 con 0x7ff3e806dfd0 2023-12-12T09:20:44.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ef1c5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80b21d0 con 0x7ff3e815cc80 2023-12-12T09:20:44.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ed762640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff3e806dfd0 0x7ff3e80b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ed762640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff3e806dfd0 0x7ff3e80b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54226/0 (socket says 172.21.15.84:54226) 2023-12-12T09:20:44.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ed762640 1 -- 172.21.15.84:0/3493138928 learned_addr learned my addr 172.21.15.84:0/3493138928 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:44.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ecf61640 1 --2- 172.21.15.84:0/3493138928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e815cc80 0x7ff3e815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ed762640 1 -- 172.21.15.84:0/3493138928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e815cc80 msgr2=0x7ff3e815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:44.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ed762640 1 --2- 172.21.15.84:0/3493138928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e815cc80 0x7ff3e815d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ed762640 1 -- 172.21.15.84:0/3493138928 >> v1:172.21.15.99:6789/0 conn(0x7ff3e8072130 legacy=0x7ff3e815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:44.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.229+0000 7ff3ed762640 1 -- 172.21.15.84:0/3493138928 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80b24b0 con 0x7ff3e806dfd0 2023-12-12T09:20:44.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.231+0000 7ff3ed762640 1 --2- 172.21.15.84:0/3493138928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e806dfd0 0x7ff3e80b2cb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009e50 tx=0x7ff3e002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ae38fe61897b97 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:44.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.231+0000 7ff3e77fe640 1 -- 172.21.15.84:0/3493138928 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e002c950 con 0x7ff3e806dfd0 2023-12-12T09:20:44.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.231+0000 7ff3e77fe640 1 -- 172.21.15.84:0/3493138928 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e002cab0 con 0x7ff3e806dfd0 2023-12-12T09:20:44.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.231+0000 7ff3e77fe640 1 -- 172.21.15.84:0/3493138928 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e002ce40 con 0x7ff3e806dfd0 2023-12-12T09:20:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.232+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/3493138928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e806dfd0 msgr2=0x7ff3e80b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.232+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/3493138928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e806dfd0 0x7ff3e80b2cb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009e50 tx=0x7ff3e002bdb0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.232+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/3493138928 shutdown_connections 2023-12-12T09:20:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.232+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/3493138928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e806dfd0 0x7ff3e80b2cb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.232+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/3493138928 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e815cc80 0x7ff3e815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.232+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/3493138928 >> 172.21.15.84:0/3493138928 conn(0x7ff3e80b0ac0 msgr2=0x7ff3e80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.232+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/3493138928 shutdown_connections 2023-12-12T09:20:44.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.232+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/3493138928 wait complete. 2023-12-12T09:20:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.233+0000 7ff3ef1c5640 1 Processor -- start 2023-12-12T09:20:44.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.234+0000 7ff3ef1c5640 1 -- start start 2023-12-12T09:20:44.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3ef1c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3e806dfd0 0x7ff3e80cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3ef1c5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e815cc80 0x7ff3e80b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3ef1c5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e80b13e0 0x7ff3e8145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3ef1c5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80b1890 con 0x7ff3e815cc80 2023-12-12T09:20:44.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3ef1c5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e81586d0 con 0x7ff3e806dfd0 2023-12-12T09:20:44.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3ef1c5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8146050 con 0x7ff3e80b13e0 2023-12-12T09:20:44.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3e7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e815cc80 0x7ff3e80b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3e7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e815cc80 0x7ff3e80b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54228/0 (socket says 172.21.15.84:54228) 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3e7fff640 1 -- 172.21.15.84:0/1352530389 learned_addr learned my addr 172.21.15.84:0/1352530389 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3ed762640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e80b13e0 0x7ff3e8145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3ecf61640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3e806dfd0 0x7ff3e80cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3e7fff640 1 -- 172.21.15.84:0/1352530389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e80b13e0 msgr2=0x7ff3e8145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3e7fff640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e80b13e0 0x7ff3e8145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3e7fff640 1 -- 172.21.15.84:0/1352530389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3e806dfd0 msgr2=0x7ff3e80cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3e7fff640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3e806dfd0 0x7ff3e80cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.235+0000 7ff3e7fff640 1 -- 172.21.15.84:0/1352530389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0009b30 con 0x7ff3e815cc80 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.236+0000 7ff3e7fff640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e815cc80 0x7ff3e80b0ea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c430 tx=0x7ff3d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.236+0000 7ff3e57fa640 1 -- 172.21.15.84:0/1352530389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4011790 con 0x7ff3e815cc80 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.236+0000 7ff3e57fa640 1 -- 172.21.15.84:0/1352530389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d40118f0 con 0x7ff3e815cc80 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.236+0000 7ff3e57fa640 1 -- 172.21.15.84:0/1352530389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4011ca0 con 0x7ff3e815cc80 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.236+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e8146330 con 0x7ff3e815cc80 2023-12-12T09:20:44.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.236+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e81468f0 con 0x7ff3e815cc80 2023-12-12T09:20:44.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.237+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e80673c0 con 0x7ff3e815cc80 2023-12-12T09:20:44.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.238+0000 7ff3e57fa640 1 -- 172.21.15.84:0/1352530389 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3d401c460 con 0x7ff3e815cc80 2023-12-12T09:20:44.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.239+0000 7ff3e57fa640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3cc06ae40 0x7ff3cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.239+0000 7ff3e57fa640 1 -- 172.21.15.84:0/1352530389 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff3d4089a10 con 0x7ff3e815cc80 2023-12-12T09:20:44.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.240+0000 7ff3ecf61640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3cc06ae40 0x7ff3cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.240+0000 7ff3ecf61640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3cc06ae40 0x7ff3cc06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc006fd0 tx=0x7ff3dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:44.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.244+0000 7ff3e57fa640 1 -- 172.21.15.84:0/1352530389 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3d4054670 con 0x7ff3e815cc80 2023-12-12T09:20:44.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.420+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3e8158ef0 con 0x7ff3e815cc80 2023-12-12T09:20:44.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.421+0000 7ff3e57fa640 1 -- 172.21.15.84:0/1352530389 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3d4057c90 con 0x7ff3e815cc80 2023-12-12T09:20:44.421 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:44.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3cc06ae40 msgr2=0x7ff3cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3cc06ae40 0x7ff3cc06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc006fd0 tx=0x7ff3dc008040 comp rx=0 tx=0).stop 2023-12-12T09:20:44.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e815cc80 msgr2=0x7ff3e80b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e815cc80 0x7ff3e80b0ea0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c430 tx=0x7ff3d400c8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 shutdown_connections 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3e80b13e0 0x7ff3e8145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3cc06ae40 0x7ff3cc06d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3e815cc80 0x7ff3e80b0ea0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 --2- 172.21.15.84:0/1352530389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3e806dfd0 0x7ff3e80cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 >> 172.21.15.84:0/1352530389 conn(0x7ff3e80b0ac0 msgr2=0x7ff3e80aed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 shutdown_connections 2023-12-12T09:20:44.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.423+0000 7ff3ef1c5640 1 -- 172.21.15.84:0/1352530389 wait complete. 2023-12-12T09:20:44.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:44.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.656+0000 7f885aa44640 1 Processor -- start 2023-12-12T09:20:44.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.656+0000 7f885aa44640 1 -- start start 2023-12-12T09:20:44.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.658+0000 7f885aa44640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8854146ac0 0x7f88540b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.658+0000 7f885aa44640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f88540b3280 0x7f885415e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.658+0000 7f885aa44640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885415e670 con 0x7f885406beb0 2023-12-12T09:20:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.658+0000 7f885aa44640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88540b3730 con 0x7f88540b3280 2023-12-12T09:20:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.658+0000 7f885aa44640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88540b21e0 con 0x7f8854146ac0 2023-12-12T09:20:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.658+0000 7f884bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f88540b3280 0x7f885415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.659+0000 7f884bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f88540b3280 0x7f885415e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54234/0 (socket says 172.21.15.84:54234) 2023-12-12T09:20:44.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.659+0000 7f884bfff640 1 -- 172.21.15.84:0/4194647255 learned_addr learned my addr 172.21.15.84:0/4194647255 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.659+0000 7f8853fff640 1 --2- 172.21.15.84:0/4194647255 >> v2:172.21.15.99:3300/0 conn(0x7f8854146ac0 0x7f88540b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.659+0000 7f884bfff640 1 -- 172.21.15.84:0/4194647255 >> v2:172.21.15.99:3300/0 conn(0x7f8854146ac0 msgr2=0x7f88540b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.659+0000 7f884bfff640 1 --2- 172.21.15.84:0/4194647255 >> v2:172.21.15.99:3300/0 conn(0x7f8854146ac0 0x7f88540b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.659+0000 7f884bfff640 1 -- 172.21.15.84:0/4194647255 >> v1:172.21.15.99:6789/0 conn(0x7f885406beb0 legacy=0x7f8854070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.659+0000 7f884bfff640 1 -- 172.21.15.84:0/4194647255 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540b24c0 con 0x7f88540b3280 2023-12-12T09:20:44.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.660+0000 7f884bfff640 1 --2- 172.21.15.84:0/4194647255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88540b3280 0x7f885415e130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8854066b00 tx=0x7f883c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccba62ce0e735c09 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.661+0000 7f88537fe640 1 -- 172.21.15.84:0/4194647255 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c031870 con 0x7f88540b3280 2023-12-12T09:20:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.661+0000 7f88537fe640 1 -- 172.21.15.84:0/4194647255 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c0319d0 con 0x7f88540b3280 2023-12-12T09:20:44.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.661+0000 7f88537fe640 1 -- 172.21.15.84:0/4194647255 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c031d60 con 0x7f88540b3280 2023-12-12T09:20:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.661+0000 7f885aa44640 1 -- 172.21.15.84:0/4194647255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88540b3280 msgr2=0x7f885415e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.661+0000 7f885aa44640 1 --2- 172.21.15.84:0/4194647255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88540b3280 0x7f885415e130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8854066b00 tx=0x7f883c02b910 comp rx=0 tx=0).stop 2023-12-12T09:20:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.661+0000 7f885aa44640 1 -- 172.21.15.84:0/4194647255 shutdown_connections 2023-12-12T09:20:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.661+0000 7f885aa44640 1 --2- 172.21.15.84:0/4194647255 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88540b3280 0x7f885415e130 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.661+0000 7f885aa44640 1 --2- 172.21.15.84:0/4194647255 >> v2:172.21.15.99:3300/0 conn(0x7f8854146ac0 0x7f88540b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.662+0000 7f885aa44640 1 -- 172.21.15.84:0/4194647255 >> 172.21.15.84:0/4194647255 conn(0x7f88540b0900 msgr2=0x7f88540b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.662+0000 7f885aa44640 1 -- 172.21.15.84:0/4194647255 shutdown_connections 2023-12-12T09:20:44.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.662+0000 7f885aa44640 1 -- 172.21.15.84:0/4194647255 wait complete. 2023-12-12T09:20:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.663+0000 7f885aa44640 1 Processor -- start 2023-12-12T09:20:44.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.663+0000 7f885aa44640 1 -- start start 2023-12-12T09:20:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.664+0000 7f885aa44640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885406beb0 0x7f885413bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.664+0000 7f885aa44640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88540b3280 0x7f88541f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.664+0000 7f885aa44640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8854146ac0 0x7f885413dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.664+0000 7f885aa44640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885413c4c0 con 0x7f8854146ac0 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.664+0000 7f885aa44640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885413d810 con 0x7f885406beb0 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.664+0000 7f885aa44640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885415cca0 con 0x7f88540b3280 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8854146ac0 0x7f885413dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8854146ac0 0x7f885413dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54240/0 (socket says 172.21.15.84:54240) 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 -- 172.21.15.84:0/1103610875 learned_addr learned my addr 172.21.15.84:0/1103610875 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8853fff640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885406beb0 0x7f885413bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f884bfff640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88540b3280 0x7f88541f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 -- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88540b3280 msgr2=0x7f88541f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88540b3280 0x7f88541f2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 -- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885406beb0 msgr2=0x7f885413bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885406beb0 0x7f885413bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 -- 172.21.15.84:0/1103610875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0094d0 con 0x7f8854146ac0 2023-12-12T09:20:44.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8853fff640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885406beb0 0x7f885413bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.665+0000 7f8858fe1640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8854146ac0 0x7f885413dca0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c780 tx=0x7f884c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.666+0000 7f88517fa640 1 -- 172.21.15.84:0/1103610875 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c004b60 con 0x7f8854146ac0 2023-12-12T09:20:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.666+0000 7f88517fa640 1 -- 172.21.15.84:0/1103610875 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c00ce90 con 0x7f8854146ac0 2023-12-12T09:20:44.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.666+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88540adde0 con 0x7f8854146ac0 2023-12-12T09:20:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.666+0000 7f88517fa640 1 -- 172.21.15.84:0/1103610875 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c00a850 con 0x7f8854146ac0 2023-12-12T09:20:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.666+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88541f34d0 con 0x7f8854146ac0 2023-12-12T09:20:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.667+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885413d980 con 0x7f8854146ac0 2023-12-12T09:20:44.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.668+0000 7f88517fa640 1 -- 172.21.15.84:0/1103610875 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f884c00a9b0 con 0x7f8854146ac0 2023-12-12T09:20:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.669+0000 7f88517fa640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883406ae40 0x7f883406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.669+0000 7f88517fa640 1 -- 172.21.15.84:0/1103610875 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f884c089bb0 con 0x7f8854146ac0 2023-12-12T09:20:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.669+0000 7f8853fff640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883406ae40 0x7f883406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:44.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.669+0000 7f8853fff640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883406ae40 0x7f883406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8844006fd0 tx=0x7f8844008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.673+0000 7f88517fa640 1 -- 172.21.15.84:0/1103610875 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f884c0548a0 con 0x7f8854146ac0 2023-12-12T09:20:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.866+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f88540673c0 con 0x7f8854146ac0 2023-12-12T09:20:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.867+0000 7f88517fa640 1 -- 172.21.15.84:0/1103610875 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f884c057ec0 con 0x7f8854146ac0 2023-12-12T09:20:44.867 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883406ae40 msgr2=0x7f883406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883406ae40 0x7f883406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8844006fd0 tx=0x7f8844008040 comp rx=0 tx=0).stop 2023-12-12T09:20:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8854146ac0 msgr2=0x7f885413dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8854146ac0 0x7f885413dca0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c780 tx=0x7f884c00cc40 comp rx=0 tx=0).stop 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 shutdown_connections 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883406ae40 0x7f883406d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8854146ac0 0x7f885413dca0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88540b3280 0x7f88541f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 --2- 172.21.15.84:0/1103610875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f885406beb0 0x7f885413bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 >> 172.21.15.84:0/1103610875 conn(0x7f88540b0900 msgr2=0x7f885415fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 shutdown_connections 2023-12-12T09:20:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:44.870+0000 7f885aa44640 1 -- 172.21.15.84:0/1103610875 wait complete. 2023-12-12T09:20:44.913 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2023-12-12T09:20:44.913 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-12T09:20:44.914 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:45.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.135+0000 7f143091c640 1 Processor -- start 2023-12-12T09:20:45.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.135+0000 7f143091c640 1 -- start start 2023-12-12T09:20:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.137+0000 7f143091c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c0cff90 0x7f142c0d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.137+0000 7f143091c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0b6460 con 0x7f142c15d130 2023-12-12T09:20:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.137+0000 7f143091c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0d1900 con 0x7f142c0d1470 2023-12-12T09:20:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.137+0000 7f143091c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c15d510 con 0x7f142c0cff90 2023-12-12T09:20:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.137+0000 7f142ad9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f142c15d130 0x7f142c0cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50396/0 (socket says 172.21.15.84:50396) 2023-12-12T09:20:45.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.137+0000 7f142ad9d640 1 -- 172.21.15.84:0/2535562537 learned_addr learned my addr 172.21.15.84:0/2535562537 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:45.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.137+0000 7f142a59c640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c0cff90 0x7f142c0d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356162793 0 0) 0x7f142c0b6460 con 0x7f142c15d130 2023-12-12T09:20:45.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1414003520 con 0x7f142c15d130 2023-12-12T09:20:45.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 584225101 0 0) 0x7f1414003520 con 0x7f142c15d130 2023-12-12T09:20:45.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c0cff90 msgr2=0x7f142c0d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:45.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c0cff90 0x7f142c0d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 >> v1:172.21.15.99:6789/0 conn(0x7f142c0d1470 legacy=0x7f142c0b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0d1b50 con 0x7f142c15d130 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f141c001670 con 0x7f142c15d130 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 >> v1:172.21.15.84:6789/0 conn(0x7f142c15d130 legacy=0x7f142c0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c0cff90 0x7f14140039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1414003f20 0x7f14140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f1414005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c15d510 con 0x7f1414004d00 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141400ba60 con 0x7f1414003f20 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.138+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141400bc20 con 0x7f142c0cff90 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.139+0000 7f142b59e640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f1414005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.139+0000 7f142a59c640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1414003f20 0x7f14140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.139+0000 7f142b59e640 1 -- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c0cff90 msgr2=0x7f14140039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.139+0000 7f142b59e640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c0cff90 0x7f14140039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.139+0000 7f142b59e640 1 -- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1414003f20 msgr2=0x7f14140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:45.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.139+0000 7f142b59e640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1414003f20 0x7f14140047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.139+0000 7f142b59e640 1 -- 172.21.15.84:0/2535562537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414003520 con 0x7f1414004d00 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.140+0000 7f142b59e640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f1414005180 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1424001e50 tx=0x7f14140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c67ae29841855c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.140+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424003b70 con 0x7f1414004d00 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.140+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424003cd0 con 0x7f1414004d00 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.140+0000 7f1429d9b640 1 -- 172.21.15.84:0/2535562537 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424005310 con 0x7f1414004d00 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.141+0000 7f143091c640 1 -- 172.21.15.84:0/2535562537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 msgr2=0x7f1414005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.141+0000 7f143091c640 1 --2- 172.21.15.84:0/2535562537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f1414005180 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1424001e50 tx=0x7f14140057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.141+0000 7f142b59e640 1 -- 172.21.15.84:0/2535562537 reap_dead start 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.141+0000 7f143091c640 1 -- 172.21.15.84:0/2535562537 shutdown_connections 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.141+0000 7f143091c640 1 -- 172.21.15.84:0/2535562537 >> 172.21.15.84:0/2535562537 conn(0x7f142c0d2e90 msgr2=0x7f142c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.141+0000 7f143091c640 1 -- 172.21.15.84:0/2535562537 shutdown_connections 2023-12-12T09:20:45.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.141+0000 7f143091c640 1 -- 172.21.15.84:0/2535562537 wait complete. 2023-12-12T09:20:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.143+0000 7f143091c640 1 Processor -- start 2023-12-12T09:20:45.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.143+0000 7f143091c640 1 -- start start 2023-12-12T09:20:45.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f143091c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f142c1f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f143091c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c152640 0x7f142c0b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f143091c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0c8f00 0x7f142c0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f143091c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0c7750 con 0x7f1414004d00 2023-12-12T09:20:45.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f143091c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0cb0e0 con 0x7f142c0c8f00 2023-12-12T09:20:45.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f143091c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0cb3c0 con 0x7f142c152640 2023-12-12T09:20:45.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f142ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f142c1f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f142ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f142c1f37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54262/0 (socket says 172.21.15.84:54262) 2023-12-12T09:20:45.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.144+0000 7f142ad9d640 1 -- 172.21.15.84:0/282979394 learned_addr learned my addr 172.21.15.84:0/282979394 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f142a59c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c152640 0x7f142c0b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f142b59e640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0c8f00 0x7f142c0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f142ad9d640 1 -- 172.21.15.84:0/282979394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c152640 msgr2=0x7f142c0b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f142ad9d640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c152640 0x7f142c0b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f142ad9d640 1 -- 172.21.15.84:0/282979394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0c8f00 msgr2=0x7f142c0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f142ad9d640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0c8f00 0x7f142c0c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f142ad9d640 1 -- 172.21.15.84:0/282979394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0cb6a0 con 0x7f1414004d00 2023-12-12T09:20:45.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f142ad9d640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f142c1f37c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f141c00c840 tx=0x7f141c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:45.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f14137fe640 1 -- 172.21.15.84:0/282979394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0074e0 con 0x7f1414004d00 2023-12-12T09:20:45.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f14137fe640 1 -- 172.21.15.84:0/282979394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c007660 con 0x7f1414004d00 2023-12-12T09:20:45.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f14137fe640 1 -- 172.21.15.84:0/282979394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c004a20 con 0x7f1414004d00 2023-12-12T09:20:45.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c0c7a30 con 0x7f1414004d00 2023-12-12T09:20:45.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.145+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c152ac0 con 0x7f1414004d00 2023-12-12T09:20:45.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.147+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c0673c0 con 0x7f1414004d00 2023-12-12T09:20:45.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.147+0000 7f14137fe640 1 -- 172.21.15.84:0/282979394 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f141c004b80 con 0x7f1414004d00 2023-12-12T09:20:45.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.149+0000 7f14137fe640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f141806ae70 0x7f141806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.149+0000 7f14137fe640 1 -- 172.21.15.84:0/282979394 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f141c088d70 con 0x7f1414004d00 2023-12-12T09:20:45.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.149+0000 7f142a59c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f141806ae70 0x7f141806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.150+0000 7f142a59c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f141806ae70 0x7f141806d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f142c0c9bc0 tx=0x7f1420008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:45.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.153+0000 7f14137fe640 1 -- 172.21.15.84:0/282979394 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f141c053bb0 con 0x7f1414004d00 2023-12-12T09:20:45.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.347+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f142c0b57d0 con 0x7f1414004d00 2023-12-12T09:20:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.350+0000 7f14137fe640 1 -- 172.21.15.84:0/282979394 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f141c018020 con 0x7f1414004d00 2023-12-12T09:20:45.351 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:45.351 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.352+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f141806ae70 msgr2=0x7f141806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.352+0000 7f143091c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f141806ae70 0x7f141806d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f142c0c9bc0 tx=0x7f1420008040 comp rx=0 tx=0).stop 2023-12-12T09:20:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 msgr2=0x7f142c1f37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f142c1f37c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f141c00c840 tx=0x7f141c00cd00 comp rx=0 tx=0).stop 2023-12-12T09:20:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 shutdown_connections 2023-12-12T09:20:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c0c8f00 0x7f142c0c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f142c152640 0x7f142c0b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f141806ae70 0x7f141806d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 --2- 172.21.15.84:0/282979394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1414004d00 0x7f142c1f37c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 >> 172.21.15.84:0/282979394 conn(0x7f142c0d2e90 msgr2=0x7f142c0b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 shutdown_connections 2023-12-12T09:20:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.353+0000 7f143091c640 1 -- 172.21.15.84:0/282979394 wait complete. 2023-12-12T09:20:45.373 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:45.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:45.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.589+0000 7fba5a168640 1 Processor -- start 2023-12-12T09:20:45.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.589+0000 7fba5a168640 1 -- start start 2023-12-12T09:20:45.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba5a168640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba5414a4a0 0x7fba5406d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba5a168640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fba5414af70 0x7fba5406d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba5a168640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414aa20 0x7fba54165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba5a168640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5414a880 con 0x7fba5414a4a0 2023-12-12T09:20:45.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba5a168640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba54070730 con 0x7fba5414af70 2023-12-12T09:20:45.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba5a168640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba540b1f60 con 0x7fba5414aa20 2023-12-12T09:20:45.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba537fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba5414a4a0 0x7fba5406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba537fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba5414a4a0 0x7fba5406d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54266/0 (socket says 172.21.15.84:54266) 2023-12-12T09:20:45.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.591+0000 7fba537fe640 1 -- 172.21.15.84:0/308915315 learned_addr learned my addr 172.21.15.84:0/308915315 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:45.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.592+0000 7fba537fe640 1 -- 172.21.15.84:0/308915315 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414aa20 msgr2=0x7fba54165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:45.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.592+0000 7fba53fff640 1 --2- 172.21.15.84:0/308915315 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414aa20 0x7fba54165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.592+0000 7fba4bfff640 1 --2- 172.21.15.84:0/308915315 >> v2:172.21.15.99:3300/0 conn(0x7fba5414af70 0x7fba5406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.592+0000 7fba537fe640 1 --2- 172.21.15.84:0/308915315 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414aa20 0x7fba54165280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.592+0000 7fba537fe640 1 -- 172.21.15.84:0/308915315 >> v2:172.21.15.99:3300/0 conn(0x7fba5414af70 msgr2=0x7fba5406d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:45.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.592+0000 7fba537fe640 1 --2- 172.21.15.84:0/308915315 >> v2:172.21.15.99:3300/0 conn(0x7fba5414af70 0x7fba5406d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.592+0000 7fba537fe640 1 -- 172.21.15.84:0/308915315 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540700e0 con 0x7fba5414a4a0 2023-12-12T09:20:45.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.592+0000 7fba4bfff640 1 --2- 172.21.15.84:0/308915315 >> v2:172.21.15.99:3300/0 conn(0x7fba5414af70 0x7fba5406d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:45.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.593+0000 7fba537fe640 1 --2- 172.21.15.84:0/308915315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414a4a0 0x7fba5406d430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fba540727a0 tx=0x7fba4402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de247318dd8a1c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:45.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.593+0000 7fba52ffd640 1 -- 172.21.15.84:0/308915315 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba440317d0 con 0x7fba5414a4a0 2023-12-12T09:20:45.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.593+0000 7fba52ffd640 1 -- 172.21.15.84:0/308915315 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba44031930 con 0x7fba5414a4a0 2023-12-12T09:20:45.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.593+0000 7fba52ffd640 1 -- 172.21.15.84:0/308915315 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44031cc0 con 0x7fba5414a4a0 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 -- 172.21.15.84:0/308915315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414a4a0 msgr2=0x7fba5406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 --2- 172.21.15.84:0/308915315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414a4a0 0x7fba5406d430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fba540727a0 tx=0x7fba4402b870 comp rx=0 tx=0).stop 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 -- 172.21.15.84:0/308915315 shutdown_connections 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 --2- 172.21.15.84:0/308915315 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414aa20 0x7fba54165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 --2- 172.21.15.84:0/308915315 >> v2:172.21.15.99:3300/0 conn(0x7fba5414af70 0x7fba5406d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 --2- 172.21.15.84:0/308915315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414a4a0 0x7fba5406d430 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 -- 172.21.15.84:0/308915315 >> 172.21.15.84:0/308915315 conn(0x7fba540b0ac0 msgr2=0x7fba540b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 -- 172.21.15.84:0/308915315 shutdown_connections 2023-12-12T09:20:45.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.594+0000 7fba5a168640 1 -- 172.21.15.84:0/308915315 wait complete. 2023-12-12T09:20:45.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.596+0000 7fba5a168640 1 Processor -- start 2023-12-12T09:20:45.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.596+0000 7fba5a168640 1 -- start start 2023-12-12T09:20:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba5a168640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba5414a4a0 0x7fba54145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba5a168640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414aa20 0x7fba54163940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba5a168640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414af70 0x7fba5415de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba5a168640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba541f7140 con 0x7fba5414aa20 2023-12-12T09:20:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba5a168640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba541f7420 con 0x7fba5414a4a0 2023-12-12T09:20:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba5a168640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba541f7700 con 0x7fba5414af70 2023-12-12T09:20:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba4bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414aa20 0x7fba54163940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba4bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414aa20 0x7fba54163940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54274/0 (socket says 172.21.15.84:54274) 2023-12-12T09:20:45.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.597+0000 7fba4bfff640 1 -- 172.21.15.84:0/689572641 learned_addr learned my addr 172.21.15.84:0/689572641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:45.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba53fff640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414af70 0x7fba5415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba537fe640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba5414a4a0 0x7fba54145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba4bfff640 1 -- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414af70 msgr2=0x7fba5415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba4bfff640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414af70 0x7fba5415de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba4bfff640 1 -- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba5414a4a0 msgr2=0x7fba54145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba4bfff640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba5414a4a0 0x7fba54145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba4bfff640 1 -- 172.21.15.84:0/689572641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440094d0 con 0x7fba5414aa20 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba537fe640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba5414a4a0 0x7fba54145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba4bfff640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414aa20 0x7fba54163940 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c7f0 tx=0x7fba3c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.598+0000 7fba50ff9640 1 -- 172.21.15.84:0/689572641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c007820 con 0x7fba5414aa20 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.599+0000 7fba50ff9640 1 -- 172.21.15.84:0/689572641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c007980 con 0x7fba5414aa20 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.599+0000 7fba50ff9640 1 -- 172.21.15.84:0/689572641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c007cf0 con 0x7fba5414aa20 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.599+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba541f79e0 con 0x7fba5414aa20 2023-12-12T09:20:45.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.599+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba54145dd0 con 0x7fba5414aa20 2023-12-12T09:20:45.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.600+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba540673c0 con 0x7fba5414aa20 2023-12-12T09:20:45.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.601+0000 7fba50ff9640 1 -- 172.21.15.84:0/689572641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba3c0113f0 con 0x7fba5414aa20 2023-12-12T09:20:45.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.602+0000 7fba50ff9640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba3406ae40 0x7fba3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:45.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.602+0000 7fba50ff9640 1 -- 172.21.15.84:0/689572641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fba3c089d80 con 0x7fba5414aa20 2023-12-12T09:20:45.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.602+0000 7fba537fe640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba3406ae40 0x7fba3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:45.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.603+0000 7fba537fe640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba3406ae40 0x7fba3406d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fba44036000 tx=0x7fba4403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:45.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.606+0000 7fba50ff9640 1 -- 172.21.15.84:0/689572641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba3c0549d0 con 0x7fba5414aa20 2023-12-12T09:20:45.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.798+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba54165200 con 0x7fba5414aa20 2023-12-12T09:20:45.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.799+0000 7fba50ff9640 1 -- 172.21.15.84:0/689572641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba3c01f0a0 con 0x7fba5414aa20 2023-12-12T09:20:45.800 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba3406ae40 msgr2=0x7fba3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba3406ae40 0x7fba3406d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fba44036000 tx=0x7fba4403d040 comp rx=0 tx=0).stop 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414aa20 msgr2=0x7fba54163940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414aa20 0x7fba54163940 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c7f0 tx=0x7fba3c00ccb0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 shutdown_connections 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba5414af70 0x7fba5415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba3406ae40 0x7fba3406d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba5414aa20 0x7fba54163940 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 --2- 172.21.15.84:0/689572641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba5414a4a0 0x7fba54145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:45.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.802+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 >> 172.21.15.84:0/689572641 conn(0x7fba540b0ac0 msgr2=0x7fba54146a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:45.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.803+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 shutdown_connections 2023-12-12T09:20:45.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:45.803+0000 7fba5a168640 1 -- 172.21.15.84:0/689572641 wait complete. 2023-12-12T09:20:45.822 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:46.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.035+0000 7fec32e2b640 1 Processor -- start 2023-12-12T09:20:46.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.035+0000 7fec32e2b640 1 -- start start 2023-12-12T09:20:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.037+0000 7fec32e2b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec2c0cde40 0x7fec2c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.037+0000 7fec32e2b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c155a70 con 0x7fec2c155690 2023-12-12T09:20:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.037+0000 7fec32e2b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c15c120 con 0x7fec2c15b4f0 2023-12-12T09:20:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.037+0000 7fec32e2b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c0ce830 con 0x7fec2c0cde40 2023-12-12T09:20:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.037+0000 7fec30bc7640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fec2c155690 0x7fec2c06ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44944/0 (socket says 172.21.15.84:44944) 2023-12-12T09:20:46.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.037+0000 7fec30bc7640 1 -- 172.21.15.84:0/4137270078 learned_addr learned my addr 172.21.15.84:0/4137270078 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:46.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.037+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850008418 0 0) 0x7fec2c155a70 con 0x7fec2c155690 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.037+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec1c003520 con 0x7fec2c155690 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2bfff640 1 --2- 172.21.15.84:0/4137270078 >> v2:172.21.15.99:3300/0 conn(0x7fec2c0cde40 0x7fec2c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155697267 0 0) 0x7fec1c003520 con 0x7fec2c155690 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 >> v2:172.21.15.99:3300/0 conn(0x7fec2c0cde40 msgr2=0x7fec2c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 --2- 172.21.15.84:0/4137270078 >> v2:172.21.15.99:3300/0 conn(0x7fec2c0cde40 0x7fec2c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 >> v1:172.21.15.99:6789/0 conn(0x7fec2c15b4f0 legacy=0x7fec2c15b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c15c400 con 0x7fec2c155690 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fec20001670 con 0x7fec2c155690 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 >> v1:172.21.15.84:6789/0 conn(0x7fec2c155690 legacy=0x7fec2c06ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c003970 0x7fec1c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec1c0047c0 0x7fec1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec1c005180 0x7fec1c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0ce830 con 0x7fec1c003970 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c00c0b0 con 0x7fec1c0047c0 2023-12-12T09:20:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c00c270 con 0x7fec1c005180 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.038+0000 7fec30bc7640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c003970 0x7fec1c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.039+0000 7fec2bfff640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec1c0047c0 0x7fec1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.039+0000 7fec313c8640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec1c005180 0x7fec1c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.039+0000 7fec30bc7640 1 -- 172.21.15.84:0/4137270078 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec1c005180 msgr2=0x7fec1c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.039+0000 7fec30bc7640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec1c005180 0x7fec1c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.039+0000 7fec30bc7640 1 -- 172.21.15.84:0/4137270078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec1c0047c0 msgr2=0x7fec1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.039+0000 7fec30bc7640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec1c0047c0 0x7fec1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.039+0000 7fec30bc7640 1 -- 172.21.15.84:0/4137270078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c003520 con 0x7fec1c003970 2023-12-12T09:20:46.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.039+0000 7fec313c8640 1 -- 172.21.15.84:0/4137270078 reap_dead start 2023-12-12T09:20:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.040+0000 7fec30bc7640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c003970 0x7fec1c003d70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fec20001eb0 tx=0x7fec1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19eb42fae14a78b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.040+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20005ad0 con 0x7fec1c003970 2023-12-12T09:20:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.040+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec20005c50 con 0x7fec1c003970 2023-12-12T09:20:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.040+0000 7fec2b7fe640 1 -- 172.21.15.84:0/4137270078 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2002c890 con 0x7fec1c003970 2023-12-12T09:20:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.041+0000 7fec32e2b640 1 -- 172.21.15.84:0/4137270078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c003970 msgr2=0x7fec1c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.041+0000 7fec32e2b640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c003970 0x7fec1c003d70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fec20001eb0 tx=0x7fec1c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.041+0000 7fec32e2b640 1 -- 172.21.15.84:0/4137270078 shutdown_connections 2023-12-12T09:20:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.041+0000 7fec32e2b640 1 --2- 172.21.15.84:0/4137270078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec1c003970 0x7fec1c003d70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.041+0000 7fec32e2b640 1 -- 172.21.15.84:0/4137270078 >> 172.21.15.84:0/4137270078 conn(0x7fec2c0b0900 msgr2=0x7fec2c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.041+0000 7fec32e2b640 1 -- 172.21.15.84:0/4137270078 shutdown_connections 2023-12-12T09:20:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.041+0000 7fec32e2b640 1 -- 172.21.15.84:0/4137270078 wait complete. 2023-12-12T09:20:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.043+0000 7fec32e2b640 1 Processor -- start 2023-12-12T09:20:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.043+0000 7fec32e2b640 1 -- start start 2023-12-12T09:20:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec32e2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec1c003970 0x7fec2c1f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec32e2b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec2c09a3b0 0x7fec2c0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec32e2b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2c09a830 0x7fec2c0ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec32e2b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c1f4480 con 0x7fec2c09a830 2023-12-12T09:20:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec32e2b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c09ce60 con 0x7fec1c003970 2023-12-12T09:20:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec32e2b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c1f3de0 con 0x7fec2c09a3b0 2023-12-12T09:20:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec313c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2c09a830 0x7fec2c0ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec313c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2c09a830 0x7fec2c0ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42076/0 (socket says 172.21.15.84:42076) 2023-12-12T09:20:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.044+0000 7fec313c8640 1 -- 172.21.15.84:0/2208137792 learned_addr learned my addr 172.21.15.84:0/2208137792 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec313c8640 1 -- 172.21.15.84:0/2208137792 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec2c09a3b0 msgr2=0x7fec2c0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec313c8640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec2c09a3b0 0x7fec2c0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec313c8640 1 -- 172.21.15.84:0/2208137792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec1c003970 msgr2=0x7fec2c1f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec313c8640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec1c003970 0x7fec2c1f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec313c8640 1 -- 172.21.15.84:0/2208137792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c099e00 con 0x7fec2c09a830 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec313c8640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2c09a830 0x7fec2c0ae920 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fec2c06fd90 tx=0x7fec2400e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec297fa640 1 -- 172.21.15.84:0/2208137792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24003df0 con 0x7fec2c09a830 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec297fa640 1 -- 172.21.15.84:0/2208137792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec24013420 con 0x7fec2c09a830 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec297fa640 1 -- 172.21.15.84:0/2208137792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240137d0 con 0x7fec2c09a830 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c1f40a0 con 0x7fec2c09a830 2023-12-12T09:20:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.045+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c099a20 con 0x7fec2c09a830 2023-12-12T09:20:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.047+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c151f90 con 0x7fec2c09a830 2023-12-12T09:20:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.047+0000 7fec297fa640 1 -- 172.21.15.84:0/2208137792 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec24013930 con 0x7fec2c09a830 2023-12-12T09:20:46.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.048+0000 7fec297fa640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fec1006ae40 0x7fec1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.048+0000 7fec297fa640 1 -- 172.21.15.84:0/2208137792 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec240893e0 con 0x7fec2c09a830 2023-12-12T09:20:46.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.049+0000 7fec30bc7640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fec1006ae40 0x7fec1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.049+0000 7fec30bc7640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fec1006ae40 0x7fec1006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fec20034000 tx=0x7fec20039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.053+0000 7fec297fa640 1 -- 172.21.15.84:0/2208137792 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec24054160 con 0x7fec2c09a830 2023-12-12T09:20:46.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.242+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec2c0673c0 con 0x7fec2c09a830 2023-12-12T09:20:46.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.242+0000 7fec297fa640 1 -- 172.21.15.84:0/2208137792 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec24057780 con 0x7fec2c09a830 2023-12-12T09:20:46.243 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:46.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fec1006ae40 msgr2=0x7fec1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fec1006ae40 0x7fec1006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fec20034000 tx=0x7fec20039040 comp rx=0 tx=0).stop 2023-12-12T09:20:46.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2c09a830 msgr2=0x7fec2c0ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2c09a830 0x7fec2c0ae920 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fec2c06fd90 tx=0x7fec2400e980 comp rx=0 tx=0).stop 2023-12-12T09:20:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 shutdown_connections 2023-12-12T09:20:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fec1006ae40 0x7fec1006d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec2c09a830 0x7fec2c0ae920 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fec2c09a3b0 0x7fec2c0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 --2- 172.21.15.84:0/2208137792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec1c003970 0x7fec2c1f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 >> 172.21.15.84:0/2208137792 conn(0x7fec2c0b0900 msgr2=0x7fec2c15ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 shutdown_connections 2023-12-12T09:20:46.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.245+0000 7fec32e2b640 1 -- 172.21.15.84:0/2208137792 wait complete. 2023-12-12T09:20:46.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:46.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.478+0000 7faf14e4f640 1 Processor -- start 2023-12-12T09:20:46.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.478+0000 7faf14e4f640 1 -- start start 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf14e4f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf1015cc80 0x7faf1015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf14e4f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf10072130 0x7faf1015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf14e4f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faf1006dfd0 0x7faf1015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf14e4f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100725c0 con 0x7faf1015cc80 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf14e4f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf100b1ef0 con 0x7faf1006dfd0 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf14e4f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf100b21d0 con 0x7faf10072130 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf0e59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf1015cc80 0x7faf1015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf0e59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faf1015cc80 0x7faf1015d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42088/0 (socket says 172.21.15.84:42088) 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf0e59c640 1 -- 172.21.15.84:0/3771413652 learned_addr learned my addr 172.21.15.84:0/3771413652 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.480+0000 7faf07fff640 1 --2- 172.21.15.84:0/3771413652 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf10072130 0x7faf1015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.481+0000 7faf0ed9d640 1 --2- 172.21.15.84:0/3771413652 >> v2:172.21.15.99:3300/0 conn(0x7faf1006dfd0 0x7faf1015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.481+0000 7faf0e59c640 1 -- 172.21.15.84:0/3771413652 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf10072130 msgr2=0x7faf1015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.481+0000 7faf0e59c640 1 --2- 172.21.15.84:0/3771413652 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf10072130 0x7faf1015d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.481+0000 7faf0e59c640 1 -- 172.21.15.84:0/3771413652 >> v2:172.21.15.99:3300/0 conn(0x7faf1006dfd0 msgr2=0x7faf1015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.481+0000 7faf0e59c640 1 --2- 172.21.15.84:0/3771413652 >> v2:172.21.15.99:3300/0 conn(0x7faf1006dfd0 0x7faf1015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.481+0000 7faf0e59c640 1 -- 172.21.15.84:0/3771413652 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf100b24b0 con 0x7faf1015cc80 2023-12-12T09:20:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.481+0000 7faf07fff640 1 --2- 172.21.15.84:0/3771413652 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf10072130 0x7faf1015d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:46.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.481+0000 7faf0ed9d640 1 --2- 172.21.15.84:0/3771413652 >> v2:172.21.15.99:3300/0 conn(0x7faf1006dfd0 0x7faf1015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:46.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.482+0000 7faf0e59c640 1 --2- 172.21.15.84:0/3771413652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1015cc80 0x7faf1015d360 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf100cfd60 tx=0x7faf0002dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4858c0e65485bfe server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.482+0000 7faf0dd9b640 1 -- 172.21.15.84:0/3771413652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0002eb30 con 0x7faf1015cc80 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.482+0000 7faf0dd9b640 1 -- 172.21.15.84:0/3771413652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf00032070 con 0x7faf1015cc80 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.482+0000 7faf0dd9b640 1 -- 172.21.15.84:0/3771413652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00038400 con 0x7faf1015cc80 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 -- 172.21.15.84:0/3771413652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1015cc80 msgr2=0x7faf1015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3771413652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1015cc80 0x7faf1015d360 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf100cfd60 tx=0x7faf0002dd80 comp rx=0 tx=0).stop 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 -- 172.21.15.84:0/3771413652 shutdown_connections 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3771413652 >> v2:172.21.15.99:3300/0 conn(0x7faf1006dfd0 0x7faf1015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3771413652 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf10072130 0x7faf1015d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3771413652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1015cc80 0x7faf1015d360 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 -- 172.21.15.84:0/3771413652 >> 172.21.15.84:0/3771413652 conn(0x7faf100b0ac0 msgr2=0x7faf100b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 -- 172.21.15.84:0/3771413652 shutdown_connections 2023-12-12T09:20:46.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.483+0000 7faf14e4f640 1 -- 172.21.15.84:0/3771413652 wait complete. 2023-12-12T09:20:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.485+0000 7faf14e4f640 1 Processor -- start 2023-12-12T09:20:46.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.485+0000 7faf14e4f640 1 -- start start 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf14e4f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1006dfd0 0x7faf1014e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf14e4f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf1015cc80 0x7faf1014e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf14e4f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf1014c6e0 0x7faf101ee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf14e4f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1014f6e0 con 0x7faf1006dfd0 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf14e4f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1014cca0 con 0x7faf1014c6e0 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf14e4f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1014f090 con 0x7faf1015cc80 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1006dfd0 0x7faf1014e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1006dfd0 0x7faf1014e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42098/0 (socket says 172.21.15.84:42098) 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0e59c640 1 -- 172.21.15.84:0/3447493686 learned_addr learned my addr 172.21.15.84:0/3447493686 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0e59c640 1 -- 172.21.15.84:0/3447493686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf1015cc80 msgr2=0x7faf1014e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0e59c640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf1015cc80 0x7faf1014e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0e59c640 1 -- 172.21.15.84:0/3447493686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf1014c6e0 msgr2=0x7faf101ee1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0ed9d640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf1014c6e0 0x7faf101ee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0e59c640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf1014c6e0 0x7faf101ee1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.486+0000 7faf0e59c640 1 -- 172.21.15.84:0/3447493686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0000b760 con 0x7faf1006dfd0 2023-12-12T09:20:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.487+0000 7faf0e59c640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1006dfd0 0x7faf1014e2e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faf0002ddc0 tx=0x7faf000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.487+0000 7faf06ffd640 1 -- 172.21.15.84:0/3447493686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00038e90 con 0x7faf1006dfd0 2023-12-12T09:20:46.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.487+0000 7faf06ffd640 1 -- 172.21.15.84:0/3447493686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf00043470 con 0x7faf1006dfd0 2023-12-12T09:20:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.487+0000 7faf06ffd640 1 -- 172.21.15.84:0/3447493686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00043800 con 0x7faf1006dfd0 2023-12-12T09:20:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.487+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1014f370 con 0x7faf1006dfd0 2023-12-12T09:20:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.487+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1014ed60 con 0x7faf1006dfd0 2023-12-12T09:20:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.488+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1014f530 con 0x7faf1006dfd0 2023-12-12T09:20:46.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.489+0000 7faf06ffd640 1 -- 172.21.15.84:0/3447493686 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf00043960 con 0x7faf1006dfd0 2023-12-12T09:20:46.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.490+0000 7faf06ffd640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faef006ae40 0x7faef006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.490+0000 7faf06ffd640 1 -- 172.21.15.84:0/3447493686 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf000ae760 con 0x7faf1006dfd0 2023-12-12T09:20:46.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.490+0000 7faf07fff640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faef006ae40 0x7faef006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.491+0000 7faf07fff640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faef006ae40 0x7faef006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faef8006fd0 tx=0x7faef8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.494+0000 7faf06ffd640 1 -- 172.21.15.84:0/3447493686 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf00079440 con 0x7faf1006dfd0 2023-12-12T09:20:46.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.683+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf100673c0 con 0x7faf1006dfd0 2023-12-12T09:20:46.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.684+0000 7faf06ffd640 1 -- 172.21.15.84:0/3447493686 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf0007ca60 con 0x7faf1006dfd0 2023-12-12T09:20:46.685 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faef006ae40 msgr2=0x7faef006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faef006ae40 0x7faef006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faef8006fd0 tx=0x7faef8008040 comp rx=0 tx=0).stop 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1006dfd0 msgr2=0x7faf1014e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1006dfd0 0x7faf1014e2e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faf0002ddc0 tx=0x7faf000046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 shutdown_connections 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf1014c6e0 0x7faf101ee1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf1015cc80 0x7faf1014e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faef006ae40 0x7faef006d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 --2- 172.21.15.84:0/3447493686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf1006dfd0 0x7faf1014e2e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.687+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 >> 172.21.15.84:0/3447493686 conn(0x7faf100b0ac0 msgr2=0x7faf100b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.688+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 shutdown_connections 2023-12-12T09:20:46.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.688+0000 7faf14e4f640 1 -- 172.21.15.84:0/3447493686 wait complete. 2023-12-12T09:20:46.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:46.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.911+0000 7fdf88141640 1 Processor -- start 2023-12-12T09:20:46.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.911+0000 7fdf88141640 1 -- start start 2023-12-12T09:20:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.913+0000 7fdf88141640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf800ac460 0x7fdf800b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.913+0000 7fdf88141640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf800b1c00 con 0x7fdf800b2f80 2023-12-12T09:20:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.913+0000 7fdf88141640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf800b1ee0 con 0x7fdf80162060 2023-12-12T09:20:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.913+0000 7fdf88141640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800b21c0 con 0x7fdf800ac460 2023-12-12T09:20:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.913+0000 7fdf856dc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdf800b2f80 0x7fdf800abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44958/0 (socket says 172.21.15.84:44958) 2023-12-12T09:20:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.913+0000 7fdf856dc640 1 -- 172.21.15.84:0/3827481218 learned_addr learned my addr 172.21.15.84:0/3827481218 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.913+0000 7fdf866de640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf800ac460 0x7fdf800b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.913+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787244138 0 0) 0x7fdf800b1c00 con 0x7fdf800b2f80 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf6c003520 con 0x7fdf800b2f80 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616603898 0 0) 0x7fdf6c003520 con 0x7fdf800b2f80 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf800ac460 msgr2=0x7fdf800b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf800ac460 0x7fdf800b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 >> v1:172.21.15.99:6789/0 conn(0x7fdf80162060 legacy=0x7fdf80162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf800b24a0 con 0x7fdf800b2f80 2023-12-12T09:20:46.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fdf70001670 con 0x7fdf800b2f80 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 >> v1:172.21.15.84:6789/0 conn(0x7fdf800b2f80 legacy=0x7fdf800abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf800ac460 0x7fdf6c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf6c003f20 0x7fdf6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800b21c0 con 0x7fdf6c004d00 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c00ba60 con 0x7fdf6c003f20 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c00bc20 con 0x7fdf800ac460 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.914+0000 7fdf866de640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.915+0000 7fdf856dc640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf6c003f20 0x7fdf6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.915+0000 7fdf866de640 1 -- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf800ac460 msgr2=0x7fdf6c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.915+0000 7fdf866de640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf800ac460 0x7fdf6c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.915+0000 7fdf866de640 1 -- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf6c003f20 msgr2=0x7fdf6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.915+0000 7fdf866de640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf6c003f20 0x7fdf6c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.915+0000 7fdf866de640 1 -- 172.21.15.84:0/3827481218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c003520 con 0x7fdf6c004d00 2023-12-12T09:20:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.916+0000 7fdf866de640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf6c005180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009f90 tx=0x7fdf6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76497a304ac5e519 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.916+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7802cc20 con 0x7fdf6c004d00 2023-12-12T09:20:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.916+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7800f040 con 0x7fdf6c004d00 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.916+0000 7fdf84edb640 1 -- 172.21.15.84:0/3827481218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78034440 con 0x7fdf6c004d00 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.917+0000 7fdf88141640 1 -- 172.21.15.84:0/3827481218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 msgr2=0x7fdf6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.917+0000 7fdf88141640 1 --2- 172.21.15.84:0/3827481218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf6c005180 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009f90 tx=0x7fdf6c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.917+0000 7fdf866de640 1 -- 172.21.15.84:0/3827481218 reap_dead start 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.917+0000 7fdf88141640 1 -- 172.21.15.84:0/3827481218 shutdown_connections 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.917+0000 7fdf88141640 1 -- 172.21.15.84:0/3827481218 >> 172.21.15.84:0/3827481218 conn(0x7fdf800b0900 msgr2=0x7fdf800b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.917+0000 7fdf88141640 1 -- 172.21.15.84:0/3827481218 shutdown_connections 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.917+0000 7fdf88141640 1 -- 172.21.15.84:0/3827481218 wait complete. 2023-12-12T09:20:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.919+0000 7fdf88141640 1 Processor -- start 2023-12-12T09:20:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.919+0000 7fdf88141640 1 -- start start 2023-12-12T09:20:46.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf88141640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf8009c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf88141640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf8006beb0 0x7fdf8006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf88141640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf80151cc0 0x7fdf80152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf88141640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf80152680 con 0x7fdf6c004d00 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf88141640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8006c930 con 0x7fdf80151cc0 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf88141640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8009a8f0 con 0x7fdf8006beb0 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf85edd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf8009c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf85edd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf8009c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42108/0 (socket says 172.21.15.84:42108) 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf85edd640 1 -- 172.21.15.84:0/67546859 learned_addr learned my addr 172.21.15.84:0/67546859 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf866de640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf80151cc0 0x7fdf80152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf856dc640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf8006beb0 0x7fdf8006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf85edd640 1 -- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf8006beb0 msgr2=0x7fdf8006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf85edd640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf8006beb0 0x7fdf8006c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf85edd640 1 -- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf80151cc0 msgr2=0x7fdf80152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:46.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf85edd640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf80151cc0 0x7fdf80152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:46.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf85edd640 1 -- 172.21.15.84:0/67546859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80099b30 con 0x7fdf6c004d00 2023-12-12T09:20:46.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.920+0000 7fdf866de640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf80151cc0 0x7fdf80152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.921+0000 7fdf85edd640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf8009c200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00c480 tx=0x7fdf7c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.921+0000 7fdf767fc640 1 -- 172.21.15.84:0/67546859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0052d0 con 0x7fdf6c004d00 2023-12-12T09:20:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.921+0000 7fdf767fc640 1 -- 172.21.15.84:0/67546859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c005430 con 0x7fdf6c004d00 2023-12-12T09:20:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.921+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf80099e10 con 0x7fdf6c004d00 2023-12-12T09:20:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.921+0000 7fdf767fc640 1 -- 172.21.15.84:0/67546859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c012870 con 0x7fdf6c004d00 2023-12-12T09:20:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.921+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8009a3d0 con 0x7fdf6c004d00 2023-12-12T09:20:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.922+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8009a590 con 0x7fdf6c004d00 2023-12-12T09:20:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.923+0000 7fdf767fc640 1 -- 172.21.15.84:0/67546859 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf7c0129d0 con 0x7fdf6c004d00 2023-12-12T09:20:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.924+0000 7fdf767fc640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf6406ae40 0x7fdf6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:46.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.925+0000 7fdf767fc640 1 -- 172.21.15.84:0/67546859 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdf7c0894b0 con 0x7fdf6c004d00 2023-12-12T09:20:46.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.925+0000 7fdf856dc640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf6406ae40 0x7fdf6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:46.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.925+0000 7fdf856dc640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf6406ae40 0x7fdf6406d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdf70001200 tx=0x7fdf70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:46.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:46.929+0000 7fdf767fc640 1 -- 172.21.15.84:0/67546859 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf7c054230 con 0x7fdf6c004d00 2023-12-12T09:20:47.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.114+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdf800673c0 con 0x7fdf6c004d00 2023-12-12T09:20:47.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.115+0000 7fdf767fc640 1 -- 172.21.15.84:0/67546859 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdf7c057850 con 0x7fdf6c004d00 2023-12-12T09:20:47.115 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:47.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf6406ae40 msgr2=0x7fdf6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:47.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf6406ae40 0x7fdf6406d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdf70001200 tx=0x7fdf70009040 comp rx=0 tx=0).stop 2023-12-12T09:20:47.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 msgr2=0x7fdf8009c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf8009c200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00c480 tx=0x7fdf7c00c940 comp rx=0 tx=0).stop 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 shutdown_connections 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf80151cc0 0x7fdf80152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdf8006beb0 0x7fdf8006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdf6406ae40 0x7fdf6406d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 --2- 172.21.15.84:0/67546859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdf6c004d00 0x7fdf8009c200 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 >> 172.21.15.84:0/67546859 conn(0x7fdf800b0900 msgr2=0x7fdf80153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 shutdown_connections 2023-12-12T09:20:47.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.117+0000 7fdf88141640 1 -- 172.21.15.84:0/67546859 wait complete. 2023-12-12T09:20:47.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-12-12T09:20:47.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.345+0000 7f668a036640 1 Processor -- start 2023-12-12T09:20:47.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.345+0000 7f668a036640 1 -- start start 2023-12-12T09:20:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.347+0000 7f668a036640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6684143d20 0x7f66840b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.347+0000 7f668a036640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66840ce550 0x7f66840b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.347+0000 7f668a036640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840cea30 con 0x7f66841447f0 2023-12-12T09:20:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.347+0000 7f668a036640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840702b0 con 0x7f6684143d20 2023-12-12T09:20:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.347+0000 7f668a036640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6684070590 con 0x7f66840ce550 2023-12-12T09:20:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.347+0000 7f66837fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6684143d20 0x7f66840b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:47.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.347+0000 7f6683fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f66841447f0 0x7f668415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44960/0 (socket says 172.21.15.84:44960) 2023-12-12T09:20:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.347+0000 7f6683fff640 1 -- 172.21.15.84:0/3370271663 learned_addr learned my addr 172.21.15.84:0/3370271663 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:47.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.348+0000 7f6682ffd640 1 --2- 172.21.15.84:0/3370271663 >> v2:172.21.15.99:3300/0 conn(0x7f66840ce550 0x7f66840b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.348+0000 7f66827fc640 1 -- 172.21.15.84:0/3370271663 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332432392 0 0) 0x7f66840cea30 con 0x7f66841447f0 2023-12-12T09:20:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.348+0000 7f66827fc640 1 -- 172.21.15.84:0/3370271663 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f666c003520 con 0x7f66841447f0 2023-12-12T09:20:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.348+0000 7f66837fe640 1 -- 172.21.15.84:0/3370271663 >> v2:172.21.15.99:3300/0 conn(0x7f66840ce550 msgr2=0x7f66840b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.348+0000 7f66837fe640 1 --2- 172.21.15.84:0/3370271663 >> v2:172.21.15.99:3300/0 conn(0x7f66840ce550 0x7f66840b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.348+0000 7f66837fe640 1 -- 172.21.15.84:0/3370271663 >> v1:172.21.15.84:6789/0 conn(0x7f66841447f0 legacy=0x7f668415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.348+0000 7f66837fe640 1 -- 172.21.15.84:0/3370271663 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6684070870 con 0x7f6684143d20 2023-12-12T09:20:47.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.349+0000 7f66837fe640 1 --2- 172.21.15.84:0/3370271663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840b40d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f668406be30 tx=0x7f667402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3b390e1553bb0a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.349+0000 7f66827fc640 1 -- 172.21.15.84:0/3370271663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674031830 con 0x7f6684143d20 2023-12-12T09:20:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.349+0000 7f66827fc640 1 -- 172.21.15.84:0/3370271663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674031990 con 0x7f6684143d20 2023-12-12T09:20:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.349+0000 7f66827fc640 1 -- 172.21.15.84:0/3370271663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674031d20 con 0x7f6684143d20 2023-12-12T09:20:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.350+0000 7f668a036640 1 -- 172.21.15.84:0/3370271663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 msgr2=0x7f66840b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:47.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.350+0000 7f668a036640 1 --2- 172.21.15.84:0/3370271663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840b40d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f668406be30 tx=0x7f667402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.350+0000 7f668a036640 1 -- 172.21.15.84:0/3370271663 shutdown_connections 2023-12-12T09:20:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.350+0000 7f668a036640 1 --2- 172.21.15.84:0/3370271663 >> v2:172.21.15.99:3300/0 conn(0x7f66840ce550 0x7f66840b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.350+0000 7f668a036640 1 --2- 172.21.15.84:0/3370271663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840b40d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.350+0000 7f668a036640 1 -- 172.21.15.84:0/3370271663 >> 172.21.15.84:0/3370271663 conn(0x7f668406c3d0 msgr2=0x7f668406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.350+0000 7f668a036640 1 -- 172.21.15.84:0/3370271663 shutdown_connections 2023-12-12T09:20:47.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.350+0000 7f668a036640 1 -- 172.21.15.84:0/3370271663 wait complete. 2023-12-12T09:20:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.352+0000 7f668a036640 1 Processor -- start 2023-12-12T09:20:47.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.352+0000 7f668a036640 1 -- start start 2023-12-12T09:20:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f668a036640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66840ce550 0x7f66840c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f668a036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f668a036640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66841447f0 0x7f668413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f668a036640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840cd370 con 0x7f6684143d20 2023-12-12T09:20:47.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f668a036640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668413df00 con 0x7f66840ce550 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f668a036640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c4c80 con 0x7f66841447f0 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f6682ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f6682ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42118/0 (socket says 172.21.15.84:42118) 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f6682ffd640 1 -- 172.21.15.84:0/1109536489 learned_addr learned my addr 172.21.15.84:0/1109536489 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f6682ffd640 1 -- 172.21.15.84:0/1109536489 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66841447f0 msgr2=0x7f668413af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f6682ffd640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66841447f0 0x7f668413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f6682ffd640 1 -- 172.21.15.84:0/1109536489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66840ce550 msgr2=0x7f66840c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f6682ffd640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66840ce550 0x7f66840c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:47.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.353+0000 7f6682ffd640 1 -- 172.21.15.84:0/1109536489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674009400 con 0x7f6684143d20 2023-12-12T09:20:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.354+0000 7f6682ffd640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840c4740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f667800d800 tx=0x7f667800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.354+0000 7f666bfff640 1 -- 172.21.15.84:0/1109536489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800b6c0 con 0x7f6684143d20 2023-12-12T09:20:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.354+0000 7f666bfff640 1 -- 172.21.15.84:0/1109536489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667800b820 con 0x7f6684143d20 2023-12-12T09:20:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.354+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668413a6a0 con 0x7f6684143d20 2023-12-12T09:20:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.354+0000 7f666bfff640 1 -- 172.21.15.84:0/1109536489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800bbb0 con 0x7f6684143d20 2023-12-12T09:20:47.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.354+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668413aa30 con 0x7f6684143d20 2023-12-12T09:20:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.355+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66840673c0 con 0x7f6684143d20 2023-12-12T09:20:47.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.356+0000 7f666bfff640 1 -- 172.21.15.84:0/1109536489 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f667800bd10 con 0x7f6684143d20 2023-12-12T09:20:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.357+0000 7f666bfff640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f667006ae40 0x7f667006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.357+0000 7f666bfff640 1 -- 172.21.15.84:0/1109536489 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6678089fb0 con 0x7f6684143d20 2023-12-12T09:20:47.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.357+0000 7f66837fe640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f667006ae40 0x7f667006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:47.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.358+0000 7f66837fe640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f667006ae40 0x7f667006d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6674036000 tx=0x7f6674030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:47.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.361+0000 7f666bfff640 1 -- 172.21.15.84:0/1109536489 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6678054c00 con 0x7f6684143d20 2023-12-12T09:20:47.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:47.602+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f668406e3b0 con 0x7f6684143d20 2023-12-12T09:20:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.242+0000 7f666bfff640 1 -- 172.21.15.84:0/1109536489 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v79) v1 ==== 150+0+0 (secure 0 0 0) 0x7f6678058220 con 0x7f6684143d20 2023-12-12T09:20:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f667006ae40 msgr2=0x7f667006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f667006ae40 0x7f667006d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6674036000 tx=0x7f6674030000 comp rx=0 tx=0).stop 2023-12-12T09:20:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 msgr2=0x7f66840c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840c4740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f667800d800 tx=0x7f667800dcc0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 shutdown_connections 2023-12-12T09:20:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66841447f0 0x7f668413af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f667006ae40 0x7f667006d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6684143d20 0x7f66840c4740 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 --2- 172.21.15.84:0/1109536489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66840ce550 0x7f66840c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 >> 172.21.15.84:0/1109536489 conn(0x7f668406c3d0 msgr2=0x7f66840ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:48.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 shutdown_connections 2023-12-12T09:20:48.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.246+0000 7f668a036640 1 -- 172.21.15.84:0/1109536489 wait complete. 2023-12-12T09:20:48.266 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-12T09:20:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.475+0000 7fe007e4f640 1 Processor -- start 2023-12-12T09:20:48.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.475+0000 7fe007e4f640 1 -- start start 2023-12-12T09:20:48.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.477+0000 7fe007e4f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0000b40d0 0x7fe00006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.477+0000 7fe007e4f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe0000ce6f0 0x7fe0000b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.477+0000 7fe007e4f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000ceb80 con 0x7fe00015be60 2023-12-12T09:20:48.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.477+0000 7fe007e4f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000ce260 con 0x7fe0000ce6f0 2023-12-12T09:20:48.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.477+0000 7fe007e4f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000b49f0 con 0x7fe0000b40d0 2023-12-12T09:20:48.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.477+0000 7fe0063ec640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe00015be60 0x7fe00013e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44968/0 (socket says 172.21.15.84:44968) 2023-12-12T09:20:48.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.477+0000 7fe0063ec640 1 -- 172.21.15.84:0/316422919 learned_addr learned my addr 172.21.15.84:0/316422919 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:48.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe0053ea640 1 --2- 172.21.15.84:0/316422919 >> v2:172.21.15.99:3300/0 conn(0x7fe0000ce6f0 0x7fe0000b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:48.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe005beb640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0000b40d0 0x7fe00006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490775237 0 0) 0x7fe0000ceb80 con 0x7fe00015be60 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfec003520 con 0x7fe00015be60 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3125355916 0 0) 0x7fdfec003520 con 0x7fe00015be60 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0000b40d0 msgr2=0x7fe00006dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0000b40d0 0x7fe00006dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 >> v2:172.21.15.99:3300/0 conn(0x7fe0000ce6f0 msgr2=0x7fe0000b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 --2- 172.21.15.84:0/316422919 >> v2:172.21.15.99:3300/0 conn(0x7fe0000ce6f0 0x7fe0000b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000cd930 con 0x7fe00015be60 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fdff80019f0 con 0x7fe00015be60 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 >> v1:172.21.15.84:6789/0 conn(0x7fe00015be60 legacy=0x7fe00013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfec003970 0x7fdfec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0000b40d0 0x7fdfec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfec004d00 0x7fdfec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000ce260 con 0x7fdfec004d00 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000b49f0 con 0x7fdfec003970 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.478+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec00b980 con 0x7fe0000b40d0 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.479+0000 7fe0063ec640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfec004d00 0x7fdfec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.479+0000 7fe0053ea640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0000b40d0 0x7fdfec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.479+0000 7fe0063ec640 1 -- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0000b40d0 msgr2=0x7fdfec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.479+0000 7fe0063ec640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe0000b40d0 0x7fdfec0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.479+0000 7fe0063ec640 1 -- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfec003970 msgr2=0x7fdfec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.479+0000 7fe0063ec640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfec003970 0x7fdfec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.479+0000 7fe0063ec640 1 -- 172.21.15.84:0/316422919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec003520 con 0x7fdfec004d00 2023-12-12T09:20:48.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.480+0000 7fe0063ec640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfec004d00 0x7fdfec005180 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdff800a8d0 tx=0x7fdfec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfeb918d05964d75 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:48.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.480+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8034630 con 0x7fdfec004d00 2023-12-12T09:20:48.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.480+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff802f070 con 0x7fdfec004d00 2023-12-12T09:20:48.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.480+0000 7fe004be9640 1 -- 172.21.15.84:0/316422919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff80349d0 con 0x7fdfec004d00 2023-12-12T09:20:48.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.481+0000 7fe007e4f640 1 -- 172.21.15.84:0/316422919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfec004d00 msgr2=0x7fdfec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:48.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.481+0000 7fe007e4f640 1 --2- 172.21.15.84:0/316422919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdfec004d00 0x7fdfec005180 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdff800a8d0 tx=0x7fdfec0057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.481+0000 7fe0063ec640 1 -- 172.21.15.84:0/316422919 reap_dead start 2023-12-12T09:20:48.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.481+0000 7fe007e4f640 1 -- 172.21.15.84:0/316422919 shutdown_connections 2023-12-12T09:20:48.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.481+0000 7fe007e4f640 1 -- 172.21.15.84:0/316422919 >> 172.21.15.84:0/316422919 conn(0x7fe0000b0ac0 msgr2=0x7fe0000b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:48.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.481+0000 7fe007e4f640 1 -- 172.21.15.84:0/316422919 shutdown_connections 2023-12-12T09:20:48.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.481+0000 7fe007e4f640 1 -- 172.21.15.84:0/316422919 wait complete. 2023-12-12T09:20:48.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.483+0000 7fe007e4f640 1 Processor -- start 2023-12-12T09:20:48.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.483+0000 7fe007e4f640 1 -- start start 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe007e4f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0001f21a0 0x7fe0000b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe007e4f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0001f2580 0x7fe000140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe007e4f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe000140eb0 0x7fe0001f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe007e4f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe000141330 con 0x7fe0001f2580 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe007e4f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000b2db0 con 0x7fe0001f21a0 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe007e4f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000ae1f0 con 0x7fe000140eb0 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe0053ea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0001f2580 0x7fe000140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe0053ea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0001f2580 0x7fe000140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42138/0 (socket says 172.21.15.84:42138) 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.484+0000 7fe0053ea640 1 -- 172.21.15.84:0/273280111 learned_addr learned my addr 172.21.15.84:0/273280111 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe005beb640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0001f21a0 0x7fe0000b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe0063ec640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe000140eb0 0x7fe0001f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe0053ea640 1 -- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe000140eb0 msgr2=0x7fe0001f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe0053ea640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe000140eb0 0x7fe0001f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe0053ea640 1 -- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0001f21a0 msgr2=0x7fe0000b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe0053ea640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0001f21a0 0x7fe0000b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe0053ea640 1 -- 172.21.15.84:0/273280111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000b2fd0 con 0x7fe0001f2580 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe005beb640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0001f21a0 0x7fe0000b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe0053ea640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0001f2580 0x7fe000140970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdff0010910 tx=0x7fdff0010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fdff67fc640 1 -- 172.21.15.84:0/273280111 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0009690 con 0x7fe0001f2580 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fdff67fc640 1 -- 172.21.15.84:0/273280111 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff000ec20 con 0x7fe0001f2580 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0000b32b0 con 0x7fe0001f2580 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.485+0000 7fdff67fc640 1 -- 172.21.15.84:0/273280111 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff001c400 con 0x7fe0001f2580 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.486+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000b3870 con 0x7fe0001f2580 2023-12-12T09:20:48.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.486+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0000673c0 con 0x7fe0001f2580 2023-12-12T09:20:48.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.488+0000 7fdff67fc640 1 -- 172.21.15.84:0/273280111 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdff001c560 con 0x7fe0001f2580 2023-12-12T09:20:48.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.489+0000 7fdff67fc640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdfe406ae40 0x7fdfe406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:48.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.489+0000 7fdff67fc640 1 -- 172.21.15.84:0/273280111 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdff008a000 con 0x7fe0001f2580 2023-12-12T09:20:48.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.489+0000 7fe005beb640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdfe406ae40 0x7fdfe406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:48.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.489+0000 7fe005beb640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdfe406ae40 0x7fdfe406d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0099c0 tx=0x7fdffc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:48.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.493+0000 7fdff67fc640 1 -- 172.21.15.84:0/273280111 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdff0054da0 con 0x7fe0001f2580 2023-12-12T09:20:48.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.683+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe00006b510 con 0x7fe0001f2580 2023-12-12T09:20:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.688+0000 7fdff67fc640 1 -- 172.21.15.84:0/273280111 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdff00583c0 con 0x7fe0001f2580 2023-12-12T09:20:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdfe406ae40 msgr2=0x7fdfe406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:48.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdfe406ae40 0x7fdfe406d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0099c0 tx=0x7fdffc008040 comp rx=0 tx=0).stop 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0001f2580 msgr2=0x7fe000140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0001f2580 0x7fe000140970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdff0010910 tx=0x7fdff0010dd0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 shutdown_connections 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe000140eb0 0x7fe0001f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdfe406ae40 0x7fdfe406d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0001f2580 0x7fe000140970 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 --2- 172.21.15.84:0/273280111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0001f21a0 0x7fe0000b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 >> 172.21.15.84:0/273280111 conn(0x7fe0000b0ac0 msgr2=0x7fe0000b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 shutdown_connections 2023-12-12T09:20:48.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:48.691+0000 7fe007e4f640 1 -- 172.21.15.84:0/273280111 wait complete. 2023-12-12T09:20:48.709 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:20:48.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:20:48.824 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:20:48.951 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:20:48.951 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:20:48.951 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:20:49.010 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:20:49.010 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:20:49.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:49.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.272+0000 7fe355fa9640 1 Processor -- start 2023-12-12T09:20:49.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.272+0000 7fe355fa9640 1 -- start start 2023-12-12T09:20:49.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.273+0000 7fe355fa9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe350143d20 0x7fe3500b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.273+0000 7fe355fa9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe3500ce550 0x7fe3500b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.273+0000 7fe355fa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3501447f0 0x7fe35015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.273+0000 7fe355fa9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3500cea30 con 0x7fe350143d20 2023-12-12T09:20:49.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.273+0000 7fe355fa9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3500702b0 con 0x7fe3500ce550 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.273+0000 7fe355fa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe350070590 con 0x7fe3501447f0 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.274+0000 7fe34f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe350143d20 0x7fe3500b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.274+0000 7fe34f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe350143d20 0x7fe3500b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42148/0 (socket says 172.21.15.84:42148) 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.274+0000 7fe34f7fe640 1 -- 172.21.15.84:0/2789281777 learned_addr learned my addr 172.21.15.84:0/2789281777 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.274+0000 7fe34f7fe640 1 -- 172.21.15.84:0/2789281777 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3501447f0 msgr2=0x7fe35015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.274+0000 7fe34f7fe640 1 --2- 172.21.15.84:0/2789281777 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3501447f0 0x7fe35015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.274+0000 7fe34f7fe640 1 -- 172.21.15.84:0/2789281777 >> v2:172.21.15.99:3300/0 conn(0x7fe3500ce550 msgr2=0x7fe3500b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.274+0000 7fe34f7fe640 1 --2- 172.21.15.84:0/2789281777 >> v2:172.21.15.99:3300/0 conn(0x7fe3500ce550 0x7fe3500b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.274+0000 7fe34f7fe640 1 -- 172.21.15.84:0/2789281777 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe350070870 con 0x7fe350143d20 2023-12-12T09:20:49.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.275+0000 7fe34f7fe640 1 --2- 172.21.15.84:0/2789281777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe350143d20 0x7fe3500b40d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe35006be30 tx=0x7fe34002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d47200efc12903 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:49.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.275+0000 7fe34effd640 1 -- 172.21.15.84:0/2789281777 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340031870 con 0x7fe350143d20 2023-12-12T09:20:49.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe34effd640 1 -- 172.21.15.84:0/2789281777 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3400319d0 con 0x7fe350143d20 2023-12-12T09:20:49.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe34effd640 1 -- 172.21.15.84:0/2789281777 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340031d60 con 0x7fe350143d20 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 -- 172.21.15.84:0/2789281777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe350143d20 msgr2=0x7fe3500b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 --2- 172.21.15.84:0/2789281777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe350143d20 0x7fe3500b40d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe35006be30 tx=0x7fe34002b910 comp rx=0 tx=0).stop 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 -- 172.21.15.84:0/2789281777 shutdown_connections 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 --2- 172.21.15.84:0/2789281777 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3501447f0 0x7fe35015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 --2- 172.21.15.84:0/2789281777 >> v2:172.21.15.99:3300/0 conn(0x7fe3500ce550 0x7fe3500b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 --2- 172.21.15.84:0/2789281777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe350143d20 0x7fe3500b40d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 -- 172.21.15.84:0/2789281777 >> 172.21.15.84:0/2789281777 conn(0x7fe35006c3d0 msgr2=0x7fe35006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 -- 172.21.15.84:0/2789281777 shutdown_connections 2023-12-12T09:20:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.276+0000 7fe355fa9640 1 -- 172.21.15.84:0/2789281777 wait complete. 2023-12-12T09:20:49.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.278+0000 7fe355fa9640 1 Processor -- start 2023-12-12T09:20:49.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.278+0000 7fe355fa9640 1 -- start start 2023-12-12T09:20:49.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.279+0000 7fe355fa9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3500ce550 0x7fe3500cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.279+0000 7fe355fa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe350143d20 0x7fe3500c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.279+0000 7fe355fa9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3501447f0 0x7fe3501f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.279+0000 7fe355fa9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3501411a0 con 0x7fe3501447f0 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.279+0000 7fe355fa9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500cced0 con 0x7fe3500ce550 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.279+0000 7fe355fa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500c5960 con 0x7fe350143d20 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3501447f0 0x7fe3501f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3501447f0 0x7fe3501f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42150/0 (socket says 172.21.15.84:42150) 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 -- 172.21.15.84:0/3298543168 learned_addr learned my addr 172.21.15.84:0/3298543168 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe347fff640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe350143d20 0x7fe3500c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34f7fe640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3500ce550 0x7fe3500cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 -- 172.21.15.84:0/3298543168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe350143d20 msgr2=0x7fe3500c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe350143d20 0x7fe3500c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 -- 172.21.15.84:0/3298543168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3500ce550 msgr2=0x7fe3500cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3500ce550 0x7fe3500cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 -- 172.21.15.84:0/3298543168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3400094d0 con 0x7fe3501447f0 2023-12-12T09:20:49.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.280+0000 7fe34ffff640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3501447f0 0x7fe3501f3240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe34800b9e0 tx=0x7fe34800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.281+0000 7fe34cff9640 1 -- 172.21.15.84:0/3298543168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800cb20 con 0x7fe3501447f0 2023-12-12T09:20:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.281+0000 7fe34cff9640 1 -- 172.21.15.84:0/3298543168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800cca0 con 0x7fe3501447f0 2023-12-12T09:20:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.281+0000 7fe34cff9640 1 -- 172.21.15.84:0/3298543168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348014680 con 0x7fe3501447f0 2023-12-12T09:20:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.281+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3501413f0 con 0x7fe3501447f0 2023-12-12T09:20:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.281+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3501419b0 con 0x7fe3501447f0 2023-12-12T09:20:49.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.282+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3500673c0 con 0x7fe3501447f0 2023-12-12T09:20:49.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.283+0000 7fe34cff9640 1 -- 172.21.15.84:0/3298543168 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe34801d3b0 con 0x7fe3501447f0 2023-12-12T09:20:49.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.284+0000 7fe34cff9640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe33006ae70 0x7fe33006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.284+0000 7fe34cff9640 1 -- 172.21.15.84:0/3298543168 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe348089820 con 0x7fe3501447f0 2023-12-12T09:20:49.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.284+0000 7fe34f7fe640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe33006ae70 0x7fe33006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.285+0000 7fe34f7fe640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe33006ae70 0x7fe33006d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe340036000 tx=0x7fe34003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:49.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.288+0000 7fe34cff9640 1 -- 172.21.15.84:0/3298543168 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3480545a0 con 0x7fe3501447f0 2023-12-12T09:20:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.480+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe35006e3b0 con 0x7fe3501447f0 2023-12-12T09:20:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.483+0000 7fe34cff9640 1 -- 172.21.15.84:0/3298543168 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7fe348019090 con 0x7fe3501447f0 2023-12-12T09:20:49.484 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:49.484 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe33006ae70 msgr2=0x7fe33006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe33006ae70 0x7fe33006d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe340036000 tx=0x7fe34003c040 comp rx=0 tx=0).stop 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3501447f0 msgr2=0x7fe3501f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3501447f0 0x7fe3501f3240 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe34800b9e0 tx=0x7fe34800bea0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 shutdown_connections 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe33006ae70 0x7fe33006d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3501447f0 0x7fe3501f3240 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe350143d20 0x7fe3500c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 --2- 172.21.15.84:0/3298543168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3500ce550 0x7fe3500cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 >> 172.21.15.84:0/3298543168 conn(0x7fe35006c3d0 msgr2=0x7fe35013e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 shutdown_connections 2023-12-12T09:20:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.486+0000 7fe355fa9640 1 -- 172.21.15.84:0/3298543168 wait complete. 2023-12-12T09:20:49.506 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:49.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:49.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.724+0000 7f712be1e640 1 Processor -- start 2023-12-12T09:20:49.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.725+0000 7f712be1e640 1 -- start start 2023-12-12T09:20:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.726+0000 7f712be1e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f712409a130 0x7f71240b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.726+0000 7f712be1e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71240cbb10 con 0x7f71240cfbc0 2023-12-12T09:20:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.726+0000 7f712be1e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71240d00c0 con 0x7f712415d460 2023-12-12T09:20:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.726+0000 7f712be1e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71240d03a0 con 0x7f712409a130 2023-12-12T09:20:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f712a3bb640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f71240cfbc0 0x7f71240cbfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44976/0 (socket says 172.21.15.84:44976) 2023-12-12T09:20:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f712a3bb640 1 -- 172.21.15.84:0/1224403555 learned_addr learned my addr 172.21.15.84:0/1224403555 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f71293b9640 1 --2- 172.21.15.84:0/1224403555 >> v2:172.21.15.99:3300/0 conn(0x7f712409a130 0x7f71240b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782014470 0 0) 0x7f71240cbb10 con 0x7f71240cfbc0 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7114003520 con 0x7f71240cfbc0 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2379915083 0 0) 0x7f7114003520 con 0x7f71240cfbc0 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 >> v2:172.21.15.99:3300/0 conn(0x7f712409a130 msgr2=0x7f71240b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f7128bb8640 1 --2- 172.21.15.84:0/1224403555 >> v2:172.21.15.99:3300/0 conn(0x7f712409a130 0x7f71240b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.727+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 >> v1:172.21.15.99:6789/0 conn(0x7f712415d460 legacy=0x7f7124099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240cb4c0 con 0x7f71240cfbc0 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f711c001670 con 0x7f71240cfbc0 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 >> v1:172.21.15.84:6789/0 conn(0x7f71240cfbc0 legacy=0x7f71240cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7114003970 0x7f7114003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71140047c0 0x7f7114004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7114005180 0x7f711400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240d03a0 con 0x7f7114003970 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711400c030 con 0x7f71140047c0 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711400c1f0 con 0x7f7114005180 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7129bba640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7114003970 0x7f7114003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f71293b9640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71140047c0 0x7f7114004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7129bba640 1 -- 172.21.15.84:0/1224403555 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7114005180 msgr2=0x7f711400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7129bba640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7114005180 0x7f711400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7129bba640 1 -- 172.21.15.84:0/1224403555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71140047c0 msgr2=0x7f7114004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.728+0000 7f7129bba640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71140047c0 0x7f7114004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.729+0000 7f7129bba640 1 -- 172.21.15.84:0/1224403555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114003520 con 0x7f7114003970 2023-12-12T09:20:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.729+0000 7f712a3bb640 1 -- 172.21.15.84:0/1224403555 reap_dead start 2023-12-12T09:20:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.730+0000 7f7129bba640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7114003970 0x7f7114003d90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7118001e50 tx=0x7f71140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57ad485b0457c9d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.730+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118003b70 con 0x7f7114003970 2023-12-12T09:20:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.730+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7118003cd0 con 0x7f7114003970 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.730+0000 7f7128bb8640 1 -- 172.21.15.84:0/1224403555 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118005310 con 0x7f7114003970 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.730+0000 7f712be1e640 1 -- 172.21.15.84:0/1224403555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7114003970 msgr2=0x7f7114003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.730+0000 7f712be1e640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7114003970 0x7f7114003d90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7118001e50 tx=0x7f71140057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.731+0000 7f712be1e640 1 -- 172.21.15.84:0/1224403555 shutdown_connections 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.731+0000 7f712be1e640 1 --2- 172.21.15.84:0/1224403555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7114003970 0x7f7114003d90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.731+0000 7f712be1e640 1 -- 172.21.15.84:0/1224403555 >> 172.21.15.84:0/1224403555 conn(0x7f71240b2960 msgr2=0x7f71240b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.731+0000 7f712be1e640 1 -- 172.21.15.84:0/1224403555 shutdown_connections 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.731+0000 7f712be1e640 1 -- 172.21.15.84:0/1224403555 wait complete. 2023-12-12T09:20:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.732+0000 7f712be1e640 1 Processor -- start 2023-12-12T09:20:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.733+0000 7f712be1e640 1 -- start start 2023-12-12T09:20:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712be1e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7114003970 0x7f712415ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712be1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7124157570 0x7f71240b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712be1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f712415f830 0x7f712415fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712be1e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240b5840 con 0x7f712415f830 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712be1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7124160220 con 0x7f7124157570 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712be1e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71240b5c60 con 0x7f7114003970 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712a3bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f712415f830 0x7f712415fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712a3bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f712415f830 0x7f712415fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42164/0 (socket says 172.21.15.84:42164) 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712a3bb640 1 -- 172.21.15.84:0/1824609265 learned_addr learned my addr 172.21.15.84:0/1824609265 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f71293b9640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7124157570 0x7f71240b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f7129bba640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7114003970 0x7f712415ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712a3bb640 1 -- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7114003970 msgr2=0x7f712415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712a3bb640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7114003970 0x7f712415ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712a3bb640 1 -- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7124157570 msgr2=0x7f71240b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712a3bb640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7124157570 0x7f71240b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f712a3bb640 1 -- 172.21.15.84:0/1824609265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240b4bc0 con 0x7f712415f830 2023-12-12T09:20:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.734+0000 7f71293b9640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7124157570 0x7f71240b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.735+0000 7f712a3bb640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f712415f830 0x7f712415fce0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71240b6ef0 tx=0x7f711c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.735+0000 7f71227fc640 1 -- 172.21.15.84:0/1824609265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0074e0 con 0x7f712415f830 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.735+0000 7f71227fc640 1 -- 172.21.15.84:0/1824609265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c007640 con 0x7f712415f830 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.735+0000 7f71227fc640 1 -- 172.21.15.84:0/1824609265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c004a20 con 0x7f712415f830 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.735+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71240b4ea0 con 0x7f712415f830 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.735+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71240b5460 con 0x7f712415f830 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.736+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71240b5980 con 0x7f712415f830 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.737+0000 7f71227fc640 1 -- 172.21.15.84:0/1824609265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f711c004b80 con 0x7f712415f830 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.738+0000 7f71227fc640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f710806ae40 0x7f710806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.738+0000 7f71227fc640 1 -- 172.21.15.84:0/1824609265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f711c088ff0 con 0x7f712415f830 2023-12-12T09:20:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.738+0000 7f7129bba640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f710806ae40 0x7f710806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.739+0000 7f7129bba640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f710806ae40 0x7f710806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7118034000 tx=0x7f7118009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:49.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.743+0000 7f71227fc640 1 -- 172.21.15.84:0/1824609265 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71240b5980 con 0x7f712415f830 2023-12-12T09:20:49.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.930+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71240b5980 con 0x7f712415f830 2023-12-12T09:20:49.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.931+0000 7f71227fc640 1 -- 172.21.15.84:0/1824609265 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71240b5980 con 0x7f712415f830 2023-12-12T09:20:49.931 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f710806ae40 msgr2=0x7f710806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f710806ae40 0x7f710806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7118034000 tx=0x7f7118009030 comp rx=0 tx=0).stop 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f712415f830 msgr2=0x7f712415fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f712415f830 0x7f712415fce0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f71240b6ef0 tx=0x7f711c00c8e0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 shutdown_connections 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f710806ae40 0x7f710806d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f712415f830 0x7f712415fce0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7124157570 0x7f71240b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 --2- 172.21.15.84:0/1824609265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7114003970 0x7f712415ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.934+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 >> 172.21.15.84:0/1824609265 conn(0x7f71240b2960 msgr2=0x7f71240cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:49.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.935+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 shutdown_connections 2023-12-12T09:20:49.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:49.935+0000 7f712be1e640 1 -- 172.21.15.84:0/1824609265 wait complete. 2023-12-12T09:20:49.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.172+0000 7fba79a1e640 1 Processor -- start 2023-12-12T09:20:50.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.172+0000 7fba79a1e640 1 -- start start 2023-12-12T09:20:50.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.174+0000 7fba79a1e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba74070130 0x7fba74070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.174+0000 7fba79a1e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba74070f30 0x7fba740713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.174+0000 7fba79a1e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba74070ad0 con 0x7fba740ad610 2023-12-12T09:20:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.174+0000 7fba79a1e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba740b3c40 con 0x7fba74070f30 2023-12-12T09:20:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.174+0000 7fba79a1e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba740b2fc0 con 0x7fba74070130 2023-12-12T09:20:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.174+0000 7fba737fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba74070f30 0x7fba740713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.174+0000 7fba737fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba74070f30 0x7fba740713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42168/0 (socket says 172.21.15.84:42168) 2023-12-12T09:20:50.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.174+0000 7fba737fe640 1 -- 172.21.15.84:0/4017284724 learned_addr learned my addr 172.21.15.84:0/4017284724 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.175+0000 7fba727fc640 1 --2- 172.21.15.84:0/4017284724 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba74070130 0x7fba74070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.175+0000 7fba737fe640 1 -- 172.21.15.84:0/4017284724 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba74070130 msgr2=0x7fba74070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.175+0000 7fba737fe640 1 --2- 172.21.15.84:0/4017284724 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba74070130 0x7fba74070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.175+0000 7fba737fe640 1 -- 172.21.15.84:0/4017284724 >> v1:172.21.15.99:6789/0 conn(0x7fba740ad610 legacy=0x7fba740ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.175+0000 7fba737fe640 1 -- 172.21.15.84:0/4017284724 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740b32a0 con 0x7fba74070f30 2023-12-12T09:20:50.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.176+0000 7fba737fe640 1 --2- 172.21.15.84:0/4017284724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba740713a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009e50 tx=0x7fba6c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379651a5fd3c484d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba71ffb640 1 -- 172.21.15.84:0/4017284724 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c02ca80 con 0x7fba74070f30 2023-12-12T09:20:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba71ffb640 1 -- 172.21.15.84:0/4017284724 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c02cbe0 con 0x7fba74070f30 2023-12-12T09:20:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba71ffb640 1 -- 172.21.15.84:0/4017284724 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c0343f0 con 0x7fba74070f30 2023-12-12T09:20:50.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba79a1e640 1 -- 172.21.15.84:0/4017284724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 msgr2=0x7fba740713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba79a1e640 1 --2- 172.21.15.84:0/4017284724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba740713a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009e50 tx=0x7fba6c02bee0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba79a1e640 1 -- 172.21.15.84:0/4017284724 shutdown_connections 2023-12-12T09:20:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba79a1e640 1 --2- 172.21.15.84:0/4017284724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba740713a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba79a1e640 1 --2- 172.21.15.84:0/4017284724 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba74070130 0x7fba74070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba79a1e640 1 -- 172.21.15.84:0/4017284724 >> 172.21.15.84:0/4017284724 conn(0x7fba740b0900 msgr2=0x7fba740b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba79a1e640 1 -- 172.21.15.84:0/4017284724 shutdown_connections 2023-12-12T09:20:50.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.177+0000 7fba79a1e640 1 -- 172.21.15.84:0/4017284724 wait complete. 2023-12-12T09:20:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.179+0000 7fba79a1e640 1 Processor -- start 2023-12-12T09:20:50.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.179+0000 7fba79a1e640 1 -- start start 2023-12-12T09:20:50.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.180+0000 7fba79a1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba74070130 0x7fba74157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.180+0000 7fba79a1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba74155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.180+0000 7fba79a1e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba740ad610 0x7fba74143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.180+0000 7fba79a1e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba74156f80 con 0x7fba74070f30 2023-12-12T09:20:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.180+0000 7fba79a1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba74156370 con 0x7fba74070130 2023-12-12T09:20:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.180+0000 7fba79a1e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba74156650 con 0x7fba740ad610 2023-12-12T09:20:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.180+0000 7fba727fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba74155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba727fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba74155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42178/0 (socket says 172.21.15.84:42178) 2023-12-12T09:20:50.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba727fc640 1 -- 172.21.15.84:0/2539104253 learned_addr learned my addr 172.21.15.84:0/2539104253 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba727fc640 1 -- 172.21.15.84:0/2539104253 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba740ad610 msgr2=0x7fba74143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba72ffd640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba74070130 0x7fba74157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba727fc640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba740ad610 0x7fba74143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba727fc640 1 -- 172.21.15.84:0/2539104253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba74070130 msgr2=0x7fba74157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba727fc640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba74070130 0x7fba74157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba727fc640 1 -- 172.21.15.84:0/2539104253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c009b30 con 0x7fba74070f30 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.181+0000 7fba727fc640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba74155a90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fba6800d5f0 tx=0x7fba6800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.182+0000 7fba5bfff640 1 -- 172.21.15.84:0/2539104253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680125f0 con 0x7fba74070f30 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.182+0000 7fba5bfff640 1 -- 172.21.15.84:0/2539104253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68012750 con 0x7fba74070f30 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.182+0000 7fba5bfff640 1 -- 172.21.15.84:0/2539104253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba68012b00 con 0x7fba74070f30 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.182+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba74156930 con 0x7fba74070f30 2023-12-12T09:20:50.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.182+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba74157950 con 0x7fba74070f30 2023-12-12T09:20:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.183+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba740673c0 con 0x7fba74070f30 2023-12-12T09:20:50.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.184+0000 7fba5bfff640 1 -- 172.21.15.84:0/2539104253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba68012c60 con 0x7fba74070f30 2023-12-12T09:20:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.185+0000 7fba5bfff640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba6006ae40 0x7fba6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.185+0000 7fba5bfff640 1 -- 172.21.15.84:0/2539104253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fba68089e70 con 0x7fba74070f30 2023-12-12T09:20:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.186+0000 7fba72ffd640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba6006ae40 0x7fba6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.187+0000 7fba72ffd640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba6006ae40 0x7fba6006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fba64000f60 tx=0x7fba64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:50.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.190+0000 7fba5bfff640 1 -- 172.21.15.84:0/2539104253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba68054b60 con 0x7fba74070f30 2023-12-12T09:20:50.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.381+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba7415d4f0 con 0x7fba74070f30 2023-12-12T09:20:50.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.382+0000 7fba5bfff640 1 -- 172.21.15.84:0/2539104253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba68058180 con 0x7fba74070f30 2023-12-12T09:20:50.382 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba6006ae40 msgr2=0x7fba6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba6006ae40 0x7fba6006d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fba64000f60 tx=0x7fba64009040 comp rx=0 tx=0).stop 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 msgr2=0x7fba74155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba74155a90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fba6800d5f0 tx=0x7fba6800dab0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 shutdown_connections 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fba740ad610 0x7fba74143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fba6006ae40 0x7fba6006d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba74070f30 0x7fba74155a90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 --2- 172.21.15.84:0/2539104253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba74070130 0x7fba74157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 >> 172.21.15.84:0/2539104253 conn(0x7fba740b0900 msgr2=0x7fba7406cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:50.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.384+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 shutdown_connections 2023-12-12T09:20:50.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.385+0000 7fba79a1e640 1 -- 172.21.15.84:0/2539104253 wait complete. 2023-12-12T09:20:50.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:50.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.605+0000 7f01e9e15640 1 Processor -- start 2023-12-12T09:20:50.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.606+0000 7f01e9e15640 1 -- start start 2023-12-12T09:20:50.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.607+0000 7f01e9e15640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 0x7f01e40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.607+0000 7f01e9e15640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e40cbb10 con 0x7f01e415d460 2023-12-12T09:20:50.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.607+0000 7f01e9e15640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e40d00c0 con 0x7f01e40cfbc0 2023-12-12T09:20:50.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.607+0000 7f01e9e15640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40d03a0 con 0x7f01e409a130 2023-12-12T09:20:50.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.607+0000 7f01e37fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01e415d460 0x7f01e4099a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44986/0 (socket says 172.21.15.84:44986) 2023-12-12T09:20:50.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e37fe640 1 -- 172.21.15.84:0/1302448795 learned_addr learned my addr 172.21.15.84:0/1302448795 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:50.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68076193 0 0) 0x7f01e40cbb10 con 0x7f01e415d460 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e2ffd640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 0x7f01e40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d0003520 con 0x7f01e415d460 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1575934407 0 0) 0x7f01d0003520 con 0x7f01e415d460 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 msgr2=0x7f01e40b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 0x7f01e40b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 >> v1:172.21.15.99:6789/0 conn(0x7f01e40cfbc0 legacy=0x7f01e40cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e40cb4c0 con 0x7f01e415d460 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f01cc001670 con 0x7f01e415d460 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 >> v1:172.21.15.84:6789/0 conn(0x7f01e415d460 legacy=0x7f01e4099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.608+0000 7f01e27fc640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d00039a0 0x7f01d0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e27fc640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01d00047c0 0x7f01d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e27fc640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 0x7f01d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40d03a0 con 0x7f01d00039a0 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d000bb40 con 0x7f01d00047c0 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d000bd00 con 0x7f01e409a130 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e37fe640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d00039a0 0x7f01d0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e2ffd640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01d00047c0 0x7f01d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e37fe640 1 -- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 msgr2=0x7f01d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e3fff640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 0x7f01d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e37fe640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 0x7f01d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e37fe640 1 -- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01d00047c0 msgr2=0x7f01d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e37fe640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01d00047c0 0x7f01d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e37fe640 1 -- 172.21.15.84:0/1302448795 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d0003520 con 0x7f01d00039a0 2023-12-12T09:20:50.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e2ffd640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01d00047c0 0x7f01d0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:50.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.609+0000 7f01e3fff640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01e409a130 0x7f01d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.610+0000 7f01e37fe640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d00039a0 0x7f01d0003dc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00c240 tx=0x7f01d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3138b10e3cfe4f7b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc005ad0 con 0x7f01d00039a0 2023-12-12T09:20:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc005c30 con 0x7f01d00039a0 2023-12-12T09:20:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e27fc640 1 -- 172.21.15.84:0/1302448795 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc02c8b0 con 0x7f01d00039a0 2023-12-12T09:20:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e9e15640 1 -- 172.21.15.84:0/1302448795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d00039a0 msgr2=0x7f01d0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e9e15640 1 --2- 172.21.15.84:0/1302448795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01d00039a0 0x7f01d0003dc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00c240 tx=0x7f01d00057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e3fff640 1 -- 172.21.15.84:0/1302448795 reap_dead start 2023-12-12T09:20:50.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e9e15640 1 -- 172.21.15.84:0/1302448795 shutdown_connections 2023-12-12T09:20:50.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e9e15640 1 -- 172.21.15.84:0/1302448795 >> 172.21.15.84:0/1302448795 conn(0x7f01e40b2960 msgr2=0x7f01e40b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:50.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e9e15640 1 -- 172.21.15.84:0/1302448795 shutdown_connections 2023-12-12T09:20:50.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.611+0000 7f01e9e15640 1 -- 172.21.15.84:0/1302448795 wait complete. 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.613+0000 7f01e9e15640 1 Processor -- start 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.613+0000 7f01e9e15640 1 -- start start 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.614+0000 7f01e9e15640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01d00039a0 0x7f01e414be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.614+0000 7f01e9e15640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01e40c5920 0x7f01e40ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.614+0000 7f01e9e15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e40c6f30 0x7f01e40c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.614+0000 7f01e9e15640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40c5e90 con 0x7f01e40c6f30 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.614+0000 7f01e9e15640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40c6170 con 0x7f01e40c5920 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.614+0000 7f01e9e15640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40c6450 con 0x7f01d00039a0 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e40c6f30 0x7f01e40c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e40c6f30 0x7f01e40c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42200/0 (socket says 172.21.15.84:42200) 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 -- 172.21.15.84:0/116883133 learned_addr learned my addr 172.21.15.84:0/116883133 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:50.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e37fe640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01d00039a0 0x7f01e414be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 -- 172.21.15.84:0/116883133 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01d00039a0 msgr2=0x7f01e414be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01d00039a0 0x7f01e414be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 -- 172.21.15.84:0/116883133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01e40c5920 msgr2=0x7f01e40ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01e40c5920 0x7f01e40ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 -- 172.21.15.84:0/116883133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e40c6730 con 0x7f01e40c6f30 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01e3fff640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e40c6f30 0x7f01e40c7f40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f01e40b0720 tx=0x7f01dc00d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.615+0000 7f01dbfff640 1 -- 172.21.15.84:0/116883133 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc00b070 con 0x7f01e40c6f30 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.616+0000 7f01dbfff640 1 -- 172.21.15.84:0/116883133 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc005480 con 0x7f01e40c6f30 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.616+0000 7f01dbfff640 1 -- 172.21.15.84:0/116883133 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc007270 con 0x7f01e40c6f30 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.616+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e40c6a10 con 0x7f01e40c6f30 2023-12-12T09:20:50.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.616+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e40c8480 con 0x7f01e40c6f30 2023-12-12T09:20:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.617+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e40673c0 con 0x7f01e40c6f30 2023-12-12T09:20:50.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.618+0000 7f01dbfff640 1 -- 172.21.15.84:0/116883133 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01dc0073d0 con 0x7f01e40c6f30 2023-12-12T09:20:50.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.619+0000 7f01dbfff640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f01c406ae40 0x7f01c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:50.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.619+0000 7f01dbfff640 1 -- 172.21.15.84:0/116883133 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f01dc089340 con 0x7f01e40c6f30 2023-12-12T09:20:50.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.619+0000 7f01e37fe640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f01c406ae40 0x7f01c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:50.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.620+0000 7f01e37fe640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f01c406ae40 0x7f01c406d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f01cc034000 tx=0x7f01cc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:50.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.624+0000 7f01dbfff640 1 -- 172.21.15.84:0/116883133 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01dc054030 con 0x7f01e40c6f30 2023-12-12T09:20:50.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.812+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01e4099d00 con 0x7f01e40c6f30 2023-12-12T09:20:50.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.813+0000 7f01dbfff640 1 -- 172.21.15.84:0/116883133 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01dc057650 con 0x7f01e40c6f30 2023-12-12T09:20:50.813 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.815+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f01c406ae40 msgr2=0x7f01c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.815+0000 7f01e9e15640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f01c406ae40 0x7f01c406d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f01cc034000 tx=0x7f01cc009030 comp rx=0 tx=0).stop 2023-12-12T09:20:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.815+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e40c6f30 msgr2=0x7f01e40c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.815+0000 7f01e9e15640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e40c6f30 0x7f01e40c7f40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f01e40b0720 tx=0x7f01dc00d680 comp rx=0 tx=0).stop 2023-12-12T09:20:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.816+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 shutdown_connections 2023-12-12T09:20:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.816+0000 7f01e9e15640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f01c406ae40 0x7f01c406d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.816+0000 7f01e9e15640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01e40c6f30 0x7f01e40c7f40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.816+0000 7f01e9e15640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f01e40c5920 0x7f01e40ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.816+0000 7f01e9e15640 1 --2- 172.21.15.84:0/116883133 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f01d00039a0 0x7f01e414be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:50.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.816+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 >> 172.21.15.84:0/116883133 conn(0x7f01e40b2960 msgr2=0x7f01e40afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:50.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.816+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 shutdown_connections 2023-12-12T09:20:50.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:50.816+0000 7f01e9e15640 1 -- 172.21.15.84:0/116883133 wait complete. 2023-12-12T09:20:50.835 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:51.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.053+0000 7fee9ccff640 1 Processor -- start 2023-12-12T09:20:51.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.054+0000 7fee9ccff640 1 -- start start 2023-12-12T09:20:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.055+0000 7fee9ccff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee9813de10 0x7fee980cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.055+0000 7fee9ccff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee981412c0 0x7fee9815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.055+0000 7fee9ccff640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980cdb80 con 0x7fee980cd670 2023-12-12T09:20:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.055+0000 7fee9ccff640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee980cde60 con 0x7fee9813de10 2023-12-12T09:20:51.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.055+0000 7fee9ccff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee980ce140 con 0x7fee981412c0 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee977fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee9813de10 0x7fee980cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee97fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fee980cd670 0x7fee9815b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44988/0 (socket says 172.21.15.84:44988) 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee97fff640 1 -- 172.21.15.84:0/2649574025 learned_addr learned my addr 172.21.15.84:0/2649574025 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee8ffff640 1 --2- 172.21.15.84:0/2649574025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee981412c0 0x7fee9815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee977fe640 1 -- 172.21.15.84:0/2649574025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee981412c0 msgr2=0x7fee9815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee977fe640 1 --2- 172.21.15.84:0/2649574025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee981412c0 0x7fee9815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee977fe640 1 -- 172.21.15.84:0/2649574025 >> v1:172.21.15.84:6789/0 conn(0x7fee980cd670 legacy=0x7fee9815b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee977fe640 1 -- 172.21.15.84:0/2649574025 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980ce420 con 0x7fee9813de10 2023-12-12T09:20:51.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.056+0000 7fee96ffd640 1 -- 172.21.15.84:0/2649574025 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064570343 0 0) 0x7fee980cdb80 con 0x7fee980cd670 2023-12-12T09:20:51.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.057+0000 7fee977fe640 1 --2- 172.21.15.84:0/2649574025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee980cd130 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fee880097a0 tx=0x7fee8802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d800af2849d7c943 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:51.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.058+0000 7fee96ffd640 1 -- 172.21.15.84:0/2649574025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88031830 con 0x7fee9813de10 2023-12-12T09:20:51.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.058+0000 7fee96ffd640 1 -- 172.21.15.84:0/2649574025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee88031990 con 0x7fee9813de10 2023-12-12T09:20:51.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.058+0000 7fee96ffd640 1 -- 172.21.15.84:0/2649574025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88031d20 con 0x7fee9813de10 2023-12-12T09:20:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.058+0000 7fee9ccff640 1 -- 172.21.15.84:0/2649574025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 msgr2=0x7fee980cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.058+0000 7fee9ccff640 1 --2- 172.21.15.84:0/2649574025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee980cd130 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fee880097a0 tx=0x7fee8802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.058+0000 7fee9ccff640 1 -- 172.21.15.84:0/2649574025 shutdown_connections 2023-12-12T09:20:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.058+0000 7fee9ccff640 1 --2- 172.21.15.84:0/2649574025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee981412c0 0x7fee9815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.058+0000 7fee9ccff640 1 --2- 172.21.15.84:0/2649574025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee980cd130 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.059+0000 7fee9ccff640 1 -- 172.21.15.84:0/2649574025 >> 172.21.15.84:0/2649574025 conn(0x7fee980b0780 msgr2=0x7fee980b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:51.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.059+0000 7fee9ccff640 1 -- 172.21.15.84:0/2649574025 shutdown_connections 2023-12-12T09:20:51.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.059+0000 7fee9ccff640 1 -- 172.21.15.84:0/2649574025 wait complete. 2023-12-12T09:20:51.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.060+0000 7fee9ccff640 1 Processor -- start 2023-12-12T09:20:51.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.060+0000 7fee9ccff640 1 -- start start 2023-12-12T09:20:51.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.061+0000 7fee9ccff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee980cd670 0x7fee98158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.061+0000 7fee9ccff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee9813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.061+0000 7fee9ccff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9813c400 0x7fee980b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.061+0000 7fee9ccff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9813c8b0 con 0x7fee9813de10 2023-12-12T09:20:51.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.061+0000 7fee9ccff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee981f2da0 con 0x7fee9813c400 2023-12-12T09:20:51.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.061+0000 7fee9ccff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee981526b0 con 0x7fee980cd670 2023-12-12T09:20:51.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee9813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee9813bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42222/0 (socket says 172.21.15.84:42222) 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 -- 172.21.15.84:0/1085845450 learned_addr learned my addr 172.21.15.84:0/1085845450 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee97fff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9813c400 0x7fee980b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee977fe640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee980cd670 0x7fee98158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 -- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee980cd670 msgr2=0x7fee98158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee980cd670 0x7fee98158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 -- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9813c400 msgr2=0x7fee980b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9813c400 0x7fee980b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 -- 172.21.15.84:0/1085845450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88009400 con 0x7fee9813de10 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee977fe640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee980cd670 0x7fee98158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.062+0000 7fee8ffff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee9813bec0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fee8000d800 tx=0x7fee8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.063+0000 7fee94ff9640 1 -- 172.21.15.84:0/1085845450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000b6c0 con 0x7fee9813de10 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.063+0000 7fee94ff9640 1 -- 172.21.15.84:0/1085845450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8000b820 con 0x7fee9813de10 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.063+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee980b2790 con 0x7fee9813de10 2023-12-12T09:20:51.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.063+0000 7fee94ff9640 1 -- 172.21.15.84:0/1085845450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000bbb0 con 0x7fee9813de10 2023-12-12T09:20:51.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.063+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee980b2d50 con 0x7fee9813de10 2023-12-12T09:20:51.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.064+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee98071980 con 0x7fee9813de10 2023-12-12T09:20:51.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.065+0000 7fee94ff9640 1 -- 172.21.15.84:0/1085845450 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee8000bd10 con 0x7fee9813de10 2023-12-12T09:20:51.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.066+0000 7fee94ff9640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee7806ae40 0x7fee7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.066+0000 7fee94ff9640 1 -- 172.21.15.84:0/1085845450 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fee80089f70 con 0x7fee9813de10 2023-12-12T09:20:51.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.066+0000 7fee977fe640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee7806ae40 0x7fee7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.067+0000 7fee977fe640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee7806ae40 0x7fee7806d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee88036000 tx=0x7fee88008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:51.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.070+0000 7fee94ff9640 1 -- 172.21.15.84:0/1085845450 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee800bce90 con 0x7fee9813de10 2023-12-12T09:20:51.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.265+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee9804e840 con 0x7fee9813de10 2023-12-12T09:20:51.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.266+0000 7fee94ff9640 1 -- 172.21.15.84:0/1085845450 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fee80054c60 con 0x7fee9813de10 2023-12-12T09:20:51.266 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee7806ae40 msgr2=0x7fee7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee7806ae40 0x7fee7806d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee88036000 tx=0x7fee88008030 comp rx=0 tx=0).stop 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 msgr2=0x7fee9813bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee9813bec0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fee8000d800 tx=0x7fee8000dcc0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 shutdown_connections 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9813c400 0x7fee980b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee7806ae40 0x7fee7806d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9813de10 0x7fee9813bec0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 --2- 172.21.15.84:0/1085845450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee980cd670 0x7fee98158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 >> 172.21.15.84:0/1085845450 conn(0x7fee980b0780 msgr2=0x7fee980aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 shutdown_connections 2023-12-12T09:20:51.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.268+0000 7fee9ccff640 1 -- 172.21.15.84:0/1085845450 wait complete. 2023-12-12T09:20:51.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:20:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.496+0000 7fd711e83640 1 Processor -- start 2023-12-12T09:20:51.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.497+0000 7fd711e83640 1 -- start start 2023-12-12T09:20:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.498+0000 7fd711e83640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd70c0cf6d0 0x7fd70c0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.498+0000 7fd711e83640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cfab0 0x7fd70c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.498+0000 7fd711e83640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c0cefb0 con 0x7fd70c0cbab0 2023-12-12T09:20:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.498+0000 7fd711e83640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c15ee20 con 0x7fd70c0cf6d0 2023-12-12T09:20:51.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.498+0000 7fd711e83640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c15f100 con 0x7fd70c0cfab0 2023-12-12T09:20:51.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.498+0000 7fd70b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd70c0cf6d0 0x7fd70c0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.499+0000 7fd70b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd70c0cf6d0 0x7fd70c0b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42224/0 (socket says 172.21.15.84:42224) 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.499+0000 7fd70b7fe640 1 -- 172.21.15.84:0/769744207 learned_addr learned my addr 172.21.15.84:0/769744207 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.499+0000 7fd70affd640 1 --2- 172.21.15.84:0/769744207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cfab0 0x7fd70c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.499+0000 7fd70b7fe640 1 -- 172.21.15.84:0/769744207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cfab0 msgr2=0x7fd70c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.499+0000 7fd70b7fe640 1 --2- 172.21.15.84:0/769744207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cfab0 0x7fd70c0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.499+0000 7fd70b7fe640 1 -- 172.21.15.84:0/769744207 >> v1:172.21.15.84:6789/0 conn(0x7fd70c0cbab0 legacy=0x7fd70c0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.499+0000 7fd70b7fe640 1 -- 172.21.15.84:0/769744207 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c15f3e0 con 0x7fd70c0cf6d0 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.499+0000 7fd70a7fc640 1 -- 172.21.15.84:0/769744207 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105027199 0 0) 0x7fd70c0cefb0 con 0x7fd70c0cbab0 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.500+0000 7fd70b7fe640 1 --2- 172.21.15.84:0/769744207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cf6d0 0x7fd70c0b34d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009e50 tx=0x7fd6fc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94207be0f0ca5586 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:51.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.500+0000 7fd70a7fc640 1 -- 172.21.15.84:0/769744207 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc02caf0 con 0x7fd70c0cf6d0 2023-12-12T09:20:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd70a7fc640 1 -- 172.21.15.84:0/769744207 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc02cc50 con 0x7fd70c0cf6d0 2023-12-12T09:20:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd70a7fc640 1 -- 172.21.15.84:0/769744207 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0343f0 con 0x7fd70c0cf6d0 2023-12-12T09:20:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd711e83640 1 -- 172.21.15.84:0/769744207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cf6d0 msgr2=0x7fd70c0b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd711e83640 1 --2- 172.21.15.84:0/769744207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cf6d0 0x7fd70c0b34d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009e50 tx=0x7fd6fc02bf50 comp rx=0 tx=0).stop 2023-12-12T09:20:51.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd711e83640 1 -- 172.21.15.84:0/769744207 shutdown_connections 2023-12-12T09:20:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd711e83640 1 --2- 172.21.15.84:0/769744207 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cfab0 0x7fd70c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd711e83640 1 --2- 172.21.15.84:0/769744207 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cf6d0 0x7fd70c0b34d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd711e83640 1 -- 172.21.15.84:0/769744207 >> 172.21.15.84:0/769744207 conn(0x7fd70c0b29b0 msgr2=0x7fd70c0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd711e83640 1 -- 172.21.15.84:0/769744207 shutdown_connections 2023-12-12T09:20:51.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.501+0000 7fd711e83640 1 -- 172.21.15.84:0/769744207 wait complete. 2023-12-12T09:20:51.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.503+0000 7fd711e83640 1 Processor -- start 2023-12-12T09:20:51.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.503+0000 7fd711e83640 1 -- start start 2023-12-12T09:20:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.504+0000 7fd711e83640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd70c0cbab0 0x7fd70c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.504+0000 7fd711e83640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cf6d0 0x7fd70c0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.504+0000 7fd711e83640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cfab0 0x7fd70c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.504+0000 7fd711e83640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c9b60 con 0x7fd70c0cfab0 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.504+0000 7fd711e83640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c15ae10 con 0x7fd70c0cbab0 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.504+0000 7fd711e83640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c9230 con 0x7fd70c0cf6d0 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cfab0 0x7fd70c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cfab0 0x7fd70c0b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42228/0 (socket says 172.21.15.84:42228) 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 -- 172.21.15.84:0/1535721750 learned_addr learned my addr 172.21.15.84:0/1535721750 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70affd640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cf6d0 0x7fd70c0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70b7fe640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd70c0cbab0 0x7fd70c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 -- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cf6d0 msgr2=0x7fd70c0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cf6d0 0x7fd70c0b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 -- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd70c0cbab0 msgr2=0x7fd70c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd70c0cbab0 0x7fd70c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 -- 172.21.15.84:0/1535721750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc009b30 con 0x7fd70c0cfab0 2023-12-12T09:20:51.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70b7fe640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd70c0cbab0 0x7fd70c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:51.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.505+0000 7fd70bfff640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cfab0 0x7fd70c0b45f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c430 tx=0x7fd70400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:51.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.506+0000 7fd703fff640 1 -- 172.21.15.84:0/1535721750 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040035f0 con 0x7fd70c0cfab0 2023-12-12T09:20:51.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.506+0000 7fd703fff640 1 -- 172.21.15.84:0/1535721750 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd704003770 con 0x7fd70c0cfab0 2023-12-12T09:20:51.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.506+0000 7fd703fff640 1 -- 172.21.15.84:0/1535721750 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704003b20 con 0x7fd70c0cfab0 2023-12-12T09:20:51.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.506+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c0c9510 con 0x7fd70c0cfab0 2023-12-12T09:20:51.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.506+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c15e080 con 0x7fd70c0cfab0 2023-12-12T09:20:51.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.507+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c0b27a0 con 0x7fd70c0cfab0 2023-12-12T09:20:51.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.508+0000 7fd703fff640 1 -- 172.21.15.84:0/1535721750 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd704003c80 con 0x7fd70c0cfab0 2023-12-12T09:20:51.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.509+0000 7fd703fff640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd6ec06ae40 0x7fd6ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:51.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.509+0000 7fd703fff640 1 -- 172.21.15.84:0/1535721750 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd7040890a0 con 0x7fd70c0cfab0 2023-12-12T09:20:51.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.510+0000 7fd70b7fe640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd6ec06ae40 0x7fd6ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:51.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.510+0000 7fd70b7fe640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd6ec06ae40 0x7fd6ec06d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc035000 tx=0x7fd6fc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:51.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.514+0000 7fd703fff640 1 -- 172.21.15.84:0/1535721750 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd704053cf0 con 0x7fd70c0cfab0 2023-12-12T09:20:51.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.716+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd70c06a9f0 con 0x7fd70c0cfab0 2023-12-12T09:20:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.716+0000 7fd703fff640 1 -- 172.21.15.84:0/1535721750 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd704017080 con 0x7fd70c0cfab0 2023-12-12T09:20:51.717 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:20:51.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd6ec06ae40 msgr2=0x7fd6ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd6ec06ae40 0x7fd6ec06d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc035000 tx=0x7fd6fc030000 comp rx=0 tx=0).stop 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cfab0 msgr2=0x7fd70c0b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cfab0 0x7fd70c0b45f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd70400c430 tx=0x7fd70400c8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 shutdown_connections 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd6ec06ae40 0x7fd6ec06d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd70c0cfab0 0x7fd70c0b45f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd70c0cf6d0 0x7fd70c0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 --2- 172.21.15.84:0/1535721750 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd70c0cbab0 0x7fd70c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 >> 172.21.15.84:0/1535721750 conn(0x7fd70c0b29b0 msgr2=0x7fd70c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 shutdown_connections 2023-12-12T09:20:51.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:51.719+0000 7fd711e83640 1 -- 172.21.15.84:0/1535721750 wait complete. 2023-12-12T09:20:51.737 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:20:51.737 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:20:51.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.051+0000 7f8ce9cf3640 1 Processor -- start 2023-12-12T09:20:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.051+0000 7f8ce9cf3640 1 -- start start 2023-12-12T09:20:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.052+0000 7f8ce9cf3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ce415b0a0 0x7f8ce40cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.052+0000 7f8ce9cf3640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ce40d19b0 0x7f8ce40cf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.052+0000 7f8ce9cf3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40cfb90 0x7f8ce406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.052+0000 7f8ce9cf3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce40cffa0 con 0x7f8ce415b0a0 2023-12-12T09:20:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.052+0000 7f8ce9cf3640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce40cce30 con 0x7f8ce40d19b0 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.052+0000 7f8ce9cf3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40ce810 con 0x7f8ce40cfb90 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ce415b0a0 0x7f8ce40cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ce415b0a0 0x7f8ce40cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42236/0 (socket says 172.21.15.84:42236) 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce37fe640 1 -- 172.21.15.84:0/756398530 learned_addr learned my addr 172.21.15.84:0/756398530 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce3fff640 1 --2- 172.21.15.84:0/756398530 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40cfb90 0x7f8ce406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce2ffd640 1 --2- 172.21.15.84:0/756398530 >> v2:172.21.15.99:3300/0 conn(0x7f8ce40d19b0 0x7f8ce40cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce37fe640 1 -- 172.21.15.84:0/756398530 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40cfb90 msgr2=0x7f8ce406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce37fe640 1 --2- 172.21.15.84:0/756398530 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40cfb90 0x7f8ce406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce37fe640 1 -- 172.21.15.84:0/756398530 >> v2:172.21.15.99:3300/0 conn(0x7f8ce40d19b0 msgr2=0x7f8ce40cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce37fe640 1 --2- 172.21.15.84:0/756398530 >> v2:172.21.15.99:3300/0 conn(0x7f8ce40d19b0 0x7f8ce40cf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.053+0000 7f8ce37fe640 1 -- 172.21.15.84:0/756398530 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce40ccb70 con 0x7f8ce415b0a0 2023-12-12T09:20:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.054+0000 7f8ce37fe640 1 --2- 172.21.15.84:0/756398530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce415b0a0 0x7f8ce40cc4f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40b6dc0 tx=0x7f8cd402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e325077b9ba7461 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce27fc640 1 -- 172.21.15.84:0/756398530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd402ca70 con 0x7f8ce415b0a0 2023-12-12T09:20:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce27fc640 1 -- 172.21.15.84:0/756398530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd402cbd0 con 0x7f8ce415b0a0 2023-12-12T09:20:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce27fc640 1 -- 172.21.15.84:0/756398530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40343f0 con 0x7f8ce415b0a0 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/756398530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce415b0a0 msgr2=0x7f8ce40cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/756398530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce415b0a0 0x7f8ce40cc4f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40b6dc0 tx=0x7f8cd402bed0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/756398530 shutdown_connections 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/756398530 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40cfb90 0x7f8ce406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/756398530 >> v2:172.21.15.99:3300/0 conn(0x7f8ce40d19b0 0x7f8ce40cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/756398530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce415b0a0 0x7f8ce40cc4f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.055+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/756398530 >> 172.21.15.84:0/756398530 conn(0x7f8ce40d0e90 msgr2=0x7f8ce40d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.056+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/756398530 shutdown_connections 2023-12-12T09:20:52.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.056+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/756398530 wait complete. 2023-12-12T09:20:52.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.057+0000 7f8ce9cf3640 1 Processor -- start 2023-12-12T09:20:52.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.057+0000 7f8ce9cf3640 1 -- start start 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.058+0000 7f8ce9cf3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce40cfb90 0x7f8ce40c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.058+0000 7f8ce9cf3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40d19b0 0x7f8ce406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.058+0000 7f8ce9cf3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ce415b0a0 0x7f8ce415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.058+0000 7f8ce9cf3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce414fac0 con 0x7f8ce40cfb90 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.058+0000 7f8ce9cf3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce415b790 con 0x7f8ce415b0a0 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.058+0000 7f8ce9cf3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce415df60 con 0x7f8ce40d19b0 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce40cfb90 0x7f8ce40c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce40cfb90 0x7f8ce40c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42248/0 (socket says 172.21.15.84:42248) 2023-12-12T09:20:52.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 -- 172.21.15.84:0/3558038879 learned_addr learned my addr 172.21.15.84:0/3558038879 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:52.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 -- 172.21.15.84:0/3558038879 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40d19b0 msgr2=0x7f8ce406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40d19b0 0x7f8ce406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 -- 172.21.15.84:0/3558038879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ce415b0a0 msgr2=0x7f8ce415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ce415b0a0 0x7f8ce415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 -- 172.21.15.84:0/3558038879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd4009b30 con 0x7f8ce40cfb90 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.059+0000 7f8ce37fe640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce40cfb90 0x7f8ce40c6aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4000f80 tx=0x7f8cd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.060+0000 7f8cdbfff640 1 -- 172.21.15.84:0/3558038879 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd403e450 con 0x7f8ce40cfb90 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.060+0000 7f8cdbfff640 1 -- 172.21.15.84:0/3558038879 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd403e5f0 con 0x7f8ce40cfb90 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.060+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce415ba30 con 0x7f8ce40cfb90 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.060+0000 7f8cdbfff640 1 -- 172.21.15.84:0/3558038879 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd403e9a0 con 0x7f8ce40cfb90 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.060+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce40c6fe0 con 0x7f8ce40cfb90 2023-12-12T09:20:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.061+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce40673c0 con 0x7f8ce40cfb90 2023-12-12T09:20:52.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.062+0000 7f8cdbfff640 1 -- 172.21.15.84:0/3558038879 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cd403eb00 con 0x7f8ce40cfb90 2023-12-12T09:20:52.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.063+0000 7f8cdbfff640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8cc406ae40 0x7f8cc406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.063+0000 7f8cdbfff640 1 -- 172.21.15.84:0/3558038879 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8cd40ac890 con 0x7f8ce40cfb90 2023-12-12T09:20:52.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.063+0000 7f8ce2ffd640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8cc406ae40 0x7f8cc406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.064+0000 7f8ce2ffd640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8cc406ae40 0x7f8cc406d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40c40d0 tx=0x7f8ccc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.067+0000 7f8cdbfff640 1 -- 172.21.15.84:0/3558038879 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cd4077620 con 0x7f8ce40cfb90 2023-12-12T09:20:52.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.262+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ce40b6e10 con 0x7f8ce40cfb90 2023-12-12T09:20:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.265+0000 7f8cdbfff640 1 -- 172.21.15.84:0/3558038879 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f8cd403edb0 con 0x7f8ce40cfb90 2023-12-12T09:20:52.265 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:52.266 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8cc406ae40 msgr2=0x7f8cc406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8cc406ae40 0x7f8cc406d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40c40d0 tx=0x7f8ccc008040 comp rx=0 tx=0).stop 2023-12-12T09:20:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce40cfb90 msgr2=0x7f8ce40c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce40cfb90 0x7f8ce40c6aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4000f80 tx=0x7f8cd4004a40 comp rx=0 tx=0).stop 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 shutdown_connections 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ce415b0a0 0x7f8ce415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ce40d19b0 0x7f8ce406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8cc406ae40 0x7f8cc406d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 --2- 172.21.15.84:0/3558038879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce40cfb90 0x7f8ce40c6aa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 >> 172.21.15.84:0/3558038879 conn(0x7f8ce40d0e90 msgr2=0x7f8ce40b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 shutdown_connections 2023-12-12T09:20:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.268+0000 7f8ce9cf3640 1 -- 172.21.15.84:0/3558038879 wait complete. 2023-12-12T09:20:52.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:52.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.487+0000 7fc34ecb4640 1 Processor -- start 2023-12-12T09:20:52.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.487+0000 7fc34ecb4640 1 -- start start 2023-12-12T09:20:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.489+0000 7fc34ecb4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3480ce6f0 0x7fc34813e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.489+0000 7fc34ecb4640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480ce260 con 0x7fc34806dff0 2023-12-12T09:20:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.489+0000 7fc34ecb4640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480ceb00 con 0x7fc3480b40d0 2023-12-12T09:20:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.489+0000 7fc34ecb4640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34806e480 con 0x7fc3480ce6f0 2023-12-12T09:20:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.489+0000 7fc34d251640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc3480ce6f0 0x7fc34813e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.489+0000 7fc347fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc34806dff0 0x7fc34815be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45006/0 (socket says 172.21.15.84:45006) 2023-12-12T09:20:52.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.489+0000 7fc347fff640 1 -- 172.21.15.84:0/27330998 learned_addr learned my addr 172.21.15.84:0/27330998 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.490+0000 7fc34d251640 1 -- 172.21.15.84:0/27330998 >> v1:172.21.15.99:6789/0 conn(0x7fc3480b40d0 legacy=0x7fc3480b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.490+0000 7fc34d251640 1 -- 172.21.15.84:0/27330998 >> v1:172.21.15.84:6789/0 conn(0x7fc34806dff0 legacy=0x7fc34815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.490+0000 7fc34d251640 1 -- 172.21.15.84:0/27330998 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480cd930 con 0x7fc3480ce6f0 2023-12-12T09:20:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.490+0000 7fc3477fe640 1 -- 172.21.15.84:0/27330998 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43272394 0 0) 0x7fc3480ce260 con 0x7fc34806dff0 2023-12-12T09:20:52.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.492+0000 7fc34d251640 1 --2- 172.21.15.84:0/27330998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480ce6f0 0x7fc34813e750 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc340009d90 tx=0x7fc34002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6a5d113862504 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.492+0000 7fc3477fe640 1 -- 172.21.15.84:0/27330998 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34002cc60 con 0x7fc3480ce6f0 2023-12-12T09:20:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.492+0000 7fc3477fe640 1 -- 172.21.15.84:0/27330998 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34002cdc0 con 0x7fc3480ce6f0 2023-12-12T09:20:52.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.492+0000 7fc3477fe640 1 -- 172.21.15.84:0/27330998 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc340034660 con 0x7fc3480ce6f0 2023-12-12T09:20:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.492+0000 7fc34ecb4640 1 -- 172.21.15.84:0/27330998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480ce6f0 msgr2=0x7fc34813e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.492+0000 7fc34ecb4640 1 --2- 172.21.15.84:0/27330998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480ce6f0 0x7fc34813e750 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc340009d90 tx=0x7fc34002beb0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.493+0000 7fc34ecb4640 1 -- 172.21.15.84:0/27330998 shutdown_connections 2023-12-12T09:20:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.493+0000 7fc34ecb4640 1 --2- 172.21.15.84:0/27330998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480ce6f0 0x7fc34813e750 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.493+0000 7fc34ecb4640 1 -- 172.21.15.84:0/27330998 >> 172.21.15.84:0/27330998 conn(0x7fc3480b0ac0 msgr2=0x7fc3480b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.493+0000 7fc34ecb4640 1 -- 172.21.15.84:0/27330998 shutdown_connections 2023-12-12T09:20:52.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.493+0000 7fc34ecb4640 1 -- 172.21.15.84:0/27330998 wait complete. 2023-12-12T09:20:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.494+0000 7fc34ecb4640 1 Processor -- start 2023-12-12T09:20:52.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.495+0000 7fc34ecb4640 1 -- start start 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.495+0000 7fc34ecb4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34806dff0 0x7fc348151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.495+0000 7fc34ecb4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b40d0 0x7fc348154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.495+0000 7fc34ecb4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3480ce6f0 0x7fc348156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.495+0000 7fc34ecb4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481555b0 con 0x7fc3480b40d0 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.495+0000 7fc34ecb4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480af040 con 0x7fc3480ce6f0 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.495+0000 7fc34ecb4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481518b0 con 0x7fc34806dff0 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc347fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b40d0 0x7fc348154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc347fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b40d0 0x7fc348154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42274/0 (socket says 172.21.15.84:42274) 2023-12-12T09:20:52.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc347fff640 1 -- 172.21.15.84:0/82659147 learned_addr learned my addr 172.21.15.84:0/82659147 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc34ca50640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34806dff0 0x7fc348151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc34d251640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3480ce6f0 0x7fc348156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc347fff640 1 -- 172.21.15.84:0/82659147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34806dff0 msgr2=0x7fc348151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc347fff640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34806dff0 0x7fc348151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc347fff640 1 -- 172.21.15.84:0/82659147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3480ce6f0 msgr2=0x7fc348156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc347fff640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3480ce6f0 0x7fc348156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.496+0000 7fc347fff640 1 -- 172.21.15.84:0/82659147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340009a70 con 0x7fc3480b40d0 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.497+0000 7fc347fff640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b40d0 0x7fc348154730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c430 tx=0x7fc33400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.497+0000 7fc3457fa640 1 -- 172.21.15.84:0/82659147 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3340074e0 con 0x7fc3480b40d0 2023-12-12T09:20:52.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.497+0000 7fc3457fa640 1 -- 172.21.15.84:0/82659147 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc334007660 con 0x7fc3480b40d0 2023-12-12T09:20:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.497+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc348154ff0 con 0x7fc3480b40d0 2023-12-12T09:20:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.497+0000 7fc3457fa640 1 -- 172.21.15.84:0/82659147 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334004a20 con 0x7fc3480b40d0 2023-12-12T09:20:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.497+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3480aecd0 con 0x7fc3480b40d0 2023-12-12T09:20:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.498+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3480aeb30 con 0x7fc3480b40d0 2023-12-12T09:20:52.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.499+0000 7fc3457fa640 1 -- 172.21.15.84:0/82659147 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc334004b80 con 0x7fc3480b40d0 2023-12-12T09:20:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.500+0000 7fc3457fa640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc32c06ae40 0x7fc32c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.500+0000 7fc3457fa640 1 -- 172.21.15.84:0/82659147 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3340898a0 con 0x7fc3480b40d0 2023-12-12T09:20:52.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.500+0000 7fc34ca50640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc32c06ae40 0x7fc32c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.501+0000 7fc34ca50640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc32c06ae40 0x7fc32c06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc33c004ea0 tx=0x7fc33c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.505+0000 7fc3457fa640 1 -- 172.21.15.84:0/82659147 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3480aeb30 con 0x7fc3480b40d0 2023-12-12T09:20:52.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.696+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3480aeb30 con 0x7fc3480b40d0 2023-12-12T09:20:52.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.696+0000 7fc3457fa640 1 -- 172.21.15.84:0/82659147 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3480aeb30 con 0x7fc3480b40d0 2023-12-12T09:20:52.697 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc32c06ae40 msgr2=0x7fc32c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc32c06ae40 0x7fc32c06d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc33c004ea0 tx=0x7fc33c009040 comp rx=0 tx=0).stop 2023-12-12T09:20:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b40d0 msgr2=0x7fc348154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b40d0 0x7fc348154730 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c430 tx=0x7fc33400c8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 shutdown_connections 2023-12-12T09:20:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3480ce6f0 0x7fc348156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc32c06ae40 0x7fc32c06d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3480b40d0 0x7fc348154730 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 --2- 172.21.15.84:0/82659147 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc34806dff0 0x7fc348151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 >> 172.21.15.84:0/82659147 conn(0x7fc3480b0ac0 msgr2=0x7fc3480b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 shutdown_connections 2023-12-12T09:20:52.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.699+0000 7fc34ecb4640 1 -- 172.21.15.84:0/82659147 wait complete. 2023-12-12T09:20:52.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:52.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.915+0000 7f5ea95c9640 1 Processor -- start 2023-12-12T09:20:52.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.916+0000 7f5ea95c9640 1 -- start start 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.917+0000 7f5ea95c9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5ea4162060 0x7f5ea4162440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.917+0000 7f5ea95c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40b2f80 0x7f5ea40b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.917+0000 7f5ea95c9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ea40abd50 0x7f5ea40ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.917+0000 7f5ea95c9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea40ac720 con 0x7f5ea40abd50 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.917+0000 7f5ea95c9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea40b1c00 con 0x7f5ea4162060 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.917+0000 7f5ea95c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40b1ee0 con 0x7f5ea40b2f80 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ea40abd50 0x7f5ea40ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ea40abd50 0x7f5ea40ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42282/0 (socket says 172.21.15.84:42282) 2023-12-12T09:20:52.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea37fe640 1 -- 172.21.15.84:0/3033605050 learned_addr learned my addr 172.21.15.84:0/3033605050 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea37fe640 1 -- 172.21.15.84:0/3033605050 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40b2f80 msgr2=0x7f5ea40b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:52.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea2ffd640 1 --2- 172.21.15.84:0/3033605050 >> v2:172.21.15.99:3300/0 conn(0x7f5ea4162060 0x7f5ea4162440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5e9a7fc640 1 --2- 172.21.15.84:0/3033605050 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40b2f80 0x7f5ea40b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea37fe640 1 --2- 172.21.15.84:0/3033605050 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40b2f80 0x7f5ea40b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea37fe640 1 -- 172.21.15.84:0/3033605050 >> v2:172.21.15.99:3300/0 conn(0x7f5ea4162060 msgr2=0x7f5ea4162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea37fe640 1 --2- 172.21.15.84:0/3033605050 >> v2:172.21.15.99:3300/0 conn(0x7f5ea4162060 0x7f5ea4162440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea37fe640 1 -- 172.21.15.84:0/3033605050 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40b21c0 con 0x7f5ea40abd50 2023-12-12T09:20:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5ea2ffd640 1 --2- 172.21.15.84:0/3033605050 >> v2:172.21.15.99:3300/0 conn(0x7f5ea4162060 0x7f5ea4162440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.918+0000 7f5e9a7fc640 1 --2- 172.21.15.84:0/3033605050 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40b2f80 0x7f5ea40b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:52.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.919+0000 7f5ea37fe640 1 --2- 172.21.15.84:0/3033605050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea40abd50 0x7f5ea40ac1e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009870 tx=0x7f5e9c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b18f6c31b7dbc76 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea27fc640 1 -- 172.21.15.84:0/3033605050 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c031640 con 0x7f5ea40abd50 2023-12-12T09:20:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea27fc640 1 -- 172.21.15.84:0/3033605050 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c0317a0 con 0x7f5ea40abd50 2023-12-12T09:20:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea27fc640 1 -- 172.21.15.84:0/3033605050 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c031b30 con 0x7f5ea40abd50 2023-12-12T09:20:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 -- 172.21.15.84:0/3033605050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea40abd50 msgr2=0x7f5ea40ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/3033605050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea40abd50 0x7f5ea40ac1e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c009870 tx=0x7f5e9c02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 -- 172.21.15.84:0/3033605050 shutdown_connections 2023-12-12T09:20:52.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/3033605050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea40abd50 0x7f5ea40ac1e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/3033605050 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40b2f80 0x7f5ea40b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/3033605050 >> v2:172.21.15.99:3300/0 conn(0x7f5ea4162060 0x7f5ea4162440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 -- 172.21.15.84:0/3033605050 >> 172.21.15.84:0/3033605050 conn(0x7f5ea40b0900 msgr2=0x7f5ea40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:52.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 -- 172.21.15.84:0/3033605050 shutdown_connections 2023-12-12T09:20:52.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.920+0000 7f5ea95c9640 1 -- 172.21.15.84:0/3033605050 wait complete. 2023-12-12T09:20:52.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.922+0000 7f5ea95c9640 1 Processor -- start 2023-12-12T09:20:52.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.923+0000 7f5ea95c9640 1 -- start start 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.923+0000 7f5ea95c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40abd50 0x7f5ea4145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.923+0000 7f5ea95c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea40b2f80 0x7f5ea4099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.923+0000 7f5ea95c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea4162060 0x7f5ea40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea95c9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40cd860 con 0x7f5ea4162060 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea95c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40ccc50 con 0x7f5ea40b2f80 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea95c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40ccf30 con 0x7f5ea40abd50 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea4162060 0x7f5ea40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea4162060 0x7f5ea40cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42290/0 (socket says 172.21.15.84:42290) 2023-12-12T09:20:52.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea37fe640 1 -- 172.21.15.84:0/2470606971 learned_addr learned my addr 172.21.15.84:0/2470606971 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5e9a7fc640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea40b2f80 0x7f5ea4099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea2ffd640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40abd50 0x7f5ea4145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea37fe640 1 -- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40abd50 msgr2=0x7f5ea4145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea37fe640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40abd50 0x7f5ea4145f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea37fe640 1 -- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea40b2f80 msgr2=0x7f5ea4099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea37fe640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea40b2f80 0x7f5ea4099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5ea37fe640 1 -- 172.21.15.84:0/2470606971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0094d0 con 0x7f5ea4162060 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.924+0000 7f5e9a7fc640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea40b2f80 0x7f5ea4099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.925+0000 7f5ea37fe640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea4162060 0x7f5ea40cdcf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c02b930 tx=0x7f5e9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.925+0000 7f5e9bfff640 1 -- 172.21.15.84:0/2470606971 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c03ac60 con 0x7f5ea4162060 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.925+0000 7f5e9bfff640 1 -- 172.21.15.84:0/2470606971 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c03ade0 con 0x7f5ea4162060 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.925+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea40cd210 con 0x7f5ea4162060 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.925+0000 7f5e9bfff640 1 -- 172.21.15.84:0/2470606971 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c044630 con 0x7f5ea4162060 2023-12-12T09:20:52.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.925+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea4150420 con 0x7f5ea4162060 2023-12-12T09:20:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.926+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea40673c0 con 0x7f5ea4162060 2023-12-12T09:20:52.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.927+0000 7f5e9bfff640 1 -- 172.21.15.84:0/2470606971 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e9c02f050 con 0x7f5ea4162060 2023-12-12T09:20:52.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.928+0000 7f5e9bfff640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e8406ae70 0x7f5e8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:52.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.928+0000 7f5e9bfff640 1 -- 172.21.15.84:0/2470606971 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e9c0ab900 con 0x7f5ea4162060 2023-12-12T09:20:52.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.928+0000 7f5ea2ffd640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e8406ae70 0x7f5e8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:52.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.929+0000 7f5ea2ffd640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e8406ae70 0x7f5e8406d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e94008f80 tx=0x7f5e940084d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:52.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:52.933+0000 7f5e9bfff640 1 -- 172.21.15.84:0/2470606971 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e9c0765e0 con 0x7f5ea4162060 2023-12-12T09:20:53.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.121+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ea40b3d70 con 0x7f5ea4162060 2023-12-12T09:20:53.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.122+0000 7f5e9bfff640 1 -- 172.21.15.84:0/2470606971 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e9c079c00 con 0x7f5ea4162060 2023-12-12T09:20:53.122 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:53.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e8406ae70 msgr2=0x7f5e8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e8406ae70 0x7f5e8406d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e94008f80 tx=0x7f5e940084d0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea4162060 msgr2=0x7f5ea40cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea4162060 0x7f5ea40cdcf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c02b930 tx=0x7f5e9c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 shutdown_connections 2023-12-12T09:20:53.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e8406ae70 0x7f5e8406d330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea4162060 0x7f5ea40cdcf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ea40b2f80 0x7f5ea4099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 --2- 172.21.15.84:0/2470606971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ea40abd50 0x7f5ea4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 >> 172.21.15.84:0/2470606971 conn(0x7f5ea40b0900 msgr2=0x7f5ea40af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:53.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 shutdown_connections 2023-12-12T09:20:53.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.125+0000 7f5ea95c9640 1 -- 172.21.15.84:0/2470606971 wait complete. 2023-12-12T09:20:53.143 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.347+0000 7f3bd22b2640 1 Processor -- start 2023-12-12T09:20:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.347+0000 7f3bd22b2640 1 -- start start 2023-12-12T09:20:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.349+0000 7f3bd22b2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc143860 0x7f3bcc0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.349+0000 7f3bd22b2640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc071c00 con 0x7f3bcc06db40 2023-12-12T09:20:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.349+0000 7f3bd22b2640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc143c40 con 0x7f3bcc0b4170 2023-12-12T09:20:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.349+0000 7f3bd22b2640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc0b4780 con 0x7f3bcc143860 2023-12-12T09:20:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.349+0000 7f3bcbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc143860 0x7f3bcc0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.349+0000 7f3bcbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3bcc143860 0x7f3bcc0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42304/0 (socket says 172.21.15.84:42304) 2023-12-12T09:20:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.349+0000 7f3bcbfff640 1 -- 172.21.15.84:0/200842115 learned_addr learned my addr 172.21.15.84:0/200842115 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.350+0000 7f3bcbfff640 1 -- 172.21.15.84:0/200842115 >> v1:172.21.15.99:6789/0 conn(0x7f3bcc0b4170 legacy=0x7f3bcc06d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.350+0000 7f3bcbfff640 1 -- 172.21.15.84:0/200842115 >> v1:172.21.15.84:6789/0 conn(0x7f3bcc06db40 legacy=0x7f3bcc0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.350+0000 7f3bcaffd640 1 -- 172.21.15.84:0/200842115 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716107152 0 0) 0x7f3bcc071c00 con 0x7f3bcc06db40 2023-12-12T09:20:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.350+0000 7f3bcbfff640 1 -- 172.21.15.84:0/200842115 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc0712d0 con 0x7f3bcc143860 2023-12-12T09:20:53.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.351+0000 7f3bcbfff640 1 --2- 172.21.15.84:0/200842115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc143860 0x7f3bcc0b3c30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009870 tx=0x7f3bbc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abc29dca3d09e5f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:53.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.351+0000 7f3bcaffd640 1 -- 172.21.15.84:0/200842115 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc0317e0 con 0x7f3bcc143860 2023-12-12T09:20:53.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.351+0000 7f3bcaffd640 1 -- 172.21.15.84:0/200842115 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc031940 con 0x7f3bcc143860 2023-12-12T09:20:53.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.351+0000 7f3bcaffd640 1 -- 172.21.15.84:0/200842115 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc031cd0 con 0x7f3bcc143860 2023-12-12T09:20:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.352+0000 7f3bd22b2640 1 -- 172.21.15.84:0/200842115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc143860 msgr2=0x7f3bcc0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.352+0000 7f3bd22b2640 1 --2- 172.21.15.84:0/200842115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc143860 0x7f3bcc0b3c30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009870 tx=0x7f3bbc02b880 comp rx=0 tx=0).stop 2023-12-12T09:20:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.352+0000 7f3bd22b2640 1 -- 172.21.15.84:0/200842115 shutdown_connections 2023-12-12T09:20:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.352+0000 7f3bd22b2640 1 --2- 172.21.15.84:0/200842115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc143860 0x7f3bcc0b3c30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.352+0000 7f3bd22b2640 1 -- 172.21.15.84:0/200842115 >> 172.21.15.84:0/200842115 conn(0x7f3bcc0b0ac0 msgr2=0x7f3bcc0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.352+0000 7f3bd22b2640 1 -- 172.21.15.84:0/200842115 shutdown_connections 2023-12-12T09:20:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.352+0000 7f3bd22b2640 1 -- 172.21.15.84:0/200842115 wait complete. 2023-12-12T09:20:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.354+0000 7f3bd22b2640 1 Processor -- start 2023-12-12T09:20:53.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.354+0000 7f3bd22b2640 1 -- start start 2023-12-12T09:20:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bd22b2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bcc06db40 0x7f3bcc15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bd22b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc0b4170 0x7f3bcc13d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bd22b2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bcc143860 0x7f3bcc13a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bd22b2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0ccc60 con 0x7f3bcc0b4170 2023-12-12T09:20:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bd22b2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc13aee0 con 0x7f3bcc06db40 2023-12-12T09:20:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bd22b2640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc13b140 con 0x7f3bcc143860 2023-12-12T09:20:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc0b4170 0x7f3bcc13d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc0b4170 0x7f3bcc13d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42320/0 (socket says 172.21.15.84:42320) 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcb7fe640 1 -- 172.21.15.84:0/556845946 learned_addr learned my addr 172.21.15.84:0/556845946 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcb7fe640 1 -- 172.21.15.84:0/556845946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bcc143860 msgr2=0x7f3bcc13a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcbfff640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bcc06db40 0x7f3bcc15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcb7fe640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bcc143860 0x7f3bcc13a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcb7fe640 1 -- 172.21.15.84:0/556845946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bcc06db40 msgr2=0x7f3bcc15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcb7fe640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bcc06db40 0x7f3bcc15ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.355+0000 7f3bcb7fe640 1 -- 172.21.15.84:0/556845946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0094d0 con 0x7f3bcc0b4170 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.356+0000 7f3bcb7fe640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc0b4170 0x7f3bcc13d8e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c430 tx=0x7f3bc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.356+0000 7f3bc8ff9640 1 -- 172.21.15.84:0/556845946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0011790 con 0x7f3bcc0b4170 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.356+0000 7f3bc8ff9640 1 -- 172.21.15.84:0/556845946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc00118f0 con 0x7f3bcc0b4170 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.356+0000 7f3bc8ff9640 1 -- 172.21.15.84:0/556845946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0011ce0 con 0x7f3bcc0b4170 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.356+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc0cc610 con 0x7f3bcc0b4170 2023-12-12T09:20:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.356+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc13b420 con 0x7f3bcc0b4170 2023-12-12T09:20:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.357+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc072070 con 0x7f3bcc0b4170 2023-12-12T09:20:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.358+0000 7f3bc8ff9640 1 -- 172.21.15.84:0/556845946 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3bc001c460 con 0x7f3bcc0b4170 2023-12-12T09:20:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.359+0000 7f3bc8ff9640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bb806ae40 0x7f3bb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.359+0000 7f3bc8ff9640 1 -- 172.21.15.84:0/556845946 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3bc0089a20 con 0x7f3bcc0b4170 2023-12-12T09:20:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.359+0000 7f3bcbfff640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bb806ae40 0x7f3bb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.360+0000 7f3bcbfff640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bb806ae40 0x7f3bb806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc036000 tx=0x7f3bbc03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:53.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.368+0000 7f3bc8ff9640 1 -- 172.21.15.84:0/556845946 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3bcc072070 con 0x7f3bcc0b4170 2023-12-12T09:20:53.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.555+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bcc072070 con 0x7f3bcc0b4170 2023-12-12T09:20:53.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.555+0000 7f3bc8ff9640 1 -- 172.21.15.84:0/556845946 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3bcc072070 con 0x7f3bcc0b4170 2023-12-12T09:20:53.555 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bb806ae40 msgr2=0x7f3bb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bb806ae40 0x7f3bb806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc036000 tx=0x7f3bbc03d040 comp rx=0 tx=0).stop 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc0b4170 msgr2=0x7f3bcc13d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc0b4170 0x7f3bcc13d8e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c430 tx=0x7f3bc000c8f0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 shutdown_connections 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3bcc143860 0x7f3bcc13a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bb806ae40 0x7f3bb806d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bcc0b4170 0x7f3bcc13d8e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 --2- 172.21.15.84:0/556845946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3bcc06db40 0x7f3bcc15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 >> 172.21.15.84:0/556845946 conn(0x7f3bcc0b0ac0 msgr2=0x7f3bcc06cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 shutdown_connections 2023-12-12T09:20:53.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.558+0000 7f3bd22b2640 1 -- 172.21.15.84:0/556845946 wait complete. 2023-12-12T09:20:53.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:53.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.782+0000 7fa09435a640 1 Processor -- start 2023-12-12T09:20:53.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.782+0000 7fa09435a640 1 -- start start 2023-12-12T09:20:53.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.783+0000 7fa09435a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa08c0b02e0 0x7fa08c06e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.783+0000 7fa09435a640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c06ee80 con 0x7fa08c0cd6c0 2023-12-12T09:20:53.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.783+0000 7fa09435a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c06f0d0 con 0x7fa08c0cdb50 2023-12-12T09:20:53.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.783+0000 7fa09435a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c06f690 con 0x7fa08c0b02e0 2023-12-12T09:20:53.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.784+0000 7fa0920f6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa08c0b02e0 0x7fa08c06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.784+0000 7fa0920f6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa08c0b02e0 0x7fa08c06e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42336/0 (socket says 172.21.15.84:42336) 2023-12-12T09:20:53.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.784+0000 7fa0920f6640 1 -- 172.21.15.84:0/1901327144 learned_addr learned my addr 172.21.15.84:0/1901327144 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:53.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.784+0000 7fa0920f6640 1 -- 172.21.15.84:0/1901327144 >> v1:172.21.15.99:6789/0 conn(0x7fa08c0cdb50 legacy=0x7fa08c15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:53.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.784+0000 7fa0920f6640 1 -- 172.21.15.84:0/1901327144 >> v1:172.21.15.84:6789/0 conn(0x7fa08c0cd6c0 legacy=0x7fa08c15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.784+0000 7fa0920f6640 1 -- 172.21.15.84:0/1901327144 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c06f3b0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.784+0000 7fa0910f4640 1 -- 172.21.15.84:0/1901327144 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41763538 0 0) 0x7fa08c06ee80 con 0x7fa08c0cd6c0 2023-12-12T09:20:53.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.785+0000 7fa0920f6640 1 --2- 172.21.15.84:0/1901327144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c06e680 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa088009870 tx=0x7fa08802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79eba232521e7f67 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:53.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.786+0000 7fa0910f4640 1 -- 172.21.15.84:0/1901327144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088030860 con 0x7fa08c0b02e0 2023-12-12T09:20:53.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.786+0000 7fa0910f4640 1 -- 172.21.15.84:0/1901327144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0880309c0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.786+0000 7fa0910f4640 1 -- 172.21.15.84:0/1901327144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088030d50 con 0x7fa08c0b02e0 2023-12-12T09:20:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.786+0000 7fa09435a640 1 -- 172.21.15.84:0/1901327144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 msgr2=0x7fa08c06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.787+0000 7fa09435a640 1 --2- 172.21.15.84:0/1901327144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c06e680 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa088009870 tx=0x7fa08802b9a0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.787+0000 7fa09435a640 1 -- 172.21.15.84:0/1901327144 shutdown_connections 2023-12-12T09:20:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.787+0000 7fa09435a640 1 --2- 172.21.15.84:0/1901327144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c06e680 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.787+0000 7fa09435a640 1 -- 172.21.15.84:0/1901327144 >> 172.21.15.84:0/1901327144 conn(0x7fa08c0b29b0 msgr2=0x7fa08c0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.787+0000 7fa09435a640 1 -- 172.21.15.84:0/1901327144 shutdown_connections 2023-12-12T09:20:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.787+0000 7fa09435a640 1 -- 172.21.15.84:0/1901327144 wait complete. 2023-12-12T09:20:53.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.790+0000 7fa09435a640 1 Processor -- start 2023-12-12T09:20:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.790+0000 7fa09435a640 1 -- start start 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.791+0000 7fa09435a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.791+0000 7fa09435a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa08c0cd6c0 0x7fa08c0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.791+0000 7fa09435a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa08c0cdb50 0x7fa08c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.791+0000 7fa09435a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0c7850 con 0x7fa08c0b02e0 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.791+0000 7fa09435a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c1fa8f0 con 0x7fa08c0cd6c0 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.791+0000 7fa09435a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c1f7800 con 0x7fa08c0cdb50 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42346/0 (socket says 172.21.15.84:42346) 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 -- 172.21.15.84:0/1517520201 learned_addr learned my addr 172.21.15.84:0/1517520201 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0928f7640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa08c0cdb50 0x7fa08c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 -- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa08c0cdb50 msgr2=0x7fa08c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0918f5640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa08c0cd6c0 0x7fa08c0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa08c0cdb50 0x7fa08c0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 -- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa08c0cd6c0 msgr2=0x7fa08c0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa08c0cd6c0 0x7fa08c0c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 -- 172.21.15.84:0/1517520201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880094d0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0928f7640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa08c0cdb50 0x7fa08c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.792+0000 7fa0920f6640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c15d200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa088009870 tx=0x7fa0880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.793+0000 7fa082ffd640 1 -- 172.21.15.84:0/1517520201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08803e070 con 0x7fa08c0b02e0 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.793+0000 7fa082ffd640 1 -- 172.21.15.84:0/1517520201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088004030 con 0x7fa08c0b02e0 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.793+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c1f7ae0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.793+0000 7fa082ffd640 1 -- 172.21.15.84:0/1517520201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880043e0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.793+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c1f80a0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.794+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c0b26b0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.795+0000 7fa082ffd640 1 -- 172.21.15.84:0/1517520201 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa088042070 con 0x7fa08c0b02e0 2023-12-12T09:20:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.796+0000 7fa082ffd640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa07006ae70 0x7fa07006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.796+0000 7fa082ffd640 1 -- 172.21.15.84:0/1517520201 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa0880ab9d0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.796+0000 7fa0918f5640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa07006ae70 0x7fa07006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.797+0000 7fa0918f5640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa07006ae70 0x7fa07006d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0aedc0 tx=0x7fa07c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.800+0000 7fa082ffd640 1 -- 172.21.15.84:0/1517520201 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa088076750 con 0x7fa08c0b02e0 2023-12-12T09:20:53.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.993+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa08c0673c0 con 0x7fa08c0b02e0 2023-12-12T09:20:53.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.994+0000 7fa082ffd640 1 -- 172.21.15.84:0/1517520201 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa088034020 con 0x7fa08c0b02e0 2023-12-12T09:20:53.994 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:53.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa07006ae70 msgr2=0x7fa07006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa07006ae70 0x7fa07006d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0aedc0 tx=0x7fa07c009040 comp rx=0 tx=0).stop 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 msgr2=0x7fa08c15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c15d200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa088009870 tx=0x7fa0880046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 shutdown_connections 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa08c0cdb50 0x7fa08c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa08c0cd6c0 0x7fa08c0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa07006ae70 0x7fa07006d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 --2- 172.21.15.84:0/1517520201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa08c0b02e0 0x7fa08c15d200 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 >> 172.21.15.84:0/1517520201 conn(0x7fa08c0b29b0 msgr2=0x7fa08c0cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 shutdown_connections 2023-12-12T09:20:53.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:53.997+0000 7fa09435a640 1 -- 172.21.15.84:0/1517520201 wait complete. 2023-12-12T09:20:54.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:20:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.227+0000 7f8a58c35640 1 Processor -- start 2023-12-12T09:20:54.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.228+0000 7f8a58c35640 1 -- start start 2023-12-12T09:20:54.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.229+0000 7f8a58c35640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a540c43a0 0x7f8a540b0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.229+0000 7f8a58c35640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8a54164cd0 0x7f8a540b0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.229+0000 7f8a58c35640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5406bdf0 con 0x7f8a541648f0 2023-12-12T09:20:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.229+0000 7f8a58c35640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a540b3350 con 0x7f8a54164cd0 2023-12-12T09:20:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.229+0000 7f8a58c35640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540b3610 con 0x7f8a540c43a0 2023-12-12T09:20:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a537fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8a541648f0 0x7f8a540c3c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:45018/0 (socket says 172.21.15.84:45018) 2023-12-12T09:20:54.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a537fe640 1 -- 172.21.15.84:0/1334009558 learned_addr learned my addr 172.21.15.84:0/1334009558 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a52ffd640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a540c43a0 0x7f8a540b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144979399 0 0) 0x7f8a5406bdf0 con 0x7f8a541648f0 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a53fff640 1 --2- 172.21.15.84:0/1334009558 >> v2:172.21.15.99:3300/0 conn(0x7f8a54164cd0 0x7f8a540b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a40003520 con 0x7f8a541648f0 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 146733240 0 0) 0x7f8a40003520 con 0x7f8a541648f0 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a540c43a0 msgr2=0x7f8a540b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a540c43a0 0x7f8a540b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 >> v2:172.21.15.99:3300/0 conn(0x7f8a54164cd0 msgr2=0x7f8a540b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 --2- 172.21.15.84:0/1334009558 >> v2:172.21.15.99:3300/0 conn(0x7f8a54164cd0 0x7f8a540b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540b2260 con 0x7f8a541648f0 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.230+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f8a440019f0 con 0x7f8a541648f0 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 >> v1:172.21.15.84:6789/0 conn(0x7f8a541648f0 legacy=0x7f8a540c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a527fc640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a40003970 0x7f8a40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a527fc640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a540c43a0 0x7f8a400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a527fc640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40004d00 0x7f8a40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540b3350 con 0x7f8a40003970 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540b3610 con 0x7f8a40004d00 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4000bab0 con 0x7f8a540c43a0 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a537fe640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a40003970 0x7f8a40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a52ffd640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a540c43a0 0x7f8a400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a53fff640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40004d00 0x7f8a40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a537fe640 1 -- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a540c43a0 msgr2=0x7f8a400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a537fe640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a540c43a0 0x7f8a400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a537fe640 1 -- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40004d00 msgr2=0x7f8a40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:54.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a537fe640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40004d00 0x7f8a40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.231+0000 7f8a537fe640 1 -- 172.21.15.84:0/1334009558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40003520 con 0x7f8a40003970 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.232+0000 7f8a537fe640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a40003970 0x7f8a40003d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400a790 tx=0x7f8a400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f69258102968e38 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a44034630 con 0x7f8a40003970 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4402f070 con 0x7f8a40003970 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a527fc640 1 -- 172.21.15.84:0/1334009558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a440349d0 con 0x7f8a40003970 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a58c35640 1 -- 172.21.15.84:0/1334009558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a40003970 msgr2=0x7f8a40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a58c35640 1 --2- 172.21.15.84:0/1334009558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a40003970 0x7f8a40003d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400a790 tx=0x7f8a400057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a53fff640 1 -- 172.21.15.84:0/1334009558 reap_dead start 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a58c35640 1 -- 172.21.15.84:0/1334009558 shutdown_connections 2023-12-12T09:20:54.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a58c35640 1 -- 172.21.15.84:0/1334009558 >> 172.21.15.84:0/1334009558 conn(0x7f8a540b2830 msgr2=0x7f8a540b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a58c35640 1 -- 172.21.15.84:0/1334009558 shutdown_connections 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.233+0000 7f8a58c35640 1 -- 172.21.15.84:0/1334009558 wait complete. 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.235+0000 7f8a58c35640 1 Processor -- start 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.235+0000 7f8a58c35640 1 -- start start 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.236+0000 7f8a58c35640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40003970 0x7f8a540c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.236+0000 7f8a58c35640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a541f4770 0x7f8a541f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.236+0000 7f8a58c35640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54163120 0x7f8a541635a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.236+0000 7f8a58c35640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a54163ae0 con 0x7f8a54163120 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.236+0000 7f8a58c35640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540c66a0 con 0x7f8a40003970 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.236+0000 7f8a58c35640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540b3850 con 0x7f8a541f4770 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54163120 0x7f8a541635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54163120 0x7f8a541635a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42364/0 (socket says 172.21.15.84:42364) 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 -- 172.21.15.84:0/1228758629 learned_addr learned my addr 172.21.15.84:0/1228758629 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 -- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a541f4770 msgr2=0x7f8a541f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a52ffd640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a541f4770 0x7f8a541f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a537fe640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40003970 0x7f8a540c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a541f4770 0x7f8a541f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 -- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40003970 msgr2=0x7f8a540c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40003970 0x7f8a540c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 -- 172.21.15.84:0/1228758629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540c4dd0 con 0x7f8a54163120 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a537fe640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40003970 0x7f8a540c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.237+0000 7f8a53fff640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54163120 0x7f8a541635a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c006fd0 tx=0x7f8a4c00f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.238+0000 7f8a4bfff640 1 -- 172.21.15.84:0/1228758629 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c004440 con 0x7f8a54163120 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.238+0000 7f8a4bfff640 1 -- 172.21.15.84:0/1228758629 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c003610 con 0x7f8a54163120 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.238+0000 7f8a4bfff640 1 -- 172.21.15.84:0/1228758629 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0039c0 con 0x7f8a54163120 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.238+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a540c50b0 con 0x7f8a54163120 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.238+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a540c5670 con 0x7f8a54163120 2023-12-12T09:20:54.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.239+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a540c5830 con 0x7f8a54163120 2023-12-12T09:20:54.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.240+0000 7f8a4bfff640 1 -- 172.21.15.84:0/1228758629 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a4c003b20 con 0x7f8a54163120 2023-12-12T09:20:54.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.241+0000 7f8a4bfff640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a3406ae70 0x7f8a3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.241+0000 7f8a4bfff640 1 -- 172.21.15.84:0/1228758629 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8a4c0896a0 con 0x7f8a54163120 2023-12-12T09:20:54.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.241+0000 7f8a537fe640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a3406ae70 0x7f8a3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.242+0000 7f8a537fe640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a3406ae70 0x7f8a3406d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a44034000 tx=0x7f8a44009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.245+0000 7f8a4bfff640 1 -- 172.21.15.84:0/1228758629 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a4c0542f0 con 0x7f8a54163120 2023-12-12T09:20:54.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.449+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8a541f4b50 con 0x7f8a54163120 2023-12-12T09:20:54.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.449+0000 7f8a4bfff640 1 -- 172.21.15.84:0/1228758629 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8a541f4b50 con 0x7f8a54163120 2023-12-12T09:20:54.450 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:20:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a3406ae70 msgr2=0x7f8a3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a3406ae70 0x7f8a3406d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8a44034000 tx=0x7f8a44009030 comp rx=0 tx=0).stop 2023-12-12T09:20:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54163120 msgr2=0x7f8a541635a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54163120 0x7f8a541635a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c006fd0 tx=0x7f8a4c00f8a0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 shutdown_connections 2023-12-12T09:20:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a3406ae70 0x7f8a3406d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a54163120 0x7f8a541635a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a541f4770 0x7f8a541f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 --2- 172.21.15.84:0/1228758629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a40003970 0x7f8a540c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 >> 172.21.15.84:0/1228758629 conn(0x7f8a540b2830 msgr2=0x7f8a540af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:54.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 shutdown_connections 2023-12-12T09:20:54.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.452+0000 7f8a58c35640 1 -- 172.21.15.84:0/1228758629 wait complete. 2023-12-12T09:20:54.471 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:20:54.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:54.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-12T09:20:54.562 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:20:54.562 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:20:54.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:20:54.562 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:20:54.610 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:20:54.611 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:20:54.671 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:20:54.672 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:20:54.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.945+0000 7f886619e640 1 Processor -- start 2023-12-12T09:20:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.945+0000 7f886619e640 1 -- start start 2023-12-12T09:20:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.946+0000 7f886619e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8860071bb0 0x7f8860071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.946+0000 7f886619e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f886013dae0 0x7f886013f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.946+0000 7f886619e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88600724d0 con 0x7f88600ce330 2023-12-12T09:20:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.946+0000 7f886619e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8860140270 con 0x7f8860071bb0 2023-12-12T09:20:54.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.946+0000 7f886619e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88600cd850 con 0x7f886013dae0 2023-12-12T09:20:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.947+0000 7f885f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8860071bb0 0x7f8860071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.947+0000 7f885ffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f886013dae0 0x7f886013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.947+0000 7f885f7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8860071bb0 0x7f8860071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:53902/0 (socket says 172.21.15.84:53902) 2023-12-12T09:20:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.947+0000 7f885f7fe640 1 -- 172.21.15.84:0/3519894363 learned_addr learned my addr 172.21.15.84:0/3519894363 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.948+0000 7f885ffff640 1 -- 172.21.15.84:0/3519894363 >> v2:172.21.15.99:3300/0 conn(0x7f8860071bb0 msgr2=0x7f8860071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.948+0000 7f885ffff640 1 --2- 172.21.15.84:0/3519894363 >> v2:172.21.15.99:3300/0 conn(0x7f8860071bb0 0x7f8860071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.948+0000 7f885ffff640 1 -- 172.21.15.84:0/3519894363 >> v1:172.21.15.99:6789/0 conn(0x7f88600ce330 legacy=0x7f886013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.948+0000 7f885ffff640 1 -- 172.21.15.84:0/3519894363 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88600cdb30 con 0x7f886013dae0 2023-12-12T09:20:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.948+0000 7f885f7fe640 1 --2- 172.21.15.84:0/3519894363 >> v2:172.21.15.99:3300/0 conn(0x7f8860071bb0 0x7f8860071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:20:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.949+0000 7f885ffff640 1 --2- 172.21.15.84:0/3519894363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f886013dae0 0x7f886013f510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8858009d90 tx=0x7f885802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dbca2a21fc297d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.949+0000 7f885effd640 1 -- 172.21.15.84:0/3519894363 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885802cc50 con 0x7f886013dae0 2023-12-12T09:20:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.949+0000 7f885effd640 1 -- 172.21.15.84:0/3519894363 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885802cdb0 con 0x7f886013dae0 2023-12-12T09:20:54.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.949+0000 7f885effd640 1 -- 172.21.15.84:0/3519894363 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858034660 con 0x7f886013dae0 2023-12-12T09:20:54.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.950+0000 7f886619e640 1 -- 172.21.15.84:0/3519894363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f886013dae0 msgr2=0x7f886013f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.950+0000 7f886619e640 1 --2- 172.21.15.84:0/3519894363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f886013dae0 0x7f886013f510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8858009d90 tx=0x7f885802bea0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.950+0000 7f886619e640 1 -- 172.21.15.84:0/3519894363 shutdown_connections 2023-12-12T09:20:54.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.950+0000 7f886619e640 1 --2- 172.21.15.84:0/3519894363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f886013dae0 0x7f886013f510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.950+0000 7f886619e640 1 --2- 172.21.15.84:0/3519894363 >> v2:172.21.15.99:3300/0 conn(0x7f8860071bb0 0x7f8860071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.950+0000 7f886619e640 1 -- 172.21.15.84:0/3519894363 >> 172.21.15.84:0/3519894363 conn(0x7f886006c3d0 msgr2=0x7f886006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:54.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.950+0000 7f886619e640 1 -- 172.21.15.84:0/3519894363 shutdown_connections 2023-12-12T09:20:54.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.950+0000 7f886619e640 1 -- 172.21.15.84:0/3519894363 wait complete. 2023-12-12T09:20:54.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.952+0000 7f886619e640 1 Processor -- start 2023-12-12T09:20:54.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.952+0000 7f886619e640 1 -- start start 2023-12-12T09:20:54.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f886619e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8860071bb0 0x7f8860153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f886619e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88600ce330 0x7f8860131560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f886619e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88601345e0 0x7f88600af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f886619e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88601540c0 con 0x7f8860071bb0 2023-12-12T09:20:54.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f886619e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860133990 con 0x7f88600ce330 2023-12-12T09:20:54.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f886619e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88601592b0 con 0x7f88601345e0 2023-12-12T09:20:54.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f885f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8860071bb0 0x7f8860153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f885f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8860071bb0 0x7f8860153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42374/0 (socket says 172.21.15.84:42374) 2023-12-12T09:20:54.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.953+0000 7f885f7fe640 1 -- 172.21.15.84:0/2581820093 learned_addr learned my addr 172.21.15.84:0/2581820093 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885ffff640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88601345e0 0x7f88600af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885f7fe640 1 -- 172.21.15.84:0/2581820093 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88601345e0 msgr2=0x7f88600af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f8857fff640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88600ce330 0x7f8860131560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885f7fe640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88601345e0 0x7f88600af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885f7fe640 1 -- 172.21.15.84:0/2581820093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88600ce330 msgr2=0x7f8860131560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885f7fe640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88600ce330 0x7f8860131560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885f7fe640 1 -- 172.21.15.84:0/2581820093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88500094d0 con 0x7f8860071bb0 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885f7fe640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8860071bb0 0x7f8860153b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f885000e9b0 tx=0x7f885000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885cff9640 1 -- 172.21.15.84:0/2581820093 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000c9a0 con 0x7f8860071bb0 2023-12-12T09:20:54.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885cff9640 1 -- 172.21.15.84:0/2581820093 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885000cb00 con 0x7f8860071bb0 2023-12-12T09:20:54.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8858009a70 con 0x7f8860071bb0 2023-12-12T09:20:54.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f885cff9640 1 -- 172.21.15.84:0/2581820093 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000ce70 con 0x7f8860071bb0 2023-12-12T09:20:54.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.954+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8860132270 con 0x7f8860071bb0 2023-12-12T09:20:54.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.956+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88600673c0 con 0x7f8860071bb0 2023-12-12T09:20:54.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.957+0000 7f885cff9640 1 -- 172.21.15.84:0/2581820093 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8850013470 con 0x7f8860071bb0 2023-12-12T09:20:54.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.957+0000 7f885cff9640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f884006ae40 0x7f884006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:54.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.958+0000 7f885cff9640 1 -- 172.21.15.84:0/2581820093 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8850089f80 con 0x7f8860071bb0 2023-12-12T09:20:54.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.958+0000 7f8857fff640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f884006ae40 0x7f884006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:54.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.958+0000 7f8857fff640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f884006ae40 0x7f884006d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f88600b4b00 tx=0x7f8848009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:54.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:54.962+0000 7f885cff9640 1 -- 172.21.15.84:0/2581820093 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88500bce90 con 0x7f8860071bb0 2023-12-12T09:20:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.155+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f886006d850 con 0x7f8860071bb0 2023-12-12T09:20:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.157+0000 7f885cff9640 1 -- 172.21.15.84:0/2581820093 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f8850017090 con 0x7f8860071bb0 2023-12-12T09:20:55.158 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:55.159 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:55.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f884006ae40 msgr2=0x7f884006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f884006ae40 0x7f884006d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f88600b4b00 tx=0x7f8848009040 comp rx=0 tx=0).stop 2023-12-12T09:20:55.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8860071bb0 msgr2=0x7f8860153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8860071bb0 0x7f8860153b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f885000e9b0 tx=0x7f885000ee70 comp rx=0 tx=0).stop 2023-12-12T09:20:55.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 shutdown_connections 2023-12-12T09:20:55.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88601345e0 0x7f88600af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88600ce330 0x7f8860131560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f884006ae40 0x7f884006d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 --2- 172.21.15.84:0/2581820093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8860071bb0 0x7f8860153b80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 >> 172.21.15.84:0/2581820093 conn(0x7f886006c3d0 msgr2=0x7f886006da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:55.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 shutdown_connections 2023-12-12T09:20:55.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.160+0000 7f886619e640 1 -- 172.21.15.84:0/2581820093 wait complete. 2023-12-12T09:20:55.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:55.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.400+0000 7f67b17a9640 1 Processor -- start 2023-12-12T09:20:55.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.400+0000 7f67b17a9640 1 -- start start 2023-12-12T09:20:55.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.401+0000 7f67b17a9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f67ac0b40d0 0x7f67ac06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.401+0000 7f67b17a9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67ac0ce6f0 0x7f67ac0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.401+0000 7f67b17a9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ac0ceb80 con 0x7f67ac15be60 2023-12-12T09:20:55.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.401+0000 7f67b17a9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ac0ce260 con 0x7f67ac0ce6f0 2023-12-12T09:20:55.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.401+0000 7f67b17a9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ac0b49f0 con 0x7f67ac0b40d0 2023-12-12T09:20:55.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67a27fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67ac0ce6f0 0x7f67ac0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67a27fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67ac0ce6f0 0x7f67ac0b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42388/0 (socket says 172.21.15.84:42388) 2023-12-12T09:20:55.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67a27fc640 1 -- 172.21.15.84:0/3012929477 learned_addr learned my addr 172.21.15.84:0/3012929477 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:55.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67aaffd640 1 --2- 172.21.15.84:0/3012929477 >> v2:172.21.15.99:3300/0 conn(0x7f67ac0b40d0 0x7f67ac06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67a27fc640 1 -- 172.21.15.84:0/3012929477 >> v2:172.21.15.99:3300/0 conn(0x7f67ac0b40d0 msgr2=0x7f67ac06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:55.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67a27fc640 1 --2- 172.21.15.84:0/3012929477 >> v2:172.21.15.99:3300/0 conn(0x7f67ac0b40d0 0x7f67ac06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67a27fc640 1 -- 172.21.15.84:0/3012929477 >> v1:172.21.15.84:6789/0 conn(0x7f67ac15be60 legacy=0x7f67ac13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67a27fc640 1 -- 172.21.15.84:0/3012929477 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac0cd930 con 0x7f67ac0ce6f0 2023-12-12T09:20:55.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.402+0000 7f67aaffd640 1 --2- 172.21.15.84:0/3012929477 >> v2:172.21.15.99:3300/0 conn(0x7f67ac0b40d0 0x7f67ac06dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.403+0000 7f67a27fc640 1 --2- 172.21.15.84:0/3012929477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0ce6f0 0x7f67ac0b44b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0b4d90 tx=0x7f679402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd6677e6af21590 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67aa7fc640 1 -- 172.21.15.84:0/3012929477 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794030870 con 0x7f67ac0ce6f0 2023-12-12T09:20:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67aa7fc640 1 -- 172.21.15.84:0/3012929477 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67940309d0 con 0x7f67ac0ce6f0 2023-12-12T09:20:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67aa7fc640 1 -- 172.21.15.84:0/3012929477 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794030d60 con 0x7f67ac0ce6f0 2023-12-12T09:20:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67b17a9640 1 -- 172.21.15.84:0/3012929477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0ce6f0 msgr2=0x7f67ac0b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67b17a9640 1 --2- 172.21.15.84:0/3012929477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0ce6f0 0x7f67ac0b44b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0b4d90 tx=0x7f679402b9b0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67b17a9640 1 -- 172.21.15.84:0/3012929477 shutdown_connections 2023-12-12T09:20:55.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67b17a9640 1 --2- 172.21.15.84:0/3012929477 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0ce6f0 0x7f67ac0b44b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67b17a9640 1 --2- 172.21.15.84:0/3012929477 >> v2:172.21.15.99:3300/0 conn(0x7f67ac0b40d0 0x7f67ac06dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67b17a9640 1 -- 172.21.15.84:0/3012929477 >> 172.21.15.84:0/3012929477 conn(0x7f67ac0b0ac0 msgr2=0x7f67ac0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:55.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67b17a9640 1 -- 172.21.15.84:0/3012929477 shutdown_connections 2023-12-12T09:20:55.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.404+0000 7f67b17a9640 1 -- 172.21.15.84:0/3012929477 wait complete. 2023-12-12T09:20:55.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.406+0000 7f67b17a9640 1 Processor -- start 2023-12-12T09:20:55.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.406+0000 7f67b17a9640 1 -- start start 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.407+0000 7f67b17a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0b40d0 0x7f67ac1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.407+0000 7f67b17a9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67ac0ce6f0 0x7f67ac1f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.407+0000 7f67b17a9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67ac15be60 0x7f67ac1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.407+0000 7f67b17a9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac0b1f50 con 0x7f67ac0b40d0 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.407+0000 7f67b17a9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac152370 con 0x7f67ac0ce6f0 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.407+0000 7f67b17a9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ac158c30 con 0x7f67ac15be60 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.407+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0b40d0 0x7f67ac1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.407+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0b40d0 0x7f67ac1586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42400/0 (socket says 172.21.15.84:42400) 2023-12-12T09:20:55.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.408+0000 7f67aaffd640 1 -- 172.21.15.84:0/4145203294 learned_addr learned my addr 172.21.15.84:0/4145203294 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.408+0000 7f67aaffd640 1 -- 172.21.15.84:0/4145203294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67ac15be60 msgr2=0x7f67ac1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.408+0000 7f67aaffd640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67ac15be60 0x7f67ac1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.408+0000 7f67aaffd640 1 -- 172.21.15.84:0/4145203294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67ac0ce6f0 msgr2=0x7f67ac1f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.408+0000 7f67aaffd640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67ac0ce6f0 0x7f67ac1f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.408+0000 7f67aaffd640 1 -- 172.21.15.84:0/4145203294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67940094d0 con 0x7f67ac0b40d0 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.408+0000 7f67aaffd640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0b40d0 0x7f67ac1586f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f679c00c820 tx=0x7f679c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.408+0000 7f67a3fff640 1 -- 172.21.15.84:0/4145203294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c007a30 con 0x7f67ac0b40d0 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.409+0000 7f67a3fff640 1 -- 172.21.15.84:0/4145203294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c007b90 con 0x7f67ac0b40d0 2023-12-12T09:20:55.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.409+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ac0ad810 con 0x7f67ac0b40d0 2023-12-12T09:20:55.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.409+0000 7f67a3fff640 1 -- 172.21.15.84:0/4145203294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c00ce10 con 0x7f67ac0b40d0 2023-12-12T09:20:55.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.409+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ac0addd0 con 0x7f67ac0b40d0 2023-12-12T09:20:55.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.410+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ac0673c0 con 0x7f67ac0b40d0 2023-12-12T09:20:55.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.411+0000 7f67a3fff640 1 -- 172.21.15.84:0/4145203294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f679c0113f0 con 0x7f67ac0b40d0 2023-12-12T09:20:55.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.411+0000 7f67a3fff640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f678c06ae70 0x7f678c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.412+0000 7f67a3fff640 1 -- 172.21.15.84:0/4145203294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f679c089a30 con 0x7f67ac0b40d0 2023-12-12T09:20:55.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.412+0000 7f67a27fc640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f678c06ae70 0x7f678c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.412+0000 7f67a27fc640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f678c06ae70 0x7f678c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6794036000 tx=0x7f679403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:55.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.416+0000 7f67a3fff640 1 -- 172.21.15.84:0/4145203294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f679c0547b0 con 0x7f67ac0b40d0 2023-12-12T09:20:55.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.604+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67ac066300 con 0x7f67ac0b40d0 2023-12-12T09:20:55.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.605+0000 7f67a3fff640 1 -- 172.21.15.84:0/4145203294 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f679c057dd0 con 0x7f67ac0b40d0 2023-12-12T09:20:55.606 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.608+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f678c06ae70 msgr2=0x7f678c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.608+0000 7f67b17a9640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f678c06ae70 0x7f678c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6794036000 tx=0x7f679403b040 comp rx=0 tx=0).stop 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.608+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0b40d0 msgr2=0x7f67ac1586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.608+0000 7f67b17a9640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0b40d0 0x7f67ac1586f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f679c00c820 tx=0x7f679c00cce0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.608+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 shutdown_connections 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.609+0000 7f67b17a9640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f67ac15be60 0x7f67ac1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.609+0000 7f67b17a9640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67ac0ce6f0 0x7f67ac1f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.609+0000 7f67b17a9640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f678c06ae70 0x7f678c06d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.609+0000 7f67b17a9640 1 --2- 172.21.15.84:0/4145203294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67ac0b40d0 0x7f67ac1586f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.609+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 >> 172.21.15.84:0/4145203294 conn(0x7f67ac0b0ac0 msgr2=0x7f67ac159300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:55.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.609+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 shutdown_connections 2023-12-12T09:20:55.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.609+0000 7f67b17a9640 1 -- 172.21.15.84:0/4145203294 wait complete. 2023-12-12T09:20:55.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:55.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.844+0000 7fa4d869b640 1 Processor -- start 2023-12-12T09:20:55.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.845+0000 7fa4d869b640 1 -- start start 2023-12-12T09:20:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.846+0000 7fa4d869b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4d00cd6c0 0x7fa4d00cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.846+0000 7fa4d869b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d015cab0 0x7fa4d015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.846+0000 7fa4d869b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d006ee80 con 0x7fa4d00b02e0 2023-12-12T09:20:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.846+0000 7fa4d869b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d006f690 con 0x7fa4d00cd6c0 2023-12-12T09:20:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.846+0000 7fa4d869b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00ce090 con 0x7fa4d015cab0 2023-12-12T09:20:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d5c36640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4d00cd6c0 0x7fa4d00cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d5c36640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4d00cd6c0 0x7fa4d00cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42412/0 (socket says 172.21.15.84:42412) 2023-12-12T09:20:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d5c36640 1 -- 172.21.15.84:0/3004718715 learned_addr learned my addr 172.21.15.84:0/3004718715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:55.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d6c38640 1 --2- 172.21.15.84:0/3004718715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d015cab0 0x7fa4d015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d5c36640 1 -- 172.21.15.84:0/3004718715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d015cab0 msgr2=0x7fa4d015cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:55.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d5c36640 1 --2- 172.21.15.84:0/3004718715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d015cab0 0x7fa4d015cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d5c36640 1 -- 172.21.15.84:0/3004718715 >> v1:172.21.15.84:6789/0 conn(0x7fa4d00b02e0 legacy=0x7fa4d006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d5c36640 1 -- 172.21.15.84:0/3004718715 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d006f0d0 con 0x7fa4d00cd6c0 2023-12-12T09:20:55.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.847+0000 7fa4d5435640 1 -- 172.21.15.84:0/3004718715 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727403309 0 0) 0x7fa4d006ee80 con 0x7fa4d00b02e0 2023-12-12T09:20:55.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.848+0000 7fa4d5c36640 1 --2- 172.21.15.84:0/3004718715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00cd6c0 0x7fa4d00cdb50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009870 tx=0x7fa4c402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2c3190ee2445e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:55.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d5435640 1 -- 172.21.15.84:0/3004718715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4030840 con 0x7fa4d00cd6c0 2023-12-12T09:20:55.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d5435640 1 -- 172.21.15.84:0/3004718715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c40309a0 con 0x7fa4d00cd6c0 2023-12-12T09:20:55.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d5435640 1 -- 172.21.15.84:0/3004718715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4030d30 con 0x7fa4d00cd6c0 2023-12-12T09:20:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d869b640 1 -- 172.21.15.84:0/3004718715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00cd6c0 msgr2=0x7fa4d00cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d869b640 1 --2- 172.21.15.84:0/3004718715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00cd6c0 0x7fa4d00cdb50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009870 tx=0x7fa4c402b980 comp rx=0 tx=0).stop 2023-12-12T09:20:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d869b640 1 -- 172.21.15.84:0/3004718715 shutdown_connections 2023-12-12T09:20:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d869b640 1 --2- 172.21.15.84:0/3004718715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d015cab0 0x7fa4d015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d869b640 1 --2- 172.21.15.84:0/3004718715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00cd6c0 0x7fa4d00cdb50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d869b640 1 -- 172.21.15.84:0/3004718715 >> 172.21.15.84:0/3004718715 conn(0x7fa4d00b29b0 msgr2=0x7fa4d00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.849+0000 7fa4d869b640 1 -- 172.21.15.84:0/3004718715 shutdown_connections 2023-12-12T09:20:55.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.850+0000 7fa4d869b640 1 -- 172.21.15.84:0/3004718715 wait complete. 2023-12-12T09:20:55.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.851+0000 7fa4d869b640 1 Processor -- start 2023-12-12T09:20:55.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.851+0000 7fa4d869b640 1 -- start start 2023-12-12T09:20:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.852+0000 7fa4d869b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00b02e0 0x7fa4d00c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.852+0000 7fa4d869b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d00cd6c0 0x7fa4d0147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.852+0000 7fa4d869b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4d015cab0 0x7fa4d0148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.852+0000 7fa4d869b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0148a40 con 0x7fa4d00b02e0 2023-12-12T09:20:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.852+0000 7fa4d869b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01490b0 con 0x7fa4d015cab0 2023-12-12T09:20:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.852+0000 7fa4d869b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d015f7f0 con 0x7fa4d00cd6c0 2023-12-12T09:20:55.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00b02e0 0x7fa4d00c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00b02e0 0x7fa4d00c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42414/0 (socket says 172.21.15.84:42414) 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 -- 172.21.15.84:0/2570469200 learned_addr learned my addr 172.21.15.84:0/2570469200 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d5c36640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d00cd6c0 0x7fa4d0147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6c38640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4d015cab0 0x7fa4d0148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 -- 172.21.15.84:0/2570469200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d00cd6c0 msgr2=0x7fa4d0147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d00cd6c0 0x7fa4d0147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 -- 172.21.15.84:0/2570469200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4d015cab0 msgr2=0x7fa4d0148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4d015cab0 0x7fa4d0148500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:55.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 -- 172.21.15.84:0/2570469200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40094d0 con 0x7fa4d00b02e0 2023-12-12T09:20:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.853+0000 7fa4d6437640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00b02e0 0x7fa4d00c6db0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c410 tx=0x7fa4cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.854+0000 7fa4c2ffd640 1 -- 172.21.15.84:0/2570469200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0035f0 con 0x7fa4d00b02e0 2023-12-12T09:20:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.854+0000 7fa4c2ffd640 1 -- 172.21.15.84:0/2570469200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc003770 con 0x7fa4d00b02e0 2023-12-12T09:20:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.854+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d015fad0 con 0x7fa4d00b02e0 2023-12-12T09:20:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.854+0000 7fa4c2ffd640 1 -- 172.21.15.84:0/2570469200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc003b20 con 0x7fa4d00b02e0 2023-12-12T09:20:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.854+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d0148d40 con 0x7fa4d00b02e0 2023-12-12T09:20:55.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.855+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d00673c0 con 0x7fa4d00b02e0 2023-12-12T09:20:55.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.856+0000 7fa4c2ffd640 1 -- 172.21.15.84:0/2570469200 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4cc003c80 con 0x7fa4d00b02e0 2023-12-12T09:20:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.857+0000 7fa4c2ffd640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa4b406ae70 0x7fa4b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.858+0000 7fa4c2ffd640 1 -- 172.21.15.84:0/2570469200 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa4cc088f90 con 0x7fa4d00b02e0 2023-12-12T09:20:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.858+0000 7fa4d5c36640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa4b406ae70 0x7fa4b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:55.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.858+0000 7fa4d5c36640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa4b406ae70 0x7fa4b406d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4036000 tx=0x7fa4c403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:55.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:55.862+0000 7fa4c2ffd640 1 -- 172.21.15.84:0/2570469200 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4cc0bbe90 con 0x7fa4d00b02e0 2023-12-12T09:20:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.052+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4d00cea30 con 0x7fa4d00b02e0 2023-12-12T09:20:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.053+0000 7fa4c2ffd640 1 -- 172.21.15.84:0/2570469200 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4cc0170a0 con 0x7fa4d00b02e0 2023-12-12T09:20:56.053 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:56.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.055+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa4b406ae70 msgr2=0x7fa4b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.055+0000 7fa4d869b640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa4b406ae70 0x7fa4b406d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4036000 tx=0x7fa4c403b040 comp rx=0 tx=0).stop 2023-12-12T09:20:56.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00b02e0 msgr2=0x7fa4d00c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00b02e0 0x7fa4d00c6db0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c410 tx=0x7fa4cc00c8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 shutdown_connections 2023-12-12T09:20:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4d015cab0 0x7fa4d0148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa4d00cd6c0 0x7fa4d0147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa4b406ae70 0x7fa4b406d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 --2- 172.21.15.84:0/2570469200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4d00b02e0 0x7fa4d00c6db0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 >> 172.21.15.84:0/2570469200 conn(0x7fa4d00b29b0 msgr2=0x7fa4d00b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 shutdown_connections 2023-12-12T09:20:56.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.056+0000 7fa4d869b640 1 -- 172.21.15.84:0/2570469200 wait complete. 2023-12-12T09:20:56.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:56.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.282+0000 7fe23432c640 1 Processor -- start 2023-12-12T09:20:56.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.282+0000 7fe23432c640 1 -- start start 2023-12-12T09:20:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.284+0000 7fe23432c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c143860 0x7fe22c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.284+0000 7fe23432c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe22c0b4170 0x7fe22c06d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.284+0000 7fe23432c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c071c00 con 0x7fe22c06d970 2023-12-12T09:20:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.284+0000 7fe23432c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c06de00 con 0x7fe22c0b4170 2023-12-12T09:20:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.284+0000 7fe23432c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c143c40 con 0x7fe22c143860 2023-12-12T09:20:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.285+0000 7fe2318c7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe22c0b4170 0x7fe22c06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.285+0000 7fe2318c7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe22c0b4170 0x7fe22c06d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34472/0 (socket says 172.21.15.84:34472) 2023-12-12T09:20:56.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.285+0000 7fe2318c7640 1 -- 172.21.15.84:0/1531172678 learned_addr learned my addr 172.21.15.84:0/1531172678 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:56.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.285+0000 7fe2320c8640 1 --2- 172.21.15.84:0/1531172678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c143860 0x7fe22c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.285+0000 7fe2318c7640 1 -- 172.21.15.84:0/1531172678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c143860 msgr2=0x7fe22c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:56.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.285+0000 7fe2318c7640 1 --2- 172.21.15.84:0/1531172678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c143860 0x7fe22c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.285+0000 7fe2318c7640 1 -- 172.21.15.84:0/1531172678 >> v1:172.21.15.99:6789/0 conn(0x7fe22c06d970 legacy=0x7fe22c15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:56.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.285+0000 7fe2318c7640 1 -- 172.21.15.84:0/1531172678 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c0b4780 con 0x7fe22c0b4170 2023-12-12T09:20:56.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.286+0000 7fe2318c7640 1 --2- 172.21.15.84:0/1531172678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c0b4170 0x7fe22c06d430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009870 tx=0x7fe21c02d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41753db7eaa55de server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:56.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.287+0000 7fe2310c6640 1 -- 172.21.15.84:0/1531172678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c031810 con 0x7fe22c0b4170 2023-12-12T09:20:56.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.287+0000 7fe2310c6640 1 -- 172.21.15.84:0/1531172678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21c031970 con 0x7fe22c0b4170 2023-12-12T09:20:56.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.287+0000 7fe2310c6640 1 -- 172.21.15.84:0/1531172678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c031d00 con 0x7fe22c0b4170 2023-12-12T09:20:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.287+0000 7fe23432c640 1 -- 172.21.15.84:0/1531172678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c0b4170 msgr2=0x7fe22c06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.287+0000 7fe23432c640 1 --2- 172.21.15.84:0/1531172678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c0b4170 0x7fe22c06d430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009870 tx=0x7fe21c02d9f0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.288+0000 7fe23432c640 1 -- 172.21.15.84:0/1531172678 shutdown_connections 2023-12-12T09:20:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.288+0000 7fe23432c640 1 --2- 172.21.15.84:0/1531172678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c0b4170 0x7fe22c06d430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.288+0000 7fe23432c640 1 --2- 172.21.15.84:0/1531172678 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c143860 0x7fe22c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.288+0000 7fe23432c640 1 -- 172.21.15.84:0/1531172678 >> 172.21.15.84:0/1531172678 conn(0x7fe22c0b0ac0 msgr2=0x7fe22c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.288+0000 7fe23432c640 1 -- 172.21.15.84:0/1531172678 shutdown_connections 2023-12-12T09:20:56.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.288+0000 7fe23432c640 1 -- 172.21.15.84:0/1531172678 wait complete. 2023-12-12T09:20:56.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.289+0000 7fe23432c640 1 Processor -- start 2023-12-12T09:20:56.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.289+0000 7fe23432c640 1 -- start start 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.290+0000 7fe23432c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c06d970 0x7fe22c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.290+0000 7fe23432c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c0b4170 0x7fe22c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.290+0000 7fe23432c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe22c143860 0x7fe22c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.290+0000 7fe23432c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0acdd0 con 0x7fe22c06d970 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.290+0000 7fe23432c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0ad000 con 0x7fe22c143860 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.290+0000 7fe23432c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0ad2e0 con 0x7fe22c0b4170 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c06d970 0x7fe22c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c06d970 0x7fe22c15a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34476/0 (socket says 172.21.15.84:34476) 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 -- 172.21.15.84:0/430165915 learned_addr learned my addr 172.21.15.84:0/430165915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2318c7640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c0b4170 0x7fe22c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 -- 172.21.15.84:0/430165915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c0b4170 msgr2=0x7fe22c0ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c0b4170 0x7fe22c0ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 -- 172.21.15.84:0/430165915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe22c143860 msgr2=0x7fe22c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe22c143860 0x7fe22c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 -- 172.21.15.84:0/430165915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0094d0 con 0x7fe22c06d970 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.291+0000 7fe2320c8640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c06d970 0x7fe22c15a890 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe22800c7f0 tx=0x7fe22800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.292+0000 7fe222ffd640 1 -- 172.21.15.84:0/430165915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228004220 con 0x7fe22c06d970 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.292+0000 7fe222ffd640 1 -- 172.21.15.84:0/430165915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2280043a0 con 0x7fe22c06d970 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.292+0000 7fe222ffd640 1 -- 172.21.15.84:0/430165915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228007860 con 0x7fe22c06d970 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.292+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c0ad5c0 con 0x7fe22c06d970 2023-12-12T09:20:56.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.292+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0cae20 con 0x7fe22c06d970 2023-12-12T09:20:56.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.293+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c0673c0 con 0x7fe22c06d970 2023-12-12T09:20:56.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.294+0000 7fe222ffd640 1 -- 172.21.15.84:0/430165915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe228007bd0 con 0x7fe22c06d970 2023-12-12T09:20:56.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.294+0000 7fe222ffd640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe21006ae40 0x7fe21006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.295+0000 7fe222ffd640 1 -- 172.21.15.84:0/430165915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe2280898c0 con 0x7fe22c06d970 2023-12-12T09:20:56.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.295+0000 7fe2318c7640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe21006ae40 0x7fe21006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.296+0000 7fe2318c7640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe21006ae40 0x7fe21006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe21c038000 tx=0x7fe21c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:56.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.299+0000 7fe222ffd640 1 -- 172.21.15.84:0/430165915 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe228054640 con 0x7fe22c06d970 2023-12-12T09:20:56.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.489+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe22c0afa40 con 0x7fe22c06d970 2023-12-12T09:20:56.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.490+0000 7fe222ffd640 1 -- 172.21.15.84:0/430165915 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe22801e0a0 con 0x7fe22c06d970 2023-12-12T09:20:56.490 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:56.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe21006ae40 msgr2=0x7fe21006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe21006ae40 0x7fe21006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe21c038000 tx=0x7fe21c03b040 comp rx=0 tx=0).stop 2023-12-12T09:20:56.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c06d970 msgr2=0x7fe22c15a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c06d970 0x7fe22c15a890 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe22800c7f0 tx=0x7fe22800ccb0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 shutdown_connections 2023-12-12T09:20:56.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe22c143860 0x7fe22c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe22c0b4170 0x7fe22c0ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe21006ae40 0x7fe21006d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.492+0000 7fe23432c640 1 --2- 172.21.15.84:0/430165915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe22c06d970 0x7fe22c15a890 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.493+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 >> 172.21.15.84:0/430165915 conn(0x7fe22c0b0ac0 msgr2=0x7fe22c06d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:56.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.493+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 shutdown_connections 2023-12-12T09:20:56.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.493+0000 7fe23432c640 1 -- 172.21.15.84:0/430165915 wait complete. 2023-12-12T09:20:56.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:56.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.710+0000 7f3ce609b640 1 Processor -- start 2023-12-12T09:20:56.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.711+0000 7f3ce609b640 1 -- start start 2023-12-12T09:20:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.712+0000 7f3ce609b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ce0160990 0x7f3ce00cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.712+0000 7f3ce609b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ce00d1410 0x7f3ce00cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.712+0000 7f3ce609b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce00d1960 con 0x7f3ce00b3100 2023-12-12T09:20:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.712+0000 7f3ce609b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00d2200 con 0x7f3ce00d1410 2023-12-12T09:20:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.712+0000 7f3ce609b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00b29d0 con 0x7f3ce0160990 2023-12-12T09:20:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.712+0000 7f3cdeffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ce00d1410 0x7f3ce00cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.713+0000 7f3cdeffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ce00d1410 0x7f3ce00cffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34486/0 (socket says 172.21.15.84:34486) 2023-12-12T09:20:56.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.713+0000 7f3cdeffd640 1 -- 172.21.15.84:0/1472829825 learned_addr learned my addr 172.21.15.84:0/1472829825 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.713+0000 7f3cdf7fe640 1 --2- 172.21.15.84:0/1472829825 >> v2:172.21.15.99:3300/0 conn(0x7f3ce0160990 0x7f3ce00cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.713+0000 7f3cdeffd640 1 -- 172.21.15.84:0/1472829825 >> v2:172.21.15.99:3300/0 conn(0x7f3ce0160990 msgr2=0x7f3ce00cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.713+0000 7f3cdeffd640 1 --2- 172.21.15.84:0/1472829825 >> v2:172.21.15.99:3300/0 conn(0x7f3ce0160990 0x7f3ce00cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.713+0000 7f3cdeffd640 1 -- 172.21.15.84:0/1472829825 >> v1:172.21.15.99:6789/0 conn(0x7f3ce00b3100 legacy=0x7f3ce00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.713+0000 7f3cdeffd640 1 -- 172.21.15.84:0/1472829825 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00d1c40 con 0x7f3ce00d1410 2023-12-12T09:20:56.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.714+0000 7f3cdeffd640 1 --2- 172.21.15.84:0/1472829825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00cffc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3ce008c130 tx=0x7f3cd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9f91d4d9c18a20 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:56.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.714+0000 7f3cde7fc640 1 -- 172.21.15.84:0/1472829825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4031870 con 0x7f3ce00d1410 2023-12-12T09:20:56.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.714+0000 7f3cde7fc640 1 -- 172.21.15.84:0/1472829825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd40319d0 con 0x7f3ce00d1410 2023-12-12T09:20:56.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.714+0000 7f3cde7fc640 1 -- 172.21.15.84:0/1472829825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4031d60 con 0x7f3ce00d1410 2023-12-12T09:20:56.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.715+0000 7f3ce609b640 1 -- 172.21.15.84:0/1472829825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 msgr2=0x7f3ce00cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.715+0000 7f3ce609b640 1 --2- 172.21.15.84:0/1472829825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00cffc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3ce008c130 tx=0x7f3cd402b910 comp rx=0 tx=0).stop 2023-12-12T09:20:56.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.715+0000 7f3ce609b640 1 -- 172.21.15.84:0/1472829825 shutdown_connections 2023-12-12T09:20:56.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.715+0000 7f3ce609b640 1 --2- 172.21.15.84:0/1472829825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00cffc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.715+0000 7f3ce609b640 1 --2- 172.21.15.84:0/1472829825 >> v2:172.21.15.99:3300/0 conn(0x7f3ce0160990 0x7f3ce00cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.715+0000 7f3ce609b640 1 -- 172.21.15.84:0/1472829825 >> 172.21.15.84:0/1472829825 conn(0x7f3ce009c3a0 msgr2=0x7f3ce00d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:56.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.715+0000 7f3ce609b640 1 -- 172.21.15.84:0/1472829825 shutdown_connections 2023-12-12T09:20:56.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.715+0000 7f3ce609b640 1 -- 172.21.15.84:0/1472829825 wait complete. 2023-12-12T09:20:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.717+0000 7f3ce609b640 1 Processor -- start 2023-12-12T09:20:56.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.717+0000 7f3ce609b640 1 -- start start 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3ce609b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce00b3100 0x7f3ce00b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3ce609b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3ce609b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ce0160990 0x7f3ce00b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3ce609b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00b68d0 con 0x7f3ce00d1410 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3ce609b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00c7f60 con 0x7f3ce00b3100 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3ce609b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00b6030 con 0x7f3ce0160990 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34496/0 (socket says 172.21.15.84:34496) 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.718+0000 7f3cdeffd640 1 -- 172.21.15.84:0/2412696966 learned_addr learned my addr 172.21.15.84:0/2412696966 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:56.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cdf7fe640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce00b3100 0x7f3ce00b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cdffff640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ce0160990 0x7f3ce00b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cdeffd640 1 -- 172.21.15.84:0/2412696966 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ce0160990 msgr2=0x7f3ce00b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cdeffd640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ce0160990 0x7f3ce00b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cdeffd640 1 -- 172.21.15.84:0/2412696966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce00b3100 msgr2=0x7f3ce00b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cdeffd640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce00b3100 0x7f3ce00b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cdeffd640 1 -- 172.21.15.84:0/2412696966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40094d0 con 0x7f3ce00d1410 2023-12-12T09:20:56.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cdeffd640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00b0e80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4000c00 tx=0x7f3cd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:56.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cc7fff640 1 -- 172.21.15.84:0/2412696966 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd403ac60 con 0x7f3ce00d1410 2023-12-12T09:20:56.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cc7fff640 1 -- 172.21.15.84:0/2412696966 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd403adc0 con 0x7f3ce00d1410 2023-12-12T09:20:56.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3cc7fff640 1 -- 172.21.15.84:0/2412696966 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40445f0 con 0x7f3ce00d1410 2023-12-12T09:20:56.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce0160ef0 con 0x7f3ce00d1410 2023-12-12T09:20:56.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.719+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce00b65f0 con 0x7f3ce00d1410 2023-12-12T09:20:56.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.720+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce0072eb0 con 0x7f3ce00d1410 2023-12-12T09:20:56.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.721+0000 7f3cc7fff640 1 -- 172.21.15.84:0/2412696966 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cd404d450 con 0x7f3ce00d1410 2023-12-12T09:20:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.723+0000 7f3cc7fff640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ccc06ae70 0x7f3ccc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.723+0000 7f3cc7fff640 1 -- 172.21.15.84:0/2412696966 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3cd402d040 con 0x7f3ce00d1410 2023-12-12T09:20:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.723+0000 7f3cdf7fe640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ccc06ae70 0x7f3ccc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:56.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.723+0000 7f3cdf7fe640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ccc06ae70 0x7f3ccc06d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0006fd0 tx=0x7f3cd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:56.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.728+0000 7f3cc7fff640 1 -- 172.21.15.84:0/2412696966 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3cd4076c60 con 0x7f3ce00d1410 2023-12-12T09:20:56.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.902+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3ce015fff0 con 0x7f3ce00d1410 2023-12-12T09:20:56.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.902+0000 7f3cc7fff640 1 -- 172.21.15.84:0/2412696966 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3cd4035020 con 0x7f3ce00d1410 2023-12-12T09:20:56.903 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:56.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.904+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ccc06ae70 msgr2=0x7f3ccc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.904+0000 7f3ce609b640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ccc06ae70 0x7f3ccc06d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0006fd0 tx=0x7f3cd0008040 comp rx=0 tx=0).stop 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.904+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 msgr2=0x7f3ce00b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.904+0000 7f3ce609b640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00b0e80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4000c00 tx=0x7f3cd40046c0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.905+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 shutdown_connections 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.905+0000 7f3ce609b640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3ce0160990 0x7f3ce00b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.905+0000 7f3ce609b640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ccc06ae70 0x7f3ccc06d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.905+0000 7f3ce609b640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ce00d1410 0x7f3ce00b0e80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.905+0000 7f3ce609b640 1 --2- 172.21.15.84:0/2412696966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce00b3100 0x7f3ce00b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.905+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 >> 172.21.15.84:0/2412696966 conn(0x7f3ce009c3a0 msgr2=0x7f3ce015e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.905+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 shutdown_connections 2023-12-12T09:20:56.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:56.905+0000 7f3ce609b640 1 -- 172.21.15.84:0/2412696966 wait complete. 2023-12-12T09:20:56.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:20:57.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.131+0000 7efcacb54640 1 Processor -- start 2023-12-12T09:20:57.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.132+0000 7efcacb54640 1 -- start start 2023-12-12T09:20:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efcacb54640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca80cff90 0x7efca80d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efcacb54640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efca80d1470 0x7efca80b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efcacb54640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca80b6460 con 0x7efca815d130 2023-12-12T09:20:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efcacb54640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca815d510 con 0x7efca80d1470 2023-12-12T09:20:57.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efcacb54640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca80d1900 con 0x7efca80cff90 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efca77fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efca815d130 0x7efca80cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54950/0 (socket says 172.21.15.84:54950) 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efca77fe640 1 -- 172.21.15.84:0/3689828010 learned_addr learned my addr 172.21.15.84:0/3689828010 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715163722 0 0) 0x7efca80b6460 con 0x7efca815d130 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.133+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc94003520 con 0x7efca815d130 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca7fff640 1 --2- 172.21.15.84:0/3689828010 >> v2:172.21.15.99:3300/0 conn(0x7efca80d1470 0x7efca80b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca6ffd640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca80cff90 0x7efca80d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3307824214 0 0) 0x7efc94003520 con 0x7efca815d130 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca80cff90 msgr2=0x7efca80d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca80cff90 0x7efca80d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 >> v2:172.21.15.99:3300/0 conn(0x7efca80d1470 msgr2=0x7efca80b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 --2- 172.21.15.84:0/3689828010 >> v2:172.21.15.99:3300/0 conn(0x7efca80d1470 0x7efca80b68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80d1b50 con 0x7efca815d130 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7efc980019f0 con 0x7efca815d130 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 >> v1:172.21.15.84:6789/0 conn(0x7efca815d130 legacy=0x7efca80cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc94003970 0x7efc94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc940047c0 0x7efc94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca80cff90 0x7efc94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca815d510 con 0x7efc940047c0 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80d1900 con 0x7efc94003970 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9400ba30 con 0x7efca80cff90 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca7fff640 1 --2- 172.21.15.84:0/3689828010 >> v2:172.21.15.99:3300/0 conn(0x7efca80d1470 0x7efca80b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.134+0000 7efca6ffd640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc940047c0 0x7efc94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.135+0000 7efca77fe640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc94003970 0x7efc94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.135+0000 7efca7fff640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca80cff90 0x7efc94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.135+0000 7efca6ffd640 1 -- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca80cff90 msgr2=0x7efc94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.135+0000 7efca6ffd640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca80cff90 0x7efc94005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.135+0000 7efca6ffd640 1 -- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc94003970 msgr2=0x7efc94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.135+0000 7efca6ffd640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc94003970 0x7efc94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.135+0000 7efca6ffd640 1 -- 172.21.15.84:0/3689828010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94003520 con 0x7efc940047c0 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.135+0000 7efca77fe640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc94003970 0x7efc94003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:57.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.136+0000 7efca6ffd640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc940047c0 0x7efc94004c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efc9000ba00 tx=0x7efc940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92be36a9c0f8758 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.136+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc900325f0 con 0x7efc940047c0 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.136+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc90032750 con 0x7efc940047c0 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.136+0000 7efca67fc640 1 -- 172.21.15.84:0/3689828010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90032ae0 con 0x7efc940047c0 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.137+0000 7efcacb54640 1 -- 172.21.15.84:0/3689828010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc940047c0 msgr2=0x7efc94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.137+0000 7efcacb54640 1 --2- 172.21.15.84:0/3689828010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc940047c0 0x7efc94004c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efc9000ba00 tx=0x7efc940057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.137+0000 7efca7fff640 1 -- 172.21.15.84:0/3689828010 reap_dead start 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.137+0000 7efcacb54640 1 -- 172.21.15.84:0/3689828010 shutdown_connections 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.137+0000 7efcacb54640 1 -- 172.21.15.84:0/3689828010 >> 172.21.15.84:0/3689828010 conn(0x7efca80d2e90 msgr2=0x7efca80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.137+0000 7efcacb54640 1 -- 172.21.15.84:0/3689828010 shutdown_connections 2023-12-12T09:20:57.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.137+0000 7efcacb54640 1 -- 172.21.15.84:0/3689828010 wait complete. 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.139+0000 7efcacb54640 1 Processor -- start 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.139+0000 7efcacb54640 1 -- start start 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efcacb54640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc940047c0 0x7efca8151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efcacb54640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca815e080 0x7efca815e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efcacb54640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca815fa60 0x7efca815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efcacb54640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca815f900 con 0x7efca815fa60 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efcacb54640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca8160420 con 0x7efc940047c0 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efcacb54640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca815ed80 con 0x7efca815e080 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efca7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca815fa60 0x7efca815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efca7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca815fa60 0x7efca815fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34514/0 (socket says 172.21.15.84:34514) 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efca7fff640 1 -- 172.21.15.84:0/2257157854 learned_addr learned my addr 172.21.15.84:0/2257157854 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.140+0000 7efca77fe640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc940047c0 0x7efca8151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efca6ffd640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca815e080 0x7efca815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efca7fff640 1 -- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca815e080 msgr2=0x7efca815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efca7fff640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca815e080 0x7efca815e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efca7fff640 1 -- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc940047c0 msgr2=0x7efca8151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efca7fff640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc940047c0 0x7efca8151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efca7fff640 1 -- 172.21.15.84:0/2257157854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca815f060 con 0x7efca815fa60 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efca77fe640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc940047c0 0x7efca8151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efca7fff640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca815fa60 0x7efca815fee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efca80c6990 tx=0x7efca000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efc9ffff640 1 -- 172.21.15.84:0/2257157854 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0004030 con 0x7efca815fa60 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efc9ffff640 1 -- 172.21.15.84:0/2257157854 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca000c070 con 0x7efca815fa60 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efc9ffff640 1 -- 172.21.15.84:0/2257157854 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0004390 con 0x7efca815fa60 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca815f340 con 0x7efca815fa60 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.141+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca80cb5b0 con 0x7efca815fa60 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.142+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca80cb3f0 con 0x7efca815fa60 2023-12-12T09:20:57.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.143+0000 7efc9ffff640 1 -- 172.21.15.84:0/2257157854 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efca0003610 con 0x7efca815fa60 2023-12-12T09:20:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.144+0000 7efc9ffff640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc8806ae70 0x7efc8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.145+0000 7efc9ffff640 1 -- 172.21.15.84:0/2257157854 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efca0089780 con 0x7efca815fa60 2023-12-12T09:20:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.145+0000 7efca77fe640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc8806ae70 0x7efc8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.145+0000 7efca77fe640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc8806ae70 0x7efc8806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efc98001b20 tx=0x7efc98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:57.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.149+0000 7efc9ffff640 1 -- 172.21.15.84:0/2257157854 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efca00543d0 con 0x7efca815fa60 2023-12-12T09:20:57.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.354+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efca80673c0 con 0x7efca815fa60 2023-12-12T09:20:57.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.354+0000 7efc9ffff640 1 -- 172.21.15.84:0/2257157854 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7efca00579f0 con 0x7efca815fa60 2023-12-12T09:20:57.355 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:20:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc8806ae70 msgr2=0x7efc8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc8806ae70 0x7efc8806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efc98001b20 tx=0x7efc98009040 comp rx=0 tx=0).stop 2023-12-12T09:20:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca815fa60 msgr2=0x7efca815fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca815fa60 0x7efca815fee0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efca80c6990 tx=0x7efca000f670 comp rx=0 tx=0).stop 2023-12-12T09:20:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 shutdown_connections 2023-12-12T09:20:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc8806ae70 0x7efc8806d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efca815fa60 0x7efca815fee0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efca815e080 0x7efca815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 --2- 172.21.15.84:0/2257157854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc940047c0 0x7efca8151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 >> 172.21.15.84:0/2257157854 conn(0x7efca80d2e90 msgr2=0x7efca80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 shutdown_connections 2023-12-12T09:20:57.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.357+0000 7efcacb54640 1 -- 172.21.15.84:0/2257157854 wait complete. 2023-12-12T09:20:57.376 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:20:57.376 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:20:57.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:20:57.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:20:57.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:20:57.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.650+0000 7f7cb249f640 1 Processor -- start 2023-12-12T09:20:57.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.650+0000 7f7cb249f640 1 -- start start 2023-12-12T09:20:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.652+0000 7f7cb249f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac144740 0x7f7cac06de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.652+0000 7f7cb249f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cac15f4c0 0x7f7cac0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.652+0000 7f7cb249f640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac144b20 con 0x7f7cac15e950 2023-12-12T09:20:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.652+0000 7f7cb249f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac06d670 con 0x7f7cac15f4c0 2023-12-12T09:20:57.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.652+0000 7f7cb249f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac06cdd0 con 0x7f7cac144740 2023-12-12T09:20:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.653+0000 7f7cb149d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac144740 0x7f7cac06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.653+0000 7f7cb1c9e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cac15f4c0 0x7f7cac0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.653+0000 7f7cb0c9c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7cac15e950 0x7f7cac15edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:42022/0 (socket says 172.21.15.84:42022) 2023-12-12T09:20:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.653+0000 7f7cb0c9c640 1 -- 172.21.15.84:0/2263919633 learned_addr learned my addr 172.21.15.84:0/2263919633 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.654+0000 7f7ca3fff640 1 -- 172.21.15.84:0/2263919633 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812614887 0 0) 0x7f7cac144b20 con 0x7f7cac15e950 2023-12-12T09:20:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.654+0000 7f7ca3fff640 1 -- 172.21.15.84:0/2263919633 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c98003520 con 0x7f7cac15e950 2023-12-12T09:20:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.654+0000 7f7cb1c9e640 1 -- 172.21.15.84:0/2263919633 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac144740 msgr2=0x7f7cac06de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.654+0000 7f7cb1c9e640 1 --2- 172.21.15.84:0/2263919633 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac144740 0x7f7cac06de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.654+0000 7f7cb1c9e640 1 -- 172.21.15.84:0/2263919633 >> v1:172.21.15.99:6789/0 conn(0x7f7cac15e950 legacy=0x7f7cac15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.654+0000 7f7cb1c9e640 1 -- 172.21.15.84:0/2263919633 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac06d0b0 con 0x7f7cac15f4c0 2023-12-12T09:20:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.654+0000 7f7cb149d640 1 --2- 172.21.15.84:0/2263919633 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac144740 0x7f7cac06de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:20:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.655+0000 7f7cb1c9e640 1 --2- 172.21.15.84:0/2263919633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 0x7f7cac0705b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009d90 tx=0x7f7ca402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b93858dd629731 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.656+0000 7f7ca3fff640 1 -- 172.21.15.84:0/2263919633 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca402cc60 con 0x7f7cac15f4c0 2023-12-12T09:20:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.656+0000 7f7ca3fff640 1 -- 172.21.15.84:0/2263919633 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca402cdc0 con 0x7f7cac15f4c0 2023-12-12T09:20:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.656+0000 7f7ca3fff640 1 -- 172.21.15.84:0/2263919633 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4034660 con 0x7f7cac15f4c0 2023-12-12T09:20:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.657+0000 7f7cb249f640 1 -- 172.21.15.84:0/2263919633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 msgr2=0x7f7cac0705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.657+0000 7f7cb249f640 1 --2- 172.21.15.84:0/2263919633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 0x7f7cac0705b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009d90 tx=0x7f7ca402beb0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.657+0000 7f7cb249f640 1 -- 172.21.15.84:0/2263919633 shutdown_connections 2023-12-12T09:20:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.657+0000 7f7cb249f640 1 --2- 172.21.15.84:0/2263919633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 0x7f7cac0705b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.657+0000 7f7cb249f640 1 --2- 172.21.15.84:0/2263919633 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac144740 0x7f7cac06de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.657+0000 7f7cb249f640 1 -- 172.21.15.84:0/2263919633 >> 172.21.15.84:0/2263919633 conn(0x7f7cac0b07f0 msgr2=0x7f7cac0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.657+0000 7f7cb249f640 1 -- 172.21.15.84:0/2263919633 shutdown_connections 2023-12-12T09:20:57.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.657+0000 7f7cb249f640 1 -- 172.21.15.84:0/2263919633 wait complete. 2023-12-12T09:20:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.659+0000 7f7cb249f640 1 Processor -- start 2023-12-12T09:20:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.659+0000 7f7cb249f640 1 -- start start 2023-12-12T09:20:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb249f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cac144740 0x7f7cac1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb249f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac15e950 0x7f7cac1f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb249f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 0x7f7cac0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb249f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac0b38f0 con 0x7f7cac144740 2023-12-12T09:20:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb249f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac13fe30 con 0x7f7cac15f4c0 2023-12-12T09:20:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb249f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1f39a0 con 0x7f7cac15e950 2023-12-12T09:20:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb149d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cac144740 0x7f7cac1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb149d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cac144740 0x7f7cac1f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34524/0 (socket says 172.21.15.84:34524) 2023-12-12T09:20:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb149d640 1 -- 172.21.15.84:0/1299385350 learned_addr learned my addr 172.21.15.84:0/1299385350 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb0c9c640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac15e950 0x7f7cac1f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb1c9e640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 0x7f7cac0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb149d640 1 -- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac15e950 msgr2=0x7f7cac1f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb149d640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac15e950 0x7f7cac1f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb149d640 1 -- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 msgr2=0x7f7cac0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb149d640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 0x7f7cac0b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb149d640 1 -- 172.21.15.84:0/1299385350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8009400 con 0x7f7cac144740 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.660+0000 7f7cb0c9c640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac15e950 0x7f7cac1f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.661+0000 7f7cb149d640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cac144740 0x7f7cac1f5d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800ebe0 tx=0x7f7ca800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.661+0000 7f7ca1ffb640 1 -- 172.21.15.84:0/1299385350 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8009760 con 0x7f7cac144740 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.661+0000 7f7ca1ffb640 1 -- 172.21.15.84:0/1299385350 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca800cc30 con 0x7f7cac144740 2023-12-12T09:20:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.661+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca4009a70 con 0x7f7cac144740 2023-12-12T09:20:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.661+0000 7f7ca1ffb640 1 -- 172.21.15.84:0/1299385350 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800eee0 con 0x7f7cac144740 2023-12-12T09:20:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.661+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac0b2b30 con 0x7f7cac144740 2023-12-12T09:20:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.663+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cac0673c0 con 0x7f7cac144740 2023-12-12T09:20:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.663+0000 7f7ca1ffb640 1 -- 172.21.15.84:0/1299385350 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ca8013470 con 0x7f7cac144740 2023-12-12T09:20:57.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.664+0000 7f7ca1ffb640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c9006ae40 0x7f7c9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:57.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.664+0000 7f7ca1ffb640 1 -- 172.21.15.84:0/1299385350 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ca8089c50 con 0x7f7cac144740 2023-12-12T09:20:57.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.665+0000 7f7cb0c9c640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c9006ae40 0x7f7c9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:57.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.665+0000 7f7cb0c9c640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c9006ae40 0x7f7c9006d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0cb8c0 tx=0x7f7c9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:57.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.669+0000 7f7ca1ffb640 1 -- 172.21.15.84:0/1299385350 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ca808f020 con 0x7f7cac144740 2023-12-12T09:20:57.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.862+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cac071f60 con 0x7f7cac144740 2023-12-12T09:20:57.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.865+0000 7f7ca1ffb640 1 -- 172.21.15.84:0/1299385350 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f7ca8017090 con 0x7f7cac144740 2023-12-12T09:20:57.866 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:20:57.866 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:20:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c9006ae40 msgr2=0x7f7c9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c9006ae40 0x7f7c9006d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0cb8c0 tx=0x7f7c9c009040 comp rx=0 tx=0).stop 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cac144740 msgr2=0x7f7cac1f5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cac144740 0x7f7cac1f5d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800ebe0 tx=0x7f7ca800c520 comp rx=0 tx=0).stop 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 shutdown_connections 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac15f4c0 0x7f7cac0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7cac15e950 0x7f7cac1f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c9006ae40 0x7f7c9006d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 --2- 172.21.15.84:0/1299385350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cac144740 0x7f7cac1f5d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 >> 172.21.15.84:0/1299385350 conn(0x7f7cac0b07f0 msgr2=0x7f7cac06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 shutdown_connections 2023-12-12T09:20:57.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:57.868+0000 7f7cb249f640 1 -- 172.21.15.84:0/1299385350 wait complete. 2023-12-12T09:20:57.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:20:57.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:20:58.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.105+0000 7fa778d81640 1 Processor -- start 2023-12-12T09:20:58.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.105+0000 7fa778d81640 1 -- start start 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa778d81640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa774144600 0x7fa7740b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa778d81640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa7740cf640 0x7fa7740b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa778d81640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77415eb20 con 0x7fa77415c140 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa778d81640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77415ee00 con 0x7fa7740cf640 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa778d81640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77415f0e0 con 0x7fa774144600 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa773fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa7740cf640 0x7fa7740b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa772ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa77415c140 0x7fa7740cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54962/0 (socket says 172.21.15.84:54962) 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa772ffd640 1 -- 172.21.15.84:0/687161135 learned_addr learned my addr 172.21.15.84:0/687161135 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa7737fe640 1 --2- 172.21.15.84:0/687161135 >> v2:172.21.15.99:3300/0 conn(0x7fa774144600 0x7fa7740b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa773fff640 1 -- 172.21.15.84:0/687161135 >> v2:172.21.15.99:3300/0 conn(0x7fa774144600 msgr2=0x7fa7740b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa773fff640 1 --2- 172.21.15.84:0/687161135 >> v2:172.21.15.99:3300/0 conn(0x7fa774144600 0x7fa7740b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa773fff640 1 -- 172.21.15.84:0/687161135 >> v1:172.21.15.84:6789/0 conn(0x7fa77415c140 legacy=0x7fa7740cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.107+0000 7fa773fff640 1 -- 172.21.15.84:0/687161135 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77415f3c0 con 0x7fa7740cf640 2023-12-12T09:20:58.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.109+0000 7fa773fff640 1 --2- 172.21.15.84:0/687161135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7740cf640 0x7fa7740b20e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa7740cfba0 tx=0x7fa76c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc9503ed643db94 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.109+0000 7fa7727fc640 1 -- 172.21.15.84:0/687161135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c02cc70 con 0x7fa7740cf640 2023-12-12T09:20:58.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.109+0000 7fa7727fc640 1 -- 172.21.15.84:0/687161135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c02cdd0 con 0x7fa7740cf640 2023-12-12T09:20:58.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.109+0000 7fa7727fc640 1 -- 172.21.15.84:0/687161135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c034660 con 0x7fa7740cf640 2023-12-12T09:20:58.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.110+0000 7fa778d81640 1 -- 172.21.15.84:0/687161135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7740cf640 msgr2=0x7fa7740b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.110+0000 7fa778d81640 1 --2- 172.21.15.84:0/687161135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7740cf640 0x7fa7740b20e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa7740cfba0 tx=0x7fa76c02bec0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.110+0000 7fa778d81640 1 -- 172.21.15.84:0/687161135 shutdown_connections 2023-12-12T09:20:58.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.110+0000 7fa778d81640 1 --2- 172.21.15.84:0/687161135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7740cf640 0x7fa7740b20e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.110+0000 7fa778d81640 1 --2- 172.21.15.84:0/687161135 >> v2:172.21.15.99:3300/0 conn(0x7fa774144600 0x7fa7740b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.110+0000 7fa778d81640 1 -- 172.21.15.84:0/687161135 >> 172.21.15.84:0/687161135 conn(0x7fa77406a920 msgr2=0x7fa77406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:58.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.110+0000 7fa778d81640 1 -- 172.21.15.84:0/687161135 shutdown_connections 2023-12-12T09:20:58.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.110+0000 7fa778d81640 1 -- 172.21.15.84:0/687161135 wait complete. 2023-12-12T09:20:58.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.112+0000 7fa778d81640 1 Processor -- start 2023-12-12T09:20:58.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.112+0000 7fa778d81640 1 -- start start 2023-12-12T09:20:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa778d81640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7740cf640 0x7fa774142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa778d81640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa774144600 0x7fa7741431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa778d81640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa77415c140 0x7fa774141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa778d81640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa774158e30 con 0x7fa774144600 2023-12-12T09:20:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa778d81640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77412fe90 con 0x7fa7740cf640 2023-12-12T09:20:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa778d81640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77413ef00 con 0x7fa77415c140 2023-12-12T09:20:58.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa772ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa774144600 0x7fa7741431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa772ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa774144600 0x7fa7741431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34552/0 (socket says 172.21.15.84:34552) 2023-12-12T09:20:58.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa772ffd640 1 -- 172.21.15.84:0/1905085322 learned_addr learned my addr 172.21.15.84:0/1905085322 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa7737fe640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7740cf640 0x7fa774142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa772ffd640 1 -- 172.21.15.84:0/1905085322 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa77415c140 msgr2=0x7fa774141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa772ffd640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa77415c140 0x7fa774141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa772ffd640 1 -- 172.21.15.84:0/1905085322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7740cf640 msgr2=0x7fa774142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa772ffd640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7740cf640 0x7fa774142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa772ffd640 1 -- 172.21.15.84:0/1905085322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c009a70 con 0x7fa774144600 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.113+0000 7fa7737fe640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7740cf640 0x7fa774142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.114+0000 7fa772ffd640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa774144600 0x7fa7741431b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa76800c500 tx=0x7fa76800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.114+0000 7fa75bfff640 1 -- 172.21.15.84:0/1905085322 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768005ce0 con 0x7fa774144600 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.114+0000 7fa75bfff640 1 -- 172.21.15.84:0/1905085322 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768005e40 con 0x7fa774144600 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.114+0000 7fa75bfff640 1 -- 172.21.15.84:0/1905085322 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680072f0 con 0x7fa774144600 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.114+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7741300e0 con 0x7fa774144600 2023-12-12T09:20:58.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.114+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7741306a0 con 0x7fa774144600 2023-12-12T09:20:58.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.115+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa774071590 con 0x7fa774144600 2023-12-12T09:20:58.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.116+0000 7fa75bfff640 1 -- 172.21.15.84:0/1905085322 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa768007450 con 0x7fa774144600 2023-12-12T09:20:58.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.117+0000 7fa75bfff640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa76006ae70 0x7fa76006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.117+0000 7fa75bfff640 1 -- 172.21.15.84:0/1905085322 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa768088d90 con 0x7fa774144600 2023-12-12T09:20:58.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.117+0000 7fa7737fe640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa76006ae70 0x7fa76006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.118+0000 7fa7737fe640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa76006ae70 0x7fa76006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa764008890 tx=0x7fa764008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.121+0000 7fa75bfff640 1 -- 172.21.15.84:0/1905085322 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa768053bc0 con 0x7fa774144600 2023-12-12T09:20:58.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.314+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7740673c0 con 0x7fa774144600 2023-12-12T09:20:58.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.315+0000 7fa75bfff640 1 -- 172.21.15.84:0/1905085322 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa768017020 con 0x7fa774144600 2023-12-12T09:20:58.315 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:20:58.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa76006ae70 msgr2=0x7fa76006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa76006ae70 0x7fa76006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa764008890 tx=0x7fa764008040 comp rx=0 tx=0).stop 2023-12-12T09:20:58.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa774144600 msgr2=0x7fa7741431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa774144600 0x7fa7741431b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa76800c500 tx=0x7fa76800c9c0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 shutdown_connections 2023-12-12T09:20:58.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa77415c140 0x7fa774141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa76006ae70 0x7fa76006d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa774144600 0x7fa7741431b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 --2- 172.21.15.84:0/1905085322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7740cf640 0x7fa774142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 >> 172.21.15.84:0/1905085322 conn(0x7fa77406a920 msgr2=0x7fa7740b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:58.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 shutdown_connections 2023-12-12T09:20:58.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.317+0000 7fa778d81640 1 -- 172.21.15.84:0/1905085322 wait complete. 2023-12-12T09:20:58.336 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:20:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.549+0000 7f5c6d15c640 1 Processor -- start 2023-12-12T09:20:58.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.549+0000 7f5c6d15c640 1 -- start start 2023-12-12T09:20:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.551+0000 7f5c6d15c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5c6813d370 0x7f5c6813d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.551+0000 7f5c6d15c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5c6806d9d0 0x7f5c6806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.551+0000 7f5c6d15c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c68070160 con 0x7f5c6813cb90 2023-12-12T09:20:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.551+0000 7f5c6d15c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c68070de0 con 0x7f5c6813d370 2023-12-12T09:20:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.551+0000 7f5c6d15c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6806e3a0 con 0x7f5c6806d9d0 2023-12-12T09:20:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.551+0000 7f5c5ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5c6813d370 0x7f5c6813d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.551+0000 7f5c67fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5c6813cb90 0x7f5c6815e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54976/0 (socket says 172.21.15.84:54976) 2023-12-12T09:20:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.551+0000 7f5c67fff640 1 -- 172.21.15.84:0/2985481508 learned_addr learned my addr 172.21.15.84:0/2985481508 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.552+0000 7f5c5ffff640 1 -- 172.21.15.84:0/2985481508 >> v2:172.21.15.99:3300/0 conn(0x7f5c6806d9d0 msgr2=0x7f5c6806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.552+0000 7f5c5ffff640 1 --2- 172.21.15.84:0/2985481508 >> v2:172.21.15.99:3300/0 conn(0x7f5c6806d9d0 0x7f5c6806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.552+0000 7f5c5ffff640 1 -- 172.21.15.84:0/2985481508 >> v1:172.21.15.84:6789/0 conn(0x7f5c6813cb90 legacy=0x7f5c6815e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.552+0000 7f5c677fe640 1 -- 172.21.15.84:0/2985481508 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005725363 0 0) 0x7f5c68070160 con 0x7f5c6813cb90 2023-12-12T09:20:58.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.552+0000 7f5c5ffff640 1 -- 172.21.15.84:0/2985481508 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68070440 con 0x7f5c6813d370 2023-12-12T09:20:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.553+0000 7f5c5ffff640 1 --2- 172.21.15.84:0/2985481508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c6813d790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5c6806ffc0 tx=0x7f5c5002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a2b3ae9afcff57 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.553+0000 7f5c677fe640 1 -- 172.21.15.84:0/2985481508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50031710 con 0x7f5c6813d370 2023-12-12T09:20:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.553+0000 7f5c677fe640 1 -- 172.21.15.84:0/2985481508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5002f050 con 0x7f5c6813d370 2023-12-12T09:20:58.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.553+0000 7f5c677fe640 1 -- 172.21.15.84:0/2985481508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50031a90 con 0x7f5c6813d370 2023-12-12T09:20:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.554+0000 7f5c6d15c640 1 -- 172.21.15.84:0/2985481508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 msgr2=0x7f5c6813d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.554+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/2985481508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c6813d790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5c6806ffc0 tx=0x7f5c5002b7b0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.554+0000 7f5c6d15c640 1 -- 172.21.15.84:0/2985481508 shutdown_connections 2023-12-12T09:20:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.554+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/2985481508 >> v2:172.21.15.99:3300/0 conn(0x7f5c6806d9d0 0x7f5c6806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.554+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/2985481508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c6813d790 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.554+0000 7f5c6d15c640 1 -- 172.21.15.84:0/2985481508 >> 172.21.15.84:0/2985481508 conn(0x7f5c680b0780 msgr2=0x7f5c680b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:58.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.554+0000 7f5c6d15c640 1 -- 172.21.15.84:0/2985481508 shutdown_connections 2023-12-12T09:20:58.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.554+0000 7f5c6d15c640 1 -- 172.21.15.84:0/2985481508 wait complete. 2023-12-12T09:20:58.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.556+0000 7f5c6d15c640 1 Processor -- start 2023-12-12T09:20:58.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.556+0000 7f5c6d15c640 1 -- start start 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6d15c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806d9d0 0x7f5c680aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6d15c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6813cb90 0x7f5c6813c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6d15c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c680b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6d15c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680b38c0 con 0x7f5c6813d370 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6d15c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680af360 con 0x7f5c6806d9d0 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6d15c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6813e640 con 0x7f5c6813cb90 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6c95b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c680b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6c95b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c680b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34580/0 (socket says 172.21.15.84:34580) 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c6c95b640 1 -- 172.21.15.84:0/3788108061 learned_addr learned my addr 172.21.15.84:0/3788108061 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c67fff640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806d9d0 0x7f5c680aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.557+0000 7f5c5ffff640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6813cb90 0x7f5c6813c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c6c95b640 1 -- 172.21.15.84:0/3788108061 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6813cb90 msgr2=0x7f5c6813c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c6c95b640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6813cb90 0x7f5c6813c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c6c95b640 1 -- 172.21.15.84:0/3788108061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806d9d0 msgr2=0x7f5c680aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c6c95b640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806d9d0 0x7f5c680aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c6c95b640 1 -- 172.21.15.84:0/3788108061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c50009400 con 0x7f5c6813d370 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c6c95b640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c680b28c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000b970 tx=0x7f5c6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c657fa640 1 -- 172.21.15.84:0/3788108061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6000cb40 con 0x7f5c6813d370 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c657fa640 1 -- 172.21.15.84:0/3788108061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6000ccc0 con 0x7f5c6813d370 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c657fa640 1 -- 172.21.15.84:0/3788108061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60014680 con 0x7f5c6813d370 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6813e920 con 0x7f5c6813d370 2023-12-12T09:20:58.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.558+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6813eee0 con 0x7f5c6813d370 2023-12-12T09:20:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.560+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6804e840 con 0x7f5c6813d370 2023-12-12T09:20:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.560+0000 7f5c657fa640 1 -- 172.21.15.84:0/3788108061 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c6001d3b0 con 0x7f5c6813d370 2023-12-12T09:20:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.561+0000 7f5c657fa640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5c4806ae70 0x7f5c4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.561+0000 7f5c657fa640 1 -- 172.21.15.84:0/3788108061 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c60089920 con 0x7f5c6813d370 2023-12-12T09:20:58.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.561+0000 7f5c67fff640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5c4806ae70 0x7f5c4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.562+0000 7f5c67fff640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5c4806ae70 0x7f5c4806d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c58007fd0 tx=0x7f5c58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.566+0000 7f5c657fa640 1 -- 172.21.15.84:0/3788108061 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c60054610 con 0x7f5c6813d370 2023-12-12T09:20:58.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.741+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c680af550 con 0x7f5c6813d370 2023-12-12T09:20:58.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.742+0000 7f5c657fa640 1 -- 172.21.15.84:0/3788108061 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c60019020 con 0x7f5c6813d370 2023-12-12T09:20:58.742 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5c4806ae70 msgr2=0x7f5c4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5c4806ae70 0x7f5c4806d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5c58007fd0 tx=0x7f5c58009040 comp rx=0 tx=0).stop 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 msgr2=0x7f5c680b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c680b28c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5c6000b970 tx=0x7f5c6000be30 comp rx=0 tx=0).stop 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 shutdown_connections 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5c4806ae70 0x7f5c4806d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c6813d370 0x7f5c680b28c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5c6813cb90 0x7f5c6813c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 --2- 172.21.15.84:0/3788108061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c6806d9d0 0x7f5c680aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.744+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 >> 172.21.15.84:0/3788108061 conn(0x7f5c680b0780 msgr2=0x7f5c6815abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:58.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.745+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 shutdown_connections 2023-12-12T09:20:58.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.745+0000 7f5c6d15c640 1 -- 172.21.15.84:0/3788108061 wait complete. 2023-12-12T09:20:58.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:20:58.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.962+0000 7f8923fff640 1 Processor -- start 2023-12-12T09:20:58.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.963+0000 7f8923fff640 1 -- start start 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.964+0000 7f8923fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f892415c140 0x7f89240cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.964+0000 7f8923fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f89240cf470 0x7f89240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.964+0000 7f8923fff640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240cf8c0 con 0x7f8924144600 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.964+0000 7f8923fff640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892415eb20 con 0x7f892415c140 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.964+0000 7f8923fff640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892415ee00 con 0x7f89240cf470 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.964+0000 7f891bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f892415c140 0x7f89240cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.964+0000 7f8922ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8924144600 0x7f89240b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54986/0 (socket says 172.21.15.84:54986) 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.964+0000 7f8922ffd640 1 -- 172.21.15.84:0/259402686 learned_addr learned my addr 172.21.15.84:0/259402686 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:58.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.965+0000 7f89237fe640 1 --2- 172.21.15.84:0/259402686 >> v2:172.21.15.99:3300/0 conn(0x7f89240cf470 0x7f89240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.965+0000 7f891bfff640 1 -- 172.21.15.84:0/259402686 >> v2:172.21.15.99:3300/0 conn(0x7f89240cf470 msgr2=0x7f89240b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.965+0000 7f891bfff640 1 --2- 172.21.15.84:0/259402686 >> v2:172.21.15.99:3300/0 conn(0x7f89240cf470 0x7f89240b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.965+0000 7f89227fc640 1 -- 172.21.15.84:0/259402686 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086713840 0 0) 0x7f8914001110 con 0x7f8924144600 2023-12-12T09:20:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.965+0000 7f891bfff640 1 -- 172.21.15.84:0/259402686 >> v1:172.21.15.84:6789/0 conn(0x7f8924144600 legacy=0x7f89240b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.965+0000 7f891bfff640 1 -- 172.21.15.84:0/259402686 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892415f0e0 con 0x7f892415c140 2023-12-12T09:20:58.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.965+0000 7f89237fe640 1 --2- 172.21.15.84:0/259402686 >> v2:172.21.15.99:3300/0 conn(0x7f89240cf470 0x7f89240b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.966+0000 7f891bfff640 1 --2- 172.21.15.84:0/259402686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f89240cef30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f89240cc950 tx=0x7f890c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0485d137c8ea426 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.966+0000 7f89227fc640 1 -- 172.21.15.84:0/259402686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c031830 con 0x7f892415c140 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.966+0000 7f89227fc640 1 -- 172.21.15.84:0/259402686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c031990 con 0x7f892415c140 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.966+0000 7f89227fc640 1 -- 172.21.15.84:0/259402686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c031d20 con 0x7f892415c140 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.967+0000 7f8923fff640 1 -- 172.21.15.84:0/259402686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 msgr2=0x7f89240cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.967+0000 7f8923fff640 1 --2- 172.21.15.84:0/259402686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f89240cef30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f89240cc950 tx=0x7f890c02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.967+0000 7f8923fff640 1 -- 172.21.15.84:0/259402686 shutdown_connections 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.967+0000 7f8923fff640 1 --2- 172.21.15.84:0/259402686 >> v2:172.21.15.99:3300/0 conn(0x7f89240cf470 0x7f89240b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.967+0000 7f8923fff640 1 --2- 172.21.15.84:0/259402686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f89240cef30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.967+0000 7f8923fff640 1 -- 172.21.15.84:0/259402686 >> 172.21.15.84:0/259402686 conn(0x7f892406a920 msgr2=0x7f892406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.967+0000 7f8923fff640 1 -- 172.21.15.84:0/259402686 shutdown_connections 2023-12-12T09:20:58.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.967+0000 7f8923fff640 1 -- 172.21.15.84:0/259402686 wait complete. 2023-12-12T09:20:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.969+0000 7f8923fff640 1 Processor -- start 2023-12-12T09:20:58.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.969+0000 7f8923fff640 1 -- start start 2023-12-12T09:20:58.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f8923fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89240cf470 0x7f892413e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f8923fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8924144600 0x7f89240b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f8923fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f892413a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f8923fff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8924142190 con 0x7f892415c140 2023-12-12T09:20:58.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f8923fff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892413f4c0 con 0x7f8924144600 2023-12-12T09:20:58.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f8923fff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892413ef00 con 0x7f89240cf470 2023-12-12T09:20:58.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f89237fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f892413a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f89237fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f892413a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34606/0 (socket says 172.21.15.84:34606) 2023-12-12T09:20:58.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.970+0000 7f89237fe640 1 -- 172.21.15.84:0/3483382526 learned_addr learned my addr 172.21.15.84:0/3483382526 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f891bfff640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8924144600 0x7f89240b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f89237fe640 1 -- 172.21.15.84:0/3483382526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89240cf470 msgr2=0x7f892413e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f89237fe640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89240cf470 0x7f892413e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f89237fe640 1 -- 172.21.15.84:0/3483382526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8924144600 msgr2=0x7f89240b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f89237fe640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8924144600 0x7f89240b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f89237fe640 1 -- 172.21.15.84:0/3483382526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009400 con 0x7f892415c140 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f89237fe640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f892413a0c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f891c00cef0 tx=0x7f891c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f891b7fe640 1 -- 172.21.15.84:0/3483382526 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00d840 con 0x7f892415c140 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f891b7fe640 1 -- 172.21.15.84:0/3483382526 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c00d9c0 con 0x7f892415c140 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f891b7fe640 1 -- 172.21.15.84:0/3483382526 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00dd70 con 0x7f892415c140 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892413f1e0 con 0x7f892415c140 2023-12-12T09:20:58.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.971+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892413ebb0 con 0x7f892415c140 2023-12-12T09:20:58.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.973+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89241422d0 con 0x7f892415c140 2023-12-12T09:20:58.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.973+0000 7f891b7fe640 1 -- 172.21.15.84:0/3483382526 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f891c01e3b0 con 0x7f892415c140 2023-12-12T09:20:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.975+0000 7f891b7fe640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f890406ae40 0x7f890406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.975+0000 7f891b7fe640 1 -- 172.21.15.84:0/3483382526 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f891c08a470 con 0x7f892415c140 2023-12-12T09:20:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.975+0000 7f8922ffd640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f890406ae40 0x7f890406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:58.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.976+0000 7f8922ffd640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f890406ae40 0x7f890406d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8914007fd0 tx=0x7f8914001310 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:58.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:58.979+0000 7f891b7fe640 1 -- 172.21.15.84:0/3483382526 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89241422d0 con 0x7f892415c140 2023-12-12T09:20:59.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.169+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89241422d0 con 0x7f892415c140 2023-12-12T09:20:59.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.170+0000 7f891b7fe640 1 -- 172.21.15.84:0/3483382526 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89241422d0 con 0x7f892415c140 2023-12-12T09:20:59.171 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f890406ae40 msgr2=0x7f890406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f890406ae40 0x7f890406d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8914007fd0 tx=0x7f8914001310 comp rx=0 tx=0).stop 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 msgr2=0x7f892413a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f892413a0c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f891c00cef0 tx=0x7f891c00a710 comp rx=0 tx=0).stop 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 shutdown_connections 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f890406ae40 0x7f890406d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f892415c140 0x7f892413a0c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8924144600 0x7f89240b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 --2- 172.21.15.84:0/3483382526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f89240cf470 0x7f892413e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 >> 172.21.15.84:0/3483382526 conn(0x7f892406a920 msgr2=0x7f89240ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 shutdown_connections 2023-12-12T09:20:59.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.173+0000 7f8923fff640 1 -- 172.21.15.84:0/3483382526 wait complete. 2023-12-12T09:20:59.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:20:59.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.406+0000 7f82eb66b640 1 Processor -- start 2023-12-12T09:20:59.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.406+0000 7f82eb66b640 1 -- start start 2023-12-12T09:20:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82eb66b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 0x7f82e40ac900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82eb66b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e415e0b0 con 0x7f82e40ad8b0 2023-12-12T09:20:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82eb66b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e415b160 con 0x7f82e4071660 2023-12-12T09:20:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82eb66b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e406ca50 con 0x7f82e415ad80 2023-12-12T09:20:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82e9c08640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f82e40ad8b0 0x7f82e40b2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55002/0 (socket says 172.21.15.84:55002) 2023-12-12T09:20:59.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82e9c08640 1 -- 172.21.15.84:0/1090140866 learned_addr learned my addr 172.21.15.84:0/1090140866 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:59.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82e9407640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 0x7f82e40ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679197607 0 0) 0x7f82e415e0b0 con 0x7f82e40ad8b0 2023-12-12T09:20:59.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.408+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d0003520 con 0x7f82e40ad8b0 2023-12-12T09:20:59.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1577171644 0 0) 0x7f82d0003520 con 0x7f82e40ad8b0 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 msgr2=0x7f82e40ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 0x7f82e40ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 >> v1:172.21.15.99:6789/0 conn(0x7f82e4071660 legacy=0x7f82e40ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40ace40 con 0x7f82e40ad8b0 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f82dc0019f0 con 0x7f82e40ad8b0 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 >> v1:172.21.15.84:6789/0 conn(0x7f82e40ad8b0 legacy=0x7f82e40b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 0x7f82d00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82d0003fd0 0x7f82d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82d0004d00 0x7f82d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e406ca50 con 0x7f82d0004d00 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d000bb70 con 0x7f82d0003fd0 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d000bd30 con 0x7f82e415ad80 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82e9c08640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82d0004d00 0x7f82d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82e8c06640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82d0003fd0 0x7f82d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.409+0000 7f82e9407640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 0x7f82d00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.410+0000 7f82e9c08640 1 -- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 msgr2=0x7f82d00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.410+0000 7f82e9c08640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 0x7f82d00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.410+0000 7f82e9c08640 1 -- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82d0003fd0 msgr2=0x7f82d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.410+0000 7f82e9c08640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82d0003fd0 0x7f82d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.410+0000 7f82e9c08640 1 -- 172.21.15.84:0/1090140866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40ace40 con 0x7f82d0004d00 2023-12-12T09:20:59.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.410+0000 7f82e9407640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e415ad80 0x7f82d00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.411+0000 7f82e9c08640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82d0004d00 0x7f82d0005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00a920 tx=0x7f82d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483f17c82b698884 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.411+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc035670 con 0x7f82d0004d00 2023-12-12T09:20:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.411+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc0357d0 con 0x7f82d0004d00 2023-12-12T09:20:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.411+0000 7f82dbfff640 1 -- 172.21.15.84:0/1090140866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc035b60 con 0x7f82d0004d00 2023-12-12T09:20:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.412+0000 7f82eb66b640 1 -- 172.21.15.84:0/1090140866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82d0004d00 msgr2=0x7f82d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.412+0000 7f82eb66b640 1 --2- 172.21.15.84:0/1090140866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82d0004d00 0x7f82d0005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00a920 tx=0x7f82d00057f0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.412+0000 7f82e9c08640 1 -- 172.21.15.84:0/1090140866 reap_dead start 2023-12-12T09:20:59.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.412+0000 7f82eb66b640 1 -- 172.21.15.84:0/1090140866 shutdown_connections 2023-12-12T09:20:59.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.412+0000 7f82eb66b640 1 -- 172.21.15.84:0/1090140866 >> 172.21.15.84:0/1090140866 conn(0x7f82e4070a20 msgr2=0x7f82e4070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:59.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.412+0000 7f82eb66b640 1 -- 172.21.15.84:0/1090140866 shutdown_connections 2023-12-12T09:20:59.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.412+0000 7f82eb66b640 1 -- 172.21.15.84:0/1090140866 wait complete. 2023-12-12T09:20:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.413+0000 7f82eb66b640 1 Processor -- start 2023-12-12T09:20:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.414+0000 7f82eb66b640 1 -- start start 2023-12-12T09:20:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82eb66b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e40cdee0 0x7f82e415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82eb66b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e415ea80 0x7f82e4157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82eb66b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e4157750 0x7f82e41470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82eb66b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e415eee0 con 0x7f82e4157750 2023-12-12T09:20:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82eb66b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e41f61b0 con 0x7f82e415ea80 2023-12-12T09:20:59.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82eb66b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e41f7010 con 0x7f82e40cdee0 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9c08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e4157750 0x7f82e41470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9c08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e4157750 0x7f82e41470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34620/0 (socket says 172.21.15.84:34620) 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9c08640 1 -- 172.21.15.84:0/2084407860 learned_addr learned my addr 172.21.15.84:0/2084407860 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e8c06640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e415ea80 0x7f82e4157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9407640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e40cdee0 0x7f82e415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9c08640 1 -- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e40cdee0 msgr2=0x7f82e415e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9c08640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e40cdee0 0x7f82e415e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9c08640 1 -- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e415ea80 msgr2=0x7f82e4157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9c08640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e415ea80 0x7f82e4157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9c08640 1 -- 172.21.15.84:0/2084407860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e41451d0 con 0x7f82e4157750 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.415+0000 7f82e9407640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e40cdee0 0x7f82e415e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.416+0000 7f82e9c08640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e4157750 0x7f82e41470d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00aa40 tx=0x7f82dc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.416+0000 7f82d9ffb640 1 -- 172.21.15.84:0/2084407860 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc043070 con 0x7f82e4157750 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.416+0000 7f82d9ffb640 1 -- 172.21.15.84:0/2084407860 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc03b040 con 0x7f82e4157750 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.416+0000 7f82d9ffb640 1 -- 172.21.15.84:0/2084407860 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc035b40 con 0x7f82e4157750 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.416+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e41f6400 con 0x7f82e4157750 2023-12-12T09:20:59.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.416+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e41f69c0 con 0x7f82e4157750 2023-12-12T09:20:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.417+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e40673c0 con 0x7f82e4157750 2023-12-12T09:20:59.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.418+0000 7f82d9ffb640 1 -- 172.21.15.84:0/2084407860 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82dc032070 con 0x7f82e4157750 2023-12-12T09:20:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.419+0000 7f82d9ffb640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f82c806ae70 0x7f82c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.419+0000 7f82d9ffb640 1 -- 172.21.15.84:0/2084407860 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f82dc0ab0b0 con 0x7f82e4157750 2023-12-12T09:20:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.419+0000 7f82e9407640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f82c806ae70 0x7f82c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.420+0000 7f82e9407640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f82c806ae70 0x7f82c806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006fd0 tx=0x7f82e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.423+0000 7f82d9ffb640 1 -- 172.21.15.84:0/2084407860 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82dc075e30 con 0x7f82e4157750 2023-12-12T09:20:59.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.598+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f82e4073c80 con 0x7f82e4157750 2023-12-12T09:20:59.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.599+0000 7f82d9ffb640 1 -- 172.21.15.84:0/2084407860 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f82dc079450 con 0x7f82e4157750 2023-12-12T09:20:59.599 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:20:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.601+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f82c806ae70 msgr2=0x7f82c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.601+0000 7f82eb66b640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f82c806ae70 0x7f82c806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82e0006fd0 tx=0x7f82e0008040 comp rx=0 tx=0).stop 2023-12-12T09:20:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.601+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e4157750 msgr2=0x7f82e41470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.601+0000 7f82eb66b640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e4157750 0x7f82e41470d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00aa40 tx=0x7f82dc02e070 comp rx=0 tx=0).stop 2023-12-12T09:20:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.602+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 shutdown_connections 2023-12-12T09:20:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.602+0000 7f82eb66b640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f82c806ae70 0x7f82c806d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.602+0000 7f82eb66b640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82e4157750 0x7f82e41470d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.602+0000 7f82eb66b640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82e415ea80 0x7f82e4157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.602+0000 7f82eb66b640 1 --2- 172.21.15.84:0/2084407860 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f82e40cdee0 0x7f82e415e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.602+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 >> 172.21.15.84:0/2084407860 conn(0x7f82e4070a20 msgr2=0x7f82e415c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:59.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.602+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 shutdown_connections 2023-12-12T09:20:59.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.602+0000 7f82eb66b640 1 -- 172.21.15.84:0/2084407860 wait complete. 2023-12-12T09:20:59.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:20:59.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.828+0000 7f0ef21fb640 1 Processor -- start 2023-12-12T09:20:59.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.828+0000 7f0ef21fb640 1 -- start start 2023-12-12T09:20:59.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.830+0000 7f0ef21fb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eec160ad0 0x7f0eec0d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.830+0000 7f0ef21fb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec0c6bf0 con 0x7f0eec0cfff0 2023-12-12T09:20:59.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.830+0000 7f0ef21fb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec0d1250 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.830+0000 7f0ef21fb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec0d1530 con 0x7f0eec160ad0 2023-12-12T09:20:59.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.830+0000 7f0eeb7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0eec160ad0 0x7f0eec0d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.830+0000 7f0eebfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0eec0cfff0 0x7f0eec0cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55016/0 (socket says 172.21.15.84:55016) 2023-12-12T09:20:59.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.830+0000 7f0eebfff640 1 -- 172.21.15.84:0/1757336901 learned_addr learned my addr 172.21.15.84:0/1757336901 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:20:59.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.831+0000 7f0eeb7fe640 1 -- 172.21.15.84:0/1757336901 >> v1:172.21.15.99:6789/0 conn(0x7f0eec0b3ed0 legacy=0x7f0eec0cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:20:59.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.831+0000 7f0eeb7fe640 1 -- 172.21.15.84:0/1757336901 >> v1:172.21.15.84:6789/0 conn(0x7f0eec0cfff0 legacy=0x7f0eec0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.831+0000 7f0eeb7fe640 1 -- 172.21.15.84:0/1757336901 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0d1810 con 0x7f0eec160ad0 2023-12-12T09:20:59.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.831+0000 7f0eea7fc640 1 -- 172.21.15.84:0/1757336901 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695206633 0 0) 0x7f0eec0c6bf0 con 0x7f0eec0cfff0 2023-12-12T09:20:59.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.832+0000 7f0eeb7fe640 1 --2- 172.21.15.84:0/1757336901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec160ad0 0x7f0eec0d0c70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009d90 tx=0x7f0edc02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7a85970bc9f5e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:59.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.832+0000 7f0eea7fc640 1 -- 172.21.15.84:0/1757336901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc02cbd0 con 0x7f0eec160ad0 2023-12-12T09:20:59.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.832+0000 7f0eea7fc640 1 -- 172.21.15.84:0/1757336901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc02cd30 con 0x7f0eec160ad0 2023-12-12T09:20:59.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.832+0000 7f0eea7fc640 1 -- 172.21.15.84:0/1757336901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc02cea0 con 0x7f0eec160ad0 2023-12-12T09:20:59.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.833+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1757336901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec160ad0 msgr2=0x7f0eec0d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.833+0000 7f0ef21fb640 1 --2- 172.21.15.84:0/1757336901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec160ad0 0x7f0eec0d0c70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009d90 tx=0x7f0edc02be20 comp rx=0 tx=0).stop 2023-12-12T09:20:59.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.833+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1757336901 shutdown_connections 2023-12-12T09:20:59.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.833+0000 7f0ef21fb640 1 --2- 172.21.15.84:0/1757336901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec160ad0 0x7f0eec0d0c70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.833+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1757336901 >> 172.21.15.84:0/1757336901 conn(0x7f0eec09c3e0 msgr2=0x7f0eec0d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:20:59.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.833+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1757336901 shutdown_connections 2023-12-12T09:20:59.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.833+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1757336901 wait complete. 2023-12-12T09:20:59.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.835+0000 7f0ef21fb640 1 Processor -- start 2023-12-12T09:20:59.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.835+0000 7f0ef21fb640 1 -- start start 2023-12-12T09:20:59.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0ef21fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec0b3ed0 0x7f0eec14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0ef21fb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0eec0cfff0 0x7f0eec0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0ef21fb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0eec160ad0 0x7f0eec0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0ef21fb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b6fb0 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0ef21fb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b7290 con 0x7f0eec0cfff0 2023-12-12T09:20:59.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0ef21fb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b7570 con 0x7f0eec160ad0 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec0b3ed0 0x7f0eec14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0eeb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec0b3ed0 0x7f0eec14b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34640/0 (socket says 172.21.15.84:34640) 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0eeb7fe640 1 -- 172.21.15.84:0/1662400529 learned_addr learned my addr 172.21.15.84:0/1662400529 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0eeaffd640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0eec0cfff0 0x7f0eec0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0eeb7fe640 1 -- 172.21.15.84:0/1662400529 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0eec160ad0 msgr2=0x7f0eec0cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0eeb7fe640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0eec160ad0 0x7f0eec0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0eeb7fe640 1 -- 172.21.15.84:0/1662400529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0eec0cfff0 msgr2=0x7f0eec0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.836+0000 7f0eeb7fe640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0eec0cfff0 0x7f0eec0b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.837+0000 7f0eeb7fe640 1 -- 172.21.15.84:0/1662400529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc009a70 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.837+0000 7f0eeaffd640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0eec0cfff0 0x7f0eec0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.837+0000 7f0eeb7fe640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec0b3ed0 0x7f0eec14b300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009d90 tx=0x7f0edc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.837+0000 7f0ee3fff640 1 -- 172.21.15.84:0/1662400529 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc02cea0 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.837+0000 7f0ee3fff640 1 -- 172.21.15.84:0/1662400529 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc03e610 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.837+0000 7f0ee3fff640 1 -- 172.21.15.84:0/1662400529 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc03e9c0 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.837+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec156fe0 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.837+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec156c00 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.838+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec072eb0 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.839+0000 7f0ee3fff640 1 -- 172.21.15.84:0/1662400529 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0edc03b050 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.840+0000 7f0ee3fff640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ecc06ae40 0x7f0ecc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:20:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.840+0000 7f0ee3fff640 1 -- 172.21.15.84:0/1662400529 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0edc0ac440 con 0x7f0eec0b3ed0 2023-12-12T09:20:59.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.840+0000 7f0eeaffd640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ecc06ae40 0x7f0ecc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:20:59.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.841+0000 7f0eeaffd640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ecc06ae40 0x7f0ecc06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0cd5b0 tx=0x7f0ed4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:20:59.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:20:59.844+0000 7f0ee3fff640 1 -- 172.21.15.84:0/1662400529 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0edc077000 con 0x7f0eec0b3ed0 2023-12-12T09:21:00.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.046+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0eec0cf4b0 con 0x7f0eec0b3ed0 2023-12-12T09:21:00.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.047+0000 7f0ee3fff640 1 -- 172.21.15.84:0/1662400529 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0edc07a620 con 0x7f0eec0b3ed0 2023-12-12T09:21:00.048 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:21:00.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ecc06ae40 msgr2=0x7f0ecc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ecc06ae40 0x7f0ecc06d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0cd5b0 tx=0x7f0ed4008040 comp rx=0 tx=0).stop 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec0b3ed0 msgr2=0x7f0eec14b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec0b3ed0 0x7f0eec14b300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009d90 tx=0x7f0edc004a40 comp rx=0 tx=0).stop 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 shutdown_connections 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0eec160ad0 0x7f0eec0cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0eec0cfff0 0x7f0eec0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ecc06ae40 0x7f0ecc06d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 --2- 172.21.15.84:0/1662400529 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0eec0b3ed0 0x7f0eec14b300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 >> 172.21.15.84:0/1662400529 conn(0x7f0eec09c3e0 msgr2=0x7f0eec160f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 shutdown_connections 2023-12-12T09:21:00.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.050+0000 7f0ef21fb640 1 -- 172.21.15.84:0/1662400529 wait complete. 2023-12-12T09:21:00.067 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2023-12-12T09:21:00.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:00.068 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-12T09:21:00.165 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:21:00.165 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:21:00.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:00.165 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:21:00.216 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:21:00.216 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:21:00.274 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:21:00.275 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:21:00.329 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:00.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.536+0000 7f57d47be640 1 Processor -- start 2023-12-12T09:21:00.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.537+0000 7f57d47be640 1 -- start start 2023-12-12T09:21:00.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.538+0000 7f57d47be640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57cc15d490 0x7f57cc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.538+0000 7f57d47be640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f57cc0d3d60 0x7f57cc0d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.538+0000 7f57d47be640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57cc0d2080 con 0x7f57cc0d1c30 2023-12-12T09:21:00.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.538+0000 7f57d47be640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc0b0090 con 0x7f57cc15d490 2023-12-12T09:21:00.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.538+0000 7f57d47be640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc0afd40 con 0x7f57cc0d3d60 2023-12-12T09:21:00.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.538+0000 7f57d255a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57cc15d490 0x7f57cc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d2d5b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f57cc0d1c30 0x7f57cc0cf740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55028/0 (socket says 172.21.15.84:55028) 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d255a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f57cc15d490 0x7f57cc0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34644/0 (socket says 172.21.15.84:34644) 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d2d5b640 1 -- 172.21.15.84:0/671056551 learned_addr learned my addr 172.21.15.84:0/671056551 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d1d59640 1 --2- 172.21.15.84:0/671056551 >> v2:172.21.15.99:3300/0 conn(0x7f57cc0d3d60 0x7f57cc0d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d255a640 1 -- 172.21.15.84:0/671056551 >> v2:172.21.15.99:3300/0 conn(0x7f57cc0d3d60 msgr2=0x7f57cc0d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d255a640 1 --2- 172.21.15.84:0/671056551 >> v2:172.21.15.99:3300/0 conn(0x7f57cc0d3d60 0x7f57cc0d16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d255a640 1 -- 172.21.15.84:0/671056551 >> v1:172.21.15.84:6789/0 conn(0x7f57cc0d1c30 legacy=0x7f57cc0cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d255a640 1 -- 172.21.15.84:0/671056551 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0ce860 con 0x7f57cc15d490 2023-12-12T09:21:00.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.539+0000 7f57d1558640 1 -- 172.21.15.84:0/671056551 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546209440 0 0) 0x7f57c4001490 con 0x7f57cc0d1c30 2023-12-12T09:21:00.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.540+0000 7f57d255a640 1 --2- 172.21.15.84:0/671056551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc15d490 0x7f57cc0d3820 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0cf380 tx=0x7f57c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98aea88f82c09023 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:00.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.540+0000 7f57d1558640 1 -- 172.21.15.84:0/671056551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c802e070 con 0x7f57cc15d490 2023-12-12T09:21:00.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.540+0000 7f57d1558640 1 -- 172.21.15.84:0/671056551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c80315a0 con 0x7f57cc15d490 2023-12-12T09:21:00.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.540+0000 7f57d1558640 1 -- 172.21.15.84:0/671056551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8031930 con 0x7f57cc15d490 2023-12-12T09:21:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.541+0000 7f57d47be640 1 -- 172.21.15.84:0/671056551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc15d490 msgr2=0x7f57cc0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.541+0000 7f57d47be640 1 --2- 172.21.15.84:0/671056551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc15d490 0x7f57cc0d3820 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0cf380 tx=0x7f57c802b840 comp rx=0 tx=0).stop 2023-12-12T09:21:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.541+0000 7f57d47be640 1 -- 172.21.15.84:0/671056551 shutdown_connections 2023-12-12T09:21:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.541+0000 7f57d47be640 1 --2- 172.21.15.84:0/671056551 >> v2:172.21.15.99:3300/0 conn(0x7f57cc0d3d60 0x7f57cc0d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.541+0000 7f57d47be640 1 --2- 172.21.15.84:0/671056551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc15d490 0x7f57cc0d3820 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.541+0000 7f57d47be640 1 -- 172.21.15.84:0/671056551 >> 172.21.15.84:0/671056551 conn(0x7f57cc09c450 msgr2=0x7f57cc0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.541+0000 7f57d47be640 1 -- 172.21.15.84:0/671056551 shutdown_connections 2023-12-12T09:21:00.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.541+0000 7f57d47be640 1 -- 172.21.15.84:0/671056551 wait complete. 2023-12-12T09:21:00.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.544+0000 7f57d47be640 1 Processor -- start 2023-12-12T09:21:00.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.544+0000 7f57d47be640 1 -- start start 2023-12-12T09:21:00.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.545+0000 7f57d47be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57cc0d1c30 0x7f57cc0b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.545+0000 7f57d47be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc0d3d60 0x7f57cc0b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.545+0000 7f57d47be640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f57cc15d490 0x7f57cc0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.545+0000 7f57d47be640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0c7520 con 0x7f57cc0d3d60 2023-12-12T09:21:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.545+0000 7f57d47be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0c71b0 con 0x7f57cc0d1c30 2023-12-12T09:21:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.545+0000 7f57d47be640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc15f510 con 0x7f57cc15d490 2023-12-12T09:21:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.545+0000 7f57d1d59640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc0d3d60 0x7f57cc0b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d1d59640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc0d3d60 0x7f57cc0b8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34656/0 (socket says 172.21.15.84:34656) 2023-12-12T09:21:00.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d1d59640 1 -- 172.21.15.84:0/4023073377 learned_addr learned my addr 172.21.15.84:0/4023073377 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:00.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d255a640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57cc0d1c30 0x7f57cc0b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d1d59640 1 -- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f57cc15d490 msgr2=0x7f57cc0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d2d5b640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f57cc15d490 0x7f57cc0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d1d59640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f57cc15d490 0x7f57cc0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d1d59640 1 -- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57cc0d1c30 msgr2=0x7f57cc0b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d1d59640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57cc0d1c30 0x7f57cc0b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d1d59640 1 -- 172.21.15.84:0/4023073377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c8009400 con 0x7f57cc0d3d60 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d255a640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57cc0d1c30 0x7f57cc0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d2d5b640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f57cc15d490 0x7f57cc0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.546+0000 7f57d1d59640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc0d3d60 0x7f57cc0b8530 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00c850 tx=0x7f57bc00cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.547+0000 7f57c2ffd640 1 -- 172.21.15.84:0/4023073377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc004020 con 0x7f57cc0d3d60 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.547+0000 7f57c2ffd640 1 -- 172.21.15.84:0/4023073377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc0041a0 con 0x7f57cc0d3d60 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.547+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57cc15f790 con 0x7f57cc0d3d60 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.547+0000 7f57c2ffd640 1 -- 172.21.15.84:0/4023073377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc007830 con 0x7f57cc0d3d60 2023-12-12T09:21:00.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.547+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57cc15fd50 con 0x7f57cc0d3d60 2023-12-12T09:21:00.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.548+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57cc072b80 con 0x7f57cc0d3d60 2023-12-12T09:21:00.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.549+0000 7f57c2ffd640 1 -- 172.21.15.84:0/4023073377 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57bc007990 con 0x7f57cc0d3d60 2023-12-12T09:21:00.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.551+0000 7f57c2ffd640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f57b006ae70 0x7f57b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.551+0000 7f57c2ffd640 1 -- 172.21.15.84:0/4023073377 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f57bc0897a0 con 0x7f57cc0d3d60 2023-12-12T09:21:00.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.551+0000 7f57d255a640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f57b006ae70 0x7f57b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.551+0000 7f57d255a640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f57b006ae70 0x7f57b006d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57c8036000 tx=0x7f57c803d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:00.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.555+0000 7f57c2ffd640 1 -- 172.21.15.84:0/4023073377 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f57bc054480 con 0x7f57cc0d3d60 2023-12-12T09:21:00.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.750+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57cc0c7660 con 0x7f57cc0d3d60 2023-12-12T09:21:00.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.752+0000 7f57c2ffd640 1 -- 172.21.15.84:0/4023073377 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f57cc0c7660 con 0x7f57cc0d3d60 2023-12-12T09:21:00.752 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:00.753 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.754+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f57b006ae70 msgr2=0x7f57b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f57b006ae70 0x7f57b006d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57c8036000 tx=0x7f57c803d040 comp rx=0 tx=0).stop 2023-12-12T09:21:00.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc0d3d60 msgr2=0x7f57cc0b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc0d3d60 0x7f57cc0b8530 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00c850 tx=0x7f57bc00cd10 comp rx=0 tx=0).stop 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 shutdown_connections 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f57cc15d490 0x7f57cc0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f57b006ae70 0x7f57b006d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57cc0d3d60 0x7f57cc0b8530 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 --2- 172.21.15.84:0/4023073377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57cc0d1c30 0x7f57cc0b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 >> 172.21.15.84:0/4023073377 conn(0x7f57cc09c450 msgr2=0x7f57cc0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 shutdown_connections 2023-12-12T09:21:00.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.755+0000 7f57d47be640 1 -- 172.21.15.84:0/4023073377 wait complete. 2023-12-12T09:21:00.774 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:21:00.775 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:21:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.991+0000 7f9560761640 1 Processor -- start 2023-12-12T09:21:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.991+0000 7f9560761640 1 -- start start 2023-12-12T09:21:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.993+0000 7f9560761640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 0x7f95580b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.993+0000 7f9560761640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9558071c00 con 0x7f9558143860 2023-12-12T09:21:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.993+0000 7f9560761640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9558143c40 con 0x7f955806d430 2023-12-12T09:21:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.993+0000 7f9560761640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95580b4780 con 0x7f955806d870 2023-12-12T09:21:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.993+0000 7f955e4fd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9558143860 0x7f95580b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55032/0 (socket says 172.21.15.84:55032) 2023-12-12T09:21:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.993+0000 7f955e4fd640 1 -- 172.21.15.84:0/846984760 learned_addr learned my addr 172.21.15.84:0/846984760 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:00.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.993+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387358291 0 0) 0x7f9558071c00 con 0x7f9558143860 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.993+0000 7f955ecfe640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 0x7f95580b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9540005730 con 0x7f9558143860 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 220038272 0 0) 0x7f9540005730 con 0x7f9558143860 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 msgr2=0x7f95580b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 0x7f95580b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 >> v1:172.21.15.99:6789/0 conn(0x7f955806d430 legacy=0x7f95580b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580712d0 con 0x7f9558143860 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f95480019f0 con 0x7f9558143860 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 >> v1:172.21.15.84:6789/0 conn(0x7f9558143860 legacy=0x7f95580b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9540005bb0 0x7f9540005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 0x7f95400069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9540007030 0x7f954000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580b4780 con 0x7f9540007030 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95400077f0 con 0x7f9540005bb0 2023-12-12T09:21:00.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954000e0d0 con 0x7f955806d870 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.994+0000 7f955ecfe640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9540007030 0x7f954000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.995+0000 7f955e4fd640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9540005bb0 0x7f9540005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.995+0000 7f955dcfc640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 0x7f95400069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.995+0000 7f955ecfe640 1 -- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 msgr2=0x7f95400069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.995+0000 7f955ecfe640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 0x7f95400069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.995+0000 7f955ecfe640 1 -- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9540005bb0 msgr2=0x7f9540005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.995+0000 7f955ecfe640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9540005bb0 0x7f9540005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.995+0000 7f955ecfe640 1 -- 172.21.15.84:0/846984760 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540005730 con 0x7f9540007030 2023-12-12T09:21:00.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.995+0000 7f955dcfc640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f955806d870 0x7f95400069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.996+0000 7f955ecfe640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9540007030 0x7f954000db90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f955000ba30 tx=0x7f9540007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803232c63e804e46 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.996+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550032640 con 0x7f9540007030 2023-12-12T09:21:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.996+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95500327a0 con 0x7f9540007030 2023-12-12T09:21:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.996+0000 7f955d4fb640 1 -- 172.21.15.84:0/846984760 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550032b30 con 0x7f9540007030 2023-12-12T09:21:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.997+0000 7f9560761640 1 -- 172.21.15.84:0/846984760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9540007030 msgr2=0x7f954000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.997+0000 7f9560761640 1 --2- 172.21.15.84:0/846984760 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9540007030 0x7f954000db90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f955000ba30 tx=0x7f9540007a00 comp rx=0 tx=0).stop 2023-12-12T09:21:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.997+0000 7f955ecfe640 1 -- 172.21.15.84:0/846984760 reap_dead start 2023-12-12T09:21:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.997+0000 7f9560761640 1 -- 172.21.15.84:0/846984760 shutdown_connections 2023-12-12T09:21:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.997+0000 7f9560761640 1 -- 172.21.15.84:0/846984760 >> 172.21.15.84:0/846984760 conn(0x7f95580b0ac0 msgr2=0x7f95580b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.997+0000 7f9560761640 1 -- 172.21.15.84:0/846984760 shutdown_connections 2023-12-12T09:21:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.997+0000 7f9560761640 1 -- 172.21.15.84:0/846984760 wait complete. 2023-12-12T09:21:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.999+0000 7f9560761640 1 Processor -- start 2023-12-12T09:21:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:00.999+0000 7f9560761640 1 -- start start 2023-12-12T09:21:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f9560761640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9540007030 0x7f955813d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f9560761640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95580a8e90 0x7f9558159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f9560761640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955815c440 0x7f95580b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f9560761640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955815a000 con 0x7f95580a8e90 2023-12-12T09:21:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f9560761640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955813dc30 con 0x7f955815c440 2023-12-12T09:21:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f9560761640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955815bfb0 con 0x7f9540007030 2023-12-12T09:21:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f955dcfc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95580a8e90 0x7f9558159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f955dcfc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95580a8e90 0x7f9558159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34666/0 (socket says 172.21.15.84:34666) 2023-12-12T09:21:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.000+0000 7f955dcfc640 1 -- 172.21.15.84:0/4215236066 learned_addr learned my addr 172.21.15.84:0/4215236066 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955e4fd640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9540007030 0x7f955813d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955ecfe640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955815c440 0x7f95580b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955dcfc640 1 -- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9540007030 msgr2=0x7f955813d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955dcfc640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9540007030 0x7f955813d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955dcfc640 1 -- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955815c440 msgr2=0x7f95580b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955dcfc640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955815c440 0x7f95580b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955dcfc640 1 -- 172.21.15.84:0/4215236066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955815b3a0 con 0x7f95580a8e90 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955ecfe640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955815c440 0x7f95580b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f955dcfc640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95580a8e90 0x7f9558159ac0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f954c00d770 tx=0x7f954c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f9556ffd640 1 -- 172.21.15.84:0/4215236066 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c005270 con 0x7f95580a8e90 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f9556ffd640 1 -- 172.21.15.84:0/4215236066 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c0053d0 con 0x7f95580a8e90 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f9556ffd640 1 -- 172.21.15.84:0/4215236066 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c00b8d0 con 0x7f95580a8e90 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.001+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955815b680 con 0x7f95580a8e90 2023-12-12T09:21:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.002+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955815bc40 con 0x7f95580a8e90 2023-12-12T09:21:01.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.003+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955815bdd0 con 0x7f95580a8e90 2023-12-12T09:21:01.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.004+0000 7f9556ffd640 1 -- 172.21.15.84:0/4215236066 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f954c00ba30 con 0x7f95580a8e90 2023-12-12T09:21:01.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.005+0000 7f9556ffd640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f954406ae40 0x7f954406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.005+0000 7f9556ffd640 1 -- 172.21.15.84:0/4215236066 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f954c089a50 con 0x7f95580a8e90 2023-12-12T09:21:01.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.005+0000 7f955e4fd640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f954406ae40 0x7f954406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.005+0000 7f955e4fd640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f954406ae40 0x7f954406d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9548001f40 tx=0x7f9548009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:01.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.009+0000 7f9556ffd640 1 -- 172.21.15.84:0/4215236066 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f954c0546a0 con 0x7f95580a8e90 2023-12-12T09:21:01.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.202+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95580673c0 con 0x7f95580a8e90 2023-12-12T09:21:01.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.204+0000 7f9556ffd640 1 -- 172.21.15.84:0/4215236066 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f954c057cc0 con 0x7f95580a8e90 2023-12-12T09:21:01.205 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:21:01.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.206+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f954406ae40 msgr2=0x7f954406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.206+0000 7f9560761640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f954406ae40 0x7f954406d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9548001f40 tx=0x7f9548009040 comp rx=0 tx=0).stop 2023-12-12T09:21:01.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.206+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95580a8e90 msgr2=0x7f9558159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.206+0000 7f9560761640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95580a8e90 0x7f9558159ac0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f954c00d770 tx=0x7f954c00dc30 comp rx=0 tx=0).stop 2023-12-12T09:21:01.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.207+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 shutdown_connections 2023-12-12T09:21:01.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.207+0000 7f9560761640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955815c440 0x7f95580b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.207+0000 7f9560761640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f954406ae40 0x7f954406d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.207+0000 7f9560761640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95580a8e90 0x7f9558159ac0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.207+0000 7f9560761640 1 --2- 172.21.15.84:0/4215236066 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9540007030 0x7f955813d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.207+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 >> 172.21.15.84:0/4215236066 conn(0x7f95580b0ac0 msgr2=0x7f95580aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:01.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.207+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 shutdown_connections 2023-12-12T09:21:01.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.207+0000 7f9560761640 1 -- 172.21.15.84:0/4215236066 wait complete. 2023-12-12T09:21:01.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:21:01.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.446+0000 7fc627409640 1 Processor -- start 2023-12-12T09:21:01.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.446+0000 7fc627409640 1 -- start start 2023-12-12T09:21:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.447+0000 7fc627409640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc62013cb90 0x7fc62015e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.447+0000 7fc627409640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 0x7fc62013d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.447+0000 7fc627409640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc620070160 con 0x7fc62006d9d0 2023-12-12T09:21:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc627409640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc620070de0 con 0x7fc62013cb90 2023-12-12T09:21:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc627409640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc620070440 con 0x7fc62013d370 2023-12-12T09:21:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc626407640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc62013cb90 0x7fc62015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc626c08640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc62006d9d0 0x7fc620071200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55038/0 (socket says 172.21.15.84:55038) 2023-12-12T09:21:01.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc626c08640 1 -- 172.21.15.84:0/3638317892 learned_addr learned my addr 172.21.15.84:0/3638317892 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:01.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc625c06640 1 --2- 172.21.15.84:0/3638317892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 0x7fc62013d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc626407640 1 -- 172.21.15.84:0/3638317892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 msgr2=0x7fc62013d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:01.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc626407640 1 --2- 172.21.15.84:0/3638317892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 0x7fc62013d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc626407640 1 -- 172.21.15.84:0/3638317892 >> v1:172.21.15.84:6789/0 conn(0x7fc62006d9d0 legacy=0x7fc620071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc626407640 1 -- 172.21.15.84:0/3638317892 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620070720 con 0x7fc62013cb90 2023-12-12T09:21:01.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.448+0000 7fc625c06640 1 --2- 172.21.15.84:0/3638317892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 0x7fc62013d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:01.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.449+0000 7fc626407640 1 --2- 172.21.15.84:0/3638317892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62013cb90 0x7fc62015e190 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0097a0 tx=0x7fc61c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13eeb1a6e814829 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc625405640 1 -- 172.21.15.84:0/3638317892 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0316f0 con 0x7fc62013cb90 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc625405640 1 -- 172.21.15.84:0/3638317892 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c031850 con 0x7fc62013cb90 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc625405640 1 -- 172.21.15.84:0/3638317892 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c031be0 con 0x7fc62013cb90 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc627409640 1 -- 172.21.15.84:0/3638317892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62013cb90 msgr2=0x7fc62015e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc627409640 1 --2- 172.21.15.84:0/3638317892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62013cb90 0x7fc62015e190 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0097a0 tx=0x7fc61c02b790 comp rx=0 tx=0).stop 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc627409640 1 -- 172.21.15.84:0/3638317892 shutdown_connections 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc627409640 1 --2- 172.21.15.84:0/3638317892 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 0x7fc62013d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc627409640 1 --2- 172.21.15.84:0/3638317892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62013cb90 0x7fc62015e190 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc627409640 1 -- 172.21.15.84:0/3638317892 >> 172.21.15.84:0/3638317892 conn(0x7fc6200b0780 msgr2=0x7fc6200b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc627409640 1 -- 172.21.15.84:0/3638317892 shutdown_connections 2023-12-12T09:21:01.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.450+0000 7fc627409640 1 -- 172.21.15.84:0/3638317892 wait complete. 2023-12-12T09:21:01.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.452+0000 7fc627409640 1 Processor -- start 2023-12-12T09:21:01.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.452+0000 7fc627409640 1 -- start start 2023-12-12T09:21:01.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.453+0000 7fc627409640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62006d9d0 0x7fc6201517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.453+0000 7fc627409640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc62013cb90 0x7fc6201537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.453+0000 7fc627409640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 0x7fc6200b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.453+0000 7fc627409640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620151cf0 con 0x7fc62006d9d0 2023-12-12T09:21:01.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.453+0000 7fc627409640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620153ce0 con 0x7fc62013cb90 2023-12-12T09:21:01.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.453+0000 7fc627409640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc620154720 con 0x7fc62013d370 2023-12-12T09:21:01.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.453+0000 7fc626407640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62006d9d0 0x7fc6201517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.454+0000 7fc626407640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62006d9d0 0x7fc6201517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34678/0 (socket says 172.21.15.84:34678) 2023-12-12T09:21:01.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.454+0000 7fc626407640 1 -- 172.21.15.84:0/1339667425 learned_addr learned my addr 172.21.15.84:0/1339667425 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:01.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.454+0000 7fc626407640 1 -- 172.21.15.84:0/1339667425 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 msgr2=0x7fc6200b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.454+0000 7fc626407640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 0x7fc6200b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.454+0000 7fc626407640 1 -- 172.21.15.84:0/1339667425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc62013cb90 msgr2=0x7fc6201537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.454+0000 7fc626407640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc62013cb90 0x7fc6201537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.454+0000 7fc626407640 1 -- 172.21.15.84:0/1339667425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c009400 con 0x7fc62006d9d0 2023-12-12T09:21:01.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.454+0000 7fc626407640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62006d9d0 0x7fc6201517b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0098c0 tx=0x7fc61c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:01.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.455+0000 7fc616ffd640 1 -- 172.21.15.84:0/1339667425 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c034890 con 0x7fc62006d9d0 2023-12-12T09:21:01.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.455+0000 7fc616ffd640 1 -- 172.21.15.84:0/1339667425 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c0349f0 con 0x7fc62006d9d0 2023-12-12T09:21:01.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.455+0000 7fc616ffd640 1 -- 172.21.15.84:0/1339667425 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c034da0 con 0x7fc62006d9d0 2023-12-12T09:21:01.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.455+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62013bfd0 con 0x7fc62006d9d0 2023-12-12T09:21:01.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.455+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62015ad20 con 0x7fc62006d9d0 2023-12-12T09:21:01.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.456+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62015e670 con 0x7fc62006d9d0 2023-12-12T09:21:01.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.457+0000 7fc616ffd640 1 -- 172.21.15.84:0/1339667425 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc61c03b040 con 0x7fc62006d9d0 2023-12-12T09:21:01.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.458+0000 7fc616ffd640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc60406ae70 0x7fc60406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.458+0000 7fc616ffd640 1 -- 172.21.15.84:0/1339667425 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc61c0ab0b0 con 0x7fc62006d9d0 2023-12-12T09:21:01.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.458+0000 7fc625c06640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc60406ae70 0x7fc60406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.459+0000 7fc625c06640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc60406ae70 0x7fc60406d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc610006fd0 tx=0x7fc610008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:01.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.462+0000 7fc616ffd640 1 -- 172.21.15.84:0/1339667425 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc61c075eb0 con 0x7fc62006d9d0 2023-12-12T09:21:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.650+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc62004e840 con 0x7fc62006d9d0 2023-12-12T09:21:01.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.651+0000 7fc616ffd640 1 -- 172.21.15.84:0/1339667425 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc61c0794d0 con 0x7fc62006d9d0 2023-12-12T09:21:01.653 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc60406ae70 msgr2=0x7fc60406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc60406ae70 0x7fc60406d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc610006fd0 tx=0x7fc610008040 comp rx=0 tx=0).stop 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62006d9d0 msgr2=0x7fc6201517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62006d9d0 0x7fc6201517b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0098c0 tx=0x7fc61c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 shutdown_connections 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc62013d370 0x7fc6200b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc62013cb90 0x7fc6201537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc60406ae70 0x7fc60406d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 --2- 172.21.15.84:0/1339667425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc62006d9d0 0x7fc6201517b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 >> 172.21.15.84:0/1339667425 conn(0x7fc6200b0780 msgr2=0x7fc620157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 shutdown_connections 2023-12-12T09:21:01.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.654+0000 7fc627409640 1 -- 172.21.15.84:0/1339667425 wait complete. 2023-12-12T09:21:01.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:21:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.884+0000 7fbf31a6d640 1 Processor -- start 2023-12-12T09:21:01.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.884+0000 7fbf31a6d640 1 -- start start 2023-12-12T09:21:01.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.886+0000 7fbf31a6d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbf2c0b2f70 0x7fbf2c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.886+0000 7fbf31a6d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c0b21b0 con 0x7fbf2c15cef0 2023-12-12T09:21:01.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.886+0000 7fbf31a6d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2c0b2490 con 0x7fbf2c0cf470 2023-12-12T09:21:01.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.886+0000 7fbf31a6d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2c0cf920 con 0x7fbf2c0b2f70 2023-12-12T09:21:01.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.886+0000 7fbf30a6b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbf2c15cef0 0x7fbf2c06ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55052/0 (socket says 172.21.15.84:55052) 2023-12-12T09:21:01.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.886+0000 7fbf30a6b640 1 -- 172.21.15.84:0/3724062703 learned_addr learned my addr 172.21.15.84:0/3724062703 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:01.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.886+0000 7fbf2bfff640 1 --2- 172.21.15.84:0/3724062703 >> v2:172.21.15.99:3300/0 conn(0x7fbf2c0b2f70 0x7fbf2c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857312371 0 0) 0x7fbf2c0b21b0 con 0x7fbf2c15cef0 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf1c003520 con 0x7fbf2c15cef0 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284497810 0 0) 0x7fbf1c003520 con 0x7fbf2c15cef0 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 >> v2:172.21.15.99:3300/0 conn(0x7fbf2c0b2f70 msgr2=0x7fbf2c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 --2- 172.21.15.84:0/3724062703 >> v2:172.21.15.99:3300/0 conn(0x7fbf2c0b2f70 0x7fbf2c0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 >> v1:172.21.15.99:6789/0 conn(0x7fbf2c0cf470 legacy=0x7fbf2c070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0b2770 con 0x7fbf2c15cef0 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fbf20001670 con 0x7fbf2c15cef0 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 >> v1:172.21.15.84:6789/0 conn(0x7fbf2c15cef0 legacy=0x7fbf2c06ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf1c0039a0 0x7fbf1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf1c0047c0 0x7fbf1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0052a0 0x7fbf1c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0cf920 con 0x7fbf1c0047c0 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c00c1a0 con 0x7fbf1c0052a0 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.887+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c00c360 con 0x7fbf1c0039a0 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf2bfff640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf1c0047c0 0x7fbf1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf30a6b640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf1c0039a0 0x7fbf1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf3126c640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0052a0 0x7fbf1c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf2bfff640 1 -- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf1c0039a0 msgr2=0x7fbf1c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf2bfff640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf1c0039a0 0x7fbf1c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf2bfff640 1 -- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0052a0 msgr2=0x7fbf1c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf2bfff640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0052a0 0x7fbf1c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf2bfff640 1 -- 172.21.15.84:0/3724062703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c003520 con 0x7fbf1c0047c0 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf3126c640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0052a0 0x7fbf1c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf3126c640 1 -- 172.21.15.84:0/3724062703 reap_dead start 2023-12-12T09:21:01.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.888+0000 7fbf30a6b640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf1c0039a0 0x7fbf1c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.889+0000 7fbf2bfff640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf1c0047c0 0x7fbf1c004c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0b4170 tx=0x7fbf1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cb9142642f67de server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.889+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1802c660 con 0x7fbf1c0047c0 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.889+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1802c7c0 con 0x7fbf1c0047c0 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.889+0000 7fbf2b7fe640 1 -- 172.21.15.84:0/3724062703 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1802cb50 con 0x7fbf1c0047c0 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.890+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3724062703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf1c0047c0 msgr2=0x7fbf1c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.890+0000 7fbf31a6d640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf1c0047c0 0x7fbf1c004c40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0b4170 tx=0x7fbf1c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.890+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3724062703 shutdown_connections 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.890+0000 7fbf31a6d640 1 --2- 172.21.15.84:0/3724062703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf1c0047c0 0x7fbf1c004c40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.890+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3724062703 >> 172.21.15.84:0/3724062703 conn(0x7fbf2c06a920 msgr2=0x7fbf2c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.890+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3724062703 shutdown_connections 2023-12-12T09:21:01.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.890+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3724062703 wait complete. 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.892+0000 7fbf31a6d640 1 Processor -- start 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.892+0000 7fbf31a6d640 1 -- start start 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf31a6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0047c0 0x7fbf2c135350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf31a6d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf2c153be0 0x7fbf2c135890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf31a6d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf2c155d50 0x7fbf2c135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf31a6d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c156b90 con 0x7fbf2c153be0 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf31a6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c150330 con 0x7fbf1c0047c0 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf31a6d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c156fb0 con 0x7fbf2c155d50 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf2bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf2c153be0 0x7fbf2c135890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf2bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf2c153be0 0x7fbf2c135890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34686/0 (socket says 172.21.15.84:34686) 2023-12-12T09:21:01.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.893+0000 7fbf2bfff640 1 -- 172.21.15.84:0/3189305662 learned_addr learned my addr 172.21.15.84:0/3189305662 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:01.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf2bfff640 1 -- 172.21.15.84:0/3189305662 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf2c155d50 msgr2=0x7fbf2c135dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf2bfff640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf2c155d50 0x7fbf2c135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf2bfff640 1 -- 172.21.15.84:0/3189305662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0047c0 msgr2=0x7fbf2c135350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:01.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf2bfff640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0047c0 0x7fbf2c135350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:01.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf2bfff640 1 -- 172.21.15.84:0/3189305662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c156260 con 0x7fbf2c153be0 2023-12-12T09:21:01.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf2bfff640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf2c153be0 0x7fbf2c135890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbf18037040 tx=0x7fbf18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:01.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf297fa640 1 -- 172.21.15.84:0/3189305662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18003810 con 0x7fbf2c153be0 2023-12-12T09:21:01.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf297fa640 1 -- 172.21.15.84:0/3189305662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18003970 con 0x7fbf2c153be0 2023-12-12T09:21:01.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf297fa640 1 -- 172.21.15.84:0/3189305662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18003d00 con 0x7fbf2c153be0 2023-12-12T09:21:01.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c1564d0 con 0x7fbf2c153be0 2023-12-12T09:21:01.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.894+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c1538e0 con 0x7fbf2c153be0 2023-12-12T09:21:01.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.896+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2c0673c0 con 0x7fbf2c153be0 2023-12-12T09:21:01.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.897+0000 7fbf297fa640 1 -- 172.21.15.84:0/3189305662 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf18040450 con 0x7fbf2c153be0 2023-12-12T09:21:01.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.898+0000 7fbf297fa640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf1006ae70 0x7fbf1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:01.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.898+0000 7fbf297fa640 1 -- 172.21.15.84:0/3189305662 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbf180ab990 con 0x7fbf2c153be0 2023-12-12T09:21:01.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.898+0000 7fbf30a6b640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf1006ae70 0x7fbf1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:01.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.899+0000 7fbf30a6b640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf1006ae70 0x7fbf1006d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf20000ff0 tx=0x7fbf20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:01.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:01.902+0000 7fbf297fa640 1 -- 172.21.15.84:0/3189305662 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf18076680 con 0x7fbf2c153be0 2023-12-12T09:21:02.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.091+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf2c1574e0 con 0x7fbf2c153be0 2023-12-12T09:21:02.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.092+0000 7fbf297fa640 1 -- 172.21.15.84:0/3189305662 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf18003e60 con 0x7fbf2c153be0 2023-12-12T09:21:02.094 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:21:02.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf1006ae70 msgr2=0x7fbf1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf1006ae70 0x7fbf1006d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf20000ff0 tx=0x7fbf20009040 comp rx=0 tx=0).stop 2023-12-12T09:21:02.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf2c153be0 msgr2=0x7fbf2c135890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf2c153be0 0x7fbf2c135890 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbf18037040 tx=0x7fbf18004730 comp rx=0 tx=0).stop 2023-12-12T09:21:02.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 shutdown_connections 2023-12-12T09:21:02.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbf2c155d50 0x7fbf2c135dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbf1006ae70 0x7fbf1006d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf2c153be0 0x7fbf2c135890 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 --2- 172.21.15.84:0/3189305662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf1c0047c0 0x7fbf2c135350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 >> 172.21.15.84:0/3189305662 conn(0x7fbf2c06a920 msgr2=0x7fbf2c0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:02.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 shutdown_connections 2023-12-12T09:21:02.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.095+0000 7fbf31a6d640 1 -- 172.21.15.84:0/3189305662 wait complete. 2023-12-12T09:21:02.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:21:02.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.330+0000 7f804950f640 1 Processor -- start 2023-12-12T09:21:02.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.331+0000 7f804950f640 1 -- start start 2023-12-12T09:21:02.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.332+0000 7f804950f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80441609f0 0x7f80440d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.332+0000 7f804950f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80440d0180 0x7f80440b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.332+0000 7f804950f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80440d3dc0 con 0x7f80440b2610 2023-12-12T09:21:02.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.332+0000 7f804950f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80440b2ad0 con 0x7f80441609f0 2023-12-12T09:21:02.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.332+0000 7f804950f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80440b2db0 con 0x7f80440d0180 2023-12-12T09:21:02.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.333+0000 7f80427fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f80440b2610 0x7f80440cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55056/0 (socket says 172.21.15.84:55056) 2023-12-12T09:21:02.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.333+0000 7f80427fc640 1 -- 172.21.15.84:0/3337071915 learned_addr learned my addr 172.21.15.84:0/3337071915 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:02.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.333+0000 7f8042ffd640 1 --2- 172.21.15.84:0/3337071915 >> v2:172.21.15.99:3300/0 conn(0x7f80441609f0 0x7f80440d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.333+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475107253 0 0) 0x7f80440d3dc0 con 0x7f80440b2610 2023-12-12T09:21:02.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.333+0000 7f80437fe640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80440d0180 0x7f80440b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.333+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8030003520 con 0x7f80440b2610 2023-12-12T09:21:02.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.333+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 503854163 0 0) 0x7f8030003520 con 0x7f80440b2610 2023-12-12T09:21:02.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.333+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80440d0180 msgr2=0x7f80440b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:02.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80440d0180 0x7f80440b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 >> v2:172.21.15.99:3300/0 conn(0x7f80441609f0 msgr2=0x7f80440d3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 --2- 172.21.15.84:0/3337071915 >> v2:172.21.15.99:3300/0 conn(0x7f80441609f0 0x7f80440d3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440b3090 con 0x7f80440b2610 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f802c001670 con 0x7f80440b2610 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 >> v1:172.21.15.84:6789/0 conn(0x7f80440b2610 legacy=0x7f80440cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8030003970 0x7f8030003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8030004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80440d0180 0x7f8030005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440b2ad0 con 0x7f80300047c0 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440b2db0 con 0x7f8030003970 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803000b980 con 0x7f80440d0180 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f80427fc640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8030004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f8042ffd640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8030003970 0x7f8030003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f80437fe640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80440d0180 0x7f8030005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f80427fc640 1 -- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80440d0180 msgr2=0x7f8030005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:02.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f80427fc640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80440d0180 0x7f8030005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f80427fc640 1 -- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8030003970 msgr2=0x7f8030003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:02.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f80427fc640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8030003970 0x7f8030003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.334+0000 7f80427fc640 1 -- 172.21.15.84:0/3337071915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030003520 con 0x7f80300047c0 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f80427fc640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8030004c40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c290 tx=0x7f80300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ffda1f9e93d4db server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c005ad0 con 0x7f80300047c0 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c005c30 con 0x7f80300047c0 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f8041ffb640 1 -- 172.21.15.84:0/3337071915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c02c8d0 con 0x7f80300047c0 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f804950f640 1 -- 172.21.15.84:0/3337071915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 msgr2=0x7f8030004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f804950f640 1 --2- 172.21.15.84:0/3337071915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8030004c40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c290 tx=0x7f80300057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f80437fe640 1 -- 172.21.15.84:0/3337071915 reap_dead start 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f804950f640 1 -- 172.21.15.84:0/3337071915 shutdown_connections 2023-12-12T09:21:02.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.336+0000 7f804950f640 1 -- 172.21.15.84:0/3337071915 >> 172.21.15.84:0/3337071915 conn(0x7f804409c3d0 msgr2=0x7f80440d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.337+0000 7f804950f640 1 -- 172.21.15.84:0/3337071915 shutdown_connections 2023-12-12T09:21:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.337+0000 7f804950f640 1 -- 172.21.15.84:0/3337071915 wait complete. 2023-12-12T09:21:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.338+0000 7f804950f640 1 Processor -- start 2023-12-12T09:21:02.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.338+0000 7f804950f640 1 -- start start 2023-12-12T09:21:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.339+0000 7f804950f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8044152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.339+0000 7f804950f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f804415e5b0 0x7f804415fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.339+0000 7f804950f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80440b5c80 0x7f80440b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.339+0000 7f804950f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804415f6a0 con 0x7f80300047c0 2023-12-12T09:21:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.339+0000 7f804950f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440b6670 con 0x7f80440b5c80 2023-12-12T09:21:02.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.339+0000 7f804950f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80441533d0 con 0x7f804415e5b0 2023-12-12T09:21:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8044152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8044152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34704/0 (socket says 172.21.15.84:34704) 2023-12-12T09:21:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 -- 172.21.15.84:0/2256724225 learned_addr learned my addr 172.21.15.84:0/2256724225 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:02.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f80437fe640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80440b5c80 0x7f80440b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f80427fc640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f804415e5b0 0x7f804415fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 -- 172.21.15.84:0/2256724225 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f804415e5b0 msgr2=0x7f804415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f804415e5b0 0x7f804415fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 -- 172.21.15.84:0/2256724225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80440b5c80 msgr2=0x7f80440b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80440b5c80 0x7f80440b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 -- 172.21.15.84:0/2256724225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804415ea90 con 0x7f80300047c0 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.340+0000 7f8042ffd640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8044152e90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f803400f400 tx=0x7f803400f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.341+0000 7f803b7fe640 1 -- 172.21.15.84:0/2256724225 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034009ea0 con 0x7f80300047c0 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.341+0000 7f803b7fe640 1 -- 172.21.15.84:0/2256724225 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8034014800 con 0x7f80300047c0 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.341+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804415ed70 con 0x7f80300047c0 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.341+0000 7f803b7fe640 1 -- 172.21.15.84:0/2256724225 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034014bb0 con 0x7f80300047c0 2023-12-12T09:21:02.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.341+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804415f330 con 0x7f80300047c0 2023-12-12T09:21:02.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.342+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804415f4c0 con 0x7f80300047c0 2023-12-12T09:21:02.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.343+0000 7f803b7fe640 1 -- 172.21.15.84:0/2256724225 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8034014d10 con 0x7f80300047c0 2023-12-12T09:21:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.344+0000 7f803b7fe640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f802406ae70 0x7f802406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.344+0000 7f803b7fe640 1 -- 172.21.15.84:0/2256724225 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f803408ac20 con 0x7f80300047c0 2023-12-12T09:21:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.344+0000 7f80427fc640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f802406ae70 0x7f802406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.345+0000 7f80427fc640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f802406ae70 0x7f802406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f802c034000 tx=0x7f802c007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:02.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.348+0000 7f803b7fe640 1 -- 172.21.15.84:0/2256724225 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8034055930 con 0x7f80300047c0 2023-12-12T09:21:02.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.536+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f80440673c0 con 0x7f80300047c0 2023-12-12T09:21:02.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.537+0000 7f803b7fe640 1 -- 172.21.15.84:0/2256724225 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8034058f50 con 0x7f80300047c0 2023-12-12T09:21:02.538 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f802406ae70 msgr2=0x7f802406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f802406ae70 0x7f802406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f802c034000 tx=0x7f802c007000 comp rx=0 tx=0).stop 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 msgr2=0x7f8044152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8044152e90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f803400f400 tx=0x7f803400f8c0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 shutdown_connections 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80440b5c80 0x7f80440b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f804415e5b0 0x7f804415fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f802406ae70 0x7f802406d330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 --2- 172.21.15.84:0/2256724225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80300047c0 0x7f8044152e90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 >> 172.21.15.84:0/2256724225 conn(0x7f804409c3d0 msgr2=0x7f804406c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 shutdown_connections 2023-12-12T09:21:02.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.539+0000 7f804950f640 1 -- 172.21.15.84:0/2256724225 wait complete. 2023-12-12T09:21:02.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:21:02.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.772+0000 7f7ad0d28640 1 Processor -- start 2023-12-12T09:21:02.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.772+0000 7f7ad0d28640 1 -- start start 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.773+0000 7f7ad0d28640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7acc15d230 0x7f7acc06d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.773+0000 7f7ad0d28640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7acc0710e0 0x7f7acc1613c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.773+0000 7f7ad0d28640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc06d680 0x7f7acc161900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.773+0000 7f7ad0d28640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc0af790 con 0x7f7acc15d230 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.773+0000 7f7ad0d28640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc071ef0 con 0x7f7acc0710e0 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.773+0000 7f7ad0d28640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc15d610 con 0x7f7acc06d680 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.773+0000 7f7acb7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7acc15d230 0x7f7acc06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acb7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7acc15d230 0x7f7acc06d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34708/0 (socket says 172.21.15.84:34708) 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acb7fe640 1 -- 172.21.15.84:0/244917682 learned_addr learned my addr 172.21.15.84:0/244917682 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:02.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acbfff640 1 --2- 172.21.15.84:0/244917682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc06d680 0x7f7acc161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acaffd640 1 --2- 172.21.15.84:0/244917682 >> v2:172.21.15.99:3300/0 conn(0x7f7acc0710e0 0x7f7acc1613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acb7fe640 1 -- 172.21.15.84:0/244917682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc06d680 msgr2=0x7f7acc161900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acb7fe640 1 --2- 172.21.15.84:0/244917682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc06d680 0x7f7acc161900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acb7fe640 1 -- 172.21.15.84:0/244917682 >> v2:172.21.15.99:3300/0 conn(0x7f7acc0710e0 msgr2=0x7f7acc1613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acb7fe640 1 --2- 172.21.15.84:0/244917682 >> v2:172.21.15.99:3300/0 conn(0x7f7acc0710e0 0x7f7acc1613c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acb7fe640 1 -- 172.21.15.84:0/244917682 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc071650 con 0x7f7acc15d230 2023-12-12T09:21:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.774+0000 7f7acaffd640 1 --2- 172.21.15.84:0/244917682 >> v2:172.21.15.99:3300/0 conn(0x7f7acc0710e0 0x7f7acc1613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.775+0000 7f7acb7fe640 1 --2- 172.21.15.84:0/244917682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc15d230 0x7f7acc06d140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7acc072c90 tx=0x7f7abc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71b153829b282c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.775+0000 7f7aca7fc640 1 -- 172.21.15.84:0/244917682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc02c9e0 con 0x7f7acc15d230 2023-12-12T09:21:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.775+0000 7f7aca7fc640 1 -- 172.21.15.84:0/244917682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc02cb40 con 0x7f7acc15d230 2023-12-12T09:21:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.775+0000 7f7aca7fc640 1 -- 172.21.15.84:0/244917682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0343f0 con 0x7f7acc15d230 2023-12-12T09:21:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 -- 172.21.15.84:0/244917682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc15d230 msgr2=0x7f7acc06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/244917682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc15d230 0x7f7acc06d140 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7acc072c90 tx=0x7f7abc02be40 comp rx=0 tx=0).stop 2023-12-12T09:21:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 -- 172.21.15.84:0/244917682 shutdown_connections 2023-12-12T09:21:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/244917682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc06d680 0x7f7acc161900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/244917682 >> v2:172.21.15.99:3300/0 conn(0x7f7acc0710e0 0x7f7acc1613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/244917682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc15d230 0x7f7acc06d140 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 -- 172.21.15.84:0/244917682 >> 172.21.15.84:0/244917682 conn(0x7f7acc0b1980 msgr2=0x7f7acc0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 -- 172.21.15.84:0/244917682 shutdown_connections 2023-12-12T09:21:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.776+0000 7f7ad0d28640 1 -- 172.21.15.84:0/244917682 wait complete. 2023-12-12T09:21:02.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.778+0000 7f7ad0d28640 1 Processor -- start 2023-12-12T09:21:02.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.778+0000 7f7ad0d28640 1 -- start start 2023-12-12T09:21:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7ad0d28640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7acc06d680 0x7f7acc157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7ad0d28640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc0710e0 0x7f7acc1f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7ad0d28640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc15d230 0x7f7acc145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7ad0d28640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc14b450 con 0x7f7acc0710e0 2023-12-12T09:21:02.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7ad0d28640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc15d7f0 con 0x7f7acc06d680 2023-12-12T09:21:02.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7ad0d28640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc15da90 con 0x7f7acc15d230 2023-12-12T09:21:02.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7acaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc0710e0 0x7f7acc1f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7acaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc0710e0 0x7f7acc1f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34716/0 (socket says 172.21.15.84:34716) 2023-12-12T09:21:02.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.779+0000 7f7acaffd640 1 -- 172.21.15.84:0/2136245176 learned_addr learned my addr 172.21.15.84:0/2136245176 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:02.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7acbfff640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc15d230 0x7f7acc145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7acaffd640 1 -- 172.21.15.84:0/2136245176 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc15d230 msgr2=0x7f7acc145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7acb7fe640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7acc06d680 0x7f7acc157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7acaffd640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc15d230 0x7f7acc145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7acaffd640 1 -- 172.21.15.84:0/2136245176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7acc06d680 msgr2=0x7f7acc157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7acaffd640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7acc06d680 0x7f7acc157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7acaffd640 1 -- 172.21.15.84:0/2136245176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc009b30 con 0x7f7acc0710e0 2023-12-12T09:21:02.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7acaffd640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc0710e0 0x7f7acc1f26c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400c7f0 tx=0x7f7ab400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7ac3fff640 1 -- 172.21.15.84:0/2136245176 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4007820 con 0x7f7acc0710e0 2023-12-12T09:21:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7ac3fff640 1 -- 172.21.15.84:0/2136245176 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4007980 con 0x7f7acc0710e0 2023-12-12T09:21:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc15dd70 con 0x7f7acc0710e0 2023-12-12T09:21:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7ac3fff640 1 -- 172.21.15.84:0/2136245176 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4007cf0 con 0x7f7acc0710e0 2023-12-12T09:21:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.780+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc1568e0 con 0x7f7acc0710e0 2023-12-12T09:21:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.782+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc072eb0 con 0x7f7acc0710e0 2023-12-12T09:21:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.782+0000 7f7ac3fff640 1 -- 172.21.15.84:0/2136245176 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ab40113f0 con 0x7f7acc0710e0 2023-12-12T09:21:02.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.783+0000 7f7ac3fff640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7aac06ae40 0x7f7aac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:02.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.783+0000 7f7ac3fff640 1 -- 172.21.15.84:0/2136245176 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ab4089db0 con 0x7f7acc0710e0 2023-12-12T09:21:02.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.784+0000 7f7acb7fe640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7aac06ae40 0x7f7aac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:02.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.784+0000 7f7acb7fe640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7aac06ae40 0x7f7aac06d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7abc035000 tx=0x7f7abc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:02.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.788+0000 7f7ac3fff640 1 -- 172.21.15.84:0/2136245176 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ab408e070 con 0x7f7acc0710e0 2023-12-12T09:21:02.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.991+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7acc06b3f0 con 0x7f7acc0710e0 2023-12-12T09:21:02.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.992+0000 7f7ac3fff640 1 -- 172.21.15.84:0/2136245176 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7ab401f080 con 0x7f7acc0710e0 2023-12-12T09:21:02.993 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:21:02.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7aac06ae40 msgr2=0x7f7aac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7aac06ae40 0x7f7aac06d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7abc035000 tx=0x7f7abc030000 comp rx=0 tx=0).stop 2023-12-12T09:21:02.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc0710e0 msgr2=0x7f7acc1f26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:02.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc0710e0 0x7f7acc1f26c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400c7f0 tx=0x7f7ab400ccb0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 shutdown_connections 2023-12-12T09:21:02.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7acc15d230 0x7f7acc145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7aac06ae40 0x7f7aac06d300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7acc0710e0 0x7f7acc1f26c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 --2- 172.21.15.84:0/2136245176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7acc06d680 0x7f7acc157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:02.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 >> 172.21.15.84:0/2136245176 conn(0x7f7acc0b1980 msgr2=0x7f7acc06a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:02.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 shutdown_connections 2023-12-12T09:21:02.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:02.995+0000 7f7ad0d28640 1 -- 172.21.15.84:0/2136245176 wait complete. 2023-12-12T09:21:03.015 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:21:03.015 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:21:03.066 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.331+0000 7fa7fc6cf640 1 Processor -- start 2023-12-12T09:21:03.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.331+0000 7fa7fc6cf640 1 -- start start 2023-12-12T09:21:03.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.333+0000 7fa7fc6cf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4143d20 0x7fa7f40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.333+0000 7fa7fc6cf640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f415f910 con 0x7fa7f40ce550 2023-12-12T09:21:03.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.333+0000 7fa7fc6cf640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f40cea30 con 0x7fa7f41447f0 2023-12-12T09:21:03.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.333+0000 7fa7fc6cf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40702b0 con 0x7fa7f4143d20 2023-12-12T09:21:03.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.333+0000 7fa7f9c6a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa7f40ce550 0x7fa7f415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55066/0 (socket says 172.21.15.84:55066) 2023-12-12T09:21:03.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9c6a640 1 -- 172.21.15.84:0/4134174414 learned_addr learned my addr 172.21.15.84:0/4134174414 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:03.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7fa46b640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4143d20 0x7fa7f40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302277144 0 0) 0x7fa7f415f910 con 0x7fa7f40ce550 2023-12-12T09:21:03.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e0003520 con 0x7fa7f40ce550 2023-12-12T09:21:03.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171150945 0 0) 0x7fa7e0003520 con 0x7fa7f40ce550 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4143d20 msgr2=0x7fa7f40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4143d20 0x7fa7f40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 >> v1:172.21.15.99:6789/0 conn(0x7fa7f41447f0 legacy=0x7fa7f415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4070590 con 0x7fa7f40ce550 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa7e4001670 con 0x7fa7f40ce550 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.334+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 >> v1:172.21.15.84:6789/0 conn(0x7fa7f40ce550 legacy=0x7fa7f415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7f9469640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7f9469640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4143d20 0x7fa7e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7f9469640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7e0004d00 0x7fa7e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40702b0 con 0x7fa7e00039a0 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e000ba30 con 0x7fa7e0004d00 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e000bbf0 con 0x7fa7f4143d20 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7fa46b640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7fa46b640 1 -- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4143d20 msgr2=0x7fa7e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:03.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7fa46b640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4143d20 0x7fa7e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7fa46b640 1 -- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7e0004d00 msgr2=0x7fa7e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:03.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7fa46b640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7e0004d00 0x7fa7e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.335+0000 7fa7fa46b640 1 -- 172.21.15.84:0/4134174414 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0003520 con 0x7fa7e00039a0 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.336+0000 7fa7fa46b640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7e0003dc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009a90 tx=0x7fa7e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9623f7414dee62fc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f002c6b0 con 0x7fa7e00039a0 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f002c810 con 0x7fa7e00039a0 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7f9469640 1 -- 172.21.15.84:0/4134174414 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f002cba0 con 0x7fa7e00039a0 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/4134174414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 msgr2=0x7fa7e0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7fc6cf640 1 --2- 172.21.15.84:0/4134174414 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7e0003dc0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009a90 tx=0x7fa7e00057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7fac6c640 1 -- 172.21.15.84:0/4134174414 reap_dead start 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/4134174414 shutdown_connections 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/4134174414 >> 172.21.15.84:0/4134174414 conn(0x7fa7f406c3d0 msgr2=0x7fa7f406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/4134174414 shutdown_connections 2023-12-12T09:21:03.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.337+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/4134174414 wait complete. 2023-12-12T09:21:03.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.339+0000 7fa7fc6cf640 1 Processor -- start 2023-12-12T09:21:03.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.339+0000 7fa7fc6cf640 1 -- start start 2023-12-12T09:21:03.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.340+0000 7fa7fc6cf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7f4140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.340+0000 7fa7fc6cf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4141830 0x7fa7f415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.340+0000 7fa7fc6cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7f415db50 0x7fa7f415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.340+0000 7fa7fc6cf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4140790 con 0x7fa7e00039a0 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.340+0000 7fa7fc6cf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4140a70 con 0x7fa7f415db50 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.340+0000 7fa7fc6cf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4140d50 con 0x7fa7f4141830 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7f4140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7f4140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34736/0 (socket says 172.21.15.84:34736) 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 -- 172.21.15.84:0/3860065141 learned_addr learned my addr 172.21.15.84:0/3860065141 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fac6c640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7f415db50 0x7fa7f415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 -- 172.21.15.84:0/3860065141 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4141830 msgr2=0x7fa7f415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4141830 0x7fa7f415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 -- 172.21.15.84:0/3860065141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7f415db50 msgr2=0x7fa7f415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7f415db50 0x7fa7f415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 -- 172.21.15.84:0/3860065141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4141030 con 0x7fa7e00039a0 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.341+0000 7fa7fa46b640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7f4140170 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa7f002c250 tx=0x7fa7f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.342+0000 7fa7eaffd640 1 -- 172.21.15.84:0/3860065141 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0003810 con 0x7fa7e00039a0 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.342+0000 7fa7eaffd640 1 -- 172.21.15.84:0/3860065141 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0003970 con 0x7fa7e00039a0 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.342+0000 7fa7eaffd640 1 -- 172.21.15.84:0/3860065141 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0003d00 con 0x7fa7e00039a0 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.342+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f4141310 con 0x7fa7e00039a0 2023-12-12T09:21:03.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.342+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f415dfe0 con 0x7fa7e00039a0 2023-12-12T09:21:03.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.343+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f41414a0 con 0x7fa7e00039a0 2023-12-12T09:21:03.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.344+0000 7fa7eaffd640 1 -- 172.21.15.84:0/3860065141 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa7f0047450 con 0x7fa7e00039a0 2023-12-12T09:21:03.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.345+0000 7fa7eaffd640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa7d806ae40 0x7fa7d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.345+0000 7fa7eaffd640 1 -- 172.21.15.84:0/3860065141 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa7f00abb50 con 0x7fa7e00039a0 2023-12-12T09:21:03.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.345+0000 7fa7f9c6a640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa7d806ae40 0x7fa7d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.346+0000 7fa7f9c6a640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa7d806ae40 0x7fa7d806d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4000f60 tx=0x7fa7e4001520 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:03.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.349+0000 7fa7eaffd640 1 -- 172.21.15.84:0/3860065141 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa7f00768f0 con 0x7fa7e00039a0 2023-12-12T09:21:03.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.541+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7f40673c0 con 0x7fa7e00039a0 2023-12-12T09:21:03.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.544+0000 7fa7eaffd640 1 -- 172.21.15.84:0/3860065141 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7fa7f00044e0 con 0x7fa7e00039a0 2023-12-12T09:21:03.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:03.546 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:03.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa7d806ae40 msgr2=0x7fa7d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa7d806ae40 0x7fa7d806d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4000f60 tx=0x7fa7e4001520 comp rx=0 tx=0).stop 2023-12-12T09:21:03.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 msgr2=0x7fa7f4140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7f4140170 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa7f002c250 tx=0x7fa7f0004730 comp rx=0 tx=0).stop 2023-12-12T09:21:03.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 shutdown_connections 2023-12-12T09:21:03.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa7f415db50 0x7fa7f415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa7f4141830 0x7fa7f415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa7d806ae40 0x7fa7d806d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 --2- 172.21.15.84:0/3860065141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7e00039a0 0x7fa7f4140170 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 >> 172.21.15.84:0/3860065141 conn(0x7fa7f406c3d0 msgr2=0x7fa7f4142770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:03.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 shutdown_connections 2023-12-12T09:21:03.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.547+0000 7fa7fc6cf640 1 -- 172.21.15.84:0/3860065141 wait complete. 2023-12-12T09:21:03.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:21:03.569 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:21:03.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.786+0000 7f1a0c200640 1 Processor -- start 2023-12-12T09:21:03.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.786+0000 7f1a0c200640 1 -- start start 2023-12-12T09:21:03.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.788+0000 7f1a0c200640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a040b40d0 0x7f1a0406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.788+0000 7f1a0c200640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a0415be60 0x7f1a0413e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.788+0000 7f1a0c200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a040ceb80 con 0x7f1a040ce6f0 2023-12-12T09:21:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.788+0000 7f1a0c200640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a040ce260 con 0x7f1a040b40d0 2023-12-12T09:21:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.788+0000 7f1a0c200640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040cd930 con 0x7f1a0415be60 2023-12-12T09:21:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.788+0000 7f1a09f9c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a040b40d0 0x7f1a0406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.788+0000 7f1a09f9c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a040b40d0 0x7f1a0406dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34744/0 (socket says 172.21.15.84:34744) 2023-12-12T09:21:03.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.788+0000 7f1a09f9c640 1 -- 172.21.15.84:0/2331801193 learned_addr learned my addr 172.21.15.84:0/2331801193 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.789+0000 7f1a09f9c640 1 -- 172.21.15.84:0/2331801193 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a0415be60 msgr2=0x7f1a0413e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.789+0000 7f1a0a79d640 1 --2- 172.21.15.84:0/2331801193 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a0415be60 0x7f1a0413e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.789+0000 7f1a09f9c640 1 --2- 172.21.15.84:0/2331801193 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a0415be60 0x7f1a0413e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.789+0000 7f1a09f9c640 1 -- 172.21.15.84:0/2331801193 >> v1:172.21.15.99:6789/0 conn(0x7f1a040ce6f0 legacy=0x7f1a040b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.789+0000 7f1a09f9c640 1 -- 172.21.15.84:0/2331801193 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040cdc10 con 0x7f1a040b40d0 2023-12-12T09:21:03.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.790+0000 7f1a09f9c640 1 --2- 172.21.15.84:0/2331801193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a040b40d0 0x7f1a0406dff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009870 tx=0x7f1a0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16497cee8c2c80f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.790+0000 7f1a08f9a640 1 -- 172.21.15.84:0/2331801193 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00031640 con 0x7f1a040b40d0 2023-12-12T09:21:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.790+0000 7f1a08f9a640 1 -- 172.21.15.84:0/2331801193 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a000317a0 con 0x7f1a040b40d0 2023-12-12T09:21:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.790+0000 7f1a08f9a640 1 -- 172.21.15.84:0/2331801193 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00031b30 con 0x7f1a040b40d0 2023-12-12T09:21:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.791+0000 7f1a0c200640 1 -- 172.21.15.84:0/2331801193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a040b40d0 msgr2=0x7f1a0406dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.791+0000 7f1a0c200640 1 --2- 172.21.15.84:0/2331801193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a040b40d0 0x7f1a0406dff0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009870 tx=0x7f1a0002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.791+0000 7f1a0c200640 1 -- 172.21.15.84:0/2331801193 shutdown_connections 2023-12-12T09:21:03.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.791+0000 7f1a0c200640 1 --2- 172.21.15.84:0/2331801193 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a0415be60 0x7f1a0413e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.791+0000 7f1a0c200640 1 --2- 172.21.15.84:0/2331801193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a040b40d0 0x7f1a0406dff0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.791+0000 7f1a0c200640 1 -- 172.21.15.84:0/2331801193 >> 172.21.15.84:0/2331801193 conn(0x7f1a040b0ac0 msgr2=0x7f1a040b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:03.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.791+0000 7f1a0c200640 1 -- 172.21.15.84:0/2331801193 shutdown_connections 2023-12-12T09:21:03.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.791+0000 7f1a0c200640 1 -- 172.21.15.84:0/2331801193 wait complete. 2023-12-12T09:21:03.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.793+0000 7f1a0c200640 1 Processor -- start 2023-12-12T09:21:03.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.793+0000 7f1a0c200640 1 -- start start 2023-12-12T09:21:03.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0c200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a040b40d0 0x7f1a04071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0c200640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a040ce6f0 0x7f1a0412c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0c200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0415be60 0x7f1a0412c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0c200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0412bf10 con 0x7f1a0415be60 2023-12-12T09:21:03.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0c200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0412ba80 con 0x7f1a040b40d0 2023-12-12T09:21:03.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0c200640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0412ae70 con 0x7f1a040ce6f0 2023-12-12T09:21:03.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0a79d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0415be60 0x7f1a0412c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0a79d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0415be60 0x7f1a0412c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34754/0 (socket says 172.21.15.84:34754) 2023-12-12T09:21:03.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.794+0000 7f1a0a79d640 1 -- 172.21.15.84:0/901662498 learned_addr learned my addr 172.21.15.84:0/901662498 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:03.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f1a0a79d640 1 -- 172.21.15.84:0/901662498 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a040ce6f0 msgr2=0x7f1a0412c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f1a0a79d640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a040ce6f0 0x7f1a0412c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f1a0a79d640 1 -- 172.21.15.84:0/901662498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a040b40d0 msgr2=0x7f1a04071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f1a0a79d640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a040b40d0 0x7f1a04071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:03.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f1a0a79d640 1 -- 172.21.15.84:0/901662498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000094d0 con 0x7f1a0415be60 2023-12-12T09:21:03.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f1a0a79d640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0415be60 0x7f1a0412c640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00cc60 tx=0x7f19fc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:03.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f19fa7fc640 1 -- 172.21.15.84:0/901662498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00ce70 con 0x7f1a0415be60 2023-12-12T09:21:03.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f19fa7fc640 1 -- 172.21.15.84:0/901662498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc003990 con 0x7f1a0415be60 2023-12-12T09:21:03.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f19fa7fc640 1 -- 172.21.15.84:0/901662498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc003d20 con 0x7f1a0415be60 2023-12-12T09:21:03.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0412b150 con 0x7f1a0415be60 2023-12-12T09:21:03.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.795+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0412b710 con 0x7f1a0415be60 2023-12-12T09:21:03.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.796+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a040673c0 con 0x7f1a0415be60 2023-12-12T09:21:03.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.797+0000 7f19fa7fc640 1 -- 172.21.15.84:0/901662498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19fc003e80 con 0x7f1a0415be60 2023-12-12T09:21:03.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.798+0000 7f19fa7fc640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f19e806ae40 0x7f19e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:03.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.798+0000 7f19fa7fc640 1 -- 172.21.15.84:0/901662498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f19fc089c70 con 0x7f1a0415be60 2023-12-12T09:21:03.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.798+0000 7f1a09f9c640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f19e806ae40 0x7f19e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:03.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.799+0000 7f1a09f9c640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f19e806ae40 0x7f19e806d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a00036000 tx=0x7f1a00030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:03.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.802+0000 7f19fa7fc640 1 -- 172.21.15.84:0/901662498 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19fc0549f0 con 0x7f1a0415be60 2023-12-12T09:21:03.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.995+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a0412bbc0 con 0x7f1a0415be60 2023-12-12T09:21:03.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.996+0000 7f19fa7fc640 1 -- 172.21.15.84:0/901662498 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19fc01d070 con 0x7f1a0415be60 2023-12-12T09:21:03.997 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:21:03.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f19e806ae40 msgr2=0x7f19e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f19e806ae40 0x7f19e806d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a00036000 tx=0x7f1a00030000 comp rx=0 tx=0).stop 2023-12-12T09:21:03.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0415be60 msgr2=0x7f1a0412c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:03.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0415be60 0x7f1a0412c640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00cc60 tx=0x7f19fc00a5c0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 shutdown_connections 2023-12-12T09:21:04.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f19e806ae40 0x7f19e806d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0415be60 0x7f1a0412c640 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1a040ce6f0 0x7f1a0412c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 --2- 172.21.15.84:0/901662498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a040b40d0 0x7f1a04071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.998+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 >> 172.21.15.84:0/901662498 conn(0x7f1a040b0ac0 msgr2=0x7f1a040b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:04.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.999+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 shutdown_connections 2023-12-12T09:21:04.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:03.999+0000 7f1a0c200640 1 -- 172.21.15.84:0/901662498 wait complete. 2023-12-12T09:21:04.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:21:04.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.230+0000 7fa83e44f640 1 Processor -- start 2023-12-12T09:21:04.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.230+0000 7fa83e44f640 1 -- start start 2023-12-12T09:21:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.232+0000 7fa83e44f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8380cde40 0x7fa8380ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.232+0000 7fa83e44f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815b4f0 0x7fa83815b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.232+0000 7fa83e44f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa838155a70 con 0x7fa838155690 2023-12-12T09:21:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.232+0000 7fa83e44f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8380ce830 con 0x7fa8380cde40 2023-12-12T09:21:04.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.232+0000 7fa83e44f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83815be60 con 0x7fa83815b4f0 2023-12-12T09:21:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.232+0000 7fa837fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa838155690 0x7fa83806ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55076/0 (socket says 172.21.15.84:55076) 2023-12-12T09:21:04.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.232+0000 7fa837fff640 1 -- 172.21.15.84:0/4153425418 learned_addr learned my addr 172.21.15.84:0/4153425418 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa83c9ec640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815b4f0 0x7fa83815b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa8377fe640 1 --2- 172.21.15.84:0/4153425418 >> v2:172.21.15.99:3300/0 conn(0x7fa8380cde40 0x7fa8380ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494719892 0 0) 0x7fa838155a70 con 0x7fa838155690 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa820003520 con 0x7fa838155690 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 794723939 0 0) 0x7fa820003520 con 0x7fa838155690 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815b4f0 msgr2=0x7fa83815b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815b4f0 0x7fa83815b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 >> v2:172.21.15.99:3300/0 conn(0x7fa8380cde40 msgr2=0x7fa8380ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 --2- 172.21.15.84:0/4153425418 >> v2:172.21.15.99:3300/0 conn(0x7fa8380cde40 0x7fa8380ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83815c120 con 0x7fa838155690 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa828001670 con 0x7fa838155690 2023-12-12T09:21:04.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 >> v1:172.21.15.84:6789/0 conn(0x7fa838155690 legacy=0x7fa83806ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa820003970 0x7fa820003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200047c0 0x7fa820004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815b4f0 0x7fa820005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380ce830 con 0x7fa8200047c0 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83815be60 con 0x7fa820003970 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.233+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82000b980 con 0x7fa83815b4f0 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.234+0000 7fa8377fe640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200047c0 0x7fa820004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.234+0000 7fa837fff640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa820003970 0x7fa820003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.234+0000 7fa8377fe640 1 -- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815b4f0 msgr2=0x7fa820005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.234+0000 7fa8377fe640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815b4f0 0x7fa820005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.234+0000 7fa8377fe640 1 -- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa820003970 msgr2=0x7fa820003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.234+0000 7fa8377fe640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa820003970 0x7fa820003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.234+0000 7fa8377fe640 1 -- 172.21.15.84:0/4153425418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa820003520 con 0x7fa8200047c0 2023-12-12T09:21:04.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.234+0000 7fa837fff640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa820003970 0x7fa820003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:04.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.235+0000 7fa8377fe640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200047c0 0x7fa820004c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009ac0 tx=0x7fa8200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e391773538104fe2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.235+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c02c710 con 0x7fa8200047c0 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.235+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c02c870 con 0x7fa8200047c0 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.235+0000 7fa836ffd640 1 -- 172.21.15.84:0/4153425418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c02cc00 con 0x7fa8200047c0 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.236+0000 7fa83e44f640 1 -- 172.21.15.84:0/4153425418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200047c0 msgr2=0x7fa820004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.236+0000 7fa83e44f640 1 --2- 172.21.15.84:0/4153425418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8200047c0 0x7fa820004c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009ac0 tx=0x7fa8200057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.236+0000 7fa83c9ec640 1 -- 172.21.15.84:0/4153425418 reap_dead start 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.236+0000 7fa83e44f640 1 -- 172.21.15.84:0/4153425418 shutdown_connections 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.236+0000 7fa83e44f640 1 -- 172.21.15.84:0/4153425418 >> 172.21.15.84:0/4153425418 conn(0x7fa8380b0900 msgr2=0x7fa8380b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.236+0000 7fa83e44f640 1 -- 172.21.15.84:0/4153425418 shutdown_connections 2023-12-12T09:21:04.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.236+0000 7fa83e44f640 1 -- 172.21.15.84:0/4153425418 wait complete. 2023-12-12T09:21:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.238+0000 7fa83e44f640 1 Processor -- start 2023-12-12T09:21:04.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.238+0000 7fa83e44f640 1 -- start start 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa83e44f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8200047c0 0x7fa838158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa83e44f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa838153300 0x7fa83815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa83e44f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815dec0 0x7fa8380ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa83e44f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83815e340 con 0x7fa838153300 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa83e44f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380b0010 con 0x7fa8200047c0 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa83e44f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8380ad6e0 con 0x7fa83815dec0 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa8377fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa838153300 0x7fa83815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa8377fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa838153300 0x7fa83815d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34774/0 (socket says 172.21.15.84:34774) 2023-12-12T09:21:04.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.239+0000 7fa8377fe640 1 -- 172.21.15.84:0/2439730365 learned_addr learned my addr 172.21.15.84:0/2439730365 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa837fff640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8200047c0 0x7fa838158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa8377fe640 1 -- 172.21.15.84:0/2439730365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815dec0 msgr2=0x7fa8380ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa8377fe640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815dec0 0x7fa8380ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa8377fe640 1 -- 172.21.15.84:0/2439730365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8200047c0 msgr2=0x7fa838158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa8377fe640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8200047c0 0x7fa838158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa8377fe640 1 -- 172.21.15.84:0/2439730365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8380adca0 con 0x7fa838153300 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa8377fe640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa838153300 0x7fa83815d980 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa82c02c2b0 tx=0x7fa82c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa834ff9640 1 -- 172.21.15.84:0/2439730365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c003810 con 0x7fa838153300 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa834ff9640 1 -- 172.21.15.84:0/2439730365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c02de90 con 0x7fa838153300 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8380b0260 con 0x7fa838153300 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.240+0000 7fa834ff9640 1 -- 172.21.15.84:0/2439730365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c003b70 con 0x7fa838153300 2023-12-12T09:21:04.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.241+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8380ad930 con 0x7fa838153300 2023-12-12T09:21:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.242+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83806c300 con 0x7fa838153300 2023-12-12T09:21:04.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.242+0000 7fa834ff9640 1 -- 172.21.15.84:0/2439730365 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa82c003cd0 con 0x7fa838153300 2023-12-12T09:21:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.243+0000 7fa834ff9640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa82406ae40 0x7fa82406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.244+0000 7fa834ff9640 1 -- 172.21.15.84:0/2439730365 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa82c0ab930 con 0x7fa838153300 2023-12-12T09:21:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.244+0000 7fa837fff640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa82406ae40 0x7fa82406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.244+0000 7fa837fff640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa82406ae40 0x7fa82406d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa8280017a0 tx=0x7fa828009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:04.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.248+0000 7fa834ff9640 1 -- 172.21.15.84:0/2439730365 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa82c0764f0 con 0x7fa838153300 2023-12-12T09:21:04.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.437+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8380673c0 con 0x7fa838153300 2023-12-12T09:21:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.438+0000 7fa834ff9640 1 -- 172.21.15.84:0/2439730365 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa82c079b10 con 0x7fa838153300 2023-12-12T09:21:04.439 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:04.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.440+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa82406ae40 msgr2=0x7fa82406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.440+0000 7fa83e44f640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa82406ae40 0x7fa82406d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa8280017a0 tx=0x7fa828009040 comp rx=0 tx=0).stop 2023-12-12T09:21:04.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.440+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa838153300 msgr2=0x7fa83815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.440+0000 7fa83e44f640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa838153300 0x7fa83815d980 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa82c02c2b0 tx=0x7fa82c004730 comp rx=0 tx=0).stop 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.441+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 shutdown_connections 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.441+0000 7fa83e44f640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa83815dec0 0x7fa8380ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.441+0000 7fa83e44f640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa82406ae40 0x7fa82406d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.441+0000 7fa83e44f640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa838153300 0x7fa83815d980 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.441+0000 7fa83e44f640 1 --2- 172.21.15.84:0/2439730365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8200047c0 0x7fa838158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.441+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 >> 172.21.15.84:0/2439730365 conn(0x7fa8380b0900 msgr2=0x7fa83806cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.441+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 shutdown_connections 2023-12-12T09:21:04.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.441+0000 7fa83e44f640 1 -- 172.21.15.84:0/2439730365 wait complete. 2023-12-12T09:21:04.463 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:21:04.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.680+0000 7f323acad640 1 Processor -- start 2023-12-12T09:21:04.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.680+0000 7f323acad640 1 -- start start 2023-12-12T09:21:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.681+0000 7f323acad640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3234143860 0x7f32340b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.681+0000 7f323acad640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f323406db40 0x7f32340b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.681+0000 7f323acad640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3234071c00 con 0x7f32340b4170 2023-12-12T09:21:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.681+0000 7f323acad640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3234143c40 con 0x7f323406db40 2023-12-12T09:21:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.681+0000 7f323acad640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32340b4780 con 0x7f3234143860 2023-12-12T09:21:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.682+0000 7f3233fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f32340b4170 0x7f323406d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55090/0 (socket says 172.21.15.84:55090) 2023-12-12T09:21:04.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.682+0000 7f3233fff640 1 -- 172.21.15.84:0/2321517399 learned_addr learned my addr 172.21.15.84:0/2321517399 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.682+0000 7f323924a640 1 --2- 172.21.15.84:0/2321517399 >> v2:172.21.15.99:3300/0 conn(0x7f323406db40 0x7f32340b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.682+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281043426 0 0) 0x7f3234071c00 con 0x7f32340b4170 2023-12-12T09:21:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.682+0000 7f3238a49640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3234143860 0x7f32340b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.682+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3224005730 con 0x7f32340b4170 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2707695991 0 0) 0x7f3224005730 con 0x7f32340b4170 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3234143860 msgr2=0x7f32340b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3234143860 0x7f32340b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 >> v2:172.21.15.99:3300/0 conn(0x7f323406db40 msgr2=0x7f32340b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 --2- 172.21.15.84:0/2321517399 >> v2:172.21.15.99:3300/0 conn(0x7f323406db40 0x7f32340b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340712d0 con 0x7f32340b4170 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f3220001670 con 0x7f32340b4170 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 >> v1:172.21.15.84:6789/0 conn(0x7f32340b4170 legacy=0x7f323406d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224005b80 0x7f3224005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32240069d0 0x7f3224006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3234143860 0x7f3224007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3234143c40 con 0x7f3224005b80 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340b4780 con 0x7f32240069d0 2023-12-12T09:21:04.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322400dcc0 con 0x7f3234143860 2023-12-12T09:21:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f3238a49640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224005b80 0x7f3224005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f3233fff640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32240069d0 0x7f3224006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f323924a640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3234143860 0x7f3224007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f3238a49640 1 -- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3234143860 msgr2=0x7f3224007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f3238a49640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3234143860 0x7f3224007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f3238a49640 1 -- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32240069d0 msgr2=0x7f3224006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f3238a49640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32240069d0 0x7f3224006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.683+0000 7f3238a49640 1 -- 172.21.15.84:0/2321517399 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224005730 con 0x7f3224005b80 2023-12-12T09:21:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.685+0000 7f3238a49640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224005b80 0x7f3224005fa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f322800ba30 tx=0x7f3224007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a74cc26ca71e3d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.685+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228032640 con 0x7f3224005b80 2023-12-12T09:21:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.685+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32280327a0 con 0x7f3224005b80 2023-12-12T09:21:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.685+0000 7f32337fe640 1 -- 172.21.15.84:0/2321517399 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228032b30 con 0x7f3224005b80 2023-12-12T09:21:04.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.685+0000 7f323acad640 1 -- 172.21.15.84:0/2321517399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224005b80 msgr2=0x7f3224005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.685+0000 7f323acad640 1 --2- 172.21.15.84:0/2321517399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3224005b80 0x7f3224005fa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f322800ba30 tx=0x7f3224007a00 comp rx=0 tx=0).stop 2023-12-12T09:21:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.685+0000 7f323924a640 1 -- 172.21.15.84:0/2321517399 reap_dead start 2023-12-12T09:21:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.686+0000 7f323acad640 1 -- 172.21.15.84:0/2321517399 shutdown_connections 2023-12-12T09:21:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.686+0000 7f323acad640 1 -- 172.21.15.84:0/2321517399 >> 172.21.15.84:0/2321517399 conn(0x7f32340b0ac0 msgr2=0x7f32340b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.686+0000 7f323acad640 1 -- 172.21.15.84:0/2321517399 shutdown_connections 2023-12-12T09:21:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.686+0000 7f323acad640 1 -- 172.21.15.84:0/2321517399 wait complete. 2023-12-12T09:21:04.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.687+0000 7f323acad640 1 Processor -- start 2023-12-12T09:21:04.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.688+0000 7f323acad640 1 -- start start 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323acad640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3224005b80 0x7f32340a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323acad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f323413e3f0 0x7f323413d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323acad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f323415c650 0x7f323415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323acad640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340a9520 con 0x7f323415c650 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323acad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323415cff0 con 0x7f323413e3f0 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323acad640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323413eba0 con 0x7f3224005b80 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323924a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f323415c650 0x7f323415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323924a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f323415c650 0x7f323415cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34800/0 (socket says 172.21.15.84:34800) 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323924a640 1 -- 172.21.15.84:0/2594005481 learned_addr learned my addr 172.21.15.84:0/2594005481 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f3233fff640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f323413e3f0 0x7f323413d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f3238a49640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3224005b80 0x7f32340a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323924a640 1 -- 172.21.15.84:0/2594005481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3224005b80 msgr2=0x7f32340a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323924a640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3224005b80 0x7f32340a8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323924a640 1 -- 172.21.15.84:0/2594005481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f323413e3f0 msgr2=0x7f323413d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323924a640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f323413e3f0 0x7f323413d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.689+0000 7f323924a640 1 -- 172.21.15.84:0/2594005481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340cc890 con 0x7f323415c650 2023-12-12T09:21:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.690+0000 7f323924a640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f323415c650 0x7f323415cab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3234074340 tx=0x7f322c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:04.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.690+0000 7f32317fa640 1 -- 172.21.15.84:0/2594005481 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c017400 con 0x7f323415c650 2023-12-12T09:21:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.690+0000 7f32317fa640 1 -- 172.21.15.84:0/2594005481 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c011040 con 0x7f323415c650 2023-12-12T09:21:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.690+0000 7f32317fa640 1 -- 172.21.15.84:0/2594005481 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0177c0 con 0x7f323415c650 2023-12-12T09:21:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.690+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32340ccb70 con 0x7f323415c650 2023-12-12T09:21:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.690+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323413e870 con 0x7f323415c650 2023-12-12T09:21:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.691+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32340cd090 con 0x7f323415c650 2023-12-12T09:21:04.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.692+0000 7f32317fa640 1 -- 172.21.15.84:0/2594005481 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f322c021440 con 0x7f323415c650 2023-12-12T09:21:04.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.693+0000 7f32317fa640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f321806ae90 0x7f321806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:04.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.693+0000 7f32317fa640 1 -- 172.21.15.84:0/2594005481 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f322c089a80 con 0x7f323415c650 2023-12-12T09:21:04.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.693+0000 7f3238a49640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f321806ae90 0x7f321806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:04.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.694+0000 7f3238a49640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f321806ae90 0x7f321806d350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f322800ba00 tx=0x7f3228030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:04.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.698+0000 7f32317fa640 1 -- 172.21.15.84:0/2594005481 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32340cd090 con 0x7f323415c650 2023-12-12T09:21:04.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.887+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32340cd090 con 0x7f323415c650 2023-12-12T09:21:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.888+0000 7f32317fa640 1 -- 172.21.15.84:0/2594005481 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f322c054850 con 0x7f323415c650 2023-12-12T09:21:04.889 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.890+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f321806ae90 msgr2=0x7f321806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.890+0000 7f323acad640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f321806ae90 0x7f321806d350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f322800ba00 tx=0x7f3228030000 comp rx=0 tx=0).stop 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f323415c650 msgr2=0x7f323415cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f323415c650 0x7f323415cab0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3234074340 tx=0x7f322c00f4a0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 shutdown_connections 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f321806ae90 0x7f321806d350 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f323415c650 0x7f323415cab0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f323413e3f0 0x7f323413d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 --2- 172.21.15.84:0/2594005481 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3224005b80 0x7f32340a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 >> 172.21.15.84:0/2594005481 conn(0x7f32340b0ac0 msgr2=0x7f323413f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 shutdown_connections 2023-12-12T09:21:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:04.891+0000 7f323acad640 1 -- 172.21.15.84:0/2594005481 wait complete. 2023-12-12T09:21:04.911 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:21:05.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.114+0000 7f6cb9b48640 1 Processor -- start 2023-12-12T09:21:05.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.114+0000 7f6cb9b48640 1 -- start start 2023-12-12T09:21:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb9b48640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6cb40b1c00 0x7f6cb40b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb9b48640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6cb406beb0 0x7f6cb406c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb9b48640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb40b21e0 con 0x7f6cb4146ac0 2023-12-12T09:21:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb9b48640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb406c880 con 0x7f6cb40b1c00 2023-12-12T09:21:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb9b48640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40b24c0 con 0x7f6cb406beb0 2023-12-12T09:21:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb37fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6cb4146ac0 0x7f6cb415e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55096/0 (socket says 172.21.15.84:55096) 2023-12-12T09:21:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb37fe640 1 -- 172.21.15.84:0/2853080421 learned_addr learned my addr 172.21.15.84:0/2853080421 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb3fff640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6cb406beb0 0x7f6cb406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.116+0000 7f6cb2ffd640 1 --2- 172.21.15.84:0/2853080421 >> v2:172.21.15.99:3300/0 conn(0x7f6cb40b1c00 0x7f6cb40b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563770585 0 0) 0x7f6cb40b21e0 con 0x7f6cb4146ac0 2023-12-12T09:21:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c9c003520 con 0x7f6cb4146ac0 2023-12-12T09:21:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 854760306 0 0) 0x7f6c9c003520 con 0x7f6cb4146ac0 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6cb406beb0 msgr2=0x7f6cb406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6cb406beb0 0x7f6cb406c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 >> v2:172.21.15.99:3300/0 conn(0x7f6cb40b1c00 msgr2=0x7f6cb40b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 --2- 172.21.15.84:0/2853080421 >> v2:172.21.15.99:3300/0 conn(0x7f6cb40b1c00 0x7f6cb40b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40b27a0 con 0x7f6cb4146ac0 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f6ca4001670 con 0x7f6cb4146ac0 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 >> v1:172.21.15.84:6789/0 conn(0x7f6cb4146ac0 legacy=0x7f6cb415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c9c003970 0x7f6c9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c9c0047c0 0x7f6c9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6cb406beb0 0x7f6c9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb406c880 con 0x7f6c9c003970 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb40b24c0 con 0x7f6c9c0047c0 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.117+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c00b9d0 con 0x7f6cb406beb0 2023-12-12T09:21:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.118+0000 7f6cb37fe640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c9c003970 0x7f6c9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.118+0000 7f6cb37fe640 1 -- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6cb406beb0 msgr2=0x7f6c9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.118+0000 7f6cb37fe640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6cb406beb0 0x7f6c9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.118+0000 7f6cb37fe640 1 -- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c9c0047c0 msgr2=0x7f6c9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.118+0000 7f6cb37fe640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c9c0047c0 0x7f6c9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.118+0000 7f6cb37fe640 1 -- 172.21.15.84:0/2853080421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c003520 con 0x7f6c9c003970 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.119+0000 7f6cb37fe640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c9c003970 0x7f6c9c003d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c190 tx=0x7f6c9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32917c1d9091b032 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.119+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4005ad0 con 0x7f6c9c003970 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.120+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca4005c30 con 0x7f6c9c003970 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.120+0000 7f6cb27fc640 1 -- 172.21.15.84:0/2853080421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca402c810 con 0x7f6c9c003970 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.120+0000 7f6cb9b48640 1 -- 172.21.15.84:0/2853080421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c9c003970 msgr2=0x7f6c9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.120+0000 7f6cb9b48640 1 --2- 172.21.15.84:0/2853080421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c9c003970 0x7f6c9c003d90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c190 tx=0x7f6c9c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.120+0000 7f6cb3fff640 1 -- 172.21.15.84:0/2853080421 reap_dead start 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.120+0000 7f6cb9b48640 1 -- 172.21.15.84:0/2853080421 shutdown_connections 2023-12-12T09:21:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.120+0000 7f6cb9b48640 1 -- 172.21.15.84:0/2853080421 >> 172.21.15.84:0/2853080421 conn(0x7f6cb40b0900 msgr2=0x7f6cb40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.120+0000 7f6cb9b48640 1 -- 172.21.15.84:0/2853080421 shutdown_connections 2023-12-12T09:21:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.121+0000 7f6cb9b48640 1 -- 172.21.15.84:0/2853080421 wait complete. 2023-12-12T09:21:05.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.123+0000 7f6cb9b48640 1 Processor -- start 2023-12-12T09:21:05.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.123+0000 7f6cb9b48640 1 -- start start 2023-12-12T09:21:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.124+0000 7f6cb9b48640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c9c003970 0x7f6cb415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.124+0000 7f6cb9b48640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cb41410c0 0x7f6cb4141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.124+0000 7f6cb9b48640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb4142b30 0x7f6cb4142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.124+0000 7f6cb9b48640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4141a80 con 0x7f6cb41410c0 2023-12-12T09:21:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.124+0000 7f6cb9b48640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4143820 con 0x7f6cb4142b30 2023-12-12T09:21:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.124+0000 7f6cb9b48640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb4143b00 con 0x7f6c9c003970 2023-12-12T09:21:05.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cb41410c0 0x7f6cb4141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cb41410c0 0x7f6cb4141540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34816/0 (socket says 172.21.15.84:34816) 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb2ffd640 1 -- 172.21.15.84:0/3582777736 learned_addr learned my addr 172.21.15.84:0/3582777736 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb37fe640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c9c003970 0x7f6cb415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb3fff640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb4142b30 0x7f6cb4142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb2ffd640 1 -- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c9c003970 msgr2=0x7f6cb415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb2ffd640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c9c003970 0x7f6cb415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb2ffd640 1 -- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb4142b30 msgr2=0x7f6cb4142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb2ffd640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb4142b30 0x7f6cb4142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb2ffd640 1 -- 172.21.15.84:0/3582777736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4143de0 con 0x7f6cb41410c0 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.125+0000 7f6cb37fe640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c9c003970 0x7f6cb415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.126+0000 7f6cb2ffd640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cb41410c0 0x7f6cb4141540 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800e7a0 tx=0x7f6ca800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:05.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.126+0000 7f6c9bfff640 1 -- 172.21.15.84:0/3582777736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800eeb0 con 0x7f6cb41410c0 2023-12-12T09:21:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.126+0000 7f6c9bfff640 1 -- 172.21.15.84:0/3582777736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800c940 con 0x7f6cb41410c0 2023-12-12T09:21:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.126+0000 7f6c9bfff640 1 -- 172.21.15.84:0/3582777736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800cd10 con 0x7f6cb41410c0 2023-12-12T09:21:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.126+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb409af30 con 0x7f6cb41410c0 2023-12-12T09:21:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.126+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb41440c0 con 0x7f6cb41410c0 2023-12-12T09:21:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.127+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb40673c0 con 0x7f6cb41410c0 2023-12-12T09:21:05.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.128+0000 7f6c9bfff640 1 -- 172.21.15.84:0/3582777736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ca8013470 con 0x7f6cb41410c0 2023-12-12T09:21:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.129+0000 7f6c9bfff640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6ca006ae70 0x7f6ca006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.129+0000 7f6c9bfff640 1 -- 172.21.15.84:0/3582777736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6ca80899d0 con 0x7f6cb41410c0 2023-12-12T09:21:05.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.129+0000 7f6cb37fe640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6ca006ae70 0x7f6ca006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.130+0000 7f6cb37fe640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6ca006ae70 0x7f6ca006d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c160 tx=0x7f6ca4007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:05.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.133+0000 7f6c9bfff640 1 -- 172.21.15.84:0/3582777736 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ca80546b0 con 0x7f6cb41410c0 2023-12-12T09:21:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.325+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6cb40b3d70 con 0x7f6cb41410c0 2023-12-12T09:21:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.326+0000 7f6c9bfff640 1 -- 172.21.15.84:0/3582777736 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6ca8057cd0 con 0x7f6cb41410c0 2023-12-12T09:21:05.327 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:05.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6ca006ae70 msgr2=0x7f6ca006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6ca006ae70 0x7f6ca006d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c160 tx=0x7f6ca4007000 comp rx=0 tx=0).stop 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cb41410c0 msgr2=0x7f6cb4141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cb41410c0 0x7f6cb4141540 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800e7a0 tx=0x7f6ca800ec60 comp rx=0 tx=0).stop 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 shutdown_connections 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb4142b30 0x7f6cb4142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6ca006ae70 0x7f6ca006d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cb41410c0 0x7f6cb4141540 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 --2- 172.21.15.84:0/3582777736 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c9c003970 0x7f6cb415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 >> 172.21.15.84:0/3582777736 conn(0x7f6cb40b0900 msgr2=0x7f6cb415eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 shutdown_connections 2023-12-12T09:21:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.328+0000 7f6cb9b48640 1 -- 172.21.15.84:0/3582777736 wait complete. 2023-12-12T09:21:05.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:21:05.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.552+0000 7fe99110f640 1 Processor -- start 2023-12-12T09:21:05.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.553+0000 7fe99110f640 1 -- start start 2023-12-12T09:21:05.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.554+0000 7fe99110f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe98c0ce330 0x7fe98c13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.554+0000 7fe99110f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 0x7fe98c13d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.554+0000 7fe99110f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98c140270 con 0x7fe98c071bb0 2023-12-12T09:21:05.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.554+0000 7fe99110f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98c0cd850 con 0x7fe98c0ce330 2023-12-12T09:21:05.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.554+0000 7fe99110f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c0cdb30 con 0x7fe98c0ce7c0 2023-12-12T09:21:05.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.554+0000 7fe98ad9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe98c071bb0 0x7fe98c071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55110/0 (socket says 172.21.15.84:55110) 2023-12-12T09:21:05.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.554+0000 7fe98a59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe98c0ce330 0x7fe98c13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.554+0000 7fe98ad9d640 1 -- 172.21.15.84:0/307900215 learned_addr learned my addr 172.21.15.84:0/307900215 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:05.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.555+0000 7fe98b59e640 1 --2- 172.21.15.84:0/307900215 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 0x7fe98c13d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.555+0000 7fe989d9b640 1 -- 172.21.15.84:0/307900215 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575202083 0 0) 0x7fe98c140270 con 0x7fe98c071bb0 2023-12-12T09:21:05.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.555+0000 7fe98a59c640 1 -- 172.21.15.84:0/307900215 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 msgr2=0x7fe98c13d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:05.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.555+0000 7fe98a59c640 1 --2- 172.21.15.84:0/307900215 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 0x7fe98c13d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.555+0000 7fe98a59c640 1 -- 172.21.15.84:0/307900215 >> v1:172.21.15.84:6789/0 conn(0x7fe98c071bb0 legacy=0x7fe98c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.555+0000 7fe98a59c640 1 -- 172.21.15.84:0/307900215 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c0cde10 con 0x7fe98c0ce330 2023-12-12T09:21:05.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.556+0000 7fe98a59c640 1 --2- 172.21.15.84:0/307900215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c13d3d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe9800097d0 tx=0x7fe98002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b925a84d4a051a02 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:05.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.556+0000 7fe989d9b640 1 -- 172.21.15.84:0/307900215 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98002d040 con 0x7fe98c0ce330 2023-12-12T09:21:05.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.556+0000 7fe989d9b640 1 -- 172.21.15.84:0/307900215 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe980031810 con 0x7fe98c0ce330 2023-12-12T09:21:05.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.556+0000 7fe989d9b640 1 -- 172.21.15.84:0/307900215 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980031ba0 con 0x7fe98c0ce330 2023-12-12T09:21:05.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.557+0000 7fe99110f640 1 -- 172.21.15.84:0/307900215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 msgr2=0x7fe98c13d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.557+0000 7fe99110f640 1 --2- 172.21.15.84:0/307900215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c13d3d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe9800097d0 tx=0x7fe98002b8b0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.557+0000 7fe99110f640 1 -- 172.21.15.84:0/307900215 shutdown_connections 2023-12-12T09:21:05.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.557+0000 7fe99110f640 1 --2- 172.21.15.84:0/307900215 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 0x7fe98c13d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.557+0000 7fe99110f640 1 --2- 172.21.15.84:0/307900215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c13d3d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.557+0000 7fe99110f640 1 -- 172.21.15.84:0/307900215 >> 172.21.15.84:0/307900215 conn(0x7fe98c06c3d0 msgr2=0x7fe98c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:05.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.557+0000 7fe99110f640 1 -- 172.21.15.84:0/307900215 shutdown_connections 2023-12-12T09:21:05.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.557+0000 7fe99110f640 1 -- 172.21.15.84:0/307900215 wait complete. 2023-12-12T09:21:05.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.559+0000 7fe99110f640 1 Processor -- start 2023-12-12T09:21:05.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.559+0000 7fe99110f640 1 -- start start 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe99110f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe98c071bb0 0x7fe98c13b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe99110f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe99110f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 0x7fe98c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe99110f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c13bd00 con 0x7fe98c0ce330 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe99110f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c157a50 con 0x7fe98c071bb0 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe99110f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98c1569b0 con 0x7fe98c0ce7c0 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe98a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe98a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34844/0 (socket says 172.21.15.84:34844) 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe98a59c640 1 -- 172.21.15.84:0/2965607042 learned_addr learned my addr 172.21.15.84:0/2965607042 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe98a59c640 1 -- 172.21.15.84:0/2965607042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 msgr2=0x7fe98c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe98a59c640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 0x7fe98c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe98a59c640 1 -- 172.21.15.84:0/2965607042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe98c071bb0 msgr2=0x7fe98c13b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe98a59c640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe98c071bb0 0x7fe98c13b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.560+0000 7fe98a59c640 1 -- 172.21.15.84:0/2965607042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980009400 con 0x7fe98c0ce330 2023-12-12T09:21:05.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.561+0000 7fe98a59c640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c155ff0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe98002bec0 tx=0x7fe9800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:05.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.561+0000 7fe9737fe640 1 -- 172.21.15.84:0/2965607042 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800443f0 con 0x7fe98c0ce330 2023-12-12T09:21:05.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.561+0000 7fe9737fe640 1 -- 172.21.15.84:0/2965607042 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe980044550 con 0x7fe98c0ce330 2023-12-12T09:21:05.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.561+0000 7fe9737fe640 1 -- 172.21.15.84:0/2965607042 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980044900 con 0x7fe98c0ce330 2023-12-12T09:21:05.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.561+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c156c90 con 0x7fe98c0ce330 2023-12-12T09:21:05.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.561+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98c157250 con 0x7fe98c0ce330 2023-12-12T09:21:05.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.562+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98c0673c0 con 0x7fe98c0ce330 2023-12-12T09:21:05.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.563+0000 7fe9737fe640 1 -- 172.21.15.84:0/2965607042 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe980044a60 con 0x7fe98c0ce330 2023-12-12T09:21:05.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.564+0000 7fe9737fe640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe97806ae40 0x7fe97806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:05.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.564+0000 7fe9737fe640 1 -- 172.21.15.84:0/2965607042 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe9800abdd0 con 0x7fe98c0ce330 2023-12-12T09:21:05.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.564+0000 7fe98ad9d640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe97806ae40 0x7fe97806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:05.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.565+0000 7fe98ad9d640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe97806ae40 0x7fe97806d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe97c007fd0 tx=0x7fe97c007920 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:05.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.568+0000 7fe9737fe640 1 -- 172.21.15.84:0/2965607042 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe980076b50 con 0x7fe98c0ce330 2023-12-12T09:21:05.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.756+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe98c0ae710 con 0x7fe98c0ce330 2023-12-12T09:21:05.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.756+0000 7fe9737fe640 1 -- 172.21.15.84:0/2965607042 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe98007a170 con 0x7fe98c0ce330 2023-12-12T09:21:05.758 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:21:05.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe97806ae40 msgr2=0x7fe97806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe97806ae40 0x7fe97806d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe97c007fd0 tx=0x7fe97c007920 comp rx=0 tx=0).stop 2023-12-12T09:21:05.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 msgr2=0x7fe98c155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:05.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c155ff0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe98002bec0 tx=0x7fe9800046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 shutdown_connections 2023-12-12T09:21:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe98c0ce7c0 0x7fe98c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe97806ae40 0x7fe97806d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe98c0ce330 0x7fe98c155ff0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 --2- 172.21.15.84:0/2965607042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe98c071bb0 0x7fe98c13b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 >> 172.21.15.84:0/2965607042 conn(0x7fe98c06c3d0 msgr2=0x7fe98c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 shutdown_connections 2023-12-12T09:21:05.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:05.759+0000 7fe99110f640 1 -- 172.21.15.84:0/2965607042 wait complete. 2023-12-12T09:21:05.777 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:21:05.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:05.777 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-12T09:21:05.868 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:21:05.868 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:21:05.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:05.869 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-12T09:21:05.914 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:21:05.914 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:21:05.975 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:21:05.975 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:21:06.028 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:06.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.250+0000 7fd65a600640 1 Processor -- start 2023-12-12T09:21:06.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.250+0000 7fd65a600640 1 -- start start 2023-12-12T09:21:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.251+0000 7fd65a600640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd654143d20 0x7fd6540b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.252+0000 7fd65a600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd6541447f0 0x7fd6540b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.252+0000 7fd65a600640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540cea30 con 0x7fd6540ce550 2023-12-12T09:21:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.252+0000 7fd65a600640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6540702b0 con 0x7fd654143d20 2023-12-12T09:21:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.252+0000 7fd65a600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd654070590 con 0x7fd6541447f0 2023-12-12T09:21:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.252+0000 7fd653fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd654143d20 0x7fd6540b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.252+0000 7fd653fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd654143d20 0x7fd6540b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57314/0 (socket says 172.21.15.84:57314) 2023-12-12T09:21:06.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.252+0000 7fd653fff640 1 -- 172.21.15.84:0/419290245 learned_addr learned my addr 172.21.15.84:0/419290245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.252+0000 7fd658b9d640 1 --2- 172.21.15.84:0/419290245 >> v2:172.21.15.99:3300/0 conn(0x7fd6541447f0 0x7fd6540b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.253+0000 7fd653fff640 1 -- 172.21.15.84:0/419290245 >> v2:172.21.15.99:3300/0 conn(0x7fd6541447f0 msgr2=0x7fd6540b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.253+0000 7fd653fff640 1 --2- 172.21.15.84:0/419290245 >> v2:172.21.15.99:3300/0 conn(0x7fd6541447f0 0x7fd6540b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.253+0000 7fd653fff640 1 -- 172.21.15.84:0/419290245 >> v1:172.21.15.84:6789/0 conn(0x7fd6540ce550 legacy=0x7fd65415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.253+0000 7fd653fff640 1 -- 172.21.15.84:0/419290245 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654070870 con 0x7fd654143d20 2023-12-12T09:21:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.253+0000 7fd652ffd640 1 -- 172.21.15.84:0/419290245 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312436955 0 0) 0x7fd6540cea30 con 0x7fd6540ce550 2023-12-12T09:21:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.254+0000 7fd653fff640 1 --2- 172.21.15.84:0/419290245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd654143d20 0x7fd6540b40d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd6540ae330 tx=0x7fd64402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fee43e187a697a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.254+0000 7fd652ffd640 1 -- 172.21.15.84:0/419290245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644030860 con 0x7fd654143d20 2023-12-12T09:21:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.254+0000 7fd652ffd640 1 -- 172.21.15.84:0/419290245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440309c0 con 0x7fd654143d20 2023-12-12T09:21:06.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.254+0000 7fd652ffd640 1 -- 172.21.15.84:0/419290245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644030d50 con 0x7fd654143d20 2023-12-12T09:21:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.255+0000 7fd65a600640 1 -- 172.21.15.84:0/419290245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd654143d20 msgr2=0x7fd6540b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.255+0000 7fd65a600640 1 --2- 172.21.15.84:0/419290245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd654143d20 0x7fd6540b40d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd6540ae330 tx=0x7fd64402b9a0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.255+0000 7fd65a600640 1 -- 172.21.15.84:0/419290245 shutdown_connections 2023-12-12T09:21:06.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.255+0000 7fd65a600640 1 --2- 172.21.15.84:0/419290245 >> v2:172.21.15.99:3300/0 conn(0x7fd6541447f0 0x7fd6540b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.255+0000 7fd65a600640 1 --2- 172.21.15.84:0/419290245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd654143d20 0x7fd6540b40d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.255+0000 7fd65a600640 1 -- 172.21.15.84:0/419290245 >> 172.21.15.84:0/419290245 conn(0x7fd65406c3d0 msgr2=0x7fd65406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.255+0000 7fd65a600640 1 -- 172.21.15.84:0/419290245 shutdown_connections 2023-12-12T09:21:06.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.255+0000 7fd65a600640 1 -- 172.21.15.84:0/419290245 wait complete. 2023-12-12T09:21:06.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.257+0000 7fd65a600640 1 Processor -- start 2023-12-12T09:21:06.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.257+0000 7fd65a600640 1 -- start start 2023-12-12T09:21:06.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd65a600640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6540ce550 0x7fd65412bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd65a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd654143d20 0x7fd654140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd65a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6541447f0 0x7fd654140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd65a600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654142210 con 0x7fd6541447f0 2023-12-12T09:21:06.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd65a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6541f2eb0 con 0x7fd654143d20 2023-12-12T09:21:06.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd65a600640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd654141600 con 0x7fd6540ce550 2023-12-12T09:21:06.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd658b9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6541447f0 0x7fd654140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd658b9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6541447f0 0x7fd654140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57322/0 (socket says 172.21.15.84:57322) 2023-12-12T09:21:06.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.258+0000 7fd658b9d640 1 -- 172.21.15.84:0/2336429811 learned_addr learned my addr 172.21.15.84:0/2336429811 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:06.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd653fff640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6540ce550 0x7fd65412bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd658b9d640 1 -- 172.21.15.84:0/2336429811 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6540ce550 msgr2=0x7fd65412bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd6537fe640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd654143d20 0x7fd654140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd658b9d640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6540ce550 0x7fd65412bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd658b9d640 1 -- 172.21.15.84:0/2336429811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd654143d20 msgr2=0x7fd654140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd658b9d640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd654143d20 0x7fd654140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd658b9d640 1 -- 172.21.15.84:0/2336429811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440094d0 con 0x7fd6541447f0 2023-12-12T09:21:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd658b9d640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6541447f0 0x7fd654140dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009fd0 tx=0x7fd64c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd650ff9640 1 -- 172.21.15.84:0/2336429811 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c014420 con 0x7fd6541447f0 2023-12-12T09:21:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd650ff9640 1 -- 172.21.15.84:0/2336429811 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c014580 con 0x7fd6541447f0 2023-12-12T09:21:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd650ff9640 1 -- 172.21.15.84:0/2336429811 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c014930 con 0x7fd6541447f0 2023-12-12T09:21:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.259+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6541418e0 con 0x7fd6541447f0 2023-12-12T09:21:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.260+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654141ea0 con 0x7fd6541447f0 2023-12-12T09:21:06.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.261+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6541423c0 con 0x7fd6541447f0 2023-12-12T09:21:06.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.262+0000 7fd650ff9640 1 -- 172.21.15.84:0/2336429811 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd64c014a90 con 0x7fd6541447f0 2023-12-12T09:21:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.263+0000 7fd650ff9640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd64006ae40 0x7fd64006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.263+0000 7fd650ff9640 1 -- 172.21.15.84:0/2336429811 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd64c08a370 con 0x7fd6541447f0 2023-12-12T09:21:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.263+0000 7fd653fff640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd64006ae40 0x7fd64006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.263+0000 7fd653fff640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd64006ae40 0x7fd64006d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd644036000 tx=0x7fd64403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:06.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.267+0000 7fd650ff9640 1 -- 172.21.15.84:0/2336429811 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd64c054fc0 con 0x7fd6541447f0 2023-12-12T09:21:06.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.461+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6540673c0 con 0x7fd6541447f0 2023-12-12T09:21:06.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.463+0000 7fd650ff9640 1 -- 172.21.15.84:0/2336429811 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7fd64c0585e0 con 0x7fd6541447f0 2023-12-12T09:21:06.465 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:06.465 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd64006ae40 msgr2=0x7fd64006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd64006ae40 0x7fd64006d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd644036000 tx=0x7fd64403b040 comp rx=0 tx=0).stop 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6541447f0 msgr2=0x7fd654140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6541447f0 0x7fd654140dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009fd0 tx=0x7fd64c00e4b0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 shutdown_connections 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd64006ae40 0x7fd64006d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6541447f0 0x7fd654140dd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd654143d20 0x7fd654140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.466+0000 7fd65a600640 1 --2- 172.21.15.84:0/2336429811 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6540ce550 0x7fd65412bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.467+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 >> 172.21.15.84:0/2336429811 conn(0x7fd65406c3d0 msgr2=0x7fd65415aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.467+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 shutdown_connections 2023-12-12T09:21:06.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.467+0000 7fd65a600640 1 -- 172.21.15.84:0/2336429811 wait complete. 2023-12-12T09:21:06.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:21:06.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:21:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.698+0000 7fb892c9b640 1 Processor -- start 2023-12-12T09:21:06.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.698+0000 7fb892c9b640 1 -- start start 2023-12-12T09:21:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.699+0000 7fb892c9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb88c0b40d0 0x7fb88c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.699+0000 7fb892c9b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c0ceb80 con 0x7fb88c15be60 2023-12-12T09:21:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.699+0000 7fb892c9b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c0ce260 con 0x7fb88c0ce6f0 2023-12-12T09:21:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.700+0000 7fb892c9b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88c0cd930 con 0x7fb88c0b40d0 2023-12-12T09:21:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.700+0000 7fb891238640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb88c15be60 0x7fb88c13e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53642/0 (socket says 172.21.15.84:53642) 2023-12-12T09:21:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.700+0000 7fb891238640 1 -- 172.21.15.84:0/2784078613 learned_addr learned my addr 172.21.15.84:0/2784078613 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:06.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.700+0000 7fb890a37640 1 --2- 172.21.15.84:0/2784078613 >> v2:172.21.15.99:3300/0 conn(0x7fb88c0b40d0 0x7fb88c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.700+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716910675 0 0) 0x7fb88c0ceb80 con 0x7fb88c15be60 2023-12-12T09:21:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.700+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb87c003520 con 0x7fb88c15be60 2023-12-12T09:21:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3005718535 0 0) 0x7fb87c003520 con 0x7fb88c15be60 2023-12-12T09:21:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 >> v2:172.21.15.99:3300/0 conn(0x7fb88c0b40d0 msgr2=0x7fb88c06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 --2- 172.21.15.84:0/2784078613 >> v2:172.21.15.99:3300/0 conn(0x7fb88c0b40d0 0x7fb88c06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 >> v1:172.21.15.99:6789/0 conn(0x7fb88c0ce6f0 legacy=0x7fb88c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c0cdc10 con 0x7fb88c15be60 2023-12-12T09:21:06.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fb8840019f0 con 0x7fb88c15be60 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 >> v1:172.21.15.84:6789/0 conn(0x7fb88c15be60 legacy=0x7fb88c13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb87c0039c0 0x7fb87c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb87c0047c0 0x7fb87c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb87c005180 0x7fb87c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0cd930 con 0x7fb87c0047c0 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c00c080 con 0x7fb87c0039c0 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c00c240 con 0x7fb87c005180 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88bfff640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb87c0047c0 0x7fb87c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb890a37640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb87c0039c0 0x7fb87c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88bfff640 1 -- 172.21.15.84:0/2784078613 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb87c005180 msgr2=0x7fb87c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88bfff640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb87c005180 0x7fb87c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88bfff640 1 -- 172.21.15.84:0/2784078613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb87c0039c0 msgr2=0x7fb87c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88bfff640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb87c0039c0 0x7fb87c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.701+0000 7fb88bfff640 1 -- 172.21.15.84:0/2784078613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c003520 con 0x7fb87c0047c0 2023-12-12T09:21:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.702+0000 7fb891238640 1 -- 172.21.15.84:0/2784078613 reap_dead start 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.703+0000 7fb88bfff640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb87c0047c0 0x7fb87c004c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb878001750 tx=0x7fb87c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fd72dd210cf3fa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.703+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8780052d0 con 0x7fb87c0047c0 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.703+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87802e050 con 0x7fb87c0047c0 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.703+0000 7fb88b7fe640 1 -- 172.21.15.84:0/2784078613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb878003830 con 0x7fb87c0047c0 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.703+0000 7fb892c9b640 1 -- 172.21.15.84:0/2784078613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb87c0047c0 msgr2=0x7fb87c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.703+0000 7fb892c9b640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb87c0047c0 0x7fb87c004c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb878001750 tx=0x7fb87c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.704+0000 7fb892c9b640 1 -- 172.21.15.84:0/2784078613 shutdown_connections 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.704+0000 7fb892c9b640 1 --2- 172.21.15.84:0/2784078613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb87c0047c0 0x7fb87c004c40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.704+0000 7fb892c9b640 1 -- 172.21.15.84:0/2784078613 >> 172.21.15.84:0/2784078613 conn(0x7fb88c0b0ac0 msgr2=0x7fb88c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.704+0000 7fb892c9b640 1 -- 172.21.15.84:0/2784078613 shutdown_connections 2023-12-12T09:21:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.704+0000 7fb892c9b640 1 -- 172.21.15.84:0/2784078613 wait complete. 2023-12-12T09:21:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.705+0000 7fb892c9b640 1 Processor -- start 2023-12-12T09:21:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.706+0000 7fb892c9b640 1 -- start start 2023-12-12T09:21:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.706+0000 7fb892c9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb87c0047c0 0x7fb88c152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.706+0000 7fb892c9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c13cc30 0x7fb88c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.706+0000 7fb892c9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb88c13d0b0 0x7fb88c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.706+0000 7fb892c9b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c13ca60 con 0x7fb88c13d0b0 2023-12-12T09:21:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.706+0000 7fb892c9b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c13be50 con 0x7fb88c13cc30 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.706+0000 7fb892c9b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c13c130 con 0x7fb87c0047c0 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb891238640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb88c13d0b0 0x7fb88c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb891238640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb88c13d0b0 0x7fb88c0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57336/0 (socket says 172.21.15.84:57336) 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb891238640 1 -- 172.21.15.84:0/3943022650 learned_addr learned my addr 172.21.15.84:0/3943022650 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb890a37640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb87c0047c0 0x7fb88c152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb88bfff640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c13cc30 0x7fb88c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb891238640 1 -- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb87c0047c0 msgr2=0x7fb88c152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb891238640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb87c0047c0 0x7fb88c152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb891238640 1 -- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c13cc30 msgr2=0x7fb88c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb891238640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c13cc30 0x7fb88c0aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb891238640 1 -- 172.21.15.84:0/3943022650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c13c410 con 0x7fb88c13d0b0 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.707+0000 7fb88bfff640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c13cc30 0x7fb88c0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.708+0000 7fb891238640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb88c13d0b0 0x7fb88c0af030 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb88c15c240 tx=0x7fb88400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.708+0000 7fb8897fa640 1 -- 172.21.15.84:0/3943022650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884007c20 con 0x7fb88c13d0b0 2023-12-12T09:21:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.708+0000 7fb8897fa640 1 -- 172.21.15.84:0/3943022650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88400cea0 con 0x7fb88c13d0b0 2023-12-12T09:21:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.708+0000 7fb8897fa640 1 -- 172.21.15.84:0/3943022650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88400a850 con 0x7fb88c13d0b0 2023-12-12T09:21:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.708+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88c13c6f0 con 0x7fb88c13d0b0 2023-12-12T09:21:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.708+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88c0b2f10 con 0x7fb88c13d0b0 2023-12-12T09:21:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.709+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c0673c0 con 0x7fb88c13d0b0 2023-12-12T09:21:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.710+0000 7fb8897fa640 1 -- 172.21.15.84:0/3943022650 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb88400a9b0 con 0x7fb88c13d0b0 2023-12-12T09:21:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.711+0000 7fb8897fa640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb87006ae40 0x7fb87006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.711+0000 7fb8897fa640 1 -- 172.21.15.84:0/3943022650 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb884089270 con 0x7fb88c13d0b0 2023-12-12T09:21:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.711+0000 7fb890a37640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb87006ae40 0x7fb87006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.712+0000 7fb890a37640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb87006ae40 0x7fb87006d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb880009a90 tx=0x7fb880008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:06.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.715+0000 7fb8897fa640 1 -- 172.21.15.84:0/3943022650 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb884053ec0 con 0x7fb88c13d0b0 2023-12-12T09:21:06.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.903+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb88c1f2b40 con 0x7fb88c13d0b0 2023-12-12T09:21:06.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.904+0000 7fb8897fa640 1 -- 172.21.15.84:0/3943022650 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb88401a0a0 con 0x7fb88c13d0b0 2023-12-12T09:21:06.905 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb87006ae40 msgr2=0x7fb87006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb87006ae40 0x7fb87006d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb880009a90 tx=0x7fb880008040 comp rx=0 tx=0).stop 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb88c13d0b0 msgr2=0x7fb88c0af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb88c13d0b0 0x7fb88c0af030 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb88c15c240 tx=0x7fb88400cc50 comp rx=0 tx=0).stop 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 shutdown_connections 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb87006ae40 0x7fb87006d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb88c13d0b0 0x7fb88c0af030 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb88c13cc30 0x7fb88c0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 --2- 172.21.15.84:0/3943022650 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb87c0047c0 0x7fb88c152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 >> 172.21.15.84:0/3943022650 conn(0x7fb88c0b0ac0 msgr2=0x7fb88c0b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 shutdown_connections 2023-12-12T09:21:06.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:06.906+0000 7fb892c9b640 1 -- 172.21.15.84:0/3943022650 wait complete. 2023-12-12T09:21:06.927 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:21:07.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.142+0000 7f3f0ba02640 1 Processor -- start 2023-12-12T09:21:07.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.143+0000 7f3f0ba02640 1 -- start start 2023-12-12T09:21:07.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.144+0000 7f3f0ba02640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 0x7f3f040b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.144+0000 7f3f0ba02640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3f0406beb0 0x7f3f0406c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.144+0000 7f3f0ba02640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f040b21e0 con 0x7f3f04146ac0 2023-12-12T09:21:07.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.144+0000 7f3f0ba02640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0406c880 con 0x7f3f0406beb0 2023-12-12T09:21:07.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.144+0000 7f3f0ba02640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040b24c0 con 0x7f3f040b1c00 2023-12-12T09:21:07.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.145+0000 7f3f0979e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3f04146ac0 0x7f3f0415e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53646/0 (socket says 172.21.15.84:53646) 2023-12-12T09:21:07.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.145+0000 7f3f0979e640 1 -- 172.21.15.84:0/2260942732 learned_addr learned my addr 172.21.15.84:0/2260942732 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:07.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.145+0000 7f3f08f9d640 1 --2- 172.21.15.84:0/2260942732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 0x7f3f040b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.145+0000 7f3f09f9f640 1 --2- 172.21.15.84:0/2260942732 >> v2:172.21.15.99:3300/0 conn(0x7f3f0406beb0 0x7f3f0406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.146+0000 7f3f08f9d640 1 -- 172.21.15.84:0/2260942732 >> v2:172.21.15.99:3300/0 conn(0x7f3f0406beb0 msgr2=0x7f3f0406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:07.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.146+0000 7f3f08f9d640 1 --2- 172.21.15.84:0/2260942732 >> v2:172.21.15.99:3300/0 conn(0x7f3f0406beb0 0x7f3f0406c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.146+0000 7f3f08f9d640 1 -- 172.21.15.84:0/2260942732 >> v1:172.21.15.84:6789/0 conn(0x7f3f04146ac0 legacy=0x7f3f0415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.146+0000 7f3f08f9d640 1 -- 172.21.15.84:0/2260942732 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f040b27a0 con 0x7f3f040b1c00 2023-12-12T09:21:07.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.146+0000 7f3efbfff640 1 -- 172.21.15.84:0/2260942732 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864732089 0 0) 0x7f3f040b21e0 con 0x7f3f04146ac0 2023-12-12T09:21:07.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.147+0000 7f3f08f9d640 1 --2- 172.21.15.84:0/2260942732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 0x7f3f040b3280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40097a0 tx=0x7f3ef402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b089cbcb8b20cd99 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:07.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.152+0000 7f3efbfff640 1 -- 172.21.15.84:0/2260942732 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef402d040 con 0x7f3f040b1c00 2023-12-12T09:21:07.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.152+0000 7f3efbfff640 1 -- 172.21.15.84:0/2260942732 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4031810 con 0x7f3f040b1c00 2023-12-12T09:21:07.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.152+0000 7f3efbfff640 1 -- 172.21.15.84:0/2260942732 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4031ba0 con 0x7f3f040b1c00 2023-12-12T09:21:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.152+0000 7f3f0ba02640 1 -- 172.21.15.84:0/2260942732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 msgr2=0x7f3f040b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.152+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/2260942732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 0x7f3f040b3280 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40097a0 tx=0x7f3ef402b8b0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.153+0000 7f3f0ba02640 1 -- 172.21.15.84:0/2260942732 shutdown_connections 2023-12-12T09:21:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.153+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/2260942732 >> v2:172.21.15.99:3300/0 conn(0x7f3f0406beb0 0x7f3f0406c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.153+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/2260942732 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 0x7f3f040b3280 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.153+0000 7f3f0ba02640 1 -- 172.21.15.84:0/2260942732 >> 172.21.15.84:0/2260942732 conn(0x7f3f040b0900 msgr2=0x7f3f040b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:07.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.153+0000 7f3f0ba02640 1 -- 172.21.15.84:0/2260942732 shutdown_connections 2023-12-12T09:21:07.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.153+0000 7f3f0ba02640 1 -- 172.21.15.84:0/2260942732 wait complete. 2023-12-12T09:21:07.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.154+0000 7f3f0ba02640 1 Processor -- start 2023-12-12T09:21:07.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.155+0000 7f3f0ba02640 1 -- start start 2023-12-12T09:21:07.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.155+0000 7f3f0ba02640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f0406beb0 0x7f3f04135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.155+0000 7f3f0ba02640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 0x7f3f04132440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.155+0000 7f3f0ba02640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f04146ac0 0x7f3f04145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.155+0000 7f3f0ba02640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f041f61e0 con 0x7f3f04146ac0 2023-12-12T09:21:07.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.155+0000 7f3f0ba02640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f041f6a80 con 0x7f3f0406beb0 2023-12-12T09:21:07.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.155+0000 7f3f0ba02640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04135c80 con 0x7f3f040b1c00 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f04146ac0 0x7f3f04145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f04146ac0 0x7f3f04145230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57342/0 (socket says 172.21.15.84:57342) 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 -- 172.21.15.84:0/1978531329 learned_addr learned my addr 172.21.15.84:0/1978531329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f0979e640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f0406beb0 0x7f3f04135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 -- 172.21.15.84:0/1978531329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 msgr2=0x7f3f04132440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 0x7f3f04132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 -- 172.21.15.84:0/1978531329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f0406beb0 msgr2=0x7f3f04135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f0406beb0 0x7f3f04135740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 -- 172.21.15.84:0/1978531329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4009400 con 0x7f3f04146ac0 2023-12-12T09:21:07.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f0979e640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f0406beb0 0x7f3f04135740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:07.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.156+0000 7f3f09f9f640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f04146ac0 0x7f3f04145230 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009dd0 tx=0x7f3efc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:07.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.157+0000 7f3ef9ffb640 1 -- 172.21.15.84:0/1978531329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc014480 con 0x7f3f04146ac0 2023-12-12T09:21:07.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.157+0000 7f3ef9ffb640 1 -- 172.21.15.84:0/1978531329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00f040 con 0x7f3f04146ac0 2023-12-12T09:21:07.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.157+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f04132980 con 0x7f3f04146ac0 2023-12-12T09:21:07.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.157+0000 7f3ef9ffb640 1 -- 172.21.15.84:0/1978531329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc014840 con 0x7f3f04146ac0 2023-12-12T09:21:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.157+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f041f6430 con 0x7f3f04146ac0 2023-12-12T09:21:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.158+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f040673c0 con 0x7f3f04146ac0 2023-12-12T09:21:07.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.159+0000 7f3ef9ffb640 1 -- 172.21.15.84:0/1978531329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3efc0149a0 con 0x7f3f04146ac0 2023-12-12T09:21:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.160+0000 7f3ef9ffb640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ee806ae40 0x7f3ee806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.160+0000 7f3ef9ffb640 1 -- 172.21.15.84:0/1978531329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3efc08a570 con 0x7f3f04146ac0 2023-12-12T09:21:07.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.160+0000 7f3f0979e640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ee806ae40 0x7f3ee806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.161+0000 7f3f0979e640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ee806ae40 0x7f3ee806d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000f60 tx=0x7f3f00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:07.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.164+0000 7f3ef9ffb640 1 -- 172.21.15.84:0/1978531329 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3efc055250 con 0x7f3f04146ac0 2023-12-12T09:21:07.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.354+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f040b3d70 con 0x7f3f04146ac0 2023-12-12T09:21:07.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.356+0000 7f3ef9ffb640 1 -- 172.21.15.84:0/1978531329 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3efc058870 con 0x7f3f04146ac0 2023-12-12T09:21:07.357 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ee806ae40 msgr2=0x7f3ee806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ee806ae40 0x7f3ee806d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000f60 tx=0x7f3f00009040 comp rx=0 tx=0).stop 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f04146ac0 msgr2=0x7f3f04145230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f04146ac0 0x7f3f04145230 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009dd0 tx=0x7f3efc00c490 comp rx=0 tx=0).stop 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 shutdown_connections 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ee806ae40 0x7f3ee806d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3f04146ac0 0x7f3f04145230 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3f040b1c00 0x7f3f04132440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 --2- 172.21.15.84:0/1978531329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f0406beb0 0x7f3f04135740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 >> 172.21.15.84:0/1978531329 conn(0x7f3f040b0900 msgr2=0x7f3f040afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 shutdown_connections 2023-12-12T09:21:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.359+0000 7f3f0ba02640 1 -- 172.21.15.84:0/1978531329 wait complete. 2023-12-12T09:21:07.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:21:07.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.590+0000 7f6caf13e640 1 Processor -- start 2023-12-12T09:21:07.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.590+0000 7f6caf13e640 1 -- start start 2023-12-12T09:21:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.592+0000 7f6caf13e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ca806dff0 0x7f6ca80ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.592+0000 7f6caf13e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6ca815be60 0x7f6ca813e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.592+0000 7f6caf13e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80ce260 con 0x7f6ca80b40d0 2023-12-12T09:21:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.592+0000 7f6caf13e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca806e480 con 0x7f6ca806dff0 2023-12-12T09:21:07.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.592+0000 7f6caf13e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80cd930 con 0x7f6ca815be60 2023-12-12T09:21:07.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.593+0000 7f6ca7fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ca806dff0 0x7f6ca80ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.593+0000 7f6ca7fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ca806dff0 0x7f6ca80ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57352/0 (socket says 172.21.15.84:57352) 2023-12-12T09:21:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.593+0000 7f6ca7fff640 1 -- 172.21.15.84:0/2193613082 learned_addr learned my addr 172.21.15.84:0/2193613082 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.593+0000 7f6cad6db640 1 --2- 172.21.15.84:0/2193613082 >> v2:172.21.15.99:3300/0 conn(0x7f6ca815be60 0x7f6ca813e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.593+0000 7f6ca7fff640 1 -- 172.21.15.84:0/2193613082 >> v2:172.21.15.99:3300/0 conn(0x7f6ca815be60 msgr2=0x7f6ca813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.593+0000 7f6ca7fff640 1 --2- 172.21.15.84:0/2193613082 >> v2:172.21.15.99:3300/0 conn(0x7f6ca815be60 0x7f6ca813e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.593+0000 7f6ca7fff640 1 -- 172.21.15.84:0/2193613082 >> v1:172.21.15.99:6789/0 conn(0x7f6ca80b40d0 legacy=0x7f6ca80b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.593+0000 7f6ca7fff640 1 -- 172.21.15.84:0/2193613082 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80cdc10 con 0x7f6ca806dff0 2023-12-12T09:21:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.595+0000 7f6ca7fff640 1 --2- 172.21.15.84:0/2193613082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca806dff0 0x7f6ca80ce6f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6ca81592b0 tx=0x7f6c9402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826bc70f5a0688a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.595+0000 7f6ca77fe640 1 -- 172.21.15.84:0/2193613082 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94030860 con 0x7f6ca806dff0 2023-12-12T09:21:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.595+0000 7f6ca77fe640 1 -- 172.21.15.84:0/2193613082 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c940309c0 con 0x7f6ca806dff0 2023-12-12T09:21:07.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.595+0000 7f6ca77fe640 1 -- 172.21.15.84:0/2193613082 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94030d50 con 0x7f6ca806dff0 2023-12-12T09:21:07.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.596+0000 7f6caf13e640 1 -- 172.21.15.84:0/2193613082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca806dff0 msgr2=0x7f6ca80ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.596+0000 7f6caf13e640 1 --2- 172.21.15.84:0/2193613082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca806dff0 0x7f6ca80ce6f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6ca81592b0 tx=0x7f6c9402b9a0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.596+0000 7f6caf13e640 1 -- 172.21.15.84:0/2193613082 shutdown_connections 2023-12-12T09:21:07.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.596+0000 7f6caf13e640 1 --2- 172.21.15.84:0/2193613082 >> v2:172.21.15.99:3300/0 conn(0x7f6ca815be60 0x7f6ca813e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.596+0000 7f6caf13e640 1 --2- 172.21.15.84:0/2193613082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca806dff0 0x7f6ca80ce6f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.596+0000 7f6caf13e640 1 -- 172.21.15.84:0/2193613082 >> 172.21.15.84:0/2193613082 conn(0x7f6ca80b0ac0 msgr2=0x7f6ca80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:07.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.596+0000 7f6caf13e640 1 -- 172.21.15.84:0/2193613082 shutdown_connections 2023-12-12T09:21:07.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.596+0000 7f6caf13e640 1 -- 172.21.15.84:0/2193613082 wait complete. 2023-12-12T09:21:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.598+0000 7f6caf13e640 1 Processor -- start 2023-12-12T09:21:07.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.598+0000 7f6caf13e640 1 -- start start 2023-12-12T09:21:07.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6caf13e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ca806dff0 0x7f6ca815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6caf13e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca80b40d0 0x7f6ca813cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6caf13e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca815be60 0x7f6ca813d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6caf13e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca813e620 con 0x7f6ca815be60 2023-12-12T09:21:07.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6caf13e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b2480 con 0x7f6ca80b40d0 2023-12-12T09:21:07.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6caf13e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80b2760 con 0x7f6ca806dff0 2023-12-12T09:21:07.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6cad6db640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca815be60 0x7f6ca813d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6cad6db640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca815be60 0x7f6ca813d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57354/0 (socket says 172.21.15.84:57354) 2023-12-12T09:21:07.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.599+0000 7f6cad6db640 1 -- 172.21.15.84:0/407147676 learned_addr learned my addr 172.21.15.84:0/407147676 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:07.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6ca7fff640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca80b40d0 0x7f6ca813cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6cad6db640 1 -- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ca806dff0 msgr2=0x7f6ca815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6caceda640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ca806dff0 0x7f6ca815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6cad6db640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ca806dff0 0x7f6ca815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6cad6db640 1 -- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca80b40d0 msgr2=0x7f6ca813cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6cad6db640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca80b40d0 0x7f6ca813cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6cad6db640 1 -- 172.21.15.84:0/407147676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940094d0 con 0x7f6ca815be60 2023-12-12T09:21:07.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6ca7fff640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca80b40d0 0x7f6ca813cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6cad6db640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca815be60 0x7f6ca813d010 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000efc0 tx=0x7f6ca000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6ca57fa640 1 -- 172.21.15.84:0/407147676 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0009ba0 con 0x7f6ca815be60 2023-12-12T09:21:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6ca57fa640 1 -- 172.21.15.84:0/407147676 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca000f040 con 0x7f6ca815be60 2023-12-12T09:21:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6ca57fa640 1 -- 172.21.15.84:0/407147676 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca00146c0 con 0x7f6ca815be60 2023-12-12T09:21:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca80b2a40 con 0x7f6ca815be60 2023-12-12T09:21:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.600+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca813d880 con 0x7f6ca815be60 2023-12-12T09:21:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.602+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca80673c0 con 0x7f6ca815be60 2023-12-12T09:21:07.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.602+0000 7f6ca57fa640 1 -- 172.21.15.84:0/407147676 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ca0014820 con 0x7f6ca815be60 2023-12-12T09:21:07.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.603+0000 7f6ca57fa640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c8c06ae40 0x7f6c8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:07.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.604+0000 7f6ca57fa640 1 -- 172.21.15.84:0/407147676 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6ca008a4c0 con 0x7f6ca815be60 2023-12-12T09:21:07.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.604+0000 7f6caceda640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c8c06ae40 0x7f6c8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:07.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.605+0000 7f6caceda640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c8c06ae40 0x7f6c8c06d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c000f60 tx=0x7f6c9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:07.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.608+0000 7f6ca57fa640 1 -- 172.21.15.84:0/407147676 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ca00551a0 con 0x7f6ca815be60 2023-12-12T09:21:07.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.796+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ca81521e0 con 0x7f6ca815be60 2023-12-12T09:21:07.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.797+0000 7f6ca57fa640 1 -- 172.21.15.84:0/407147676 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ca00587c0 con 0x7f6ca815be60 2023-12-12T09:21:07.799 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:21:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c8c06ae40 msgr2=0x7f6c8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c8c06ae40 0x7f6c8c06d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c000f60 tx=0x7f6c9c009040 comp rx=0 tx=0).stop 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca815be60 msgr2=0x7f6ca813d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca815be60 0x7f6ca813d010 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6ca000efc0 tx=0x7f6ca000c490 comp rx=0 tx=0).stop 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 shutdown_connections 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c8c06ae40 0x7f6c8c06d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ca815be60 0x7f6ca813d010 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca80b40d0 0x7f6ca813cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 --2- 172.21.15.84:0/407147676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ca806dff0 0x7f6ca815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 >> 172.21.15.84:0/407147676 conn(0x7f6ca80b0ac0 msgr2=0x7f6ca8154810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 shutdown_connections 2023-12-12T09:21:07.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:07.800+0000 7f6caf13e640 1 -- 172.21.15.84:0/407147676 wait complete. 2023-12-12T09:21:07.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:21:08.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.029+0000 7f2bceae0640 1 Processor -- start 2023-12-12T09:21:08.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.030+0000 7f2bceae0640 1 -- start start 2023-12-12T09:21:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.031+0000 7f2bceae0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bc815acf0 0x7f2bc8071f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.031+0000 7f2bceae0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc806e270 con 0x7f2bc806a500 2023-12-12T09:21:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.031+0000 7f2bceae0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc80714a0 con 0x7f2bc815e5f0 2023-12-12T09:21:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.031+0000 7f2bceae0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80724c0 con 0x7f2bc815acf0 2023-12-12T09:21:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.032+0000 7f2bcd07d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2bc806a500 0x7f2bc80b3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53658/0 (socket says 172.21.15.84:53658) 2023-12-12T09:21:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.032+0000 7f2bcd07d640 1 -- 172.21.15.84:0/703363266 learned_addr learned my addr 172.21.15.84:0/703363266 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.032+0000 7f2bcc87c640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bc815acf0 0x7f2bc8071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.032+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424457010 0 0) 0x7f2bc806e270 con 0x7f2bc806a500 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.032+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb8003520 con 0x7f2bc806a500 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.032+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1831948020 0 0) 0x7f2bb8003520 con 0x7f2bc806a500 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.032+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bc815acf0 msgr2=0x7f2bc8071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.032+0000 7f2bc77fe640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bc815acf0 0x7f2bc8071f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 >> v1:172.21.15.99:6789/0 conn(0x7f2bc815e5f0 legacy=0x7f2bc806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8071780 con 0x7f2bc806a500 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2bc00019f0 con 0x7f2bc806a500 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 >> v1:172.21.15.84:6789/0 conn(0x7f2bc806a500 legacy=0x7f2bc80b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb80039a0 0x7f2bb8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bc815acf0 0x7f2bb80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8004d00 0x7f2bb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80724c0 con 0x7f2bb8004d00 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb800bab0 con 0x7f2bb80039a0 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb800bc70 con 0x7f2bc815acf0 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bcd07d640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8004d00 0x7f2bb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bcc87c640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb80039a0 0x7f2bb8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bc7fff640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bc815acf0 0x7f2bb80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bcd07d640 1 -- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bc815acf0 msgr2=0x7f2bb80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bcd07d640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bc815acf0 0x7f2bb80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bcd07d640 1 -- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb80039a0 msgr2=0x7f2bb8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bcd07d640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb80039a0 0x7f2bb8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.033+0000 7f2bcd07d640 1 -- 172.21.15.84:0/703363266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb8003520 con 0x7f2bb8004d00 2023-12-12T09:21:08.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.034+0000 7f2bcc87c640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb80039a0 0x7f2bb8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:08.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bcd07d640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8004d00 0x7f2bb8005180 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000a830 tx=0x7f2bb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3817188a0867046 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00072d0 con 0x7f2bb8004d00 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc002f070 con 0x7f2bb8004d00 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bc77fe640 1 -- 172.21.15.84:0/703363266 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00076b0 con 0x7f2bb8004d00 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bceae0640 1 -- 172.21.15.84:0/703363266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8004d00 msgr2=0x7f2bb8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bceae0640 1 --2- 172.21.15.84:0/703363266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bb8004d00 0x7f2bb8005180 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000a830 tx=0x7f2bb80057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bcd07d640 1 -- 172.21.15.84:0/703363266 reap_dead start 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bceae0640 1 -- 172.21.15.84:0/703363266 shutdown_connections 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.035+0000 7f2bceae0640 1 -- 172.21.15.84:0/703363266 >> 172.21.15.84:0/703363266 conn(0x7f2bc80cffa0 msgr2=0x7f2bc80d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.036+0000 7f2bceae0640 1 -- 172.21.15.84:0/703363266 shutdown_connections 2023-12-12T09:21:08.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.036+0000 7f2bceae0640 1 -- 172.21.15.84:0/703363266 wait complete. 2023-12-12T09:21:08.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.037+0000 7f2bceae0640 1 Processor -- start 2023-12-12T09:21:08.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.037+0000 7f2bceae0640 1 -- start start 2023-12-12T09:21:08.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.038+0000 7f2bceae0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bb8004d00 0x7f2bc815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.038+0000 7f2bceae0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bc814d830 0x7f2bc814dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.038+0000 7f2bceae0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc80b0f50 0x7f2bc80b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.038+0000 7f2bceae0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80c5d20 con 0x7f2bc80b0f50 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.038+0000 7f2bceae0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc814e1f0 con 0x7f2bc814d830 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.038+0000 7f2bceae0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80b1910 con 0x7f2bb8004d00 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc80b0f50 0x7f2bc80b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc80b0f50 0x7f2bc80b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57364/0 (socket says 172.21.15.84:57364) 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 -- 172.21.15.84:0/914039830 learned_addr learned my addr 172.21.15.84:0/914039830 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bc7fff640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bc814d830 0x7f2bc814dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcc87c640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bb8004d00 0x7f2bc815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 -- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bb8004d00 msgr2=0x7f2bc815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bb8004d00 0x7f2bc815cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 -- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bc814d830 msgr2=0x7f2bc814dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bc814d830 0x7f2bc814dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 -- 172.21.15.84:0/914039830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80c50a0 con 0x7f2bc80b0f50 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcc87c640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bb8004d00 0x7f2bc815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:08.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bc7fff640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bc814d830 0x7f2bc814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:08.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.039+0000 7f2bcd07d640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc80b0f50 0x7f2bc80b13d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0000f80 tx=0x7f2bc0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.040+0000 7f2bc57fa640 1 -- 172.21.15.84:0/914039830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00019b0 con 0x7f2bc80b0f50 2023-12-12T09:21:08.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.040+0000 7f2bc57fa640 1 -- 172.21.15.84:0/914039830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0004e90 con 0x7f2bc80b0f50 2023-12-12T09:21:08.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.040+0000 7f2bc57fa640 1 -- 172.21.15.84:0/914039830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00072d0 con 0x7f2bc80b0f50 2023-12-12T09:21:08.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.040+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc80c5380 con 0x7f2bc80b0f50 2023-12-12T09:21:08.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.040+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc80c5940 con 0x7f2bc80b0f50 2023-12-12T09:21:08.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.041+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc8072eb0 con 0x7f2bc80b0f50 2023-12-12T09:21:08.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.042+0000 7f2bc57fa640 1 -- 172.21.15.84:0/914039830 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2bc0031030 con 0x7f2bc80b0f50 2023-12-12T09:21:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.043+0000 7f2bc57fa640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bac06ae40 0x7f2bac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.043+0000 7f2bc57fa640 1 -- 172.21.15.84:0/914039830 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2bc00ab4c0 con 0x7f2bc80b0f50 2023-12-12T09:21:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.043+0000 7f2bcc87c640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bac06ae40 0x7f2bac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.044+0000 7f2bcc87c640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bac06ae40 0x7f2bac06d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009aa0 tx=0x7f2bbc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.048+0000 7f2bc57fa640 1 -- 172.21.15.84:0/914039830 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2bc0076240 con 0x7f2bc80b0f50 2023-12-12T09:21:08.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.237+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2bc8072eb0 con 0x7f2bc80b0f50 2023-12-12T09:21:08.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.238+0000 7f2bc57fa640 1 -- 172.21.15.84:0/914039830 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2bc00011c0 con 0x7f2bc80b0f50 2023-12-12T09:21:08.239 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:08.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.240+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bac06ae40 msgr2=0x7f2bac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.240+0000 7f2bceae0640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bac06ae40 0x7f2bac06d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009aa0 tx=0x7f2bbc008040 comp rx=0 tx=0).stop 2023-12-12T09:21:08.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc80b0f50 msgr2=0x7f2bc80b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc80b0f50 0x7f2bc80b13d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0000f80 tx=0x7f2bc0001d80 comp rx=0 tx=0).stop 2023-12-12T09:21:08.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 shutdown_connections 2023-12-12T09:21:08.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bac06ae40 0x7f2bac06d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bc80b0f50 0x7f2bc80b13d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bc814d830 0x7f2bc814dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 --2- 172.21.15.84:0/914039830 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bb8004d00 0x7f2bc815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 >> 172.21.15.84:0/914039830 conn(0x7f2bc80cffa0 msgr2=0x7f2bc815bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:08.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 shutdown_connections 2023-12-12T09:21:08.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.241+0000 7f2bceae0640 1 -- 172.21.15.84:0/914039830 wait complete. 2023-12-12T09:21:08.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:21:08.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.459+0000 7fa86cbdc640 1 Processor -- start 2023-12-12T09:21:08.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.459+0000 7fa86cbdc640 1 -- start start 2023-12-12T09:21:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.461+0000 7fa86cbdc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8680ce330 0x7fa86813d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.461+0000 7fa86cbdc640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa868140270 con 0x7fa868071bb0 2023-12-12T09:21:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.461+0000 7fa86cbdc640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8680cd850 con 0x7fa8680ce790 2023-12-12T09:21:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.461+0000 7fa86cbdc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680cdb30 con 0x7fa8680ce330 2023-12-12T09:21:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.461+0000 7fa86659c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa868071bb0 0x7fa868071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53660/0 (socket says 172.21.15.84:53660) 2023-12-12T09:21:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.461+0000 7fa86659c640 1 -- 172.21.15.84:0/1894336503 learned_addr learned my addr 172.21.15.84:0/1894336503 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:08.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.461+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996728036 0 0) 0x7fa868140270 con 0x7fa868071bb0 2023-12-12T09:21:08.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa865d9b640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8680ce330 0x7fa86813d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa850003520 con 0x7fa868071bb0 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2933401100 0 0) 0x7fa850003520 con 0x7fa868071bb0 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8680ce330 msgr2=0x7fa86813d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8680ce330 0x7fa86813d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 >> v1:172.21.15.99:6789/0 conn(0x7fa8680ce790 legacy=0x7fa86813f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8680cde10 con 0x7fa868071bb0 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa858001670 con 0x7fa868071bb0 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 >> v1:172.21.15.84:6789/0 conn(0x7fa868071bb0 legacy=0x7fa868071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8500039a0 0x7fa850003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8680ce330 0x7fa8500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa850004d00 0x7fa850005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680cdb30 con 0x7fa8500039a0 2023-12-12T09:21:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85000bb90 con 0x7fa850004d00 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85000df60 con 0x7fa8680ce330 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.462+0000 7fa86659c640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8500039a0 0x7fa850003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.463+0000 7fa866d9d640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa850004d00 0x7fa850005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.463+0000 7fa86659c640 1 -- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8680ce330 msgr2=0x7fa8500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.463+0000 7fa86659c640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8680ce330 0x7fa8500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.463+0000 7fa86659c640 1 -- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa850004d00 msgr2=0x7fa850005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.463+0000 7fa86659c640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa850004d00 0x7fa850005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.463+0000 7fa86659c640 1 -- 172.21.15.84:0/1894336503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850003520 con 0x7fa8500039a0 2023-12-12T09:21:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.463+0000 7fa866d9d640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa850004d00 0x7fa850005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.464+0000 7fa86659c640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8500039a0 0x7fa850003dc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c0e0 tx=0x7fa8500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69290a226636ce1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.464+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858005ad0 con 0x7fa8500039a0 2023-12-12T09:21:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.464+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858005c30 con 0x7fa8500039a0 2023-12-12T09:21:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.464+0000 7fa86559a640 1 -- 172.21.15.84:0/1894336503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85802c810 con 0x7fa8500039a0 2023-12-12T09:21:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.465+0000 7fa86cbdc640 1 -- 172.21.15.84:0/1894336503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8500039a0 msgr2=0x7fa850003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.465+0000 7fa86cbdc640 1 --2- 172.21.15.84:0/1894336503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8500039a0 0x7fa850003dc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa85800c0e0 tx=0x7fa8500057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.465+0000 7fa866d9d640 1 -- 172.21.15.84:0/1894336503 reap_dead start 2023-12-12T09:21:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.465+0000 7fa86cbdc640 1 -- 172.21.15.84:0/1894336503 shutdown_connections 2023-12-12T09:21:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.465+0000 7fa86cbdc640 1 -- 172.21.15.84:0/1894336503 >> 172.21.15.84:0/1894336503 conn(0x7fa86806c3d0 msgr2=0x7fa86806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.465+0000 7fa86cbdc640 1 -- 172.21.15.84:0/1894336503 shutdown_connections 2023-12-12T09:21:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.465+0000 7fa86cbdc640 1 -- 172.21.15.84:0/1894336503 wait complete. 2023-12-12T09:21:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.467+0000 7fa86cbdc640 1 Processor -- start 2023-12-12T09:21:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.467+0000 7fa86cbdc640 1 -- start start 2023-12-12T09:21:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa86cbdc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8500039a0 0x7fa8681365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa86cbdc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86814fcc0 0x7fa868138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa86cbdc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa868139500 0x7fa868139e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa86cbdc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa868136180 con 0x7fa86814fcc0 2023-12-12T09:21:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa86cbdc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa868150140 con 0x7fa868139500 2023-12-12T09:21:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa86cbdc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa868135500 con 0x7fa8500039a0 2023-12-12T09:21:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa865d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86814fcc0 0x7fa868138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa865d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86814fcc0 0x7fa868138fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57382/0 (socket says 172.21.15.84:57382) 2023-12-12T09:21:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa865d9b640 1 -- 172.21.15.84:0/3019126373 learned_addr learned my addr 172.21.15.84:0/3019126373 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.468+0000 7fa86659c640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8500039a0 0x7fa8681365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa866d9d640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa868139500 0x7fa868139e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa865d9b640 1 -- 172.21.15.84:0/3019126373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8500039a0 msgr2=0x7fa8681365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa865d9b640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8500039a0 0x7fa8681365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa865d9b640 1 -- 172.21.15.84:0/3019126373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa868139500 msgr2=0x7fa868139e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa865d9b640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa868139500 0x7fa868139e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa865d9b640 1 -- 172.21.15.84:0/3019126373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8681357e0 con 0x7fa86814fcc0 2023-12-12T09:21:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa865d9b640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86814fcc0 0x7fa868138fc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00d5f0 tx=0x7fa85c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa856ffd640 1 -- 172.21.15.84:0/3019126373 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0125f0 con 0x7fa86814fcc0 2023-12-12T09:21:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa856ffd640 1 -- 172.21.15.84:0/3019126373 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c012750 con 0x7fa86814fcc0 2023-12-12T09:21:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa856ffd640 1 -- 172.21.15.84:0/3019126373 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c012b00 con 0x7fa86814fcc0 2023-12-12T09:21:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.469+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa868135ac0 con 0x7fa86814fcc0 2023-12-12T09:21:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.470+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8681350e0 con 0x7fa86814fcc0 2023-12-12T09:21:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.471+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8681363f0 con 0x7fa86814fcc0 2023-12-12T09:21:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.471+0000 7fa856ffd640 1 -- 172.21.15.84:0/3019126373 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa85c012c60 con 0x7fa86814fcc0 2023-12-12T09:21:08.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.472+0000 7fa856ffd640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84806ae40 0x7fa84806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.472+0000 7fa856ffd640 1 -- 172.21.15.84:0/3019126373 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa85c089df0 con 0x7fa86814fcc0 2023-12-12T09:21:08.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.473+0000 7fa86659c640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84806ae40 0x7fa84806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.473+0000 7fa86659c640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84806ae40 0x7fa84806d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa858034000 tx=0x7fa858009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.477+0000 7fa856ffd640 1 -- 172.21.15.84:0/3019126373 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa85c054b10 con 0x7fa86814fcc0 2023-12-12T09:21:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.678+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa868135270 con 0x7fa86814fcc0 2023-12-12T09:21:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.679+0000 7fa856ffd640 1 -- 172.21.15.84:0/3019126373 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa85c058130 con 0x7fa86814fcc0 2023-12-12T09:21:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84806ae40 msgr2=0x7fa84806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84806ae40 0x7fa84806d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa858034000 tx=0x7fa858009030 comp rx=0 tx=0).stop 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86814fcc0 msgr2=0x7fa868138fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86814fcc0 0x7fa868138fc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00d5f0 tx=0x7fa85c00dab0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 shutdown_connections 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa868139500 0x7fa868139e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa84806ae40 0x7fa84806d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86814fcc0 0x7fa868138fc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 --2- 172.21.15.84:0/3019126373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8500039a0 0x7fa8681365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 >> 172.21.15.84:0/3019126373 conn(0x7fa86806c3d0 msgr2=0x7fa868150860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.681+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 shutdown_connections 2023-12-12T09:21:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.682+0000 7fa86cbdc640 1 -- 172.21.15.84:0/3019126373 wait complete. 2023-12-12T09:21:08.702 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:21:08.702 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:21:08.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:08.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.979+0000 7f046e18e640 1 Processor -- start 2023-12-12T09:21:08.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.979+0000 7f046e18e640 1 -- start start 2023-12-12T09:21:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.981+0000 7f046e18e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f046806aa00 0x7f0468160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.981+0000 7f046e18e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806ade0 0x7f0468161320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.981+0000 7f046e18e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046806b2d0 con 0x7f0468146500 2023-12-12T09:21:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.981+0000 7f046e18e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0468140840 con 0x7f046806aa00 2023-12-12T09:21:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.981+0000 7f046e18e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046806b5b0 con 0x7f046806ade0 2023-12-12T09:21:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.981+0000 7f04677fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f046806aa00 0x7f0468160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.982+0000 7f0467fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0468146500 0x7f04680b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53672/0 (socket says 172.21.15.84:53672) 2023-12-12T09:21:08.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.982+0000 7f0467fff640 1 -- 172.21.15.84:0/116489889 learned_addr learned my addr 172.21.15.84:0/116489889 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:08.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.982+0000 7f0466ffd640 1 --2- 172.21.15.84:0/116489889 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806ade0 0x7f0468161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.982+0000 7f04677fe640 1 -- 172.21.15.84:0/116489889 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806ade0 msgr2=0x7f0468161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:08.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.982+0000 7f04677fe640 1 --2- 172.21.15.84:0/116489889 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806ade0 0x7f0468161320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.982+0000 7f04677fe640 1 -- 172.21.15.84:0/116489889 >> v1:172.21.15.84:6789/0 conn(0x7f0468146500 legacy=0x7f04680b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.982+0000 7f04677fe640 1 -- 172.21.15.84:0/116489889 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046806b890 con 0x7f046806aa00 2023-12-12T09:21:08.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.983+0000 7f04677fe640 1 --2- 172.21.15.84:0/116489889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f046806aa00 0x7f0468160de0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f04580097a0 tx=0x7f045802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b323917efbc1613 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.983+0000 7f04667fc640 1 -- 172.21.15.84:0/116489889 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0458030710 con 0x7f046806aa00 2023-12-12T09:21:08.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.983+0000 7f04667fc640 1 -- 172.21.15.84:0/116489889 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045802e050 con 0x7f046806aa00 2023-12-12T09:21:08.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f04667fc640 1 -- 172.21.15.84:0/116489889 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0458030a90 con 0x7f046806aa00 2023-12-12T09:21:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f046e18e640 1 -- 172.21.15.84:0/116489889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f046806aa00 msgr2=0x7f0468160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f046e18e640 1 --2- 172.21.15.84:0/116489889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f046806aa00 0x7f0468160de0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f04580097a0 tx=0x7f045802b710 comp rx=0 tx=0).stop 2023-12-12T09:21:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f046e18e640 1 -- 172.21.15.84:0/116489889 shutdown_connections 2023-12-12T09:21:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f046e18e640 1 --2- 172.21.15.84:0/116489889 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806ade0 0x7f0468161320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f046e18e640 1 --2- 172.21.15.84:0/116489889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f046806aa00 0x7f0468160de0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f046e18e640 1 -- 172.21.15.84:0/116489889 >> 172.21.15.84:0/116489889 conn(0x7f04680cf660 msgr2=0x7f04680cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f046e18e640 1 -- 172.21.15.84:0/116489889 shutdown_connections 2023-12-12T09:21:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.984+0000 7f046e18e640 1 -- 172.21.15.84:0/116489889 wait complete. 2023-12-12T09:21:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.986+0000 7f046e18e640 1 Processor -- start 2023-12-12T09:21:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.986+0000 7f046e18e640 1 -- start start 2023-12-12T09:21:08.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.987+0000 7f046e18e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806aa00 0x7f046815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.987+0000 7f046e18e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f046806ade0 0x7f04680ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.987+0000 7f046e18e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468146500 0x7f04680ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.987+0000 7f046e18e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046815ffd0 con 0x7f0468146500 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.987+0000 7f046e18e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046815f3c0 con 0x7f046806ade0 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.987+0000 7f046e18e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046815f6a0 con 0x7f046806aa00 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468146500 0x7f04680ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468146500 0x7f04680ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57404/0 (socket says 172.21.15.84:57404) 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 -- 172.21.15.84:0/3434036835 learned_addr learned my addr 172.21.15.84:0/3434036835 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f04677fe640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806aa00 0x7f046815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 -- 172.21.15.84:0/3434036835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806aa00 msgr2=0x7f046815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806aa00 0x7f046815cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 -- 172.21.15.84:0/3434036835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f046806ade0 msgr2=0x7f04680ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f046806ade0 0x7f04680ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 -- 172.21.15.84:0/3434036835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458009400 con 0x7f0468146500 2023-12-12T09:21:08.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.988+0000 7f0467fff640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468146500 0x7f04680ce970 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f046000c8c0 tx=0x7f046000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.989+0000 7f044ffff640 1 -- 172.21.15.84:0/3434036835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000a640 con 0x7f0468146500 2023-12-12T09:21:08.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.989+0000 7f044ffff640 1 -- 172.21.15.84:0/3434036835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046000a7a0 con 0x7f0468146500 2023-12-12T09:21:08.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.989+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046815f980 con 0x7f0468146500 2023-12-12T09:21:08.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.989+0000 7f044ffff640 1 -- 172.21.15.84:0/3434036835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000ab90 con 0x7f0468146500 2023-12-12T09:21:08.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.989+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046815e650 con 0x7f0468146500 2023-12-12T09:21:08.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.990+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04680b37d0 con 0x7f0468146500 2023-12-12T09:21:08.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.991+0000 7f044ffff640 1 -- 172.21.15.84:0/3434036835 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f046000acf0 con 0x7f0468146500 2023-12-12T09:21:08.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.992+0000 7f044ffff640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f045406ae70 0x7f045406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:08.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.992+0000 7f044ffff640 1 -- 172.21.15.84:0/3434036835 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f04600893f0 con 0x7f0468146500 2023-12-12T09:21:08.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.992+0000 7f04677fe640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f045406ae70 0x7f045406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:08.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.993+0000 7f04677fe640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f045406ae70 0x7f045406d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0458034000 tx=0x7f0458008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:08.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:08.997+0000 7f044ffff640 1 -- 172.21.15.84:0/3434036835 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0460054080 con 0x7f0468146500 2023-12-12T09:21:09.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.178+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04680673c0 con 0x7f0468146500 2023-12-12T09:21:09.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.180+0000 7f044ffff640 1 -- 172.21.15.84:0/3434036835 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f04600576a0 con 0x7f0468146500 2023-12-12T09:21:09.181 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:09.181 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f045406ae70 msgr2=0x7f045406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f045406ae70 0x7f045406d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0458034000 tx=0x7f0458008030 comp rx=0 tx=0).stop 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468146500 msgr2=0x7f04680ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468146500 0x7f04680ce970 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f046000c8c0 tx=0x7f046000cd80 comp rx=0 tx=0).stop 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 shutdown_connections 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f045406ae70 0x7f045406d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468146500 0x7f04680ce970 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f046806ade0 0x7f04680ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 --2- 172.21.15.84:0/3434036835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f046806aa00 0x7f046815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 >> 172.21.15.84:0/3434036835 conn(0x7f04680cf660 msgr2=0x7f046813f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 shutdown_connections 2023-12-12T09:21:09.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.182+0000 7f046e18e640 1 -- 172.21.15.84:0/3434036835 wait complete. 2023-12-12T09:21:09.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:21:09.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:21:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.406+0000 7ff3f56d4640 1 Processor -- start 2023-12-12T09:21:09.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.406+0000 7ff3f56d4640 1 -- start start 2023-12-12T09:21:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3f56d4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff3f00b40d0 0x7ff3f006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3f56d4640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff3f015be60 0x7ff3f013e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3f56d4640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f00ceb80 con 0x7ff3f00ce6f0 2023-12-12T09:21:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3f56d4640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00ce260 con 0x7ff3f00b40d0 2023-12-12T09:21:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3f56d4640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00cd930 con 0x7ff3f015be60 2023-12-12T09:21:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3eeffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff3f00b40d0 0x7ff3f006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3eeffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff3f00b40d0 0x7ff3f006dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57410/0 (socket says 172.21.15.84:57410) 2023-12-12T09:21:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3e7fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff3f00ce6f0 0x7ff3f00b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53688/0 (socket says 172.21.15.84:53688) 2023-12-12T09:21:09.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.408+0000 7ff3eeffd640 1 -- 172.21.15.84:0/756524830 learned_addr learned my addr 172.21.15.84:0/756524830 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.409+0000 7ff3ef7fe640 1 --2- 172.21.15.84:0/756524830 >> v2:172.21.15.99:3300/0 conn(0x7ff3f015be60 0x7ff3f013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.409+0000 7ff3eeffd640 1 -- 172.21.15.84:0/756524830 >> v2:172.21.15.99:3300/0 conn(0x7ff3f015be60 msgr2=0x7ff3f013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.409+0000 7ff3eeffd640 1 --2- 172.21.15.84:0/756524830 >> v2:172.21.15.99:3300/0 conn(0x7ff3f015be60 0x7ff3f013e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.409+0000 7ff3eeffd640 1 -- 172.21.15.84:0/756524830 >> v1:172.21.15.84:6789/0 conn(0x7ff3f00ce6f0 legacy=0x7ff3f00b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.409+0000 7ff3eeffd640 1 -- 172.21.15.84:0/756524830 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00cdc10 con 0x7ff3f00b40d0 2023-12-12T09:21:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.409+0000 7ff3ef7fe640 1 --2- 172.21.15.84:0/756524830 >> v2:172.21.15.99:3300/0 conn(0x7ff3f015be60 0x7ff3f013e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.409+0000 7ff3ee7fc640 1 -- 172.21.15.84:0/756524830 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902387577 0 0) 0x7ff3f00ceb80 con 0x7ff3f00ce6f0 2023-12-12T09:21:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.411+0000 7ff3eeffd640 1 --2- 172.21.15.84:0/756524830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b40d0 0x7ff3f006dff0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff3f01592b0 tx=0x7ff3e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281d10eff81261d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:09.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.411+0000 7ff3ee7fc640 1 -- 172.21.15.84:0/756524830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0030860 con 0x7ff3f00b40d0 2023-12-12T09:21:09.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.411+0000 7ff3ee7fc640 1 -- 172.21.15.84:0/756524830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e00309c0 con 0x7ff3f00b40d0 2023-12-12T09:21:09.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.411+0000 7ff3ee7fc640 1 -- 172.21.15.84:0/756524830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0030d50 con 0x7ff3f00b40d0 2023-12-12T09:21:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.411+0000 7ff3f56d4640 1 -- 172.21.15.84:0/756524830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b40d0 msgr2=0x7ff3f006dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.411+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/756524830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b40d0 0x7ff3f006dff0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff3f01592b0 tx=0x7ff3e002b9a0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.412+0000 7ff3f56d4640 1 -- 172.21.15.84:0/756524830 shutdown_connections 2023-12-12T09:21:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.412+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/756524830 >> v2:172.21.15.99:3300/0 conn(0x7ff3f015be60 0x7ff3f013e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.412+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/756524830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f00b40d0 0x7ff3f006dff0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.412+0000 7ff3f56d4640 1 -- 172.21.15.84:0/756524830 >> 172.21.15.84:0/756524830 conn(0x7ff3f00b0ac0 msgr2=0x7ff3f00b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.412+0000 7ff3f56d4640 1 -- 172.21.15.84:0/756524830 shutdown_connections 2023-12-12T09:21:09.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.412+0000 7ff3f56d4640 1 -- 172.21.15.84:0/756524830 wait complete. 2023-12-12T09:21:09.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.413+0000 7ff3f56d4640 1 Processor -- start 2023-12-12T09:21:09.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.414+0000 7ff3f56d4640 1 -- start start 2023-12-12T09:21:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.414+0000 7ff3f56d4640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f00b40d0 0x7ff3f00704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.414+0000 7ff3f56d4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f00ce6f0 0x7ff3f0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3f56d4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f015be60 0x7ff3f01303b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3f56d4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0152e60 con 0x7ff3f015be60 2023-12-12T09:21:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3f56d4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0070ef0 con 0x7ff3f00ce6f0 2023-12-12T09:21:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3f56d4640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0141200 con 0x7ff3f00b40d0 2023-12-12T09:21:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f015be60 0x7ff3f01303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f015be60 0x7ff3f01303b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57414/0 (socket says 172.21.15.84:57414) 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3ef7fe640 1 -- 172.21.15.84:0/306373191 learned_addr learned my addr 172.21.15.84:0/306373191 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3eeffd640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f00b40d0 0x7ff3f00704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3e7fff640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f00ce6f0 0x7ff3f0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3ef7fe640 1 -- 172.21.15.84:0/306373191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f00b40d0 msgr2=0x7ff3f00704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3ef7fe640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f00b40d0 0x7ff3f00704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3ef7fe640 1 -- 172.21.15.84:0/306373191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f00ce6f0 msgr2=0x7ff3f0071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3ef7fe640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f00ce6f0 0x7ff3f0071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.415+0000 7ff3ef7fe640 1 -- 172.21.15.84:0/306373191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e00094d0 con 0x7ff3f015be60 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.416+0000 7ff3ef7fe640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f015be60 0x7ff3f01303b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800cf20 tx=0x7ff3e800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.416+0000 7ff3e77fe640 1 -- 172.21.15.84:0/306373191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800d840 con 0x7ff3f015be60 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.416+0000 7ff3e77fe640 1 -- 172.21.15.84:0/306373191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e800d9a0 con 0x7ff3f015be60 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.416+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f01528a0 con 0x7ff3f015be60 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.416+0000 7ff3e77fe640 1 -- 172.21.15.84:0/306373191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800dd50 con 0x7ff3f015be60 2023-12-12T09:21:09.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.416+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f0070b80 con 0x7ff3f015be60 2023-12-12T09:21:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.417+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f00673c0 con 0x7ff3f015be60 2023-12-12T09:21:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.418+0000 7ff3e77fe640 1 -- 172.21.15.84:0/306373191 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3e801e3b0 con 0x7ff3f015be60 2023-12-12T09:21:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.419+0000 7ff3e77fe640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d406ae40 0x7ff3d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.419+0000 7ff3e77fe640 1 -- 172.21.15.84:0/306373191 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff3e808a5c0 con 0x7ff3f015be60 2023-12-12T09:21:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.420+0000 7ff3eeffd640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d406ae40 0x7ff3d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.420+0000 7ff3eeffd640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d406ae40 0x7ff3d406d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0036000 tx=0x7ff3e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.423+0000 7ff3e77fe640 1 -- 172.21.15.84:0/306373191 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3e8055180 con 0x7ff3f015be60 2023-12-12T09:21:09.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.616+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3f0071030 con 0x7ff3f015be60 2023-12-12T09:21:09.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.617+0000 7ff3e77fe640 1 -- 172.21.15.84:0/306373191 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3e801a0a0 con 0x7ff3f015be60 2023-12-12T09:21:09.618 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:21:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d406ae40 msgr2=0x7ff3d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d406ae40 0x7ff3d406d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0036000 tx=0x7ff3e0008030 comp rx=0 tx=0).stop 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f015be60 msgr2=0x7ff3f01303b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f015be60 0x7ff3f01303b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800cf20 tx=0x7ff3e800a7d0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 shutdown_connections 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d406ae40 0x7ff3d406d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f015be60 0x7ff3f01303b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f00ce6f0 0x7ff3f0071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 --2- 172.21.15.84:0/306373191 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f00b40d0 0x7ff3f00704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 >> 172.21.15.84:0/306373191 conn(0x7ff3f00b0ac0 msgr2=0x7ff3f015e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 shutdown_connections 2023-12-12T09:21:09.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.620+0000 7ff3f56d4640 1 -- 172.21.15.84:0/306373191 wait complete. 2023-12-12T09:21:09.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:21:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.855+0000 7faf0413e640 1 Processor -- start 2023-12-12T09:21:09.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.856+0000 7faf0413e640 1 -- start start 2023-12-12T09:21:09.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.858+0000 7faf0413e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faefc0b2f80 0x7faefc0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.858+0000 7faf0413e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc0b1c00 con 0x7faefc162060 2023-12-12T09:21:09.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.858+0000 7faf0413e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc0b1ee0 con 0x7faefc0abd50 2023-12-12T09:21:09.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.858+0000 7faf0413e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc0b21c0 con 0x7faefc0b2f80 2023-12-12T09:21:09.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.858+0000 7faf01eda640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faefc162060 0x7faefc162440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53696/0 (socket says 172.21.15.84:53696) 2023-12-12T09:21:09.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.858+0000 7faf01eda640 1 -- 172.21.15.84:0/3368954313 learned_addr learned my addr 172.21.15.84:0/3368954313 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:09.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.858+0000 7faf016d9640 1 --2- 172.21.15.84:0/3368954313 >> v2:172.21.15.99:3300/0 conn(0x7faefc0b2f80 0x7faefc0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.858+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624480978 0 0) 0x7faefc0b1c00 con 0x7faefc162060 2023-12-12T09:21:09.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faee8003520 con 0x7faefc162060 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449749452 0 0) 0x7faee8003520 con 0x7faefc162060 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 >> v2:172.21.15.99:3300/0 conn(0x7faefc0b2f80 msgr2=0x7faefc0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 --2- 172.21.15.84:0/3368954313 >> v2:172.21.15.99:3300/0 conn(0x7faefc0b2f80 0x7faefc0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 >> v1:172.21.15.99:6789/0 conn(0x7faefc0abd50 legacy=0x7faefc06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0b24a0 con 0x7faefc162060 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf016d9640 1 --2- 172.21.15.84:0/3368954313 >> v2:172.21.15.99:3300/0 conn(0x7faefc0b2f80 0x7faefc0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7faef8001670 con 0x7faefc162060 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 >> v1:172.21.15.84:6789/0 conn(0x7faefc162060 legacy=0x7faefc162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80039c0 0x7faee8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee80047c0 0x7faee8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faee8005180 0x7faee800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0b21c0 con 0x7faee80047c0 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee800c080 con 0x7faee80039c0 2023-12-12T09:21:09.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.859+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee800c240 con 0x7faee8005180 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf016d9640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee80047c0 0x7faee8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf01eda640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80039c0 0x7faee8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf016d9640 1 -- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faee8005180 msgr2=0x7faee800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf026db640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faee8005180 0x7faee800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf016d9640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faee8005180 0x7faee800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf016d9640 1 -- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80039c0 msgr2=0x7faee8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf016d9640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80039c0 0x7faee8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf016d9640 1 -- 172.21.15.84:0/3368954313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee8003520 con 0x7faee80047c0 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf01eda640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80039c0 0x7faee8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf026db640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faee8005180 0x7faee800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:09.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.860+0000 7faf026db640 1 -- 172.21.15.84:0/3368954313 reap_dead start 2023-12-12T09:21:09.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.861+0000 7faf016d9640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee80047c0 0x7faee8004c40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7faeec009c90 tx=0x7faee80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae04e462ce8354b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:09.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.862+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec02c8f0 con 0x7faee80047c0 2023-12-12T09:21:09.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.862+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec02ca50 con 0x7faee80047c0 2023-12-12T09:21:09.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.862+0000 7faf00ed8640 1 -- 172.21.15.84:0/3368954313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec02ce40 con 0x7faee80047c0 2023-12-12T09:21:09.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.862+0000 7faf0413e640 1 -- 172.21.15.84:0/3368954313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee80047c0 msgr2=0x7faee8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.862+0000 7faf0413e640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee80047c0 0x7faee8004c40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7faeec009c90 tx=0x7faee80057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.862+0000 7faf0413e640 1 -- 172.21.15.84:0/3368954313 shutdown_connections 2023-12-12T09:21:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.862+0000 7faf0413e640 1 --2- 172.21.15.84:0/3368954313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faee80047c0 0x7faee8004c40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.862+0000 7faf0413e640 1 -- 172.21.15.84:0/3368954313 >> 172.21.15.84:0/3368954313 conn(0x7faefc0b0900 msgr2=0x7faefc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.863+0000 7faf0413e640 1 -- 172.21.15.84:0/3368954313 shutdown_connections 2023-12-12T09:21:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.863+0000 7faf0413e640 1 -- 172.21.15.84:0/3368954313 wait complete. 2023-12-12T09:21:09.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.864+0000 7faf0413e640 1 Processor -- start 2023-12-12T09:21:09.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.865+0000 7faf0413e640 1 -- start start 2023-12-12T09:21:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf0413e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80047c0 0x7faefc0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf0413e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0ce170 0x7faefc157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf0413e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faefc1f72f0 0x7faefc0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf0413e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1579c0 con 0x7faefc0ce170 2023-12-12T09:21:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf0413e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc09aa50 con 0x7faee80047c0 2023-12-12T09:21:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf0413e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc09ad30 con 0x7faefc1f72f0 2023-12-12T09:21:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf016d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0ce170 0x7faefc157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf016d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0ce170 0x7faefc157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57428/0 (socket says 172.21.15.84:57428) 2023-12-12T09:21:09.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf016d9640 1 -- 172.21.15.84:0/241142089 learned_addr learned my addr 172.21.15.84:0/241142089 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:09.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf01eda640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80047c0 0x7faefc0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf016d9640 1 -- 172.21.15.84:0/241142089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faefc1f72f0 msgr2=0x7faefc0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf016d9640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faefc1f72f0 0x7faefc0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf016d9640 1 -- 172.21.15.84:0/241142089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80047c0 msgr2=0x7faefc0cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf016d9640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80047c0 0x7faefc0cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.866+0000 7faf016d9640 1 -- 172.21.15.84:0/241142089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc09b010 con 0x7faefc0ce170 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.867+0000 7faf016d9640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0ce170 0x7faefc157480 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faeec037040 tx=0x7faeec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.867+0000 7faef27fc640 1 -- 172.21.15.84:0/241142089 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec034a80 con 0x7faefc0ce170 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.867+0000 7faef27fc640 1 -- 172.21.15.84:0/241142089 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec034be0 con 0x7faefc0ce170 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.867+0000 7faef27fc640 1 -- 172.21.15.84:0/241142089 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec004020 con 0x7faefc0ce170 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.867+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc09b2f0 con 0x7faefc0ce170 2023-12-12T09:21:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.868+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc09b8b0 con 0x7faefc0ce170 2023-12-12T09:21:09.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.869+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc0673c0 con 0x7faefc0ce170 2023-12-12T09:21:09.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.870+0000 7faef27fc640 1 -- 172.21.15.84:0/241142089 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faeec004180 con 0x7faefc0ce170 2023-12-12T09:21:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.871+0000 7faef27fc640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faee006ae40 0x7faee006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.871+0000 7faef27fc640 1 -- 172.21.15.84:0/241142089 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faeec0abd30 con 0x7faefc0ce170 2023-12-12T09:21:09.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.871+0000 7faf01eda640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faee006ae40 0x7faee006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:09.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.872+0000 7faf01eda640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faee006ae40 0x7faee006d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faef8000ff0 tx=0x7faef8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:09.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:09.876+0000 7faef27fc640 1 -- 172.21.15.84:0/241142089 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faeec076ab0 con 0x7faefc0ce170 2023-12-12T09:21:10.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.063+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faefc0b3d70 con 0x7faefc0ce170 2023-12-12T09:21:10.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.064+0000 7faef27fc640 1 -- 172.21.15.84:0/241142089 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7faeec07a0d0 con 0x7faefc0ce170 2023-12-12T09:21:10.065 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:10.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faee006ae40 msgr2=0x7faee006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faee006ae40 0x7faee006d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faef8000ff0 tx=0x7faef8009040 comp rx=0 tx=0).stop 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0ce170 msgr2=0x7faefc157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0ce170 0x7faefc157480 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7faeec037040 tx=0x7faeec004730 comp rx=0 tx=0).stop 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 shutdown_connections 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faefc1f72f0 0x7faefc0cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faee006ae40 0x7faee006d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faefc0ce170 0x7faefc157480 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 --2- 172.21.15.84:0/241142089 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faee80047c0 0x7faefc0cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 >> 172.21.15.84:0/241142089 conn(0x7faefc0b0900 msgr2=0x7faefc0afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 shutdown_connections 2023-12-12T09:21:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.066+0000 7faf0413e640 1 -- 172.21.15.84:0/241142089 wait complete. 2023-12-12T09:21:10.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:21:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.303+0000 7f4b3a27c640 1 Processor -- start 2023-12-12T09:21:10.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.304+0000 7f4b3a27c640 1 -- start start 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.305+0000 7f4b3a27c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b3415d810 0x7f4b340b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.305+0000 7f4b3a27c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4b3406d5e0 0x7f4b3406da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.305+0000 7f4b3a27c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340b4e80 con 0x7f4b340b4560 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.305+0000 7f4b3a27c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3415e8a0 con 0x7f4b3415d810 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.305+0000 7f4b3a27c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3415dc90 con 0x7f4b3406d5e0 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.306+0000 7f4b2b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b3415d810 0x7f4b340b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.306+0000 7f4b33fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4b340b4560 0x7f4b340b2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53698/0 (socket says 172.21.15.84:53698) 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.306+0000 7f4b2b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b3415d810 0x7f4b340b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57442/0 (socket says 172.21.15.84:57442) 2023-12-12T09:21:10.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.306+0000 7f4b33fff640 1 -- 172.21.15.84:0/2783903971 learned_addr learned my addr 172.21.15.84:0/2783903971 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.306+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/2783903971 >> v2:172.21.15.99:3300/0 conn(0x7f4b3406d5e0 msgr2=0x7f4b3406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.306+0000 7f4b2b7fe640 1 --2- 172.21.15.84:0/2783903971 >> v2:172.21.15.99:3300/0 conn(0x7f4b3406d5e0 0x7f4b3406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.306+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/2783903971 >> v1:172.21.15.84:6789/0 conn(0x7f4b340b4560 legacy=0x7f4b340b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.306+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/2783903971 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3415df70 con 0x7f4b3415d810 2023-12-12T09:21:10.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.307+0000 7f4b2b7fe640 1 --2- 172.21.15.84:0/2783903971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340b4940 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4b340b1640 tx=0x7f4b1c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f79dd2eb56ac797 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.307+0000 7f4b337fe640 1 -- 172.21.15.84:0/2783903971 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c02e070 con 0x7f4b3415d810 2023-12-12T09:21:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.307+0000 7f4b337fe640 1 -- 172.21.15.84:0/2783903971 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0315a0 con 0x7f4b3415d810 2023-12-12T09:21:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.307+0000 7f4b337fe640 1 -- 172.21.15.84:0/2783903971 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c031930 con 0x7f4b3415d810 2023-12-12T09:21:10.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.308+0000 7f4b3a27c640 1 -- 172.21.15.84:0/2783903971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 msgr2=0x7f4b340b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.308+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/2783903971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340b4940 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4b340b1640 tx=0x7f4b1c02b840 comp rx=0 tx=0).stop 2023-12-12T09:21:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.308+0000 7f4b3a27c640 1 -- 172.21.15.84:0/2783903971 shutdown_connections 2023-12-12T09:21:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.308+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/2783903971 >> v2:172.21.15.99:3300/0 conn(0x7f4b3406d5e0 0x7f4b3406da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.308+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/2783903971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340b4940 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.308+0000 7f4b3a27c640 1 -- 172.21.15.84:0/2783903971 >> 172.21.15.84:0/2783903971 conn(0x7f4b340b0ac0 msgr2=0x7f4b340b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.308+0000 7f4b3a27c640 1 -- 172.21.15.84:0/2783903971 shutdown_connections 2023-12-12T09:21:10.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.308+0000 7f4b3a27c640 1 -- 172.21.15.84:0/2783903971 wait complete. 2023-12-12T09:21:10.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.310+0000 7f4b3a27c640 1 Processor -- start 2023-12-12T09:21:10.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.310+0000 7f4b3a27c640 1 -- start start 2023-12-12T09:21:10.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.311+0000 7f4b3a27c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b3406d5e0 0x7f4b340cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.311+0000 7f4b3a27c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b340b4560 0x7f4b340c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.311+0000 7f4b3a27c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.311+0000 7f4b3a27c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b341452e0 con 0x7f4b3415d810 2023-12-12T09:21:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.311+0000 7f4b3a27c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b341455a0 con 0x7f4b340b4560 2023-12-12T09:21:10.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.311+0000 7f4b3a27c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34145840 con 0x7f4b3406d5e0 2023-12-12T09:21:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57446/0 (socket says 172.21.15.84:57446) 2023-12-12T09:21:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 -- 172.21.15.84:0/1408381831 learned_addr learned my addr 172.21.15.84:0/1408381831 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b33fff640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b3406d5e0 0x7f4b340cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b2b7fe640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b340b4560 0x7f4b340c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 -- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b3406d5e0 msgr2=0x7f4b340cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b3406d5e0 0x7f4b340cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 -- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b340b4560 msgr2=0x7f4b340c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b340b4560 0x7f4b340c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 -- 172.21.15.84:0/1408381831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c009400 con 0x7f4b3415d810 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b33fff640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b3406d5e0 0x7f4b340cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b2b7fe640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b340b4560 0x7f4b340c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.312+0000 7f4b38819640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340c4270 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00b970 tx=0x7f4b2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.313+0000 7f4b317fa640 1 -- 172.21.15.84:0/1408381831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00cb40 con 0x7f4b3415d810 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.313+0000 7f4b317fa640 1 -- 172.21.15.84:0/1408381831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00ccc0 con 0x7f4b3415d810 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.313+0000 7f4b317fa640 1 -- 172.21.15.84:0/1408381831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c014680 con 0x7f4b3415d810 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.313+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b34145b20 con 0x7f4b3415d810 2023-12-12T09:21:10.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.313+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b341460e0 con 0x7f4b3415d810 2023-12-12T09:21:10.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.314+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b341462d0 con 0x7f4b3415d810 2023-12-12T09:21:10.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.315+0000 7f4b317fa640 1 -- 172.21.15.84:0/1408381831 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b2c01d3b0 con 0x7f4b3415d810 2023-12-12T09:21:10.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.316+0000 7f4b317fa640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b1406ae40 0x7f4b1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.316+0000 7f4b317fa640 1 -- 172.21.15.84:0/1408381831 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4b2c0898f0 con 0x7f4b3415d810 2023-12-12T09:21:10.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.316+0000 7f4b33fff640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b1406ae40 0x7f4b1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.317+0000 7f4b33fff640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b1406ae40 0x7f4b1406d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4b24005880 tx=0x7f4b24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:10.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.320+0000 7f4b317fa640 1 -- 172.21.15.84:0/1408381831 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b2c054670 con 0x7f4b3415d810 2023-12-12T09:21:10.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.513+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b340673c0 con 0x7f4b3415d810 2023-12-12T09:21:10.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.515+0000 7f4b317fa640 1 -- 172.21.15.84:0/1408381831 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b2c0190a0 con 0x7f4b3415d810 2023-12-12T09:21:10.516 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:21:10.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b1406ae40 msgr2=0x7f4b1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b1406ae40 0x7f4b1406d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4b24005880 tx=0x7f4b24009040 comp rx=0 tx=0).stop 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 msgr2=0x7f4b340c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340c4270 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00b970 tx=0x7f4b2c00be30 comp rx=0 tx=0).stop 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 shutdown_connections 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b1406ae40 0x7f4b1406d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3415d810 0x7f4b340c4270 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b340b4560 0x7f4b340c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 --2- 172.21.15.84:0/1408381831 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b3406d5e0 0x7f4b340cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 >> 172.21.15.84:0/1408381831 conn(0x7f4b340b0ac0 msgr2=0x7f4b340ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 shutdown_connections 2023-12-12T09:21:10.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.517+0000 7f4b3a27c640 1 -- 172.21.15.84:0/1408381831 wait complete. 2023-12-12T09:21:10.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:21:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.750+0000 7efc69fdb640 1 Processor -- start 2023-12-12T09:21:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.750+0000 7efc69fdb640 1 -- start start 2023-12-12T09:21:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc69fdb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efc641606b0 0x7efc6406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc69fdb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc641615e0 0x7efc640b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc69fdb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6406b180 con 0x7efc641602d0 2023-12-12T09:21:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc69fdb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6406d9d0 con 0x7efc641615e0 2023-12-12T09:21:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc69fdb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc64161a90 con 0x7efc641606b0 2023-12-12T09:21:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc697da640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc641615e0 0x7efc640b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc697da640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc641615e0 0x7efc640b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57452/0 (socket says 172.21.15.84:57452) 2023-12-12T09:21:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc697da640 1 -- 172.21.15.84:0/2495472705 learned_addr learned my addr 172.21.15.84:0/2495472705 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc63fff640 1 --2- 172.21.15.84:0/2495472705 >> v2:172.21.15.99:3300/0 conn(0x7efc641606b0 0x7efc6406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc697da640 1 -- 172.21.15.84:0/2495472705 >> v2:172.21.15.99:3300/0 conn(0x7efc641606b0 msgr2=0x7efc6406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc697da640 1 --2- 172.21.15.84:0/2495472705 >> v2:172.21.15.99:3300/0 conn(0x7efc641606b0 0x7efc6406a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.752+0000 7efc697da640 1 -- 172.21.15.84:0/2495472705 >> v1:172.21.15.99:6789/0 conn(0x7efc641602d0 legacy=0x7efc640acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.753+0000 7efc697da640 1 -- 172.21.15.84:0/2495472705 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6406abc0 con 0x7efc641615e0 2023-12-12T09:21:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.754+0000 7efc697da640 1 --2- 172.21.15.84:0/2495472705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641615e0 0x7efc640b40a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efc640cf7d0 tx=0x7efc5c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92081944db47fe48 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.754+0000 7efc637fe640 1 -- 172.21.15.84:0/2495472705 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c02ca80 con 0x7efc641615e0 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.754+0000 7efc637fe640 1 -- 172.21.15.84:0/2495472705 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c02cbe0 con 0x7efc641615e0 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.754+0000 7efc637fe640 1 -- 172.21.15.84:0/2495472705 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c0343f0 con 0x7efc641615e0 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.754+0000 7efc69fdb640 1 -- 172.21.15.84:0/2495472705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641615e0 msgr2=0x7efc640b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.754+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2495472705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641615e0 0x7efc640b40a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efc640cf7d0 tx=0x7efc5c02bee0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.755+0000 7efc69fdb640 1 -- 172.21.15.84:0/2495472705 shutdown_connections 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.755+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2495472705 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641615e0 0x7efc640b40a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.755+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2495472705 >> v2:172.21.15.99:3300/0 conn(0x7efc641606b0 0x7efc6406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.755+0000 7efc69fdb640 1 -- 172.21.15.84:0/2495472705 >> 172.21.15.84:0/2495472705 conn(0x7efc640b1a80 msgr2=0x7efc640b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.755+0000 7efc69fdb640 1 -- 172.21.15.84:0/2495472705 shutdown_connections 2023-12-12T09:21:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.755+0000 7efc69fdb640 1 -- 172.21.15.84:0/2495472705 wait complete. 2023-12-12T09:21:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.756+0000 7efc69fdb640 1 Processor -- start 2023-12-12T09:21:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.756+0000 7efc69fdb640 1 -- start start 2023-12-12T09:21:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.757+0000 7efc69fdb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641602d0 0x7efc640c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.757+0000 7efc69fdb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc641606b0 0x7efc6415b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.757+0000 7efc69fdb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc641615e0 0x7efc6415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.757+0000 7efc69fdb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6415cbf0 con 0x7efc641602d0 2023-12-12T09:21:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.757+0000 7efc69fdb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc641f2d00 con 0x7efc641615e0 2023-12-12T09:21:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.757+0000 7efc69fdb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6415bf70 con 0x7efc641606b0 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641602d0 0x7efc640c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641602d0 0x7efc640c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57460/0 (socket says 172.21.15.84:57460) 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 -- 172.21.15.84:0/2198207511 learned_addr learned my addr 172.21.15.84:0/2198207511 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc63fff640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc641606b0 0x7efc6415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc697da640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc641615e0 0x7efc6415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 -- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc641606b0 msgr2=0x7efc6415b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc641606b0 0x7efc6415b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 -- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc641615e0 msgr2=0x7efc6415b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc641615e0 0x7efc6415b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 -- 172.21.15.84:0/2198207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c009b30 con 0x7efc641602d0 2023-12-12T09:21:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc697da640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc641615e0 0x7efc6415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.758+0000 7efc68fd9640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641602d0 0x7efc640c7b90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c410 tx=0x7efc5800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.759+0000 7efc617fa640 1 -- 172.21.15.84:0/2198207511 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc580035f0 con 0x7efc641602d0 2023-12-12T09:21:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.759+0000 7efc617fa640 1 -- 172.21.15.84:0/2198207511 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58003750 con 0x7efc641602d0 2023-12-12T09:21:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.759+0000 7efc617fa640 1 -- 172.21.15.84:0/2198207511 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58003b40 con 0x7efc641602d0 2023-12-12T09:21:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.759+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6415c250 con 0x7efc641602d0 2023-12-12T09:21:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.759+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6415c810 con 0x7efc641602d0 2023-12-12T09:21:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.760+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6415cd30 con 0x7efc641602d0 2023-12-12T09:21:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.761+0000 7efc617fa640 1 -- 172.21.15.84:0/2198207511 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc58003ca0 con 0x7efc641602d0 2023-12-12T09:21:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.762+0000 7efc617fa640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc4806ae40 0x7efc4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.762+0000 7efc617fa640 1 -- 172.21.15.84:0/2198207511 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efc58088ba0 con 0x7efc641602d0 2023-12-12T09:21:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.762+0000 7efc63fff640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc4806ae40 0x7efc4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.763+0000 7efc63fff640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc4806ae40 0x7efc4806d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efc50006fd0 tx=0x7efc50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.767+0000 7efc617fa640 1 -- 172.21.15.84:0/2198207511 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc58053880 con 0x7efc641602d0 2023-12-12T09:21:10.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.941+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc6404e840 con 0x7efc641602d0 2023-12-12T09:21:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.942+0000 7efc617fa640 1 -- 172.21.15.84:0/2198207511 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc58056ea0 con 0x7efc641602d0 2023-12-12T09:21:10.944 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc4806ae40 msgr2=0x7efc4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc4806ae40 0x7efc4806d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efc50006fd0 tx=0x7efc50008040 comp rx=0 tx=0).stop 2023-12-12T09:21:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641602d0 msgr2=0x7efc640c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641602d0 0x7efc640c7b90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c410 tx=0x7efc5800c8d0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 shutdown_connections 2023-12-12T09:21:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc641615e0 0x7efc6415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc641606b0 0x7efc6415b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc4806ae40 0x7efc4806d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 --2- 172.21.15.84:0/2198207511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc641602d0 0x7efc640c7b90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 >> 172.21.15.84:0/2198207511 conn(0x7efc640b1a80 msgr2=0x7efc640cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 shutdown_connections 2023-12-12T09:21:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:10.945+0000 7efc69fdb640 1 -- 172.21.15.84:0/2198207511 wait complete. 2023-12-12T09:21:10.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:21:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.169+0000 7f7453fc5640 1 Processor -- start 2023-12-12T09:21:11.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.170+0000 7f7453fc5640 1 -- start start 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.171+0000 7f7453fc5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f744c143d20 0x7f744c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.171+0000 7f7453fc5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f744c0ce550 0x7f744c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.171+0000 7f7453fc5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c0cea30 con 0x7f744c1447f0 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.171+0000 7f7453fc5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c0702b0 con 0x7f744c143d20 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.171+0000 7f7453fc5640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c070590 con 0x7f744c0ce550 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7451d61640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f744c143d20 0x7f744c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7452562640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f744c1447f0 0x7f744c15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53704/0 (socket says 172.21.15.84:53704) 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7452562640 1 -- 172.21.15.84:0/2211775280 learned_addr learned my addr 172.21.15.84:0/2211775280 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7451560640 1 --2- 172.21.15.84:0/2211775280 >> v2:172.21.15.99:3300/0 conn(0x7f744c0ce550 0x7f744c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7451d61640 1 -- 172.21.15.84:0/2211775280 >> v2:172.21.15.99:3300/0 conn(0x7f744c0ce550 msgr2=0x7f744c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7451d61640 1 --2- 172.21.15.84:0/2211775280 >> v2:172.21.15.99:3300/0 conn(0x7f744c0ce550 0x7f744c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7451d61640 1 -- 172.21.15.84:0/2211775280 >> v1:172.21.15.84:6789/0 conn(0x7f744c1447f0 legacy=0x7f744c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7451d61640 1 -- 172.21.15.84:0/2211775280 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c070870 con 0x7f744c143d20 2023-12-12T09:21:11.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.172+0000 7f7450d5f640 1 -- 172.21.15.84:0/2211775280 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326343202 0 0) 0x7f744c0cea30 con 0x7f744c1447f0 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.173+0000 7f7451d61640 1 --2- 172.21.15.84:0/2211775280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c143d20 0x7f744c0b40d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f744c06be30 tx=0x7f743c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967bec41e9ba76fb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7450d5f640 1 -- 172.21.15.84:0/2211775280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c02cc80 con 0x7f744c143d20 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7450d5f640 1 -- 172.21.15.84:0/2211775280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c02cde0 con 0x7f744c143d20 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7450d5f640 1 -- 172.21.15.84:0/2211775280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c034660 con 0x7f744c143d20 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7453fc5640 1 -- 172.21.15.84:0/2211775280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c143d20 msgr2=0x7f744c0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7453fc5640 1 --2- 172.21.15.84:0/2211775280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c143d20 0x7f744c0b40d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f744c06be30 tx=0x7f743c02bed0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7453fc5640 1 -- 172.21.15.84:0/2211775280 shutdown_connections 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7453fc5640 1 --2- 172.21.15.84:0/2211775280 >> v2:172.21.15.99:3300/0 conn(0x7f744c0ce550 0x7f744c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7453fc5640 1 --2- 172.21.15.84:0/2211775280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c143d20 0x7f744c0b40d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7453fc5640 1 -- 172.21.15.84:0/2211775280 >> 172.21.15.84:0/2211775280 conn(0x7f744c06c3d0 msgr2=0x7f744c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7453fc5640 1 -- 172.21.15.84:0/2211775280 shutdown_connections 2023-12-12T09:21:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.174+0000 7f7453fc5640 1 -- 172.21.15.84:0/2211775280 wait complete. 2023-12-12T09:21:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.176+0000 7f7453fc5640 1 Processor -- start 2023-12-12T09:21:11.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.176+0000 7f7453fc5640 1 -- start start 2023-12-12T09:21:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.177+0000 7f7453fc5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c0ce550 0x7f744c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.177+0000 7f7453fc5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f744c143d20 0x7f744c1ec950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.177+0000 7f7453fc5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f744c1447f0 0x7f744c1f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.177+0000 7f7453fc5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c1f70a0 con 0x7f744c0ce550 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.177+0000 7f7453fc5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c13e000 con 0x7f744c143d20 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.177+0000 7f7453fc5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c13e8a0 con 0x7f744c1447f0 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451d61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c0ce550 0x7f744c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451d61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c0ce550 0x7f744c0ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57480/0 (socket says 172.21.15.84:57480) 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451d61640 1 -- 172.21.15.84:0/3233087376 learned_addr learned my addr 172.21.15.84:0/3233087376 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451560640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f744c143d20 0x7f744c1ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7452562640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f744c1447f0 0x7f744c1f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451d61640 1 -- 172.21.15.84:0/3233087376 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f744c1447f0 msgr2=0x7f744c1f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451d61640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f744c1447f0 0x7f744c1f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451d61640 1 -- 172.21.15.84:0/3233087376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f744c143d20 msgr2=0x7f744c1ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451d61640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f744c143d20 0x7f744c1ec950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.178+0000 7f7451d61640 1 -- 172.21.15.84:0/3233087376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c009a70 con 0x7f744c0ce550 2023-12-12T09:21:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.179+0000 7f7451d61640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c0ce550 0x7f744c0ccd70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f743c009e80 tx=0x7f743c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.179+0000 7f744a7fc640 1 -- 172.21.15.84:0/3233087376 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c03e610 con 0x7f744c0ce550 2023-12-12T09:21:11.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.179+0000 7f744a7fc640 1 -- 172.21.15.84:0/3233087376 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c03e7b0 con 0x7f744c0ce550 2023-12-12T09:21:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.179+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c0cd2b0 con 0x7f744c0ce550 2023-12-12T09:21:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.179+0000 7f744a7fc640 1 -- 172.21.15.84:0/3233087376 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c03eb60 con 0x7f744c0ce550 2023-12-12T09:21:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.179+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c13e250 con 0x7f744c0ce550 2023-12-12T09:21:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.180+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c0673c0 con 0x7f744c0ce550 2023-12-12T09:21:11.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.181+0000 7f744a7fc640 1 -- 172.21.15.84:0/3233087376 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f743c03b050 con 0x7f744c0ce550 2023-12-12T09:21:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.183+0000 7f744a7fc640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f743806ae40 0x7f743806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.183+0000 7f744a7fc640 1 -- 172.21.15.84:0/3233087376 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f743c0ac330 con 0x7f744c0ce550 2023-12-12T09:21:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.183+0000 7f7451560640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f743806ae40 0x7f743806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.183+0000 7f7451560640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f743806ae40 0x7f743806d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f744c1f7250 tx=0x7f7440008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:11.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.187+0000 7f744a7fc640 1 -- 172.21.15.84:0/3233087376 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f743c077020 con 0x7f744c0ce550 2023-12-12T09:21:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.391+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f744c06e3b0 con 0x7f744c0ce550 2023-12-12T09:21:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.392+0000 7f744a7fc640 1 -- 172.21.15.84:0/3233087376 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f743c07a640 con 0x7f744c0ce550 2023-12-12T09:21:11.393 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:21:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f743806ae40 msgr2=0x7f743806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f743806ae40 0x7f743806d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f744c1f7250 tx=0x7f7440008040 comp rx=0 tx=0).stop 2023-12-12T09:21:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c0ce550 msgr2=0x7f744c0ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c0ce550 0x7f744c0ccd70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f743c009e80 tx=0x7f743c004a40 comp rx=0 tx=0).stop 2023-12-12T09:21:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 shutdown_connections 2023-12-12T09:21:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f744c1447f0 0x7f744c1f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f744c143d20 0x7f744c1ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f743806ae40 0x7f743806d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 --2- 172.21.15.84:0/3233087376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f744c0ce550 0x7f744c0ccd70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 >> 172.21.15.84:0/3233087376 conn(0x7f744c06c3d0 msgr2=0x7f744c139320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 shutdown_connections 2023-12-12T09:21:11.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.396+0000 7f7453fc5640 1 -- 172.21.15.84:0/3233087376 wait complete. 2023-12-12T09:21:11.415 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2023-12-12T09:21:11.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:11.415 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-12T09:21:11.521 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:21:11.521 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:21:11.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:11.521 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-12T09:21:11.575 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-12T09:21:11.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:21:11.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.792+0000 7f2b2c93b640 1 Processor -- start 2023-12-12T09:21:11.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.792+0000 7f2b2c93b640 1 -- start start 2023-12-12T09:21:11.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.793+0000 7f2b2c93b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b2806de80 0x7f2b2815f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.793+0000 7f2b2c93b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2806e2e0 con 0x7f2b280705b0 2023-12-12T09:21:11.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.793+0000 7f2b2c93b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b28144b20 con 0x7f2b28144740 2023-12-12T09:21:11.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.793+0000 7f2b2c93b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2806d670 con 0x7f2b2806de80 2023-12-12T09:21:11.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.794+0000 7f2b2759e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b280705b0 0x7f2b28070a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53710/0 (socket says 172.21.15.84:53710) 2023-12-12T09:21:11.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.794+0000 7f2b2759e640 1 -- 172.21.15.84:0/2007497123 learned_addr learned my addr 172.21.15.84:0/2007497123 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.794+0000 7f2b2659c640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b2806de80 0x7f2b2815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.794+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286376991 0 0) 0x7f2b20001490 con 0x7f2b280705b0 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.794+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b14003520 con 0x7f2b280705b0 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332691790 0 0) 0x7f2b14003520 con 0x7f2b280705b0 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b2806de80 msgr2=0x7f2b2815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b2806de80 0x7f2b2815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 >> v1:172.21.15.99:6789/0 conn(0x7f2b28144740 legacy=0x7f2b2815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2806cdd0 con 0x7f2b280705b0 2023-12-12T09:21:11.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2b20001b80 con 0x7f2b280705b0 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 >> v1:172.21.15.84:6789/0 conn(0x7f2b280705b0 legacy=0x7f2b28070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b2806de80 0x7f2b140039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b14004d00 0x7f2b14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2806d670 con 0x7f2b14004020 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1400bbc0 con 0x7f2b14004d00 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1400bd80 con 0x7f2b2806de80 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b2659c640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b2659c640 1 -- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b2806de80 msgr2=0x7f2b140039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b2659c640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b2806de80 0x7f2b140039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b2659c640 1 -- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b14004d00 msgr2=0x7f2b14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.795+0000 7f2b2659c640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b14004d00 0x7f2b14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.796+0000 7f2b2659c640 1 -- 172.21.15.84:0/2007497123 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b14003520 con 0x7f2b14004020 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b2659c640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b140047c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000ba30 tx=0x7f2b140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb986995185aed server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10032680 con 0x7f2b14004020 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b100327e0 con 0x7f2b14004020 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b25d9b640 1 -- 172.21.15.84:0/2007497123 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10032b70 con 0x7f2b14004020 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b2c93b640 1 -- 172.21.15.84:0/2007497123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 msgr2=0x7f2b140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b2c93b640 1 --2- 172.21.15.84:0/2007497123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b140047c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000ba30 tx=0x7f2b140057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b2759e640 1 -- 172.21.15.84:0/2007497123 reap_dead start 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b2c93b640 1 -- 172.21.15.84:0/2007497123 shutdown_connections 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.797+0000 7f2b2c93b640 1 -- 172.21.15.84:0/2007497123 >> 172.21.15.84:0/2007497123 conn(0x7f2b280b07f0 msgr2=0x7f2b280b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.798+0000 7f2b2c93b640 1 -- 172.21.15.84:0/2007497123 shutdown_connections 2023-12-12T09:21:11.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.798+0000 7f2b2c93b640 1 -- 172.21.15.84:0/2007497123 wait complete. 2023-12-12T09:21:11.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.799+0000 7f2b2c93b640 1 Processor -- start 2023-12-12T09:21:11.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.800+0000 7f2b2c93b640 1 -- start start 2023-12-12T09:21:11.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.800+0000 7f2b2c93b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b28153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b2c93b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b281540a0 0x7f2b28156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b2c93b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b280b2c00 0x7f2b280b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b2c93b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280b1bf0 con 0x7f2b14004020 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b2c93b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280b2770 con 0x7f2b281540a0 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b2c93b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280b1e40 con 0x7f2b280b2c00 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b26d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b28153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b26d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b28153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57490/0 (socket says 172.21.15.84:57490) 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b26d9d640 1 -- 172.21.15.84:0/302322742 learned_addr learned my addr 172.21.15.84:0/302322742 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b2659c640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b281540a0 0x7f2b28156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b2759e640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b280b2c00 0x7f2b280b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b26d9d640 1 -- 172.21.15.84:0/302322742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b280b2c00 msgr2=0x7f2b280b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b26d9d640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b280b2c00 0x7f2b280b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b26d9d640 1 -- 172.21.15.84:0/302322742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b281540a0 msgr2=0x7f2b28156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b26d9d640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b281540a0 0x7f2b28156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:11.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.801+0000 7f2b26d9d640 1 -- 172.21.15.84:0/302322742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280b2120 con 0x7f2b14004020 2023-12-12T09:21:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.802+0000 7f2b26d9d640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b28153610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800c530 tx=0x7f2b1800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.802+0000 7f2b1f7fe640 1 -- 172.21.15.84:0/302322742 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180052d0 con 0x7f2b14004020 2023-12-12T09:21:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.802+0000 7f2b1f7fe640 1 -- 172.21.15.84:0/302322742 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18005430 con 0x7f2b14004020 2023-12-12T09:21:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.802+0000 7f2b1f7fe640 1 -- 172.21.15.84:0/302322742 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18012870 con 0x7f2b14004020 2023-12-12T09:21:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.802+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b280b2400 con 0x7f2b14004020 2023-12-12T09:21:11.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.802+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b28156ba0 con 0x7f2b14004020 2023-12-12T09:21:11.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.803+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b280673c0 con 0x7f2b14004020 2023-12-12T09:21:11.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.804+0000 7f2b1f7fe640 1 -- 172.21.15.84:0/302322742 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b180129d0 con 0x7f2b14004020 2023-12-12T09:21:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.805+0000 7f2b1f7fe640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0806ae70 0x7f2b0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.806+0000 7f2b1f7fe640 1 -- 172.21.15.84:0/302322742 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b180896c0 con 0x7f2b14004020 2023-12-12T09:21:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.806+0000 7f2b2659c640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0806ae70 0x7f2b0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:11.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.806+0000 7f2b2659c640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0806ae70 0x7f2b0806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000ba00 tx=0x7f2b1003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:11.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:11.810+0000 7f2b1f7fe640 1 -- 172.21.15.84:0/302322742 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b18054280 con 0x7f2b14004020 2023-12-12T09:21:12.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.036+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b2815a880 con 0x7f2b14004020 2023-12-12T09:21:12.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.037+0000 7f2b1f7fe640 1 -- 172.21.15.84:0/302322742 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f2b180578a0 con 0x7f2b14004020 2023-12-12T09:21:12.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:12.038 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:20:07.638154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:21:12.039 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-12-12T09:21:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.039+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0806ae70 msgr2=0x7f2b0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.039+0000 7f2b2c93b640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0806ae70 0x7f2b0806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000ba00 tx=0x7f2b1003d040 comp rx=0 tx=0).stop 2023-12-12T09:21:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.039+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 msgr2=0x7f2b28153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.039+0000 7f2b2c93b640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b28153610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800c530 tx=0x7f2b1800c9f0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.040+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 shutdown_connections 2023-12-12T09:21:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.040+0000 7f2b2c93b640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b280b2c00 0x7f2b280b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.040+0000 7f2b2c93b640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b281540a0 0x7f2b28156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.040+0000 7f2b2c93b640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0806ae70 0x7f2b0806d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.040+0000 7f2b2c93b640 1 --2- 172.21.15.84:0/302322742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b14004020 0x7f2b28153610 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.040+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 >> 172.21.15.84:0/302322742 conn(0x7f2b280b07f0 msgr2=0x7f2b28140f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.040+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 shutdown_connections 2023-12-12T09:21:12.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.040+0000 7f2b2c93b640 1 -- 172.21.15.84:0/302322742 wait complete. 2023-12-12T09:21:12.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:12.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.275+0000 7f15d8776640 1 Processor -- start 2023-12-12T09:21:12.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.275+0000 7f15d8776640 1 -- start start 2023-12-12T09:21:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.276+0000 7f15d8776640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d0071bb0 0x7f15d0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.276+0000 7f15d8776640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f15d013dae0 0x7f15d013f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d8776640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d00724d0 con 0x7f15d00ce330 2023-12-12T09:21:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d8776640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d0140270 con 0x7f15d013dae0 2023-12-12T09:21:12.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d8776640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00cd850 con 0x7f15d0071bb0 2023-12-12T09:21:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d6d13640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f15d013dae0 0x7f15d013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d6d13640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f15d013dae0 0x7f15d013f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57500/0 (socket says 172.21.15.84:57500) 2023-12-12T09:21:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d6d13640 1 -- 172.21.15.84:0/2211797917 learned_addr learned my addr 172.21.15.84:0/2211797917 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d6512640 1 --2- 172.21.15.84:0/2211797917 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d0071bb0 0x7f15d0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d6d13640 1 -- 172.21.15.84:0/2211797917 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d0071bb0 msgr2=0x7f15d0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d6d13640 1 --2- 172.21.15.84:0/2211797917 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d0071bb0 0x7f15d0071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d6d13640 1 -- 172.21.15.84:0/2211797917 >> v1:172.21.15.99:6789/0 conn(0x7f15d00ce330 legacy=0x7f15d013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:12.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.277+0000 7f15d6d13640 1 -- 172.21.15.84:0/2211797917 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00cdb30 con 0x7f15d013dae0 2023-12-12T09:21:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.279+0000 7f15d6d13640 1 --2- 172.21.15.84:0/2211797917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013dae0 0x7f15d013f510 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009e50 tx=0x7f15c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f59176ea6fc3ee server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.279+0000 7f15d5510640 1 -- 172.21.15.84:0/2211797917 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c802ca70 con 0x7f15d013dae0 2023-12-12T09:21:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.279+0000 7f15d5510640 1 -- 172.21.15.84:0/2211797917 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c802cbd0 con 0x7f15d013dae0 2023-12-12T09:21:12.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.279+0000 7f15d5510640 1 -- 172.21.15.84:0/2211797917 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c80343f0 con 0x7f15d013dae0 2023-12-12T09:21:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.279+0000 7f15d8776640 1 -- 172.21.15.84:0/2211797917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013dae0 msgr2=0x7f15d013f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.279+0000 7f15d8776640 1 --2- 172.21.15.84:0/2211797917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013dae0 0x7f15d013f510 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009e50 tx=0x7f15c802bed0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.280+0000 7f15d8776640 1 -- 172.21.15.84:0/2211797917 shutdown_connections 2023-12-12T09:21:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.280+0000 7f15d8776640 1 --2- 172.21.15.84:0/2211797917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013dae0 0x7f15d013f510 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.280+0000 7f15d8776640 1 --2- 172.21.15.84:0/2211797917 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d0071bb0 0x7f15d0071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.280+0000 7f15d8776640 1 -- 172.21.15.84:0/2211797917 >> 172.21.15.84:0/2211797917 conn(0x7f15d006c3d0 msgr2=0x7f15d006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.280+0000 7f15d8776640 1 -- 172.21.15.84:0/2211797917 shutdown_connections 2023-12-12T09:21:12.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.280+0000 7f15d8776640 1 -- 172.21.15.84:0/2211797917 wait complete. 2023-12-12T09:21:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.281+0000 7f15d8776640 1 Processor -- start 2023-12-12T09:21:12.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.282+0000 7f15d8776640 1 -- start start 2023-12-12T09:21:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.282+0000 7f15d8776640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15d0071bb0 0x7f15d013a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.282+0000 7f15d8776640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d00ce330 0x7f15d00a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.282+0000 7f15d8776640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013bc50 0x7f15d00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d8776640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00ad1b0 con 0x7f15d013bc50 2023-12-12T09:21:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d8776640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00ac300 con 0x7f15d0071bb0 2023-12-12T09:21:12.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d8776640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00ac5a0 con 0x7f15d00ce330 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6d13640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013bc50 0x7f15d00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6d13640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013bc50 0x7f15d00b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57512/0 (socket says 172.21.15.84:57512) 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6d13640 1 -- 172.21.15.84:0/796734747 learned_addr learned my addr 172.21.15.84:0/796734747 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6512640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15d0071bb0 0x7f15d013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d5d11640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d00ce330 0x7f15d00a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6d13640 1 -- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d00ce330 msgr2=0x7f15d00a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6d13640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d00ce330 0x7f15d00a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6d13640 1 -- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15d0071bb0 msgr2=0x7f15d013a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6d13640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15d0071bb0 0x7f15d013a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6d13640 1 -- 172.21.15.84:0/796734747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8009b30 con 0x7f15d013bc50 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.283+0000 7f15d6512640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15d0071bb0 0x7f15d013a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.284+0000 7f15d6d13640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013bc50 0x7f15d00b42b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009e50 tx=0x7f15c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.284+0000 7f15c6ffd640 1 -- 172.21.15.84:0/796734747 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8009510 con 0x7f15d013bc50 2023-12-12T09:21:12.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.284+0000 7f15c6ffd640 1 -- 172.21.15.84:0/796734747 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c803e450 con 0x7f15d013bc50 2023-12-12T09:21:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.284+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00ac880 con 0x7f15d013bc50 2023-12-12T09:21:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.284+0000 7f15c6ffd640 1 -- 172.21.15.84:0/796734747 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c803e800 con 0x7f15d013bc50 2023-12-12T09:21:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.284+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d00ace40 con 0x7f15d013bc50 2023-12-12T09:21:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.285+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d00ad360 con 0x7f15d013bc50 2023-12-12T09:21:12.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.286+0000 7f15c6ffd640 1 -- 172.21.15.84:0/796734747 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15c803e960 con 0x7f15d013bc50 2023-12-12T09:21:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.287+0000 7f15c6ffd640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f15b406ae40 0x7f15b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.287+0000 7f15c6ffd640 1 -- 172.21.15.84:0/796734747 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15c80ac790 con 0x7f15d013bc50 2023-12-12T09:21:12.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.287+0000 7f15d6512640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f15b406ae40 0x7f15b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.288+0000 7f15d6512640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f15b406ae40 0x7f15b406d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f15cc006fd0 tx=0x7f15cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.292+0000 7f15c6ffd640 1 -- 172.21.15.84:0/796734747 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15d00ad360 con 0x7f15d013bc50 2023-12-12T09:21:12.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.485+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15d00673c0 con 0x7f15d013bc50 2023-12-12T09:21:12.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.487+0000 7f15c6ffd640 1 -- 172.21.15.84:0/796734747 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f15c8077460 con 0x7f15d013bc50 2023-12-12T09:21:12.489 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:12.489 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:12.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f15b406ae40 msgr2=0x7f15b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f15b406ae40 0x7f15b406d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f15cc006fd0 tx=0x7f15cc008040 comp rx=0 tx=0).stop 2023-12-12T09:21:12.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013bc50 msgr2=0x7f15d00b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013bc50 0x7f15d00b42b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009e50 tx=0x7f15c8004a40 comp rx=0 tx=0).stop 2023-12-12T09:21:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 shutdown_connections 2023-12-12T09:21:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f15b406ae40 0x7f15b406d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15d013bc50 0x7f15d00b42b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f15d00ce330 0x7f15d00a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 --2- 172.21.15.84:0/796734747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15d0071bb0 0x7f15d013a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 >> 172.21.15.84:0/796734747 conn(0x7f15d006c3d0 msgr2=0x7f15d006da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 shutdown_connections 2023-12-12T09:21:12.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.490+0000 7f15d8776640 1 -- 172.21.15.84:0/796734747 wait complete. 2023-12-12T09:21:12.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:19:39.409918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:19:40.582144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T09:19:44.192068+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T09:21:12.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:21:12.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.712+0000 7f2b4bb1d640 1 Processor -- start 2023-12-12T09:21:12.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.712+0000 7f2b4bb1d640 1 -- start start 2023-12-12T09:21:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.714+0000 7f2b4bb1d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b4406d430 0x7f2b4406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.714+0000 7f2b4bb1d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b440b1dc0 0x7f2b440b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.714+0000 7f2b4bb1d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b44071c00 con 0x7f2b44143860 2023-12-12T09:21:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.714+0000 7f2b4bb1d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4406ddb0 con 0x7f2b4406d430 2023-12-12T09:21:12.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.714+0000 7f2b4bb1d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44143c40 con 0x7f2b440b1dc0 2023-12-12T09:21:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.714+0000 7f2b490b8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b4406d430 0x7f2b4406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.714+0000 7f2b490b8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b4406d430 0x7f2b4406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57522/0 (socket says 172.21.15.84:57522) 2023-12-12T09:21:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.714+0000 7f2b490b8640 1 -- 172.21.15.84:0/811260365 learned_addr learned my addr 172.21.15.84:0/811260365 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.715+0000 7f2b490b8640 1 -- 172.21.15.84:0/811260365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b440b1dc0 msgr2=0x7f2b440b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.715+0000 7f2b4a0ba640 1 --2- 172.21.15.84:0/811260365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b440b1dc0 0x7f2b440b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.715+0000 7f2b490b8640 1 --2- 172.21.15.84:0/811260365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b440b1dc0 0x7f2b440b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.715+0000 7f2b490b8640 1 -- 172.21.15.84:0/811260365 >> v1:172.21.15.99:6789/0 conn(0x7f2b44143860 legacy=0x7f2b440b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.715+0000 7f2b490b8640 1 -- 172.21.15.84:0/811260365 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440b4780 con 0x7f2b4406d430 2023-12-12T09:21:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.716+0000 7f2b490b8640 1 --2- 172.21.15.84:0/811260365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b4406d870 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009870 tx=0x7f2b3002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cde5e7222d6387 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:12.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.716+0000 7f2b488b7640 1 -- 172.21.15.84:0/811260365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30031740 con 0x7f2b4406d430 2023-12-12T09:21:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.716+0000 7f2b488b7640 1 -- 172.21.15.84:0/811260365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b300318a0 con 0x7f2b4406d430 2023-12-12T09:21:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.716+0000 7f2b488b7640 1 -- 172.21.15.84:0/811260365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30031c30 con 0x7f2b4406d430 2023-12-12T09:21:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.717+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/811260365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 msgr2=0x7f2b4406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.717+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/811260365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b4406d870 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009870 tx=0x7f2b3002b7e0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.717+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/811260365 shutdown_connections 2023-12-12T09:21:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.717+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/811260365 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b440b1dc0 0x7f2b440b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.717+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/811260365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b4406d870 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.717+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/811260365 >> 172.21.15.84:0/811260365 conn(0x7f2b440b0ac0 msgr2=0x7f2b440b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.717+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/811260365 shutdown_connections 2023-12-12T09:21:12.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.717+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/811260365 wait complete. 2023-12-12T09:21:12.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.719+0000 7f2b4bb1d640 1 Processor -- start 2023-12-12T09:21:12.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.719+0000 7f2b4bb1d640 1 -- start start 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b4bb1d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b44138940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b4bb1d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b440b1dc0 0x7f2b44141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b4bb1d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b44143860 0x7f2b44142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b4bb1d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ac890 con 0x7f2b4406d430 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b4bb1d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44142920 con 0x7f2b440b1dc0 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b4bb1d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44142c00 con 0x7f2b44143860 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b498b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b44138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b498b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b44138940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57524/0 (socket says 172.21.15.84:57524) 2023-12-12T09:21:12.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.720+0000 7f2b498b9640 1 -- 172.21.15.84:0/3558414921 learned_addr learned my addr 172.21.15.84:0/3558414921 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:12.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b498b9640 1 -- 172.21.15.84:0/3558414921 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b44143860 msgr2=0x7f2b44142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b498b9640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b44143860 0x7f2b44142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b498b9640 1 -- 172.21.15.84:0/3558414921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b440b1dc0 msgr2=0x7f2b44141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b498b9640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b440b1dc0 0x7f2b44141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b498b9640 1 -- 172.21.15.84:0/3558414921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b300094d0 con 0x7f2b4406d430 2023-12-12T09:21:12.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b498b9640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b44138940 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c7c0 tx=0x7f2b3800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:12.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b427fc640 1 -- 172.21.15.84:0/3558414921 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3800aa50 con 0x7f2b4406d430 2023-12-12T09:21:12.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b427fc640 1 -- 172.21.15.84:0/3558414921 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3800abb0 con 0x7f2b4406d430 2023-12-12T09:21:12.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b44142ee0 con 0x7f2b4406d430 2023-12-12T09:21:12.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.721+0000 7f2b427fc640 1 -- 172.21.15.84:0/3558414921 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38012420 con 0x7f2b4406d430 2023-12-12T09:21:12.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.722+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4413f460 con 0x7f2b4406d430 2023-12-12T09:21:12.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.723+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b440acd20 con 0x7f2b4406d430 2023-12-12T09:21:12.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.723+0000 7f2b427fc640 1 -- 172.21.15.84:0/3558414921 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b38012580 con 0x7f2b4406d430 2023-12-12T09:21:12.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.724+0000 7f2b427fc640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b2806ae40 0x7f2b2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:12.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.724+0000 7f2b427fc640 1 -- 172.21.15.84:0/3558414921 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b38089a10 con 0x7f2b4406d430 2023-12-12T09:21:12.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.725+0000 7f2b490b8640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b2806ae40 0x7f2b2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:12.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.725+0000 7f2b490b8640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b2806ae40 0x7f2b2806d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b30035000 tx=0x7f2b30030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:12.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.729+0000 7f2b427fc640 1 -- 172.21.15.84:0/3558414921 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b38054660 con 0x7f2b4406d430 2023-12-12T09:21:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.918+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b440673c0 con 0x7f2b4406d430 2023-12-12T09:21:12.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.919+0000 7f2b427fc640 1 -- 172.21.15.84:0/3558414921 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b38057c80 con 0x7f2b4406d430 2023-12-12T09:21:12.921 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:21:12.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b2806ae40 msgr2=0x7f2b2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b2806ae40 0x7f2b2806d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2b30035000 tx=0x7f2b30030000 comp rx=0 tx=0).stop 2023-12-12T09:21:12.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 msgr2=0x7f2b44138940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:12.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b44138940 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c7c0 tx=0x7f2b3800cc80 comp rx=0 tx=0).stop 2023-12-12T09:21:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 shutdown_connections 2023-12-12T09:21:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b44143860 0x7f2b44142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b440b1dc0 0x7f2b44141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b2806ae40 0x7f2b2806d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 --2- 172.21.15.84:0/3558414921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b4406d430 0x7f2b44138940 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 >> 172.21.15.84:0/3558414921 conn(0x7f2b440b0ac0 msgr2=0x7f2b4415ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 shutdown_connections 2023-12-12T09:21:12.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:12.922+0000 7f2b4bb1d640 1 -- 172.21.15.84:0/3558414921 wait complete. 2023-12-12T09:21:12.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:21:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.147+0000 7f1ae1fa9640 1 Processor -- start 2023-12-12T09:21:13.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.147+0000 7f1ae1fa9640 1 -- start start 2023-12-12T09:21:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.148+0000 7f1ae1fa9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1adc0709b0 0x7f1adc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.149+0000 7f1ae1fa9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc0b21e0 con 0x7f1adc0abd50 2023-12-12T09:21:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.149+0000 7f1ae1fa9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc0b24c0 con 0x7f1adc0b3990 2023-12-12T09:21:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.149+0000 7f1ae1fa9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1adc159a60 con 0x7f1adc0709b0 2023-12-12T09:21:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.149+0000 7f1adb7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1adc0709b0 0x7f1adc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.149+0000 7f1ad3fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1adc0abd50 0x7f1adc0b3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53722/0 (socket says 172.21.15.84:53722) 2023-12-12T09:21:13.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.149+0000 7f1ad3fff640 1 -- 172.21.15.84:0/2843706005 learned_addr learned my addr 172.21.15.84:0/2843706005 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.149+0000 7f1adb7fe640 1 -- 172.21.15.84:0/2843706005 >> v1:172.21.15.99:6789/0 conn(0x7f1adc0b3990 legacy=0x7f1adc06cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.150+0000 7f1adb7fe640 1 -- 172.21.15.84:0/2843706005 >> v1:172.21.15.84:6789/0 conn(0x7f1adc0abd50 legacy=0x7f1adc0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.150+0000 7f1adb7fe640 1 -- 172.21.15.84:0/2843706005 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0b27a0 con 0x7f1adc0709b0 2023-12-12T09:21:13.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.150+0000 7f1adaffd640 1 -- 172.21.15.84:0/2843706005 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164503003 0 0) 0x7f1adc0b21e0 con 0x7f1adc0abd50 2023-12-12T09:21:13.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.151+0000 7f1adb7fe640 1 --2- 172.21.15.84:0/2843706005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0709b0 0x7f1adc0b1c00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097a0 tx=0x7f1acc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fa40b17573369b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:13.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.151+0000 7f1adaffd640 1 -- 172.21.15.84:0/2843706005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc031830 con 0x7f1adc0709b0 2023-12-12T09:21:13.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.151+0000 7f1adaffd640 1 -- 172.21.15.84:0/2843706005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc031990 con 0x7f1adc0709b0 2023-12-12T09:21:13.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.151+0000 7f1adaffd640 1 -- 172.21.15.84:0/2843706005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc031d20 con 0x7f1adc0709b0 2023-12-12T09:21:13.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.152+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/2843706005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0709b0 msgr2=0x7f1adc0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.152+0000 7f1ae1fa9640 1 --2- 172.21.15.84:0/2843706005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0709b0 0x7f1adc0b1c00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0097a0 tx=0x7f1acc02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.152+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/2843706005 shutdown_connections 2023-12-12T09:21:13.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.152+0000 7f1ae1fa9640 1 --2- 172.21.15.84:0/2843706005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0709b0 0x7f1adc0b1c00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.152+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/2843706005 >> 172.21.15.84:0/2843706005 conn(0x7f1adc0b0900 msgr2=0x7f1adc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:13.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.152+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/2843706005 shutdown_connections 2023-12-12T09:21:13.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.152+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/2843706005 wait complete. 2023-12-12T09:21:13.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.154+0000 7f1ae1fa9640 1 Processor -- start 2023-12-12T09:21:13.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.154+0000 7f1ae1fa9640 1 -- start start 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1ae1fa9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1adc0709b0 0x7f1adc0cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1ae1fa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1adc0abd50 0x7f1adc14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1ae1fa9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0b3990 0x7f1adc159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1ae1fa9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1532b0 con 0x7f1adc0b3990 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1ae1fa9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc152ca0 con 0x7f1adc0709b0 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1ae1fa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc15a560 con 0x7f1adc0abd50 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1adbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0b3990 0x7f1adc159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1adbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0b3990 0x7f1adc159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57548/0 (socket says 172.21.15.84:57548) 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1adbfff640 1 -- 172.21.15.84:0/654419262 learned_addr learned my addr 172.21.15.84:0/654419262 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1adbfff640 1 -- 172.21.15.84:0/654419262 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1adc0abd50 msgr2=0x7f1adc14f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1adbfff640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1adc0abd50 0x7f1adc14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1adbfff640 1 -- 172.21.15.84:0/654419262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1adc0709b0 msgr2=0x7f1adc0cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1adbfff640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1adc0709b0 0x7f1adc0cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.155+0000 7f1adbfff640 1 -- 172.21.15.84:0/654419262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009400 con 0x7f1adc0b3990 2023-12-12T09:21:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.156+0000 7f1adbfff640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0b3990 0x7f1adc159ba0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400c780 tx=0x7f1ad400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.156+0000 7f1ad8ff9640 1 -- 172.21.15.84:0/654419262 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4003d80 con 0x7f1adc0b3990 2023-12-12T09:21:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.156+0000 7f1ad8ff9640 1 -- 172.21.15.84:0/654419262 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad400ce90 con 0x7f1adc0b3990 2023-12-12T09:21:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.156+0000 7f1ad8ff9640 1 -- 172.21.15.84:0/654419262 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40052b0 con 0x7f1adc0b3990 2023-12-12T09:21:13.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.156+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1adc152f40 con 0x7f1adc0b3990 2023-12-12T09:21:13.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.156+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc15a840 con 0x7f1adc0b3990 2023-12-12T09:21:13.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.157+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1adc0673c0 con 0x7f1adc0b3990 2023-12-12T09:21:13.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.158+0000 7f1ad8ff9640 1 -- 172.21.15.84:0/654419262 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ad4005410 con 0x7f1adc0b3990 2023-12-12T09:21:13.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.159+0000 7f1ad8ff9640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1abc06ae70 0x7f1abc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.159+0000 7f1ad8ff9640 1 -- 172.21.15.84:0/654419262 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1ad4088db0 con 0x7f1adc0b3990 2023-12-12T09:21:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.160+0000 7f1adb7fe640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1abc06ae70 0x7f1abc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.160+0000 7f1adb7fe640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1abc06ae70 0x7f1abc06d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1acc036000 tx=0x7f1acc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:13.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.164+0000 7f1ad8ff9640 1 -- 172.21.15.84:0/654419262 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ad408d070 con 0x7f1adc0b3990 2023-12-12T09:21:13.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.355+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1adc1533f0 con 0x7f1adc0b3990 2023-12-12T09:21:13.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.356+0000 7f1ad8ff9640 1 -- 172.21.15.84:0/654419262 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ad4053a00 con 0x7f1adc0b3990 2023-12-12T09:21:13.358 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:13.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1abc06ae70 msgr2=0x7f1abc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1abc06ae70 0x7f1abc06d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1acc036000 tx=0x7f1acc030000 comp rx=0 tx=0).stop 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0b3990 msgr2=0x7f1adc159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0b3990 0x7f1adc159ba0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400c780 tx=0x7f1ad400cc40 comp rx=0 tx=0).stop 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 shutdown_connections 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1abc06ae70 0x7f1abc06d330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1adc0b3990 0x7f1adc159ba0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1adc0abd50 0x7f1adc14f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 --2- 172.21.15.84:0/654419262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1adc0709b0 0x7f1adc0cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 >> 172.21.15.84:0/654419262 conn(0x7f1adc0b0900 msgr2=0x7f1adc06d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 shutdown_connections 2023-12-12T09:21:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.359+0000 7f1ae1fa9640 1 -- 172.21.15.84:0/654419262 wait complete. 2023-12-12T09:21:13.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:21:13.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.595+0000 7ff048256640 1 Processor -- start 2023-12-12T09:21:13.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.595+0000 7ff048256640 1 -- start start 2023-12-12T09:21:13.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.597+0000 7ff048256640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015d460 0x7ff0400b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.597+0000 7ff048256640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0400cfbc0 0x7ff040099a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.597+0000 7ff048256640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400cbb10 con 0x7ff040099f60 2023-12-12T09:21:13.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.597+0000 7ff048256640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04009a410 con 0x7ff0400cfbc0 2023-12-12T09:21:13.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.597+0000 7ff048256640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400d00c0 con 0x7ff04015d460 2023-12-12T09:21:13.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.597+0000 7ff0467f3640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff040099f60 0x7ff04006b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53728/0 (socket says 172.21.15.84:53728) 2023-12-12T09:21:13.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.597+0000 7ff0467f3640 1 -- 172.21.15.84:0/3217651082 learned_addr learned my addr 172.21.15.84:0/3217651082 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff0457f1640 1 --2- 172.21.15.84:0/3217651082 >> v2:172.21.15.99:3300/0 conn(0x7ff0400cfbc0 0x7ff040099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff045ff2640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015d460 0x7ff0400b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059164268 0 0) 0x7ff0400cbb10 con 0x7ff040099f60 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff02c003520 con 0x7ff040099f60 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1115151046 0 0) 0x7ff02c003520 con 0x7ff040099f60 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015d460 msgr2=0x7ff0400b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015d460 0x7ff0400b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 >> v2:172.21.15.99:3300/0 conn(0x7ff0400cfbc0 msgr2=0x7ff040099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 --2- 172.21.15.84:0/3217651082 >> v2:172.21.15.99:3300/0 conn(0x7ff0400cfbc0 0x7ff040099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400d03a0 con 0x7ff040099f60 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7ff0380019f0 con 0x7ff040099f60 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 >> v1:172.21.15.84:6789/0 conn(0x7ff040099f60 legacy=0x7ff04006b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c003970 0x7ff02c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.598+0000 7ff044ff0640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015d460 0x7ff02c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff044ff0640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff02c004d00 0x7ff02c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04009a410 con 0x7ff02c004d00 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400d00c0 con 0x7ff02c003970 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c00b9b0 con 0x7ff04015d460 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff0467f3640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff02c004d00 0x7ff02c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff045ff2640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c003970 0x7ff02c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff0467f3640 1 -- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015d460 msgr2=0x7ff02c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff0457f1640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015d460 0x7ff02c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff0467f3640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015d460 0x7ff02c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff0467f3640 1 -- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c003970 msgr2=0x7ff02c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff0467f3640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c003970 0x7ff02c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.599+0000 7ff0467f3640 1 -- 172.21.15.84:0/3217651082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c003520 con 0x7ff02c004d00 2023-12-12T09:21:13.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.600+0000 7ff0467f3640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff02c004d00 0x7ff02c005180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff03800a780 tx=0x7ff02c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a584ac4fbc893473 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:13.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.600+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038034630 con 0x7ff02c004d00 2023-12-12T09:21:13.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03802f070 con 0x7ff02c004d00 2023-12-12T09:21:13.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff044ff0640 1 -- 172.21.15.84:0/3217651082 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380349d0 con 0x7ff02c004d00 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff048256640 1 -- 172.21.15.84:0/3217651082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff02c004d00 msgr2=0x7ff02c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff048256640 1 --2- 172.21.15.84:0/3217651082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff02c004d00 0x7ff02c005180 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff03800a780 tx=0x7ff02c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff0467f3640 1 -- 172.21.15.84:0/3217651082 reap_dead start 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff048256640 1 -- 172.21.15.84:0/3217651082 shutdown_connections 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff048256640 1 -- 172.21.15.84:0/3217651082 >> 172.21.15.84:0/3217651082 conn(0x7ff0400b2960 msgr2=0x7ff0400b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff048256640 1 -- 172.21.15.84:0/3217651082 shutdown_connections 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.601+0000 7ff048256640 1 -- 172.21.15.84:0/3217651082 wait complete. 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.603+0000 7ff048256640 1 Processor -- start 2023-12-12T09:21:13.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.603+0000 7ff048256640 1 -- start start 2023-12-12T09:21:13.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff048256640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c004d00 0x7ff0401f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff048256640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0400c7460 0x7ff04006f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff048256640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015e960 0x7ff04015ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff048256640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400c7f40 con 0x7ff0400c7460 2023-12-12T09:21:13.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff048256640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401f6890 con 0x7ff02c004d00 2023-12-12T09:21:13.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff048256640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401f6b70 con 0x7ff04015e960 2023-12-12T09:21:13.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff0457f1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0400c7460 0x7ff04006f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff0457f1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0400c7460 0x7ff04006f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57552/0 (socket says 172.21.15.84:57552) 2023-12-12T09:21:13.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.604+0000 7ff0457f1640 1 -- 172.21.15.84:0/2607364567 learned_addr learned my addr 172.21.15.84:0/2607364567 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:13.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0457f1640 1 -- 172.21.15.84:0/2607364567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015e960 msgr2=0x7ff04015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0457f1640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015e960 0x7ff04015ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0457f1640 1 -- 172.21.15.84:0/2607364567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c004d00 msgr2=0x7ff0401f6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0457f1640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c004d00 0x7ff0401f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0457f1640 1 -- 172.21.15.84:0/2607364567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0401f6e50 con 0x7ff0400c7460 2023-12-12T09:21:13.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0457f1640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0400c7460 0x7ff04006f010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff0300108e0 tx=0x7ff030010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:13.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0367fc640 1 -- 172.21.15.84:0/2607364567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03000eae0 con 0x7ff0400c7460 2023-12-12T09:21:13.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0367fc640 1 -- 172.21.15.84:0/2607364567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03000ec40 con 0x7ff0400c7460 2023-12-12T09:21:13.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff0367fc640 1 -- 172.21.15.84:0/2607364567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03001c400 con 0x7ff0400c7460 2023-12-12T09:21:13.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.605+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0400c81e0 con 0x7ff0400c7460 2023-12-12T09:21:13.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.606+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04006f550 con 0x7ff0400c7460 2023-12-12T09:21:13.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.607+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0400d1d20 con 0x7ff0400c7460 2023-12-12T09:21:13.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.608+0000 7ff0367fc640 1 -- 172.21.15.84:0/2607364567 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff03001c560 con 0x7ff0400c7460 2023-12-12T09:21:13.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.608+0000 7ff0367fc640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff02406ae70 0x7ff02406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:13.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.609+0000 7ff0367fc640 1 -- 172.21.15.84:0/2607364567 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff030089ff0 con 0x7ff0400c7460 2023-12-12T09:21:13.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.609+0000 7ff045ff2640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff02406ae70 0x7ff02406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:13.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.609+0000 7ff045ff2640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff02406ae70 0x7ff02406d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009950 tx=0x7ff03c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:13.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.613+0000 7ff0367fc640 1 -- 172.21.15.84:0/2607364567 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff030054d50 con 0x7ff0400c7460 2023-12-12T09:21:13.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.802+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0401f6fe0 con 0x7ff0400c7460 2023-12-12T09:21:13.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.803+0000 7ff0367fc640 1 -- 172.21.15.84:0/2607364567 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff030058370 con 0x7ff0400c7460 2023-12-12T09:21:13.805 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff02406ae70 msgr2=0x7ff02406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff02406ae70 0x7ff02406d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009950 tx=0x7ff03c008040 comp rx=0 tx=0).stop 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0400c7460 msgr2=0x7ff04006f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0400c7460 0x7ff04006f010 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff0300108e0 tx=0x7ff030010da0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 shutdown_connections 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff04015e960 0x7ff04015ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff02406ae70 0x7ff02406d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0400c7460 0x7ff04006f010 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 --2- 172.21.15.84:0/2607364567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff02c004d00 0x7ff0401f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.806+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 >> 172.21.15.84:0/2607364567 conn(0x7ff0400b2960 msgr2=0x7ff0400afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:13.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.807+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 shutdown_connections 2023-12-12T09:21:13.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:13.807+0000 7ff048256640 1 -- 172.21.15.84:0/2607364567 wait complete. 2023-12-12T09:21:13.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T09:21:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.033+0000 7fd65909f640 1 Processor -- start 2023-12-12T09:21:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.033+0000 7fd65909f640 1 -- start start 2023-12-12T09:21:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd65909f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd6540b47b0 0x7fd65406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd65909f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65406b180 con 0x7fd6541602d0 2023-12-12T09:21:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd65909f640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65406d9d0 con 0x7fd6541606b0 2023-12-12T09:21:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd65909f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65406abc0 con 0x7fd6540b47b0 2023-12-12T09:21:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd653fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd6541602d0 0x7fd6540acd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53742/0 (socket says 172.21.15.84:53742) 2023-12-12T09:21:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd653fff640 1 -- 172.21.15.84:0/2969569610 learned_addr learned my addr 172.21.15.84:0/2969569610 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd65889e640 1 --2- 172.21.15.84:0/2969569610 >> v2:172.21.15.99:3300/0 conn(0x7fd6540b47b0 0x7fd65406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114141788 0 0) 0x7fd65406b180 con 0x7fd6541602d0 2023-12-12T09:21:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.035+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd634003520 con 0x7fd6541602d0 2023-12-12T09:21:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 219441641 0 0) 0x7fd634003520 con 0x7fd6541602d0 2023-12-12T09:21:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 >> v2:172.21.15.99:3300/0 conn(0x7fd6540b47b0 msgr2=0x7fd65406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 --2- 172.21.15.84:0/2969569610 >> v2:172.21.15.99:3300/0 conn(0x7fd6540b47b0 0x7fd65406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 >> v1:172.21.15.99:6789/0 conn(0x7fd6541606b0 legacy=0x7fd6540b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65406aea0 con 0x7fd6541602d0 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fd644001670 con 0x7fd6541602d0 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 >> v1:172.21.15.84:6789/0 conn(0x7fd6541602d0 legacy=0x7fd6540acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd634003a30 0x7fd634003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd634004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6340051d0 0x7fd63400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65406abc0 con 0x7fd6340047c0 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63400c100 con 0x7fd6340051d0 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63400c2c0 con 0x7fd634003a30 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.036+0000 7fd64bfff640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd634004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.037+0000 7fd653fff640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd634003a30 0x7fd634003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.037+0000 7fd65889e640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6340051d0 0x7fd63400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.037+0000 7fd64bfff640 1 -- 172.21.15.84:0/2969569610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd634003a30 msgr2=0x7fd634003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:14.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.037+0000 7fd64bfff640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd634003a30 0x7fd634003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.037+0000 7fd64bfff640 1 -- 172.21.15.84:0/2969569610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6340051d0 msgr2=0x7fd63400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:14.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.037+0000 7fd64bfff640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6340051d0 0x7fd63400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.037+0000 7fd64bfff640 1 -- 172.21.15.84:0/2969569610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd634003520 con 0x7fd6340047c0 2023-12-12T09:21:14.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.037+0000 7fd65889e640 1 -- 172.21.15.84:0/2969569610 reap_dead start 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.038+0000 7fd64bfff640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd634004c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd6540b2770 tx=0x7fd6340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5b8cc9f582c237 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.038+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0052d0 con 0x7fd6340047c0 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c02e050 con 0x7fd6340047c0 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd6537fe640 1 -- 172.21.15.84:0/2969569610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c003830 con 0x7fd6340047c0 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd65909f640 1 -- 172.21.15.84:0/2969569610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 msgr2=0x7fd634004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd65909f640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd634004c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd6540b2770 tx=0x7fd6340057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd65909f640 1 -- 172.21.15.84:0/2969569610 shutdown_connections 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd65909f640 1 --2- 172.21.15.84:0/2969569610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd634004c40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd65909f640 1 -- 172.21.15.84:0/2969569610 >> 172.21.15.84:0/2969569610 conn(0x7fd6540b1a80 msgr2=0x7fd6540b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:14.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd65909f640 1 -- 172.21.15.84:0/2969569610 shutdown_connections 2023-12-12T09:21:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.039+0000 7fd65909f640 1 -- 172.21.15.84:0/2969569610 wait complete. 2023-12-12T09:21:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.041+0000 7fd65909f640 1 Processor -- start 2023-12-12T09:21:14.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.041+0000 7fd65909f640 1 -- start start 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd65909f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd654151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd65909f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6541e8150 0x7fd654157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd65909f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd654152380 0x7fd65415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd65909f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654157a70 con 0x7fd6340047c0 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd65909f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654158440 con 0x7fd6541e8150 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd65909f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6541e8680 con 0x7fd654152380 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd653fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd654151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd653fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd654151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57562/0 (socket says 172.21.15.84:57562) 2023-12-12T09:21:14.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.042+0000 7fd653fff640 1 -- 172.21.15.84:0/4127909991 learned_addr learned my addr 172.21.15.84:0/4127909991 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.043+0000 7fd653fff640 1 -- 172.21.15.84:0/4127909991 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd654152380 msgr2=0x7fd65415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.043+0000 7fd653fff640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd654152380 0x7fd65415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.043+0000 7fd653fff640 1 -- 172.21.15.84:0/4127909991 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6541e8150 msgr2=0x7fd654157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.043+0000 7fd653fff640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6541e8150 0x7fd654157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.043+0000 7fd653fff640 1 -- 172.21.15.84:0/4127909991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654157140 con 0x7fd6340047c0 2023-12-12T09:21:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.043+0000 7fd653fff640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd654151d10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd64400e730 tx=0x7fd64400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.043+0000 7fd6517fa640 1 -- 172.21.15.84:0/4127909991 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64400c640 con 0x7fd6340047c0 2023-12-12T09:21:14.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.044+0000 7fd6517fa640 1 -- 172.21.15.84:0/4127909991 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64400c7c0 con 0x7fd6340047c0 2023-12-12T09:21:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.044+0000 7fd6517fa640 1 -- 172.21.15.84:0/4127909991 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64400cb70 con 0x7fd6340047c0 2023-12-12T09:21:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.044+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd654157420 con 0x7fd6340047c0 2023-12-12T09:21:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.044+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654152a20 con 0x7fd6340047c0 2023-12-12T09:21:14.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.045+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6541e87f0 con 0x7fd6340047c0 2023-12-12T09:21:14.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.046+0000 7fd6517fa640 1 -- 172.21.15.84:0/4127909991 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd64400ccd0 con 0x7fd6340047c0 2023-12-12T09:21:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.047+0000 7fd6517fa640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd63806ae70 0x7fd63806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.047+0000 7fd6517fa640 1 -- 172.21.15.84:0/4127909991 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd6440897f0 con 0x7fd6340047c0 2023-12-12T09:21:14.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.047+0000 7fd64bfff640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd63806ae70 0x7fd63806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.048+0000 7fd64bfff640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd63806ae70 0x7fd63806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd63c033000 tx=0x7fd63c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.051+0000 7fd6517fa640 1 -- 172.21.15.84:0/4127909991 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6440544d0 con 0x7fd6340047c0 2023-12-12T09:21:14.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.245+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd654152bb0 con 0x7fd6340047c0 2023-12-12T09:21:14.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.246+0000 7fd6517fa640 1 -- 172.21.15.84:0/4127909991 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd644057af0 con 0x7fd6340047c0 2023-12-12T09:21:14.247 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.248+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd63806ae70 msgr2=0x7fd63806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.248+0000 7fd65909f640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd63806ae70 0x7fd63806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd63c033000 tx=0x7fd63c02f000 comp rx=0 tx=0).stop 2023-12-12T09:21:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.248+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 msgr2=0x7fd654151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.248+0000 7fd65909f640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd654151d10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd64400e730 tx=0x7fd64400ebf0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.249+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 shutdown_connections 2023-12-12T09:21:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.249+0000 7fd65909f640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd654152380 0x7fd65415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.249+0000 7fd65909f640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6541e8150 0x7fd654157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.249+0000 7fd65909f640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd63806ae70 0x7fd63806d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.249+0000 7fd65909f640 1 --2- 172.21.15.84:0/4127909991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6340047c0 0x7fd654151d10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.249+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 >> 172.21.15.84:0/4127909991 conn(0x7fd6540b1a80 msgr2=0x7fd6540b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:14.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.249+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 shutdown_connections 2023-12-12T09:21:14.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.249+0000 7fd65909f640 1 -- 172.21.15.84:0/4127909991 wait complete. 2023-12-12T09:21:14.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:21:14.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.480+0000 7f078359e640 1 Processor -- start 2023-12-12T09:21:14.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.480+0000 7f078359e640 1 -- start start 2023-12-12T09:21:14.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.481+0000 7f078359e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f078415d050 0x7f078406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.481+0000 7f078359e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f078406d1f0 0x7f078406de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.481+0000 7f078359e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078406c430 con 0x7f0784070800 2023-12-12T09:21:14.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.481+0000 7f078359e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0784071430 con 0x7f078406d1f0 2023-12-12T09:21:14.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.482+0000 7f078359e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078406c710 con 0x7f078415d050 2023-12-12T09:21:14.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.482+0000 7f077bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f078406d1f0 0x7f078406de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.482+0000 7f077bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f078406d1f0 0x7f078406de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57570/0 (socket says 172.21.15.84:57570) 2023-12-12T09:21:14.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.482+0000 7f077bfff640 1 -- 172.21.15.84:0/4189537725 learned_addr learned my addr 172.21.15.84:0/4189537725 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:14.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.482+0000 7f077bfff640 1 -- 172.21.15.84:0/4189537725 >> v2:172.21.15.99:3300/0 conn(0x7f078415d050 msgr2=0x7f078406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:14.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.482+0000 7f077bfff640 1 --2- 172.21.15.84:0/4189537725 >> v2:172.21.15.99:3300/0 conn(0x7f078415d050 0x7f078406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.482+0000 7f077bfff640 1 -- 172.21.15.84:0/4189537725 >> v1:172.21.15.99:6789/0 conn(0x7f0784070800 legacy=0x7f0784070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:14.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.482+0000 7f077bfff640 1 -- 172.21.15.84:0/4189537725 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078406c9f0 con 0x7f078406d1f0 2023-12-12T09:21:14.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.483+0000 7f077bfff640 1 --2- 172.21.15.84:0/4189537725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f078406de20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f078406b730 tx=0x7f076c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21a13467369bbd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.484+0000 7f0781d9b640 1 -- 172.21.15.84:0/4189537725 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c031870 con 0x7f078406d1f0 2023-12-12T09:21:14.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.484+0000 7f0781d9b640 1 -- 172.21.15.84:0/4189537725 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c0319d0 con 0x7f078406d1f0 2023-12-12T09:21:14.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.484+0000 7f0781d9b640 1 -- 172.21.15.84:0/4189537725 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c031d60 con 0x7f078406d1f0 2023-12-12T09:21:14.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.484+0000 7f078359e640 1 -- 172.21.15.84:0/4189537725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 msgr2=0x7f078406de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.484+0000 7f078359e640 1 --2- 172.21.15.84:0/4189537725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f078406de20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f078406b730 tx=0x7f076c02b910 comp rx=0 tx=0).stop 2023-12-12T09:21:14.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.484+0000 7f078359e640 1 -- 172.21.15.84:0/4189537725 shutdown_connections 2023-12-12T09:21:14.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.484+0000 7f078359e640 1 --2- 172.21.15.84:0/4189537725 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f078406de20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.484+0000 7f078359e640 1 --2- 172.21.15.84:0/4189537725 >> v2:172.21.15.99:3300/0 conn(0x7f078415d050 0x7f078406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.485+0000 7f078359e640 1 -- 172.21.15.84:0/4189537725 >> 172.21.15.84:0/4189537725 conn(0x7f07840b07f0 msgr2=0x7f07840b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:14.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.485+0000 7f078359e640 1 -- 172.21.15.84:0/4189537725 shutdown_connections 2023-12-12T09:21:14.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.485+0000 7f078359e640 1 -- 172.21.15.84:0/4189537725 wait complete. 2023-12-12T09:21:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.487+0000 7f078359e640 1 Processor -- start 2023-12-12T09:21:14.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.487+0000 7f078359e640 1 -- start start 2023-12-12T09:21:14.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f0784154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078359e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0784070800 0x7f0784144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f078415d050 0x7f0784156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078359e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07840c3c80 con 0x7f078406d1f0 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078359e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0784144750 con 0x7f078415d050 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078359e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0784145710 con 0x7f0784070800 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f0784154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f0784154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57582/0 (socket says 172.21.15.84:57582) 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078259c640 1 -- 172.21.15.84:0/1257804581 learned_addr learned my addr 172.21.15.84:0/1257804581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078259c640 1 -- 172.21.15.84:0/1257804581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0784070800 msgr2=0x7f0784144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078259c640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0784070800 0x7f0784144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078259c640 1 -- 172.21.15.84:0/1257804581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f078415d050 msgr2=0x7f0784156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078259c640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f078415d050 0x7f0784156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.488+0000 7f078259c640 1 -- 172.21.15.84:0/1257804581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0094d0 con 0x7f078406d1f0 2023-12-12T09:21:14.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.489+0000 7f078259c640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f0784154190 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f077400b440 tx=0x7f077400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.489+0000 7f077affd640 1 -- 172.21.15.84:0/1257804581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011890 con 0x7f078406d1f0 2023-12-12T09:21:14.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.489+0000 7f077affd640 1 -- 172.21.15.84:0/1257804581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07740119f0 con 0x7f078406d1f0 2023-12-12T09:21:14.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.489+0000 7f077affd640 1 -- 172.21.15.84:0/1257804581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011da0 con 0x7f078406d1f0 2023-12-12T09:21:14.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.489+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0784144b00 con 0x7f078406d1f0 2023-12-12T09:21:14.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.489+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07841450c0 con 0x7f078406d1f0 2023-12-12T09:21:14.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.490+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07840673c0 con 0x7f078406d1f0 2023-12-12T09:21:14.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.491+0000 7f077affd640 1 -- 172.21.15.84:0/1257804581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f077401a400 con 0x7f078406d1f0 2023-12-12T09:21:14.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.492+0000 7f077affd640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f076406ae40 0x7f076406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.492+0000 7f077affd640 1 -- 172.21.15.84:0/1257804581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0774089d10 con 0x7f078406d1f0 2023-12-12T09:21:14.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.492+0000 7f077bfff640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f076406ae40 0x7f076406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.493+0000 7f077bfff640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f076406ae40 0x7f076406d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f076c036000 tx=0x7f076c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.496+0000 7f077affd640 1 -- 172.21.15.84:0/1257804581 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0774054a90 con 0x7f078406d1f0 2023-12-12T09:21:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.723+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07840b1fe0 con 0x7f078406d1f0 2023-12-12T09:21:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.725+0000 7f077affd640 1 -- 172.21.15.84:0/1257804581 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f0774015020 con 0x7f078406d1f0 2023-12-12T09:21:14.726 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:14.726 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:20:07.638154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:21:14.727 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-12-12T09:21:14.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f076406ae40 msgr2=0x7f076406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f076406ae40 0x7f076406d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f076c036000 tx=0x7f076c030000 comp rx=0 tx=0).stop 2023-12-12T09:21:14.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 msgr2=0x7f0784154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f0784154190 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f077400b440 tx=0x7f077400b900 comp rx=0 tx=0).stop 2023-12-12T09:21:14.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 shutdown_connections 2023-12-12T09:21:14.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f078415d050 0x7f0784156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0784070800 0x7f0784144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f076406ae40 0x7f076406d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 --2- 172.21.15.84:0/1257804581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f078406d1f0 0x7f0784154190 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 >> 172.21.15.84:0/1257804581 conn(0x7f07840b07f0 msgr2=0x7f078406d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:14.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 shutdown_connections 2023-12-12T09:21:14.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.728+0000 7f078359e640 1 -- 172.21.15.84:0/1257804581 wait complete. 2023-12-12T09:21:14.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:14.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.961+0000 7f4afd9db640 1 Processor -- start 2023-12-12T09:21:14.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.961+0000 7f4afd9db640 1 -- start start 2023-12-12T09:21:14.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afd9db640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4af806e910 0x7f4af806f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afd9db640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806f6d0 0x7f4af80acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afd9db640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4af80ad2a0 0x7f4af80710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afd9db640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80af420 con 0x7f4af806e910 2023-12-12T09:21:14.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afd9db640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af806fb30 con 0x7f4af80ad2a0 2023-12-12T09:21:14.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afd9db640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80ad6d0 con 0x7f4af806f6d0 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afc9d9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4af806e910 0x7f4af806f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afc9d9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4af806e910 0x7f4af806f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57588/0 (socket says 172.21.15.84:57588) 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.963+0000 7f4afc9d9640 1 -- 172.21.15.84:0/2032793167 learned_addr learned my addr 172.21.15.84:0/2032793167 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.964+0000 7f4afd1da640 1 --2- 172.21.15.84:0/2032793167 >> v2:172.21.15.99:3300/0 conn(0x7f4af80ad2a0 0x7f4af80710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.964+0000 7f4afc9d9640 1 -- 172.21.15.84:0/2032793167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806f6d0 msgr2=0x7f4af80acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.964+0000 7f4af7fff640 1 --2- 172.21.15.84:0/2032793167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806f6d0 0x7f4af80acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.964+0000 7f4afc9d9640 1 --2- 172.21.15.84:0/2032793167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806f6d0 0x7f4af80acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.964+0000 7f4afc9d9640 1 -- 172.21.15.84:0/2032793167 >> v2:172.21.15.99:3300/0 conn(0x7f4af80ad2a0 msgr2=0x7f4af80710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.964+0000 7f4afc9d9640 1 --2- 172.21.15.84:0/2032793167 >> v2:172.21.15.99:3300/0 conn(0x7f4af80ad2a0 0x7f4af80710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.964+0000 7f4afc9d9640 1 -- 172.21.15.84:0/2032793167 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80ad970 con 0x7f4af806e910 2023-12-12T09:21:14.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.964+0000 7f4afd1da640 1 --2- 172.21.15.84:0/2032793167 >> v2:172.21.15.99:3300/0 conn(0x7f4af80ad2a0 0x7f4af80710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:14.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.965+0000 7f4afc9d9640 1 --2- 172.21.15.84:0/2032793167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af806e910 0x7f4af806f190 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4af8159110 tx=0x7f4aec02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d89b880c33b214e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.965+0000 7f4af77fe640 1 -- 172.21.15.84:0/2032793167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0317d0 con 0x7f4af806e910 2023-12-12T09:21:14.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.965+0000 7f4af77fe640 1 -- 172.21.15.84:0/2032793167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec031930 con 0x7f4af806e910 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.965+0000 7f4af77fe640 1 -- 172.21.15.84:0/2032793167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec031cc0 con 0x7f4af806e910 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 -- 172.21.15.84:0/2032793167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af806e910 msgr2=0x7f4af806f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 --2- 172.21.15.84:0/2032793167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af806e910 0x7f4af806f190 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4af8159110 tx=0x7f4aec02b870 comp rx=0 tx=0).stop 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 -- 172.21.15.84:0/2032793167 shutdown_connections 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 --2- 172.21.15.84:0/2032793167 >> v2:172.21.15.99:3300/0 conn(0x7f4af80ad2a0 0x7f4af80710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 --2- 172.21.15.84:0/2032793167 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806f6d0 0x7f4af80acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 --2- 172.21.15.84:0/2032793167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af806e910 0x7f4af806f190 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 -- 172.21.15.84:0/2032793167 >> 172.21.15.84:0/2032793167 conn(0x7f4af80b1980 msgr2=0x7f4af80b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 -- 172.21.15.84:0/2032793167 shutdown_connections 2023-12-12T09:21:14.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.966+0000 7f4afd9db640 1 -- 172.21.15.84:0/2032793167 wait complete. 2023-12-12T09:21:14.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.969+0000 7f4afd9db640 1 Processor -- start 2023-12-12T09:21:14.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.969+0000 7f4afd9db640 1 -- start start 2023-12-12T09:21:14.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.970+0000 7f4afd9db640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806e910 0x7f4af81487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.970+0000 7f4afd9db640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4af806f6d0 0x7f4af8159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.970+0000 7f4afd9db640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af80ad2a0 0x7f4af815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.970+0000 7f4afd9db640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8148d20 con 0x7f4af80ad2a0 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.970+0000 7f4afd9db640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af81e4300 con 0x7f4af806f6d0 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.970+0000 7f4afd9db640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af815b520 con 0x7f4af806e910 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.970+0000 7f4afd1da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af80ad2a0 0x7f4af815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afd1da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af80ad2a0 0x7f4af815a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57598/0 (socket says 172.21.15.84:57598) 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afd1da640 1 -- 172.21.15.84:0/3473897829 learned_addr learned my addr 172.21.15.84:0/3473897829 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afc9d9640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806e910 0x7f4af81487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4af7fff640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4af806f6d0 0x7f4af8159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afd1da640 1 -- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806e910 msgr2=0x7f4af81487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afd1da640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806e910 0x7f4af81487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afd1da640 1 -- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4af806f6d0 msgr2=0x7f4af8159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afd1da640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4af806f6d0 0x7f4af8159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afd1da640 1 -- 172.21.15.84:0/3473897829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0094d0 con 0x7f4af80ad2a0 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afc9d9640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806e910 0x7f4af81487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:14.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4afd1da640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af80ad2a0 0x7f4af815a2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4af000cf20 tx=0x7f4af000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.971+0000 7f4af57fa640 1 -- 172.21.15.84:0/3473897829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af000d840 con 0x7f4af80ad2a0 2023-12-12T09:21:14.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.972+0000 7f4af57fa640 1 -- 172.21.15.84:0/3473897829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af000d9a0 con 0x7f4af80ad2a0 2023-12-12T09:21:14.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.972+0000 7f4af57fa640 1 -- 172.21.15.84:0/3473897829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af000dd50 con 0x7f4af80ad2a0 2023-12-12T09:21:14.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.972+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af815a9a0 con 0x7f4af80ad2a0 2023-12-12T09:21:14.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.972+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af815af60 con 0x7f4af80ad2a0 2023-12-12T09:21:14.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.973+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af8072eb0 con 0x7f4af80ad2a0 2023-12-12T09:21:14.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.974+0000 7f4af57fa640 1 -- 172.21.15.84:0/3473897829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4af001e3b0 con 0x7f4af80ad2a0 2023-12-12T09:21:14.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.975+0000 7f4af57fa640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4adc06ae40 0x7f4adc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:14.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.975+0000 7f4af57fa640 1 -- 172.21.15.84:0/3473897829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4af008a540 con 0x7f4af80ad2a0 2023-12-12T09:21:14.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.976+0000 7f4afc9d9640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4adc06ae40 0x7f4adc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:14.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.976+0000 7f4afc9d9640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4adc06ae40 0x7f4adc06d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4aec036000 tx=0x7f4aec03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:14.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:14.980+0000 7f4af57fa640 1 -- 172.21.15.84:0/3473897829 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4af0055190 con 0x7f4af80ad2a0 2023-12-12T09:21:15.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.172+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4af806b3f0 con 0x7f4af80ad2a0 2023-12-12T09:21:15.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.175+0000 7f4af57fa640 1 -- 172.21.15.84:0/3473897829 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f4af00587b0 con 0x7f4af80ad2a0 2023-12-12T09:21:15.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:15.177 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4adc06ae40 msgr2=0x7f4adc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4adc06ae40 0x7f4adc06d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4aec036000 tx=0x7f4aec03d040 comp rx=0 tx=0).stop 2023-12-12T09:21:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af80ad2a0 msgr2=0x7f4af815a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af80ad2a0 0x7f4af815a2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4af000cf20 tx=0x7f4af000a7d0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 shutdown_connections 2023-12-12T09:21:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4adc06ae40 0x7f4adc06d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4af80ad2a0 0x7f4af815a2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4af806f6d0 0x7f4af8159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 --2- 172.21.15.84:0/3473897829 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4af806e910 0x7f4af81487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 >> 172.21.15.84:0/3473897829 conn(0x7f4af80b1980 msgr2=0x7f4af80716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 shutdown_connections 2023-12-12T09:21:15.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.179+0000 7f4afd9db640 1 -- 172.21.15.84:0/3473897829 wait complete. 2023-12-12T09:21:15.198 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:21:15.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:21:15.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.411+0000 7f1afd000640 1 Processor -- start 2023-12-12T09:21:15.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.411+0000 7f1afd000640 1 -- start start 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1afd000640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af8071bb0 0x7f1af8071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1afd000640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1af80ce330 0x7f1af813d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1afd000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af80724d0 con 0x7f1af80ce790 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1afd000640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af8140270 con 0x7f1af80ce330 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1afd000640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80cd850 con 0x7f1af8071bb0 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1aeffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1af80ce330 0x7f1af813d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1aeffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1af80ce330 0x7f1af813d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57606/0 (socket says 172.21.15.84:57606) 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1aeffff640 1 -- 172.21.15.84:0/3166929902 learned_addr learned my addr 172.21.15.84:0/3166929902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.413+0000 7f1af659c640 1 --2- 172.21.15.84:0/3166929902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af8071bb0 0x7f1af8071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.414+0000 7f1aeffff640 1 -- 172.21.15.84:0/3166929902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af8071bb0 msgr2=0x7f1af8071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.414+0000 7f1aeffff640 1 --2- 172.21.15.84:0/3166929902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af8071bb0 0x7f1af8071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.414+0000 7f1aeffff640 1 -- 172.21.15.84:0/3166929902 >> v1:172.21.15.99:6789/0 conn(0x7f1af80ce790 legacy=0x7f1af813f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:15.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.414+0000 7f1aeffff640 1 -- 172.21.15.84:0/3166929902 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80cdb30 con 0x7f1af80ce330 2023-12-12T09:21:15.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.415+0000 7f1aeffff640 1 --2- 172.21.15.84:0/3166929902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af813d3d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009870 tx=0x7f1ae002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe759559396dcf85 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:15.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.415+0000 7f1af5d9b640 1 -- 172.21.15.84:0/3166929902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0031640 con 0x7f1af80ce330 2023-12-12T09:21:15.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.415+0000 7f1af5d9b640 1 -- 172.21.15.84:0/3166929902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae00317a0 con 0x7f1af80ce330 2023-12-12T09:21:15.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.415+0000 7f1af5d9b640 1 -- 172.21.15.84:0/3166929902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0031b30 con 0x7f1af80ce330 2023-12-12T09:21:15.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.416+0000 7f1afd000640 1 -- 172.21.15.84:0/3166929902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 msgr2=0x7f1af813d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.416+0000 7f1afd000640 1 --2- 172.21.15.84:0/3166929902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af813d3d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009870 tx=0x7f1ae002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.416+0000 7f1afd000640 1 -- 172.21.15.84:0/3166929902 shutdown_connections 2023-12-12T09:21:15.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.416+0000 7f1afd000640 1 --2- 172.21.15.84:0/3166929902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af813d3d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.416+0000 7f1afd000640 1 --2- 172.21.15.84:0/3166929902 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af8071bb0 0x7f1af8071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.416+0000 7f1afd000640 1 -- 172.21.15.84:0/3166929902 >> 172.21.15.84:0/3166929902 conn(0x7f1af806c3d0 msgr2=0x7f1af806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:15.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.416+0000 7f1afd000640 1 -- 172.21.15.84:0/3166929902 shutdown_connections 2023-12-12T09:21:15.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.416+0000 7f1afd000640 1 -- 172.21.15.84:0/3166929902 wait complete. 2023-12-12T09:21:15.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.418+0000 7f1afd000640 1 Processor -- start 2023-12-12T09:21:15.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.418+0000 7f1afd000640 1 -- start start 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1afd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1af8071bb0 0x7f1af81f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1afd000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af81499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1afd000640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af80ce790 0x7f1af8149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1afd000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af81492e0 con 0x7f1af80ce330 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1afd000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af8149700 con 0x7f1af8071bb0 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1afd000640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af8148660 con 0x7f1af80ce790 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af81499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af81499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57614/0 (socket says 172.21.15.84:57614) 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1aeffff640 1 -- 172.21.15.84:0/2093846479 learned_addr learned my addr 172.21.15.84:0/2093846479 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1aeffff640 1 -- 172.21.15.84:0/2093846479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af80ce790 msgr2=0x7f1af8149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1aeffff640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af80ce790 0x7f1af8149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1aeffff640 1 -- 172.21.15.84:0/2093846479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1af8071bb0 msgr2=0x7f1af81f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1aeffff640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1af8071bb0 0x7f1af81f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.419+0000 7f1aeffff640 1 -- 172.21.15.84:0/2093846479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00094d0 con 0x7f1af80ce330 2023-12-12T09:21:15.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.420+0000 7f1aeffff640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af81499c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009870 tx=0x7f1ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:15.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.420+0000 7f1aeeffd640 1 -- 172.21.15.84:0/2093846479 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae003ac60 con 0x7f1af80ce330 2023-12-12T09:21:15.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.420+0000 7f1aeeffd640 1 -- 172.21.15.84:0/2093846479 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae003adc0 con 0x7f1af80ce330 2023-12-12T09:21:15.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.420+0000 7f1aeeffd640 1 -- 172.21.15.84:0/2093846479 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0044630 con 0x7f1af80ce330 2023-12-12T09:21:15.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.420+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af8148940 con 0x7f1af80ce330 2023-12-12T09:21:15.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.420+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af8148f00 con 0x7f1af80ce330 2023-12-12T09:21:15.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.421+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af80673c0 con 0x7f1af80ce330 2023-12-12T09:21:15.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.422+0000 7f1aeeffd640 1 -- 172.21.15.84:0/2093846479 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ae002f050 con 0x7f1af80ce330 2023-12-12T09:21:15.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.423+0000 7f1aeeffd640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ad806ae40 0x7f1ad806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.423+0000 7f1aeeffd640 1 -- 172.21.15.84:0/2093846479 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1ae00ab8f0 con 0x7f1af80ce330 2023-12-12T09:21:15.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.423+0000 7f1af659c640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ad806ae40 0x7f1ad806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:15.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.424+0000 7f1af659c640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ad806ae40 0x7f1ad806d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8006fd0 tx=0x7f1ae8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:15.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.428+0000 7f1aeeffd640 1 -- 172.21.15.84:0/2093846479 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ae0076660 con 0x7f1af80ce330 2023-12-12T09:21:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.654+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1af80b08a0 con 0x7f1af80ce330 2023-12-12T09:21:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.655+0000 7f1aeeffd640 1 -- 172.21.15.84:0/2093846479 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f1ae0031e60 con 0x7f1af80ce330 2023-12-12T09:21:15.656 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:15.656 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:20:07.638154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:21:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-12-12T09:21:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ad806ae40 msgr2=0x7f1ad806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ad806ae40 0x7f1ad806d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8006fd0 tx=0x7f1ae8008040 comp rx=0 tx=0).stop 2023-12-12T09:21:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 msgr2=0x7f1af81499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af81499c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009870 tx=0x7f1ae00046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 shutdown_connections 2023-12-12T09:21:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1af80ce790 0x7f1af8149f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ad806ae40 0x7f1ad806d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1af80ce330 0x7f1af81499c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 --2- 172.21.15.84:0/2093846479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1af8071bb0 0x7f1af81f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 >> 172.21.15.84:0/2093846479 conn(0x7f1af806c3d0 msgr2=0x7f1af8070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 shutdown_connections 2023-12-12T09:21:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.658+0000 7f1afd000640 1 -- 172.21.15.84:0/2093846479 wait complete. 2023-12-12T09:21:15.679 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:21:15.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.884+0000 7f66d023d640 1 Processor -- start 2023-12-12T09:21:15.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.885+0000 7f66d023d640 1 -- start start 2023-12-12T09:21:15.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.886+0000 7f66d023d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66c80b47e0 0x7f66c8071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.886+0000 7f66d023d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c80cea30 con 0x7f66c8143d20 2023-12-12T09:21:15.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.886+0000 7f66d023d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c80702b0 con 0x7f66c80ce550 2023-12-12T09:21:15.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.886+0000 7f66d023d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c8070590 con 0x7f66c80b47e0 2023-12-12T09:21:15.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.887+0000 7f66cd7d8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66c80b47e0 0x7f66c8071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:15.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.887+0000 7f66cd7d8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f66c80b47e0 0x7f66c8071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50012/0 (socket says 172.21.15.84:50012) 2023-12-12T09:21:15.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.887+0000 7f66cd7d8640 1 -- 172.21.15.84:0/3008588960 learned_addr learned my addr 172.21.15.84:0/3008588960 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:15.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.887+0000 7f66cd7d8640 1 -- 172.21.15.84:0/3008588960 >> v1:172.21.15.99:6789/0 conn(0x7f66c80ce550 legacy=0x7f66c80715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:15.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.887+0000 7f66cd7d8640 1 -- 172.21.15.84:0/3008588960 >> v1:172.21.15.84:6789/0 conn(0x7f66c8143d20 legacy=0x7f66c80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.887+0000 7f66cd7d8640 1 -- 172.21.15.84:0/3008588960 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8070870 con 0x7f66c80b47e0 2023-12-12T09:21:15.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.887+0000 7f66ccfd7640 1 -- 172.21.15.84:0/3008588960 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971564269 0 0) 0x7f66c80cea30 con 0x7f66c8143d20 2023-12-12T09:21:15.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.888+0000 7f66cd7d8640 1 --2- 172.21.15.84:0/3008588960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c80b47e0 0x7f66c8071070 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009870 tx=0x7f66b802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2db3e8dc4a1336 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:15.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66ccfd7640 1 -- 172.21.15.84:0/3008588960 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8030860 con 0x7f66c80b47e0 2023-12-12T09:21:15.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66ccfd7640 1 -- 172.21.15.84:0/3008588960 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b80309c0 con 0x7f66c80b47e0 2023-12-12T09:21:15.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66ccfd7640 1 -- 172.21.15.84:0/3008588960 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8030d50 con 0x7f66c80b47e0 2023-12-12T09:21:15.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66d023d640 1 -- 172.21.15.84:0/3008588960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c80b47e0 msgr2=0x7f66c8071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66d023d640 1 --2- 172.21.15.84:0/3008588960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c80b47e0 0x7f66c8071070 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009870 tx=0x7f66b802b9a0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66d023d640 1 -- 172.21.15.84:0/3008588960 shutdown_connections 2023-12-12T09:21:15.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66d023d640 1 --2- 172.21.15.84:0/3008588960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c80b47e0 0x7f66c8071070 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66d023d640 1 -- 172.21.15.84:0/3008588960 >> 172.21.15.84:0/3008588960 conn(0x7f66c806c3d0 msgr2=0x7f66c806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:15.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66d023d640 1 -- 172.21.15.84:0/3008588960 shutdown_connections 2023-12-12T09:21:15.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.889+0000 7f66d023d640 1 -- 172.21.15.84:0/3008588960 wait complete. 2023-12-12T09:21:15.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.891+0000 7f66d023d640 1 Processor -- start 2023-12-12T09:21:15.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.891+0000 7f66d023d640 1 -- start start 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.892+0000 7f66d023d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66c80b47e0 0x7f66c815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.892+0000 7f66d023d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66c80ce550 0x7f66c81e5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.892+0000 7f66d023d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c8143d20 0x7f66c80b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.892+0000 7f66d023d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81e4dc0 con 0x7f66c8143d20 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.892+0000 7f66d023d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81e50a0 con 0x7f66c80ce550 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.892+0000 7f66d023d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81e5380 con 0x7f66c80b47e0 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c8143d20 0x7f66c80b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c8143d20 0x7f66c80b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50022/0 (socket says 172.21.15.84:50022) 2023-12-12T09:21:15.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 -- 172.21.15.84:0/2971118320 learned_addr learned my addr 172.21.15.84:0/2971118320 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:15.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66cd7d8640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66c80ce550 0x7f66c81e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:15.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 -- 172.21.15.84:0/2971118320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66c80b47e0 msgr2=0x7f66c815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66c80b47e0 0x7f66c815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 -- 172.21.15.84:0/2971118320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66c80ce550 msgr2=0x7f66c81e5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66c80ce550 0x7f66c81e5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 -- 172.21.15.84:0/2971118320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b80094d0 con 0x7f66c8143d20 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.893+0000 7f66ce7da640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c8143d20 0x7f66c80b2900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f66c000c6d0 tx=0x7f66c000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.894+0000 7f66be7fc640 1 -- 172.21.15.84:0/2971118320 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000a840 con 0x7f66c8143d20 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.894+0000 7f66be7fc640 1 -- 172.21.15.84:0/2971118320 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c000a9a0 con 0x7f66c8143d20 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.894+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c81e5660 con 0x7f66c8143d20 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.894+0000 7f66be7fc640 1 -- 172.21.15.84:0/2971118320 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000ad90 con 0x7f66c8143d20 2023-12-12T09:21:15.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.894+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c815a570 con 0x7f66c8143d20 2023-12-12T09:21:15.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.895+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c81e5b80 con 0x7f66c8143d20 2023-12-12T09:21:15.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.896+0000 7f66be7fc640 1 -- 172.21.15.84:0/2971118320 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66c0012420 con 0x7f66c8143d20 2023-12-12T09:21:15.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.897+0000 7f66be7fc640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66ac06ae40 0x7f66ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:15.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.897+0000 7f66be7fc640 1 -- 172.21.15.84:0/2971118320 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f66c0089ee0 con 0x7f66c8143d20 2023-12-12T09:21:15.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.897+0000 7f66cdfd9640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66ac06ae40 0x7f66ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:15.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.898+0000 7f66cdfd9640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66ac06ae40 0x7f66ac06d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f66c4001560 tx=0x7f66c4007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:15.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:15.901+0000 7f66be7fc640 1 -- 172.21.15.84:0/2971118320 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f66c81e5b80 con 0x7f66c8143d20 2023-12-12T09:21:16.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.123+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66c81e5b80 con 0x7f66c8143d20 2023-12-12T09:21:16.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.125+0000 7f66be7fc640 1 -- 172.21.15.84:0/2971118320 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f66c81e5b80 con 0x7f66c8143d20 2023-12-12T09:21:16.126 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:16.126 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2314955121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2314955121},{"type":"v1","addr":"172.21.15.99:6835","nonce":2314955121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/1646248197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1646248197},{"type":"v1","addr":"172.21.15.84:6835","nonce":1646248197}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2665981583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2665981583},{"type":"v1","addr":"172.21.15.84:6837","nonce":2665981583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:19:41.565378+0000","modified":"2023-12-12T09:20:07.638154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6833/3738121458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3738121458},{"type":"v1","addr":"172.21.15.99:6833","nonce":3738121458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T09:21:16.126 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-12-12T09:21:16.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66ac06ae40 msgr2=0x7f66ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66ac06ae40 0x7f66ac06d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f66c4001560 tx=0x7f66c4007930 comp rx=0 tx=0).stop 2023-12-12T09:21:16.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c8143d20 msgr2=0x7f66c80b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c8143d20 0x7f66c80b2900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f66c000c6d0 tx=0x7f66c000cb90 comp rx=0 tx=0).stop 2023-12-12T09:21:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 shutdown_connections 2023-12-12T09:21:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66ac06ae40 0x7f66ac06d300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66c8143d20 0x7f66c80b2900 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66c80ce550 0x7f66c81e5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 --2- 172.21.15.84:0/2971118320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66c80b47e0 0x7f66c815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 >> 172.21.15.84:0/2971118320 conn(0x7f66c806c3d0 msgr2=0x7f66c8071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 shutdown_connections 2023-12-12T09:21:16.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.127+0000 7f66d023d640 1 -- 172.21.15.84:0/2971118320 wait complete. 2023-12-12T09:21:16.145 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.347+0000 7f7b6d91d640 1 Processor -- start 2023-12-12T09:21:16.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.348+0000 7f7b6d91d640 1 -- start start 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.349+0000 7f7b6d91d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b6815e810 0x7f7b680ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.349+0000 7f7b6d91d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b6806b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.349+0000 7f7b6d91d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7b680aeab0 0x7f7b6806ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.349+0000 7f7b6d91d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b680ce8b0 con 0x7f7b6815e810 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.349+0000 7f7b6d91d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b68071850 con 0x7f7b680aeab0 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.349+0000 7f7b6d91d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680ce260 con 0x7f7b6806f280 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b66ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b6815e810 0x7f7b680ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b66ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b6815e810 0x7f7b680ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50032/0 (socket says 172.21.15.84:50032) 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b66ffd640 1 -- 172.21.15.84:0/1071551381 learned_addr learned my addr 172.21.15.84:0/1071551381 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:16.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b677fe640 1 --2- 172.21.15.84:0/1071551381 >> v2:172.21.15.99:3300/0 conn(0x7f7b680aeab0 0x7f7b6806ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b667fc640 1 --2- 172.21.15.84:0/1071551381 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b6806b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b66ffd640 1 -- 172.21.15.84:0/1071551381 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 msgr2=0x7f7b6806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b66ffd640 1 --2- 172.21.15.84:0/1071551381 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b6806b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b66ffd640 1 -- 172.21.15.84:0/1071551381 >> v2:172.21.15.99:3300/0 conn(0x7f7b680aeab0 msgr2=0x7f7b6806ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:16.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b66ffd640 1 --2- 172.21.15.84:0/1071551381 >> v2:172.21.15.99:3300/0 conn(0x7f7b680aeab0 0x7f7b6806ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b66ffd640 1 -- 172.21.15.84:0/1071551381 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680ce540 con 0x7f7b6815e810 2023-12-12T09:21:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.350+0000 7f7b677fe640 1 --2- 172.21.15.84:0/1071551381 >> v2:172.21.15.99:3300/0 conn(0x7f7b680aeab0 0x7f7b6806ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:21:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.352+0000 7f7b66ffd640 1 --2- 172.21.15.84:0/1071551381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b680ced40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7b6815fe00 tx=0x7f7b5802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b9666dd303a4bf server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.352+0000 7f7b65ffb640 1 -- 172.21.15.84:0/1071551381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5802c9e0 con 0x7f7b6815e810 2023-12-12T09:21:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.352+0000 7f7b65ffb640 1 -- 172.21.15.84:0/1071551381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5802cb40 con 0x7f7b6815e810 2023-12-12T09:21:16.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.352+0000 7f7b65ffb640 1 -- 172.21.15.84:0/1071551381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580343f0 con 0x7f7b6815e810 2023-12-12T09:21:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 -- 172.21.15.84:0/1071551381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 msgr2=0x7f7b680ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/1071551381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b680ced40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7b6815fe00 tx=0x7f7b5802be40 comp rx=0 tx=0).stop 2023-12-12T09:21:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 -- 172.21.15.84:0/1071551381 shutdown_connections 2023-12-12T09:21:16.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/1071551381 >> v2:172.21.15.99:3300/0 conn(0x7f7b680aeab0 0x7f7b6806ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/1071551381 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b6806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/1071551381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b680ced40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 -- 172.21.15.84:0/1071551381 >> 172.21.15.84:0/1071551381 conn(0x7f7b68070b20 msgr2=0x7f7b68070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 -- 172.21.15.84:0/1071551381 shutdown_connections 2023-12-12T09:21:16.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.353+0000 7f7b6d91d640 1 -- 172.21.15.84:0/1071551381 wait complete. 2023-12-12T09:21:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.355+0000 7f7b6d91d640 1 Processor -- start 2023-12-12T09:21:16.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.355+0000 7f7b6d91d640 1 -- start start 2023-12-12T09:21:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b6d91d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b68152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b6d91d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680aeab0 0x7f7b68140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b6d91d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b6806d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b6d91d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6806ebb0 con 0x7f7b6815e810 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b6d91d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6806e030 con 0x7f7b680aeab0 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b6d91d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6806e310 con 0x7f7b6806f280 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b6806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b6806d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50038/0 (socket says 172.21.15.84:50038) 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b677fe640 1 -- 172.21.15.84:0/2099867846 learned_addr learned my addr 172.21.15.84:0/2099867846 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b66ffd640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b68152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b667fc640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680aeab0 0x7f7b68140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b677fe640 1 -- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 msgr2=0x7f7b68152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b677fe640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b68152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b677fe640 1 -- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680aeab0 msgr2=0x7f7b68140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.356+0000 7f7b677fe640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680aeab0 0x7f7b68140790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.357+0000 7f7b677fe640 1 -- 172.21.15.84:0/2099867846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58009b30 con 0x7f7b6815e810 2023-12-12T09:21:16.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.357+0000 7f7b66ffd640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b68152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.357+0000 7f7b677fe640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b6806d530 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000e5e0 tx=0x7f7b6000eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.357+0000 7f7b4ffff640 1 -- 172.21.15.84:0/2099867846 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60004230 con 0x7f7b6815e810 2023-12-12T09:21:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.357+0000 7f7b4ffff640 1 -- 172.21.15.84:0/2099867846 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b60004390 con 0x7f7b6815e810 2023-12-12T09:21:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.357+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6806f040 con 0x7f7b6815e810 2023-12-12T09:21:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.357+0000 7f7b4ffff640 1 -- 172.21.15.84:0/2099867846 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60003830 con 0x7f7b6815e810 2023-12-12T09:21:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.357+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6806e8d0 con 0x7f7b6815e810 2023-12-12T09:21:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.358+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b68072eb0 con 0x7f7b6815e810 2023-12-12T09:21:16.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.359+0000 7f7b4ffff640 1 -- 172.21.15.84:0/2099867846 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b60003990 con 0x7f7b6815e810 2023-12-12T09:21:16.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.360+0000 7f7b4ffff640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b5406ae40 0x7f7b5406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.360+0000 7f7b4ffff640 1 -- 172.21.15.84:0/2099867846 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7b60089620 con 0x7f7b6815e810 2023-12-12T09:21:16.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.360+0000 7f7b66ffd640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b5406ae40 0x7f7b5406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.361+0000 7f7b66ffd640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b5406ae40 0x7f7b5406d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7b58035000 tx=0x7f7b58030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:16.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.364+0000 7f7b4ffff640 1 -- 172.21.15.84:0/2099867846 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b60054270 con 0x7f7b6815e810 2023-12-12T09:21:16.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.555+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b68071dd0 con 0x7f7b6815e810 2023-12-12T09:21:16.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.558+0000 7f7b4ffff640 1 -- 172.21.15.84:0/2099867846 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f7b60057890 con 0x7f7b6815e810 2023-12-12T09:21:16.559 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:16.559 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:20:28.746994+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:19:39.409918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T09:19:40.582144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T09:19:44.192068+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:16.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.560+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b5406ae40 msgr2=0x7f7b5406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.560+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b5406ae40 0x7f7b5406d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7b58035000 tx=0x7f7b58030000 comp rx=0 tx=0).stop 2023-12-12T09:21:16.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.560+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 msgr2=0x7f7b6806d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.560+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b6806d530 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000e5e0 tx=0x7f7b6000eaa0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.561+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 shutdown_connections 2023-12-12T09:21:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.561+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b5406ae40 0x7f7b5406d300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.561+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b6815e810 0x7f7b6806d530 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.561+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b680aeab0 0x7f7b68140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.561+0000 7f7b6d91d640 1 --2- 172.21.15.84:0/2099867846 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b6806f280 0x7f7b68152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.561+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 >> 172.21.15.84:0/2099867846 conn(0x7f7b68070b20 msgr2=0x7f7b680b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.561+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 shutdown_connections 2023-12-12T09:21:16.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.561+0000 7f7b6d91d640 1 -- 172.21.15.84:0/2099867846 wait complete. 2023-12-12T09:21:16.581 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T09:21:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.784+0000 7f8d3849b640 1 Processor -- start 2023-12-12T09:21:16.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.785+0000 7f8d3849b640 1 -- start start 2023-12-12T09:21:16.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.786+0000 7f8d3849b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d30143d20 0x7f8d300b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.786+0000 7f8d3849b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8d300ce550 0x7f8d300b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.786+0000 7f8d3849b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d301447f0 0x7f8d3015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.786+0000 7f8d3849b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d300cea30 con 0x7f8d301447f0 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.786+0000 7f8d3849b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d300702b0 con 0x7f8d300ce550 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.786+0000 7f8d3849b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30070590 con 0x7f8d30143d20 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36a38640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d301447f0 0x7f8d3015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36a38640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8d301447f0 0x7f8d3015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50046/0 (socket says 172.21.15.84:50046) 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36a38640 1 -- 172.21.15.84:0/1580415363 learned_addr learned my addr 172.21.15.84:0/1580415363 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36237640 1 --2- 172.21.15.84:0/1580415363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d30143d20 0x7f8d300b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36a38640 1 -- 172.21.15.84:0/1580415363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d30143d20 msgr2=0x7f8d300b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36a38640 1 --2- 172.21.15.84:0/1580415363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d30143d20 0x7f8d300b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d35a36640 1 --2- 172.21.15.84:0/1580415363 >> v2:172.21.15.99:3300/0 conn(0x7f8d300ce550 0x7f8d300b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36a38640 1 -- 172.21.15.84:0/1580415363 >> v2:172.21.15.99:3300/0 conn(0x7f8d300ce550 msgr2=0x7f8d300b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36a38640 1 --2- 172.21.15.84:0/1580415363 >> v2:172.21.15.99:3300/0 conn(0x7f8d300ce550 0x7f8d300b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d36a38640 1 -- 172.21.15.84:0/1580415363 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30070870 con 0x7f8d301447f0 2023-12-12T09:21:16.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.787+0000 7f8d35a36640 1 --2- 172.21.15.84:0/1580415363 >> v2:172.21.15.99:3300/0 conn(0x7f8d300ce550 0x7f8d300b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.788+0000 7f8d36a38640 1 --2- 172.21.15.84:0/1580415363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d301447f0 0x7f8d3015eaf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8d3006bd40 tx=0x7f8d2802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228e8b4bee7c8d11 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d35235640 1 -- 172.21.15.84:0/1580415363 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2802ca80 con 0x7f8d301447f0 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d35235640 1 -- 172.21.15.84:0/1580415363 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2802cbe0 con 0x7f8d301447f0 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d35235640 1 -- 172.21.15.84:0/1580415363 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d280343f0 con 0x7f8d301447f0 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 -- 172.21.15.84:0/1580415363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d301447f0 msgr2=0x7f8d3015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 --2- 172.21.15.84:0/1580415363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d301447f0 0x7f8d3015eaf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8d3006bd40 tx=0x7f8d2802bee0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 -- 172.21.15.84:0/1580415363 shutdown_connections 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 --2- 172.21.15.84:0/1580415363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d301447f0 0x7f8d3015eaf0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 --2- 172.21.15.84:0/1580415363 >> v2:172.21.15.99:3300/0 conn(0x7f8d300ce550 0x7f8d300b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 --2- 172.21.15.84:0/1580415363 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d30143d20 0x7f8d300b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 -- 172.21.15.84:0/1580415363 >> 172.21.15.84:0/1580415363 conn(0x7f8d3006c3d0 msgr2=0x7f8d3006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 -- 172.21.15.84:0/1580415363 shutdown_connections 2023-12-12T09:21:16.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.789+0000 7f8d3849b640 1 -- 172.21.15.84:0/1580415363 wait complete. 2023-12-12T09:21:16.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.791+0000 7f8d3849b640 1 Processor -- start 2023-12-12T09:21:16.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.791+0000 7f8d3849b640 1 -- start start 2023-12-12T09:21:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d3849b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d300ce550 0x7f8d3015a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d3849b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d30143d20 0x7f8d30142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d3849b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d301447f0 0x7f8d30142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d3849b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d301f2d90 con 0x7f8d300ce550 2023-12-12T09:21:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d3849b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d301401a0 con 0x7f8d30143d20 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d3849b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3013f770 con 0x7f8d301447f0 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d36237640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d300ce550 0x7f8d3015a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d36237640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d300ce550 0x7f8d3015a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50056/0 (socket says 172.21.15.84:50056) 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.792+0000 7f8d36237640 1 -- 172.21.15.84:0/386310709 learned_addr learned my addr 172.21.15.84:0/386310709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.793+0000 7f8d36237640 1 -- 172.21.15.84:0/386310709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d301447f0 msgr2=0x7f8d30142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.793+0000 7f8d36237640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d301447f0 0x7f8d30142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.793+0000 7f8d36237640 1 -- 172.21.15.84:0/386310709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d30143d20 msgr2=0x7f8d30142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.793+0000 7f8d35a36640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d30143d20 0x7f8d30142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.793+0000 7f8d36237640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d30143d20 0x7f8d30142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.793+0000 7f8d36237640 1 -- 172.21.15.84:0/386310709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28009b30 con 0x7f8d300ce550 2023-12-12T09:21:16.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.793+0000 7f8d36237640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d300ce550 0x7f8d3015a6d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00c7f0 tx=0x7f8d2c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.794+0000 7f8d26ffd640 1 -- 172.21.15.84:0/386310709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c004220 con 0x7f8d300ce550 2023-12-12T09:21:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.794+0000 7f8d26ffd640 1 -- 172.21.15.84:0/386310709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c0043a0 con 0x7f8d300ce550 2023-12-12T09:21:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.794+0000 7f8d26ffd640 1 -- 172.21.15.84:0/386310709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c007860 con 0x7f8d300ce550 2023-12-12T09:21:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.794+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d30140440 con 0x7f8d300ce550 2023-12-12T09:21:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.794+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d30140a00 con 0x7f8d300ce550 2023-12-12T09:21:16.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.795+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d30140bf0 con 0x7f8d300ce550 2023-12-12T09:21:16.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.796+0000 7f8d26ffd640 1 -- 172.21.15.84:0/386310709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d2c007bd0 con 0x7f8d300ce550 2023-12-12T09:21:16.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.796+0000 7f8d26ffd640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8d1406ae40 0x7f8d1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:16.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.797+0000 7f8d26ffd640 1 -- 172.21.15.84:0/386310709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8d2c089950 con 0x7f8d300ce550 2023-12-12T09:21:16.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.797+0000 7f8d35a36640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8d1406ae40 0x7f8d1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:16.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.797+0000 7f8d35a36640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8d1406ae40 0x7f8d1406d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8d3015e9d0 tx=0x7f8d20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:16.801+0000 7f8d26ffd640 1 -- 172.21.15.84:0/386310709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d2c0545a0 con 0x7f8d300ce550 2023-12-12T09:21:17.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.019+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8d300673c0 con 0x7f8d300ce550 2023-12-12T09:21:17.020 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-12-12T09:21:17.019+0000 7f59e3967640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:21:17.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.023+0000 7f8d26ffd640 1 -- 172.21.15.84:0/386310709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8d2c01e090 con 0x7f8d300ce550 2023-12-12T09:21:17.024 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:21:17.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8d1406ae40 msgr2=0x7f8d1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:17.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8d1406ae40 0x7f8d1406d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8d3015e9d0 tx=0x7f8d20008040 comp rx=0 tx=0).stop 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d300ce550 msgr2=0x7f8d3015a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d300ce550 0x7f8d3015a6d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00c7f0 tx=0x7f8d2c00ccb0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 shutdown_connections 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8d301447f0 0x7f8d30142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d30143d20 0x7f8d30142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8d1406ae40 0x7f8d1406d300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 --2- 172.21.15.84:0/386310709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8d300ce550 0x7f8d3015a6d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 >> 172.21.15.84:0/386310709 conn(0x7f8d3006c3d0 msgr2=0x7f8d3006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 shutdown_connections 2023-12-12T09:21:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.026+0000 7f8d3849b640 1 -- 172.21.15.84:0/386310709 wait complete. 2023-12-12T09:21:17.047 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T09:21:17.061 INFO:tasks.ceph.mds.b.smithi099.stderr: -5433> 2023-12-12T09:19:45.443+0000 7f0fdfa5b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:21:17.135 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2023-12-12T09:21:17.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.254+0000 7f5ac57f5640 1 Processor -- start 2023-12-12T09:21:17.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.254+0000 7f5ac57f5640 1 -- start start 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.256+0000 7f5ac57f5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ac015d510 0x7f5ac00aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.256+0000 7f5ac57f5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac00cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.256+0000 7f5ac57f5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac015d8f0 con 0x7f5ac00cd9c0 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.256+0000 7f5ac57f5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac00af000 con 0x7f5ac015d510 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.256+0000 7f5ac57f5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0070ec0 con 0x7f5ac006ba40 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.256+0000 7f5abeffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ac015d510 0x7f5ac00aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.256+0000 7f5abeffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5ac015d510 0x7f5ac00aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50064/0 (socket says 172.21.15.84:50064) 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.256+0000 7f5abeffd640 1 -- 172.21.15.84:0/410077354 learned_addr learned my addr 172.21.15.84:0/410077354 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.257+0000 7f5abeffd640 1 -- 172.21.15.84:0/410077354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 msgr2=0x7f5ac00cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:17.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.257+0000 7f5abe7fc640 1 --2- 172.21.15.84:0/410077354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac00cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.257+0000 7f5abeffd640 1 --2- 172.21.15.84:0/410077354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac00cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.257+0000 7f5abeffd640 1 -- 172.21.15.84:0/410077354 >> v1:172.21.15.99:6789/0 conn(0x7f5ac00cd9c0 legacy=0x7f5ac006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.257+0000 7f5abeffd640 1 -- 172.21.15.84:0/410077354 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac006e900 con 0x7f5ac015d510 2023-12-12T09:21:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.257+0000 7f5abe7fc640 1 --2- 172.21.15.84:0/410077354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac00cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.258+0000 7f5abeffd640 1 --2- 172.21.15.84:0/410077354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac00aeac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009e50 tx=0x7f5ab002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de920ac611be25ac server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:17.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.258+0000 7f5abdffb640 1 -- 172.21.15.84:0/410077354 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab002c950 con 0x7f5ac015d510 2023-12-12T09:21:17.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5abdffb640 1 -- 172.21.15.84:0/410077354 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab002cab0 con 0x7f5ac015d510 2023-12-12T09:21:17.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5abdffb640 1 -- 172.21.15.84:0/410077354 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab002ce40 con 0x7f5ac015d510 2023-12-12T09:21:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5ac57f5640 1 -- 172.21.15.84:0/410077354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 msgr2=0x7f5ac00aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/410077354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac00aeac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009e50 tx=0x7f5ab002bdb0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5ac57f5640 1 -- 172.21.15.84:0/410077354 shutdown_connections 2023-12-12T09:21:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/410077354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac00cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/410077354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac00aeac0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5ac57f5640 1 -- 172.21.15.84:0/410077354 >> 172.21.15.84:0/410077354 conn(0x7f5ac00cf580 msgr2=0x7f5ac00cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5ac57f5640 1 -- 172.21.15.84:0/410077354 shutdown_connections 2023-12-12T09:21:17.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.259+0000 7f5ac57f5640 1 -- 172.21.15.84:0/410077354 wait complete. 2023-12-12T09:21:17.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.262+0000 7f5ac57f5640 1 Processor -- start 2023-12-12T09:21:17.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.262+0000 7f5ac57f5640 1 -- start start 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.263+0000 7f5ac57f5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.263+0000 7f5ac57f5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac0159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.263+0000 7f5ac57f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ac015f7c0 0x7f5ac00b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.263+0000 7f5ac57f5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac015a750 con 0x7f5ac015d510 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.263+0000 7f5ac57f5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac015b530 con 0x7f5ac015f7c0 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.263+0000 7f5ac57f5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0159b40 con 0x7f5ac006ba40 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.263+0000 7f5abe7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac0159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abe7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac0159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50066/0 (socket says 172.21.15.84:50066) 2023-12-12T09:21:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abe7fc640 1 -- 172.21.15.84:0/2821321976 learned_addr learned my addr 172.21.15.84:0/2821321976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abe7fc640 1 -- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 msgr2=0x7f5ac015aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abeffd640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abf7fe640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ac015f7c0 0x7f5ac00b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abe7fc640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abe7fc640 1 -- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ac015f7c0 msgr2=0x7f5ac00b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abe7fc640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ac015f7c0 0x7f5ac00b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abe7fc640 1 -- 172.21.15.84:0/2821321976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009b30 con 0x7f5ac015d510 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abf7fe640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ac015f7c0 0x7f5ac00b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.264+0000 7f5abe7fc640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac0159260 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c7f0 tx=0x7f5ab400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.265+0000 7f5aa77fe640 1 -- 172.21.15.84:0/2821321976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4007a30 con 0x7f5ac015d510 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.265+0000 7f5aa77fe640 1 -- 172.21.15.84:0/2821321976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4007b90 con 0x7f5ac015d510 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.265+0000 7f5aa77fe640 1 -- 172.21.15.84:0/2821321976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab400ce40 con 0x7f5ac015d510 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.265+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac0159e20 con 0x7f5ac015d510 2023-12-12T09:21:17.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.265+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac015a3e0 con 0x7f5ac015d510 2023-12-12T09:21:17.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.266+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac00673c0 con 0x7f5ac015d510 2023-12-12T09:21:17.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.267+0000 7f5aa77fe640 1 -- 172.21.15.84:0/2821321976 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ab40113f0 con 0x7f5ac015d510 2023-12-12T09:21:17.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.268+0000 7f5aa77fe640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5aac06ae70 0x7f5aac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:17.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.268+0000 7f5aa77fe640 1 -- 172.21.15.84:0/2821321976 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f5ab4089c00 con 0x7f5ac015d510 2023-12-12T09:21:17.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.268+0000 7f5abeffd640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5aac06ae70 0x7f5aac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:17.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.269+0000 7f5abeffd640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5aac06ae70 0x7f5aac06d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0035000 tx=0x7f5ab0030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:17.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.272+0000 7f5aa77fe640 1 -- 172.21.15.84:0/2821321976 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ab4054890 con 0x7f5ac015d510 2023-12-12T09:21:17.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:17.501+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5ac00cce40 con 0x7f5ac015d510 2023-12-12T09:21:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.033+0000 7f5aa77fe640 1 -- 172.21.15.84:0/2821321976 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ab4057eb0 con 0x7f5ac015d510 2023-12-12T09:21:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5aac06ae70 msgr2=0x7f5aac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5aac06ae70 0x7f5aac06d330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0035000 tx=0x7f5ab0030000 comp rx=0 tx=0).stop 2023-12-12T09:21:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 msgr2=0x7f5ac0159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:18.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac0159260 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400c7f0 tx=0x7f5ab400cbf0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 shutdown_connections 2023-12-12T09:21:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ac015f7c0 0x7f5ac00b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5aac06ae70 0x7f5aac06d330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ac015d510 0x7f5ac0159260 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 --2- 172.21.15.84:0/2821321976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5ac006ba40 0x7f5ac015aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.036+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 >> 172.21.15.84:0/2821321976 conn(0x7f5ac00cf580 msgr2=0x7f5ac006d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.037+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 shutdown_connections 2023-12-12T09:21:18.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.037+0000 7f5ac57f5640 1 -- 172.21.15.84:0/2821321976 wait complete. 2023-12-12T09:21:18.058 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T09:21:18.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.267+0000 7f4db2035640 1 Processor -- start 2023-12-12T09:21:18.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.267+0000 7f4db2035640 1 -- start start 2023-12-12T09:21:18.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.268+0000 7f4db2035640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4dac06d600 0x7f4dac1648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:18.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.268+0000 7f4db2035640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac06c160 con 0x7f4dac159e00 2023-12-12T09:21:18.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.268+0000 7f4db2035640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac06be30 con 0x7f4dac0cf440 2023-12-12T09:21:18.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.268+0000 7f4db2035640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac0711c0 con 0x7f4dac06d600 2023-12-12T09:21:18.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4db1033640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4dac159e00 0x7f4dac0ced30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34392/0 (socket says 172.21.15.84:34392) 2023-12-12T09:21:18.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4db1033640 1 -- 172.21.15.84:0/1411162335 learned_addr learned my addr 172.21.15.84:0/1411162335 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828609453 0 0) 0x7f4dac06c160 con 0x7f4dac159e00 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4db1834640 1 --2- 172.21.15.84:0/1411162335 >> v2:172.21.15.99:3300/0 conn(0x7f4dac06d600 0x7f4dac1648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d98005730 con 0x7f4dac159e00 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1505401787 0 0) 0x7f4d98005730 con 0x7f4dac159e00 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 >> v2:172.21.15.99:3300/0 conn(0x7f4dac06d600 msgr2=0x7f4dac1648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4da3fff640 1 --2- 172.21.15.84:0/1411162335 >> v2:172.21.15.99:3300/0 conn(0x7f4dac06d600 0x7f4dac1648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.269+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 >> v1:172.21.15.99:6789/0 conn(0x7f4dac0cf440 legacy=0x7f4dac0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0714a0 con 0x7f4dac159e00 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f4da8001670 con 0x7f4dac159e00 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 >> v1:172.21.15.84:6789/0 conn(0x7f4dac159e00 legacy=0x7f4dac0ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98005b80 0x7f4d98005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:18.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d980069d0 0x7f4d98006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d98007390 0x7f4d9800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0711c0 con 0x7f4d98007390 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9800e230 con 0x7f4d98005b80 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9800e3f0 con 0x7f4d980069d0 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4db1834640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d98007390 0x7f4d9800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4db1033640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98005b80 0x7f4d98005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4db1834640 1 -- 172.21.15.84:0/1411162335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d980069d0 msgr2=0x7f4d98006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4db0832640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d980069d0 0x7f4d98006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4db1834640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4d980069d0 0x7f4d98006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4db1834640 1 -- 172.21.15.84:0/1411162335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98005b80 msgr2=0x7f4d98005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4db1834640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98005b80 0x7f4d98005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.270+0000 7f4db1834640 1 -- 172.21.15.84:0/1411162335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98005730 con 0x7f4d98007390 2023-12-12T09:21:18.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.271+0000 7f4db1834640 1 -- 172.21.15.84:0/1411162335 reap_dead start 2023-12-12T09:21:18.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4db1834640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d98007390 0x7f4d9800db90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009fc0 tx=0x7f4d98007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e521aaa079b6af server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da402cc60 con 0x7f4d98007390 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400f040 con 0x7f4d98007390 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4da3fff640 1 -- 172.21.15.84:0/1411162335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4003990 con 0x7f4d98007390 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4db2035640 1 -- 172.21.15.84:0/1411162335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d98007390 msgr2=0x7f4d9800db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4db2035640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d98007390 0x7f4d9800db90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009fc0 tx=0x7f4d98007a00 comp rx=0 tx=0).stop 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4db2035640 1 -- 172.21.15.84:0/1411162335 shutdown_connections 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4db2035640 1 --2- 172.21.15.84:0/1411162335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d98007390 0x7f4d9800db90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.272+0000 7f4db2035640 1 -- 172.21.15.84:0/1411162335 >> 172.21.15.84:0/1411162335 conn(0x7f4dac06a6e0 msgr2=0x7f4dac06aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.273+0000 7f4db2035640 1 -- 172.21.15.84:0/1411162335 shutdown_connections 2023-12-12T09:21:18.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.273+0000 7f4db2035640 1 -- 172.21.15.84:0/1411162335 wait complete. 2023-12-12T09:21:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.274+0000 7f4db2035640 1 Processor -- start 2023-12-12T09:21:18.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.274+0000 7f4db2035640 1 -- start start 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.275+0000 7f4db2035640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98007390 0x7f4dac150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.275+0000 7f4db2035640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dac151fa0 0x7f4dac0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.275+0000 7f4db2035640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dac0aecf0 0x7f4dac0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.275+0000 7f4db2035640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac150e60 con 0x7f4dac0aecf0 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.275+0000 7f4db2035640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac151750 con 0x7f4d98007390 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.275+0000 7f4db2035640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac151a30 con 0x7f4dac151fa0 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dac0aecf0 0x7f4dac0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dac0aecf0 0x7f4dac0af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50094/0 (socket says 172.21.15.84:50094) 2023-12-12T09:21:18.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 -- 172.21.15.84:0/4261254437 learned_addr learned my addr 172.21.15.84:0/4261254437 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:18.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db0832640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dac151fa0 0x7f4dac0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:18.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1033640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98007390 0x7f4dac150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:18.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 -- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dac151fa0 msgr2=0x7f4dac0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dac151fa0 0x7f4dac0ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 -- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98007390 msgr2=0x7f4dac150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98007390 0x7f4dac150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 -- 172.21.15.84:0/4261254437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac15b150 con 0x7f4dac0aecf0 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1033640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98007390 0x7f4dac150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db0832640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dac151fa0 0x7f4dac0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.276+0000 7f4db1834640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dac0aecf0 0x7f4dac0af1a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4da402c6d0 tx=0x7f4da4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.277+0000 7f4da1ffb640 1 -- 172.21.15.84:0/4261254437 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4035e40 con 0x7f4dac0aecf0 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.277+0000 7f4da1ffb640 1 -- 172.21.15.84:0/4261254437 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4003990 con 0x7f4dac0aecf0 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.277+0000 7f4da1ffb640 1 -- 172.21.15.84:0/4261254437 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4003d80 con 0x7f4dac0aecf0 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.277+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac15b430 con 0x7f4dac0aecf0 2023-12-12T09:21:18.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.277+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac1539b0 con 0x7f4dac0aecf0 2023-12-12T09:21:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.278+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac06e3c0 con 0x7f4dac0aecf0 2023-12-12T09:21:18.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.279+0000 7f4da1ffb640 1 -- 172.21.15.84:0/4261254437 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4da4004030 con 0x7f4dac0aecf0 2023-12-12T09:21:18.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.280+0000 7f4da1ffb640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4d9006ae40 0x7f4d9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:18.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.280+0000 7f4da1ffb640 1 -- 172.21.15.84:0/4261254437 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4da40ac700 con 0x7f4dac0aecf0 2023-12-12T09:21:18.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.280+0000 7f4db1033640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4d9006ae40 0x7f4d9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:18.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.281+0000 7f4db1033640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4d9006ae40 0x7f4d9006d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4da8001200 tx=0x7f4da8000f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:18.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.284+0000 7f4da1ffb640 1 -- 172.21.15.84:0/4261254437 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4da40774c0 con 0x7f4dac0aecf0 2023-12-12T09:21:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:18.477+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4dac15afb0 con 0x7f4dac0aecf0 2023-12-12T09:21:19.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.431+0000 7f4da1ffb640 1 -- 172.21.15.84:0/4261254437 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4dac15afb0 con 0x7f4dac0aecf0 2023-12-12T09:21:19.433 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-12-12T09:21:19.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4d9006ae40 msgr2=0x7f4d9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:19.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4d9006ae40 0x7f4d9006d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4da8001200 tx=0x7f4da8000f30 comp rx=0 tx=0).stop 2023-12-12T09:21:19.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dac0aecf0 msgr2=0x7f4dac0af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:19.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dac0aecf0 0x7f4dac0af1a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4da402c6d0 tx=0x7f4da4009750 comp rx=0 tx=0).stop 2023-12-12T09:21:19.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 shutdown_connections 2023-12-12T09:21:19.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4d9006ae40 0x7f4d9006d300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dac0aecf0 0x7f4dac0af1a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4dac151fa0 0x7f4dac0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 --2- 172.21.15.84:0/4261254437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d98007390 0x7f4dac150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 >> 172.21.15.84:0/4261254437 conn(0x7f4dac06a6e0 msgr2=0x7f4dac0b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 shutdown_connections 2023-12-12T09:21:19.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.435+0000 7f4db2035640 1 -- 172.21.15.84:0/4261254437 wait complete. 2023-12-12T09:21:19.459 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T09:21:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.662+0000 7f2e5c93c640 1 Processor -- start 2023-12-12T09:21:19.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.662+0000 7f2e5c93c640 1 -- start start 2023-12-12T09:21:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.664+0000 7f2e5c93c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2e5806c060 0x7f2e58071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.664+0000 7f2e5c93c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e580abd50 0x7f2e580ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.664+0000 7f2e5c93c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e58070cb0 con 0x7f2e580ac6f0 2023-12-12T09:21:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.664+0000 7f2e5c93c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e58070f50 con 0x7f2e5806c060 2023-12-12T09:21:19.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.664+0000 7f2e5c93c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5806d8c0 con 0x7f2e580abd50 2023-12-12T09:21:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.665+0000 7f2e5659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2e5806c060 0x7f2e58071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.665+0000 7f2e55d9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e580abd50 0x7f2e580ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.665+0000 7f2e55d9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e580abd50 0x7f2e580ac1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:42188/0 (socket says 172.21.15.84:42188) 2023-12-12T09:21:19.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.665+0000 7f2e55d9b640 1 -- 172.21.15.84:0/3303690907 learned_addr learned my addr 172.21.15.84:0/3303690907 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.666+0000 7f2e55d9b640 1 -- 172.21.15.84:0/3303690907 >> v2:172.21.15.99:3300/0 conn(0x7f2e5806c060 msgr2=0x7f2e58071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.666+0000 7f2e55d9b640 1 --2- 172.21.15.84:0/3303690907 >> v2:172.21.15.99:3300/0 conn(0x7f2e5806c060 0x7f2e58071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.666+0000 7f2e55d9b640 1 -- 172.21.15.84:0/3303690907 >> v1:172.21.15.99:6789/0 conn(0x7f2e580ac6f0 legacy=0x7f2e5815ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:19.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.666+0000 7f2e55d9b640 1 -- 172.21.15.84:0/3303690907 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580711f0 con 0x7f2e580abd50 2023-12-12T09:21:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.667+0000 7f2e55d9b640 1 --2- 172.21.15.84:0/3303690907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e580abd50 0x7f2e580ac1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009870 tx=0x7f2e4c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a8d26d5a7e5a44 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.667+0000 7f2e5559a640 1 -- 172.21.15.84:0/3303690907 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c031640 con 0x7f2e580abd50 2023-12-12T09:21:19.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.667+0000 7f2e5559a640 1 -- 172.21.15.84:0/3303690907 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0317a0 con 0x7f2e580abd50 2023-12-12T09:21:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.667+0000 7f2e5559a640 1 -- 172.21.15.84:0/3303690907 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c031b30 con 0x7f2e580abd50 2023-12-12T09:21:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.668+0000 7f2e5c93c640 1 -- 172.21.15.84:0/3303690907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e580abd50 msgr2=0x7f2e580ac1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.668+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/3303690907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e580abd50 0x7f2e580ac1b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009870 tx=0x7f2e4c02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.668+0000 7f2e5c93c640 1 -- 172.21.15.84:0/3303690907 shutdown_connections 2023-12-12T09:21:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.668+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/3303690907 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e580abd50 0x7f2e580ac1b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.668+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/3303690907 >> v2:172.21.15.99:3300/0 conn(0x7f2e5806c060 0x7f2e58071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.668+0000 7f2e5c93c640 1 -- 172.21.15.84:0/3303690907 >> 172.21.15.84:0/3303690907 conn(0x7f2e580b0970 msgr2=0x7f2e580b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.668+0000 7f2e5c93c640 1 -- 172.21.15.84:0/3303690907 shutdown_connections 2023-12-12T09:21:19.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.668+0000 7f2e5c93c640 1 -- 172.21.15.84:0/3303690907 wait complete. 2023-12-12T09:21:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.670+0000 7f2e5c93c640 1 Processor -- start 2023-12-12T09:21:19.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.670+0000 7f2e5c93c640 1 -- start start 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e5c93c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e5806c060 0x7f2e5814be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e5c93c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e580abd50 0x7f2e58154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e5c93c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e580ac6f0 0x7f2e58155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e5c93c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e581e5bf0 con 0x7f2e580ac6f0 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e5c93c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5814cbc0 con 0x7f2e580abd50 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e5c93c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5815bd20 con 0x7f2e5806c060 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e56d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e580ac6f0 0x7f2e58155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e56d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e580ac6f0 0x7f2e58155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50100/0 (socket says 172.21.15.84:50100) 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.671+0000 7f2e56d9d640 1 -- 172.21.15.84:0/4042545034 learned_addr learned my addr 172.21.15.84:0/4042545034 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e55d9b640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e580abd50 0x7f2e58154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e5659c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e5806c060 0x7f2e5814be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e56d9d640 1 -- 172.21.15.84:0/4042545034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e5806c060 msgr2=0x7f2e5814be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e56d9d640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e5806c060 0x7f2e5814be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e56d9d640 1 -- 172.21.15.84:0/4042545034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e580abd50 msgr2=0x7f2e58154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e56d9d640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e580abd50 0x7f2e58154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:19.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e56d9d640 1 -- 172.21.15.84:0/4042545034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0094d0 con 0x7f2e580ac6f0 2023-12-12T09:21:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e56d9d640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e580ac6f0 0x7f2e58155000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000c6b0 tx=0x7f2e5000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.672+0000 7f2e46ffd640 1 -- 172.21.15.84:0/4042545034 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50003b70 con 0x7f2e580ac6f0 2023-12-12T09:21:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.673+0000 7f2e46ffd640 1 -- 172.21.15.84:0/4042545034 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e50003cf0 con 0x7f2e580ac6f0 2023-12-12T09:21:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.673+0000 7f2e46ffd640 1 -- 172.21.15.84:0/4042545034 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e50005310 con 0x7f2e580ac6f0 2023-12-12T09:21:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.673+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5815bfc0 con 0x7f2e580ac6f0 2023-12-12T09:21:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.673+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e581e5910 con 0x7f2e580ac6f0 2023-12-12T09:21:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.674+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e58067f60 con 0x7f2e580ac6f0 2023-12-12T09:21:19.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.675+0000 7f2e46ffd640 1 -- 172.21.15.84:0/4042545034 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e50005470 con 0x7f2e580ac6f0 2023-12-12T09:21:19.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.675+0000 7f2e46ffd640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2e3806ae40 0x7f2e3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.676+0000 7f2e46ffd640 1 -- 172.21.15.84:0/4042545034 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f2e50089610 con 0x7f2e580ac6f0 2023-12-12T09:21:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.676+0000 7f2e5659c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2e3806ae40 0x7f2e3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:19.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.676+0000 7f2e5659c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2e3806ae40 0x7f2e3806d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009a30 tx=0x7f2e48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:19.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.682+0000 7f2e46ffd640 1 -- 172.21.15.84:0/4042545034 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e500543c0 con 0x7f2e580ac6f0 2023-12-12T09:21:19.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:19.871+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2e580673c0 con 0x7f2e580ac6f0 2023-12-12T09:21:20.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.435+0000 7f2e46ffd640 1 -- 172.21.15.84:0/4042545034 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2e50003e60 con 0x7f2e580ac6f0 2023-12-12T09:21:20.437 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-12-12T09:21:20.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2e3806ae40 msgr2=0x7f2e3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2e3806ae40 0x7f2e3806d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009a30 tx=0x7f2e48008040 comp rx=0 tx=0).stop 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e580ac6f0 msgr2=0x7f2e58155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e580ac6f0 0x7f2e58155000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000c6b0 tx=0x7f2e5000cb70 comp rx=0 tx=0).stop 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 shutdown_connections 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2e3806ae40 0x7f2e3806d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e580ac6f0 0x7f2e58155000 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e580abd50 0x7f2e58154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 --2- 172.21.15.84:0/4042545034 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2e5806c060 0x7f2e5814be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 >> 172.21.15.84:0/4042545034 conn(0x7f2e580b0970 msgr2=0x7f2e580acb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 shutdown_connections 2023-12-12T09:21:20.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.439+0000 7f2e5c93c640 1 -- 172.21.15.84:0/4042545034 wait complete. 2023-12-12T09:21:20.468 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-12T09:21:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.667+0000 7f6c59347640 1 Processor -- start 2023-12-12T09:21:20.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.668+0000 7f6c59347640 1 -- start start 2023-12-12T09:21:20.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.669+0000 7f6c59347640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6c540d06d0 0x7f6c540ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.669+0000 7f6c59347640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540ce6e0 0x7f6c540b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.669+0000 7f6c59347640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540d1920 con 0x7f6c5415d070 2023-12-12T09:21:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.669+0000 7f6c59347640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540d1c00 con 0x7f6c540d06d0 2023-12-12T09:21:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.669+0000 7f6c59347640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b5ee0 con 0x7f6c540ce6e0 2023-12-12T09:21:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.669+0000 7f6c53fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6c5415d070 0x7f6c540cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34404/0 (socket says 172.21.15.84:34404) 2023-12-12T09:21:20.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c53fff640 1 -- 172.21.15.84:0/2262174785 learned_addr learned my addr 172.21.15.84:0/2262174785 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c58b46640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540ce6e0 0x7f6c540b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c537fe640 1 --2- 172.21.15.84:0/2262174785 >> v2:172.21.15.99:3300/0 conn(0x7f6c540d06d0 0x7f6c540ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740810544 0 0) 0x7f6c540d1920 con 0x7f6c5415d070 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c40003520 con 0x7f6c5415d070 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3940387617 0 0) 0x7f6c40003520 con 0x7f6c5415d070 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540ce6e0 msgr2=0x7f6c540b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c52ffd640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540ce6e0 0x7f6c540b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 >> v2:172.21.15.99:3300/0 conn(0x7f6c540d06d0 msgr2=0x7f6c540ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c52ffd640 1 --2- 172.21.15.84:0/2262174785 >> v2:172.21.15.99:3300/0 conn(0x7f6c540d06d0 0x7f6c540ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.670+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540b61c0 con 0x7f6c5415d070 2023-12-12T09:21:20.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f6c440019f0 con 0x7f6c5415d070 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c537fe640 1 --2- 172.21.15.84:0/2262174785 >> v2:172.21.15.99:3300/0 conn(0x7f6c540d06d0 0x7f6c540ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 >> v1:172.21.15.84:6789/0 conn(0x7f6c5415d070 legacy=0x7f6c540cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c52ffd640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003970 0x7f6c40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c52ffd640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540ce6e0 0x7f6c400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c52ffd640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40004d00 0x7f6c40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540d1c00 con 0x7f6c40004d00 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b5ee0 con 0x7f6c40003970 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4000ba00 con 0x7f6c540ce6e0 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c58b46640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40004d00 0x7f6c40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c537fe640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540ce6e0 0x7f6c400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c53fff640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003970 0x7f6c40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c58b46640 1 -- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540ce6e0 msgr2=0x7f6c400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:20.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c58b46640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c540ce6e0 0x7f6c400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c58b46640 1 -- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003970 msgr2=0x7f6c40003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:20.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.671+0000 7f6c58b46640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003970 0x7f6c40003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.672+0000 7f6c58b46640 1 -- 172.21.15.84:0/2262174785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40003520 con 0x7f6c40004d00 2023-12-12T09:21:20.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.672+0000 7f6c53fff640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c40003970 0x7f6c40003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.673+0000 7f6c58b46640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40004d00 0x7f6c40005180 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009a90 tx=0x7f6c400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96629ab46dad7b7a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.673+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c02c680 con 0x7f6c40004d00 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.673+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c02c7e0 con 0x7f6c40004d00 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.673+0000 7f6c52ffd640 1 -- 172.21.15.84:0/2262174785 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c02cb90 con 0x7f6c40004d00 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.673+0000 7f6c59347640 1 -- 172.21.15.84:0/2262174785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40004d00 msgr2=0x7f6c40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.673+0000 7f6c59347640 1 --2- 172.21.15.84:0/2262174785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c40004d00 0x7f6c40005180 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009a90 tx=0x7f6c400057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.673+0000 7f6c58b46640 1 -- 172.21.15.84:0/2262174785 reap_dead start 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.674+0000 7f6c59347640 1 -- 172.21.15.84:0/2262174785 shutdown_connections 2023-12-12T09:21:20.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.674+0000 7f6c59347640 1 -- 172.21.15.84:0/2262174785 >> 172.21.15.84:0/2262174785 conn(0x7f6c540d2f80 msgr2=0x7f6c540d3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.674+0000 7f6c59347640 1 -- 172.21.15.84:0/2262174785 shutdown_connections 2023-12-12T09:21:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.674+0000 7f6c59347640 1 -- 172.21.15.84:0/2262174785 wait complete. 2023-12-12T09:21:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.675+0000 7f6c59347640 1 Processor -- start 2023-12-12T09:21:20.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.676+0000 7f6c59347640 1 -- start start 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.676+0000 7f6c59347640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c40004d00 0x7f6c540c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c59347640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c54155c70 0x7f6c541592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c59347640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c540c8e30 0x7f6c540c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c59347640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54160060 con 0x7f6c54155c70 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c59347640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54160480 con 0x7f6c540c8e30 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c59347640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c7860 con 0x7f6c40004d00 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c54155c70 0x7f6c541592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c54155c70 0x7f6c541592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50126/0 (socket says 172.21.15.84:50126) 2023-12-12T09:21:20.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 -- 172.21.15.84:0/2766270265 learned_addr learned my addr 172.21.15.84:0/2766270265 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 -- 172.21.15.84:0/2766270265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c40004d00 msgr2=0x7f6c540c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c40004d00 0x7f6c540c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 -- 172.21.15.84:0/2766270265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c540c8e30 msgr2=0x7f6c540c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c540c8e30 0x7f6c540c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 -- 172.21.15.84:0/2766270265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5415f410 con 0x7f6c54155c70 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.677+0000 7f6c537fe640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c54155c70 0x7f6c541592a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c010890 tx=0x7f6c3c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.678+0000 7f6c50ff9640 1 -- 172.21.15.84:0/2766270265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00ea80 con 0x7f6c54155c70 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.678+0000 7f6c50ff9640 1 -- 172.21.15.84:0/2766270265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c00c050 con 0x7f6c54155c70 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.678+0000 7f6c50ff9640 1 -- 172.21.15.84:0/2766270265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00ede0 con 0x7f6c54155c70 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.678+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5415f6c0 con 0x7f6c54155c70 2023-12-12T09:21:20.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.678+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5415fc80 con 0x7f6c54155c70 2023-12-12T09:21:20.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.679+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540b4120 con 0x7f6c54155c70 2023-12-12T09:21:20.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.680+0000 7f6c50ff9640 1 -- 172.21.15.84:0/2766270265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c3c015470 con 0x7f6c54155c70 2023-12-12T09:21:20.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.681+0000 7f6c50ff9640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c3406ae40 0x7f6c3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:20.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.681+0000 7f6c50ff9640 1 -- 172.21.15.84:0/2766270265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f6c3c089ea0 con 0x7f6c54155c70 2023-12-12T09:21:20.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.681+0000 7f6c53fff640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c3406ae40 0x7f6c3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:20.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.682+0000 7f6c53fff640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c3406ae40 0x7f6c3406d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c44001b20 tx=0x7f6c44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:20.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.686+0000 7f6c50ff9640 1 -- 172.21.15.84:0/2766270265 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c3c054f90 con 0x7f6c54155c70 2023-12-12T09:21:20.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:20.877+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c540673c0 con 0x7f6c54155c70 2023-12-12T09:21:21.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.462+0000 7f6c50ff9640 1 -- 172.21.15.84:0/2766270265 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6c3c0585b0 con 0x7f6c54155c70 2023-12-12T09:21:21.464 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' removed 2023-12-12T09:21:21.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c3406ae40 msgr2=0x7f6c3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:21.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c3406ae40 0x7f6c3406d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c44001b20 tx=0x7f6c44009040 comp rx=0 tx=0).stop 2023-12-12T09:21:21.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c54155c70 msgr2=0x7f6c541592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:21.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c54155c70 0x7f6c541592a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c010890 tx=0x7f6c3c010d50 comp rx=0 tx=0).stop 2023-12-12T09:21:21.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 shutdown_connections 2023-12-12T09:21:21.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c540c8e30 0x7f6c540c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:21.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6c3406ae40 0x7f6c3406d300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:21.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c54155c70 0x7f6c541592a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:21.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 --2- 172.21.15.84:0/2766270265 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6c40004d00 0x7f6c540c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:21.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.466+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 >> 172.21.15.84:0/2766270265 conn(0x7f6c540d2f80 msgr2=0x7f6c540cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:21.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.467+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 shutdown_connections 2023-12-12T09:21:21.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.468+0000 7f6c59347640 1 -- 172.21.15.84:0/2766270265 wait complete. 2023-12-12T09:21:21.492 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T09:21:21.492 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-12T09:21:21.492 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T09:21:21.493 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:21:21.493 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T09:21:21.493 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-12T09:21:21.493 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T09:21:21.493 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:21:21.493 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T09:21:21.493 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-12T09:21:21.494 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T09:21:21.494 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:21:21.494 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T09:21:21.494 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-12T09:21:21.494 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T09:21:21.494 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:21:21.510 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T09:21:21.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T09:21:21.514 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T09:21:21.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T09:21:21.521 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T09:21:21.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T09:21:21.522 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T09:21:21.522 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T09:21:21.569 INFO:tasks.ceph.mds.a:Started 2023-12-12T09:21:21.569 DEBUG:teuthology.parallel:result is None 2023-12-12T09:21:21.570 INFO:tasks.ceph.mds.b:Started 2023-12-12T09:21:21.570 DEBUG:teuthology.parallel:result is None 2023-12-12T09:21:21.577 INFO:tasks.ceph.mds.c:Started 2023-12-12T09:21:21.577 DEBUG:teuthology.parallel:result is None 2023-12-12T09:21:21.578 INFO:tasks.ceph.mds.d:Started 2023-12-12T09:21:21.578 DEBUG:teuthology.parallel:result is None 2023-12-12T09:21:21.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-12T09:21:21.741 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2023-12-12T09:21:21.741 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2023-12-12T09:21:21.743 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-12-12T09:21:21.743 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-12-12T09:21:21.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.780+0000 7fdef1716640 1 Processor -- start 2023-12-12T09:21:21.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.780+0000 7fdef1716640 1 -- start start 2023-12-12T09:21:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.782+0000 7fdef1716640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdeec143d20 0x7fdeec0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.782+0000 7fdef1716640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec15f910 con 0x7fdeec0ce550 2023-12-12T09:21:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.782+0000 7fdef1716640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec0cea30 con 0x7fdeec1447f0 2023-12-12T09:21:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.782+0000 7fdef1716640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec0702b0 con 0x7fdeec143d20 2023-12-12T09:21:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.782+0000 7fdeeaffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdeec143d20 0x7fdeec0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.782+0000 7fdeeaffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdeec143d20 0x7fdeec0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50172/0 (socket says 172.21.15.84:50172) 2023-12-12T09:21:21.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.782+0000 7fdeeaffd640 1 -- 172.21.15.84:0/378081036 learned_addr learned my addr 172.21.15.84:0/378081036 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:21.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.782+0000 7fdeeaffd640 1 -- 172.21.15.84:0/378081036 >> v1:172.21.15.99:6789/0 conn(0x7fdeec1447f0 legacy=0x7fdeec15f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:21.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.783+0000 7fdeeaffd640 1 -- 172.21.15.84:0/378081036 >> v1:172.21.15.84:6789/0 conn(0x7fdeec0ce550 legacy=0x7fdeec15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:21.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.783+0000 7fdeeaffd640 1 -- 172.21.15.84:0/378081036 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec070590 con 0x7fdeec143d20 2023-12-12T09:21:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.784+0000 7fdeeaffd640 1 --2- 172.21.15.84:0/378081036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec143d20 0x7fdeec0b40d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81681869acd0494 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.784+0000 7fdeea7fc640 1 -- 172.21.15.84:0/378081036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc02f850 con 0x7fdeec143d20 2023-12-12T09:21:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.784+0000 7fdeea7fc640 1 -- 172.21.15.84:0/378081036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc02f9b0 con 0x7fdeec143d20 2023-12-12T09:21:21.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.784+0000 7fdeea7fc640 1 -- 172.21.15.84:0/378081036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc02fd40 con 0x7fdeec143d20 2023-12-12T09:21:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.784+0000 7fdef1716640 1 -- 172.21.15.84:0/378081036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec143d20 msgr2=0x7fdeec0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.784+0000 7fdef1716640 1 --2- 172.21.15.84:0/378081036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec143d20 0x7fdeec0b40d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc02ba30 comp rx=0 tx=0).stop 2023-12-12T09:21:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.785+0000 7fdef1716640 1 -- 172.21.15.84:0/378081036 shutdown_connections 2023-12-12T09:21:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.785+0000 7fdef1716640 1 --2- 172.21.15.84:0/378081036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec143d20 0x7fdeec0b40d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.785+0000 7fdef1716640 1 -- 172.21.15.84:0/378081036 >> 172.21.15.84:0/378081036 conn(0x7fdeec06c3d0 msgr2=0x7fdeec06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.785+0000 7fdef1716640 1 -- 172.21.15.84:0/378081036 shutdown_connections 2023-12-12T09:21:21.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.785+0000 7fdef1716640 1 -- 172.21.15.84:0/378081036 wait complete. 2023-12-12T09:21:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.786+0000 7fdef1716640 1 Processor -- start 2023-12-12T09:21:21.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.786+0000 7fdef1716640 1 -- start start 2023-12-12T09:21:21.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.787+0000 7fdef1716640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeec0ce550 0x7fdeec0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:21.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.787+0000 7fdef1716640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdeec143d20 0x7fdeec1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:21.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.787+0000 7fdef1716640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec1447f0 0x7fdeec1f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:21.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.787+0000 7fdef1716640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec13abd0 con 0x7fdeec1447f0 2023-12-12T09:21:21.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.787+0000 7fdef1716640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec1f78a0 con 0x7fdeec0ce550 2023-12-12T09:21:21.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.787+0000 7fdef1716640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec1f72e0 con 0x7fdeec143d20 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec1447f0 0x7fdeec1f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec1447f0 0x7fdeec1f6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50180/0 (socket says 172.21.15.84:50180) 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 -- 172.21.15.84:0/525243040 learned_addr learned my addr 172.21.15.84:0/525243040 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdee3fff640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdeec143d20 0x7fdeec1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeaffd640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeec0ce550 0x7fdeec0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 -- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdeec143d20 msgr2=0x7fdeec1f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdeec143d20 0x7fdeec1f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 -- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeec0ce550 msgr2=0x7fdeec0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeec0ce550 0x7fdeec0b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 -- 172.21.15.84:0/525243040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0094d0 con 0x7fdeec1447f0 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeaffd640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeec0ce550 0x7fdeec0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.788+0000 7fdeeb7fe640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec1447f0 0x7fdeec1f6970 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c680 tx=0x7fdee400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.789+0000 7fdee37fe640 1 -- 172.21.15.84:0/525243040 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4003b70 con 0x7fdeec1447f0 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.789+0000 7fdee37fe640 1 -- 172.21.15.84:0/525243040 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee4003cd0 con 0x7fdeec1447f0 2023-12-12T09:21:21.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.789+0000 7fdee37fe640 1 -- 172.21.15.84:0/525243040 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee4005310 con 0x7fdeec1447f0 2023-12-12T09:21:21.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.789+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec1f75c0 con 0x7fdeec1447f0 2023-12-12T09:21:21.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.789+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec0b2400 con 0x7fdeec1447f0 2023-12-12T09:21:21.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.790+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec13b320 con 0x7fdeec1447f0 2023-12-12T09:21:21.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.791+0000 7fdee37fe640 1 -- 172.21.15.84:0/525243040 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdee4005470 con 0x7fdeec1447f0 2023-12-12T09:21:21.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.792+0000 7fdee37fe640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdecc06ae40 0x7fdecc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:21.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.792+0000 7fdee37fe640 1 -- 172.21.15.84:0/525243040 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdee4089130 con 0x7fdeec1447f0 2023-12-12T09:21:21.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.792+0000 7fdeeaffd640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdecc06ae40 0x7fdecc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:21.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.793+0000 7fdeeaffd640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdecc06ae40 0x7fdecc06d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdedc036000 tx=0x7fdedc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:21.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.797+0000 7fdee37fe640 1 -- 172.21.15.84:0/525243040 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdeec13b320 con 0x7fdeec1447f0 2023-12-12T09:21:21.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:21.998+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdeec13b320 con 0x7fdeec1447f0 2023-12-12T09:21:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.184+0000 7fdee37fe640 1 -- 172.21.15.84:0/525243040 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdeec13b320 con 0x7fdeec1447f0 2023-12-12T09:21:23.185 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-12-12T09:21:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdecc06ae40 msgr2=0x7fdecc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdecc06ae40 0x7fdecc06d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdedc036000 tx=0x7fdedc008030 comp rx=0 tx=0).stop 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec1447f0 msgr2=0x7fdeec1f6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec1447f0 0x7fdeec1f6970 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c680 tx=0x7fdee400cb40 comp rx=0 tx=0).stop 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 shutdown_connections 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdecc06ae40 0x7fdecc06d300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdeec1447f0 0x7fdeec1f6970 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdeec143d20 0x7fdeec1f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 --2- 172.21.15.84:0/525243040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdeec0ce550 0x7fdeec0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 >> 172.21.15.84:0/525243040 conn(0x7fdeec06c3d0 msgr2=0x7fdeec06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 shutdown_connections 2023-12-12T09:21:23.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.189+0000 7fdef1716640 1 -- 172.21.15.84:0/525243040 wait complete. 2023-12-12T09:21:23.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-12T09:21:23.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.420+0000 7f524a07c640 1 Processor -- start 2023-12-12T09:21:23.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.421+0000 7f524a07c640 1 -- start start 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.422+0000 7f524a07c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406d230 0x7f52440cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.422+0000 7f524a07c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f524406e3e0 0x7f52440cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.422+0000 7f524a07c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440cffd0 con 0x7f524406f300 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.422+0000 7f524a07c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440cf160 con 0x7f524406e3e0 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.422+0000 7f524a07c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440cf400 con 0x7f524406d230 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.422+0000 7f523bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f524406e3e0 0x7f52440cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.422+0000 7f5243fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f524406f300 0x7f524415cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34440/0 (socket says 172.21.15.84:34440) 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.422+0000 7f5243fff640 1 -- 172.21.15.84:0/584433540 learned_addr learned my addr 172.21.15.84:0/584433540 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:23.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.423+0000 7f52437fe640 1 --2- 172.21.15.84:0/584433540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406d230 0x7f52440cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.423+0000 7f523bfff640 1 -- 172.21.15.84:0/584433540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406d230 msgr2=0x7f52440cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:23.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.423+0000 7f523bfff640 1 --2- 172.21.15.84:0/584433540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406d230 0x7f52440cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.423+0000 7f523bfff640 1 -- 172.21.15.84:0/584433540 >> v1:172.21.15.84:6789/0 conn(0x7f524406f300 legacy=0x7f524415cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.423+0000 7f523bfff640 1 -- 172.21.15.84:0/584433540 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524406d610 con 0x7f524406e3e0 2023-12-12T09:21:23.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.423+0000 7f5242ffd640 1 -- 172.21.15.84:0/584433540 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869044814 0 0) 0x7f52440cffd0 con 0x7f524406f300 2023-12-12T09:21:23.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.424+0000 7f523bfff640 1 --2- 172.21.15.84:0/584433540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f52440cddb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f522c0097a0 tx=0x7f522c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a61b96042368cb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:23.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f5242ffd640 1 -- 172.21.15.84:0/584433540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c02e070 con 0x7f524406e3e0 2023-12-12T09:21:23.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f5242ffd640 1 -- 172.21.15.84:0/584433540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0315a0 con 0x7f524406e3e0 2023-12-12T09:21:23.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f5242ffd640 1 -- 172.21.15.84:0/584433540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c031930 con 0x7f524406e3e0 2023-12-12T09:21:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f524a07c640 1 -- 172.21.15.84:0/584433540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 msgr2=0x7f52440cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f524a07c640 1 --2- 172.21.15.84:0/584433540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f52440cddb0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f522c0097a0 tx=0x7f522c02b840 comp rx=0 tx=0).stop 2023-12-12T09:21:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f524a07c640 1 -- 172.21.15.84:0/584433540 shutdown_connections 2023-12-12T09:21:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f524a07c640 1 --2- 172.21.15.84:0/584433540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f52440cddb0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f524a07c640 1 --2- 172.21.15.84:0/584433540 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406d230 0x7f52440cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f524a07c640 1 -- 172.21.15.84:0/584433540 >> 172.21.15.84:0/584433540 conn(0x7f52440d0e90 msgr2=0x7f52440d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f524a07c640 1 -- 172.21.15.84:0/584433540 shutdown_connections 2023-12-12T09:21:23.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.425+0000 7f524a07c640 1 -- 172.21.15.84:0/584433540 wait complete. 2023-12-12T09:21:23.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.427+0000 7f524a07c640 1 Processor -- start 2023-12-12T09:21:23.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.427+0000 7f524a07c640 1 -- start start 2023-12-12T09:21:23.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.428+0000 7f524a07c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f524406d230 0x7f524409c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.428+0000 7f524a07c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f524409e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.428+0000 7f524a07c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406f300 0x7f524409e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.428+0000 7f524a07c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c70e0 con 0x7f524406e3e0 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.428+0000 7f524a07c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c54c0 con 0x7f524406d230 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.428+0000 7f524a07c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524409eb30 con 0x7f524406f300 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f524409e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f524409e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50192/0 (socket says 172.21.15.84:50192) 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 -- 172.21.15.84:0/1170655428 learned_addr learned my addr 172.21.15.84:0/1170655428 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f5243fff640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406f300 0x7f524409e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 -- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406f300 msgr2=0x7f524409e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f52437fe640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f524406d230 0x7f524409c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406f300 0x7f524409e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 -- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f524406d230 msgr2=0x7f524409c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f524406d230 0x7f524409c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 -- 172.21.15.84:0/1170655428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c009400 con 0x7f524406e3e0 2023-12-12T09:21:23.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f5243fff640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406f300 0x7f524409e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:23.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.429+0000 7f523bfff640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f524409e0b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f522c034040 tx=0x7f522c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.430+0000 7f5240ff9640 1 -- 172.21.15.84:0/1170655428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c004230 con 0x7f524406e3e0 2023-12-12T09:21:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.430+0000 7f5240ff9640 1 -- 172.21.15.84:0/1170655428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c031f00 con 0x7f524406e3e0 2023-12-12T09:21:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.430+0000 7f5240ff9640 1 -- 172.21.15.84:0/1170655428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c032640 con 0x7f524406e3e0 2023-12-12T09:21:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.430+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440c4b20 con 0x7f524406e3e0 2023-12-12T09:21:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.430+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440c50e0 con 0x7f524406e3e0 2023-12-12T09:21:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.431+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52440c5600 con 0x7f524406e3e0 2023-12-12T09:21:23.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.432+0000 7f5240ff9640 1 -- 172.21.15.84:0/1170655428 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f522c0327a0 con 0x7f524406e3e0 2023-12-12T09:21:23.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.433+0000 7f5240ff9640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f522406ae40 0x7f522406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.433+0000 7f5240ff9640 1 -- 172.21.15.84:0/1170655428 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f522c0ab4d0 con 0x7f524406e3e0 2023-12-12T09:21:23.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.433+0000 7f52437fe640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f522406ae40 0x7f522406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.434+0000 7f52437fe640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f522406ae40 0x7f522406d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5234006fd0 tx=0x7f5234008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:23.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.437+0000 7f5240ff9640 1 -- 172.21.15.84:0/1170655428 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f522c076780 con 0x7f524406e3e0 2023-12-12T09:21:23.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.700+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f52440673c0 con 0x7f524406e3e0 2023-12-12T09:21:23.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.701+0000 7f5240ff9640 1 -- 172.21.15.84:0/1170655428 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f522c079da0 con 0x7f524406e3e0 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBnJXhlazPlCRAA8h1rv4l+wATTogAYJaJACA==", 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:21:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBnJXhl2U3oLBAAamxW25qScCfsVFF8J5k66w==", 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBnJXhlyuNKGxAArml3MuY84tPlWVEkGXrQfA==", 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-12-12T09:21:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhlFkIjAhAArQOrgyVa4DoHVjka8fe9IQ==", 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBsJXhlGWtaKBAAcvay28WkisUnS9PkhhQAWQ==", 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBwJXhlzLyeBRAAF0OQ1/uxjMtcH7Dlq19+wQ==", 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-12-12T09:21:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBzJXhlDeDLDxAAs1H0Lw3yvvj26MgWz8tf+w==", 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQB2JXhlCGrHGxAAcT18fJklTVxEPj2Ax9bLkw==", 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQB9JXhlvGCgFRAANKCYQxghEUOGixr7gZ3QBA==", 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCAJXhlAK3nLhAAvPsU0fD/waCxvw8zQ3L07w==", 2023-12-12T09:21:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCDJXhlXIk1ORAApKc5rcRGatUeNq+RVIh6Ng==", 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCHJXhlPw0zBxAAd3PQvyZAAGDlzbPKm/0zgA==", 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-12-12T09:21:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg==", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhl/GmeJRAAUJlsvxorGdsBuqqHSU8LWw==", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-12-12T09:21:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhlei68GhAAU3Wy1eq+3Pkruvpil5J1Zg==", 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhli8+AMRAAc4+osq4LmnMpuknxONr3YQ==", 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBlJXhlYHMiORAAHWgXN5g13bYNUU0F8QGp3A==", 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.713 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mds", 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCaJXhlZW9tChAAK/Axs9J4Vk1lNLEuQXbBFw==", 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mds" 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.714 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mgr", 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCaJXhlcJNtChAAeP55zQpU3czaO9G1HXju4w==", 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-osd", 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCaJXhlMKxtChAAFcBRbefdb53O0OlUAP+j/g==", 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-osd" 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd", 2023-12-12T09:21:23.715 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCaJXhlPsVtChAA2vKNL0UIs7OiiQPzTxIZ1A==", 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCaJXhlTt1tChAAROcHrU4KEYTJMunUVfEvxg==", 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rgw", 2023-12-12T09:21:23.716 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCaJXhlaPZtChAAta2ngJqHmXiXeP6FEWZzMg==", 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBmJXhlWTtoOhAAHRRsQlAYQsSgQIzlShMGXw==", 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-12-12T09:21:23.717 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBmJXhlNy8cLRAANZgrMuGBpqE0vziSKDEZZw==", 2023-12-12T09:21:23.718 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:21:23.718 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-12-12T09:21:23.718 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-12-12T09:21:23.718 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:21:23.718 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.718 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:23.718 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-12-12T09:21:23.718 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f522406ae40 msgr2=0x7f522406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f522406ae40 0x7f522406d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5234006fd0 tx=0x7f5234008040 comp rx=0 tx=0).stop 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 msgr2=0x7f524409e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f524409e0b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f522c034040 tx=0x7f522c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 shutdown_connections 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f524406f300 0x7f524409e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f522406ae40 0x7f522406d300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f524406e3e0 0x7f524409e0b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 --2- 172.21.15.84:0/1170655428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f524406d230 0x7f524409c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 >> 172.21.15.84:0/1170655428 conn(0x7f52440d0e90 msgr2=0x7f52440d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:23.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.704+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 shutdown_connections 2023-12-12T09:21:23.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.705+0000 7f524a07c640 1 -- 172.21.15.84:0/1170655428 wait complete. 2023-12-12T09:21:23.723 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-12T09:21:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.924+0000 7f80704bb640 1 Processor -- start 2023-12-12T09:21:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.924+0000 7f80704bb640 1 -- start start 2023-12-12T09:21:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f80704bb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80680b47e0 0x7f8068071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f80704bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80680ce550 0x7f80680715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f80704bb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680cea30 con 0x7f8068143d20 2023-12-12T09:21:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f80704bb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80680702b0 con 0x7f80680b47e0 2023-12-12T09:21:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f80704bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8068070590 con 0x7f80680ce550 2023-12-12T09:21:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f806ea58640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80680ce550 0x7f80680715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f806da56640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80680b47e0 0x7f8068071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f806ea58640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80680ce550 0x7f80680715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:42294/0 (socket says 172.21.15.84:42294) 2023-12-12T09:21:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.926+0000 7f806ea58640 1 -- 172.21.15.84:0/709738569 learned_addr learned my addr 172.21.15.84:0/709738569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.927+0000 7f806da56640 1 -- 172.21.15.84:0/709738569 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80680ce550 msgr2=0x7f80680715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.927+0000 7f806da56640 1 --2- 172.21.15.84:0/709738569 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80680ce550 0x7f80680715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.927+0000 7f806da56640 1 -- 172.21.15.84:0/709738569 >> v1:172.21.15.99:6789/0 conn(0x7f8068143d20 legacy=0x7f80680b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.927+0000 7f806da56640 1 -- 172.21.15.84:0/709738569 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068070870 con 0x7f80680b47e0 2023-12-12T09:21:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.928+0000 7f806da56640 1 --2- 172.21.15.84:0/709738569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680b47e0 0x7f8068071070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80580097a0 tx=0x7f805802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c777c0f5f07306d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.929+0000 7f806d255640 1 -- 172.21.15.84:0/709738569 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058031830 con 0x7f80680b47e0 2023-12-12T09:21:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.929+0000 7f806d255640 1 -- 172.21.15.84:0/709738569 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8058031990 con 0x7f80680b47e0 2023-12-12T09:21:23.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.929+0000 7f806d255640 1 -- 172.21.15.84:0/709738569 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8058031d20 con 0x7f80680b47e0 2023-12-12T09:21:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.930+0000 7f80704bb640 1 -- 172.21.15.84:0/709738569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680b47e0 msgr2=0x7f8068071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.930+0000 7f80704bb640 1 --2- 172.21.15.84:0/709738569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680b47e0 0x7f8068071070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f80580097a0 tx=0x7f805802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.930+0000 7f80704bb640 1 -- 172.21.15.84:0/709738569 shutdown_connections 2023-12-12T09:21:23.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.930+0000 7f80704bb640 1 --2- 172.21.15.84:0/709738569 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80680ce550 0x7f80680715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.930+0000 7f80704bb640 1 --2- 172.21.15.84:0/709738569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680b47e0 0x7f8068071070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.930+0000 7f80704bb640 1 -- 172.21.15.84:0/709738569 >> 172.21.15.84:0/709738569 conn(0x7f806806c3d0 msgr2=0x7f806806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.930+0000 7f80704bb640 1 -- 172.21.15.84:0/709738569 shutdown_connections 2023-12-12T09:21:23.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.930+0000 7f80704bb640 1 -- 172.21.15.84:0/709738569 wait complete. 2023-12-12T09:21:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.932+0000 7f80704bb640 1 Processor -- start 2023-12-12T09:21:23.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.933+0000 7f80704bb640 1 -- start start 2023-12-12T09:21:23.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f80704bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680b47e0 0x7f8068159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f80704bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680ce550 0x7f80680b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f80704bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8068143d20 0x7f80680af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f80704bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806815a4e0 con 0x7f80680b47e0 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f80704bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806815c980 con 0x7f80680ce550 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f80704bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806815b8e0 con 0x7f8068143d20 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f806e257640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680b47e0 0x7f8068159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f806e257640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680b47e0 0x7f8068159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50208/0 (socket says 172.21.15.84:50208) 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.934+0000 7f806e257640 1 -- 172.21.15.84:0/663477715 learned_addr learned my addr 172.21.15.84:0/663477715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806da56640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680ce550 0x7f80680b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806ea58640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8068143d20 0x7f80680af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806e257640 1 -- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8068143d20 msgr2=0x7f80680af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806e257640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8068143d20 0x7f80680af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806e257640 1 -- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680ce550 msgr2=0x7f80680b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806e257640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680ce550 0x7f80680b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806e257640 1 -- 172.21.15.84:0/663477715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8058009400 con 0x7f80680b47e0 2023-12-12T09:21:23.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806ea58640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8068143d20 0x7f80680af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806da56640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680ce550 0x7f80680b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f806e257640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680b47e0 0x7f8068159fa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f806400c730 tx=0x7f806400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f805effd640 1 -- 172.21.15.84:0/663477715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064003b70 con 0x7f80680b47e0 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f805effd640 1 -- 172.21.15.84:0/663477715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8064003cf0 con 0x7f80680b47e0 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806815bbc0 con 0x7f80680b47e0 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f805effd640 1 -- 172.21.15.84:0/663477715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064003ea0 con 0x7f80680b47e0 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.935+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806815c180 con 0x7f80680b47e0 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.936+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80680673c0 con 0x7f80680b47e0 2023-12-12T09:21:23.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.937+0000 7f805effd640 1 -- 172.21.15.84:0/663477715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f806400aa90 con 0x7f80680b47e0 2023-12-12T09:21:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.939+0000 7f805effd640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f804c06ae40 0x7f804c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.939+0000 7f805effd640 1 -- 172.21.15.84:0/663477715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f80640892f0 con 0x7f80680b47e0 2023-12-12T09:21:23.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.939+0000 7f806da56640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f804c06ae40 0x7f804c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:23.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.940+0000 7f806da56640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f804c06ae40 0x7f804c06d300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8058036000 tx=0x7f8058008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:23.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:23.943+0000 7f805effd640 1 -- 172.21.15.84:0/663477715 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8064054510 con 0x7f80680b47e0 2023-12-12T09:21:24.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.183+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f806806e3b0 con 0x7f80680b47e0 2023-12-12T09:21:24.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.187+0000 7f805effd640 1 -- 172.21.15.84:0/663477715 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8064057b30 con 0x7f80680b47e0 2023-12-12T09:21:24.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.190+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f804c06ae40 msgr2=0x7f804c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.190+0000 7f80704bb640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f804c06ae40 0x7f804c06d300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8058036000 tx=0x7f8058008030 comp rx=0 tx=0).stop 2023-12-12T09:21:24.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.190+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680b47e0 msgr2=0x7f8068159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.190+0000 7f80704bb640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680b47e0 0x7f8068159fa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f806400c730 tx=0x7f806400cbf0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.191+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 shutdown_connections 2023-12-12T09:21:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.191+0000 7f80704bb640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8068143d20 0x7f80680af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.191+0000 7f80704bb640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680ce550 0x7f80680b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.191+0000 7f80704bb640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f804c06ae40 0x7f804c06d300 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.191+0000 7f80704bb640 1 --2- 172.21.15.84:0/663477715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80680b47e0 0x7f8068159fa0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.191+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 >> 172.21.15.84:0/663477715 conn(0x7f806806c3d0 msgr2=0x7f80680b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.191+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 shutdown_connections 2023-12-12T09:21:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.191+0000 7f80704bb640 1 -- 172.21.15.84:0/663477715 wait complete. 2023-12-12T09:21:24.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-12T09:21:24.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.413+0000 7fd635d7c640 1 Processor -- start 2023-12-12T09:21:24.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.413+0000 7fd635d7c640 1 -- start start 2023-12-12T09:21:24.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.415+0000 7fd635d7c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd630143d20 0x7fd6300b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.415+0000 7fd635d7c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd6301447f0 0x7fd6300b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.415+0000 7fd635d7c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6300cea30 con 0x7fd6300ce550 2023-12-12T09:21:24.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.415+0000 7fd635d7c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6300702b0 con 0x7fd6301447f0 2023-12-12T09:21:24.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.415+0000 7fd635d7c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd630070590 con 0x7fd630143d20 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.415+0000 7fd626ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd6300ce550 0x7fd63015eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34442/0 (socket says 172.21.15.84:34442) 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.415+0000 7fd626ffd640 1 -- 172.21.15.84:0/3447143470 learned_addr learned my addr 172.21.15.84:0/3447143470 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62f7fe640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd630143d20 0x7fd6300b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62ffff640 1 --2- 172.21.15.84:0/3447143470 >> v2:172.21.15.99:3300/0 conn(0x7fd6301447f0 0x7fd6300b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87095924 0 0) 0x7fd6300cea30 con 0x7fd6300ce550 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd61c003520 con 0x7fd6300ce550 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830476438 0 0) 0x7fd61c003520 con 0x7fd6300ce550 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd630143d20 msgr2=0x7fd6300b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd630143d20 0x7fd6300b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 >> v2:172.21.15.99:3300/0 conn(0x7fd6301447f0 msgr2=0x7fd6300b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 --2- 172.21.15.84:0/3447143470 >> v2:172.21.15.99:3300/0 conn(0x7fd6301447f0 0x7fd6300b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd630070870 con 0x7fd6300ce550 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fd618001670 con 0x7fd6300ce550 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 >> v1:172.21.15.84:6789/0 conn(0x7fd6300ce550 legacy=0x7fd63015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd61c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c0047c0 0x7fd61c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.416+0000 7fd62effd640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd630143d20 0x7fd61c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300702b0 con 0x7fd61c003970 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630070590 con 0x7fd61c0047c0 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61c00b980 con 0x7fd630143d20 2023-12-12T09:21:24.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62f7fe640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd61c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62ffff640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd630143d20 0x7fd61c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62f7fe640 1 -- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd630143d20 msgr2=0x7fd61c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62f7fe640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd630143d20 0x7fd61c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd626ffd640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c0047c0 0x7fd61c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62f7fe640 1 -- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c0047c0 msgr2=0x7fd61c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62f7fe640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c0047c0 0x7fd61c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd62f7fe640 1 -- 172.21.15.84:0/3447143470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c003520 con 0x7fd61c003970 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.417+0000 7fd626ffd640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd61c0047c0 0x7fd61c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.418+0000 7fd62f7fe640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd61c003d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd620009fc0 tx=0x7fd61c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91b017c73948243 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62002cc00 con 0x7fd61c003970 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62000f040 con 0x7fd61c003970 2023-12-12T09:21:24.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd62effd640 1 -- 172.21.15.84:0/3447143470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620034440 con 0x7fd61c003970 2023-12-12T09:21:24.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd635d7c640 1 -- 172.21.15.84:0/3447143470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 msgr2=0x7fd61c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd635d7c640 1 --2- 172.21.15.84:0/3447143470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd61c003d90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd620009fc0 tx=0x7fd61c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd62ffff640 1 -- 172.21.15.84:0/3447143470 reap_dead start 2023-12-12T09:21:24.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd635d7c640 1 -- 172.21.15.84:0/3447143470 shutdown_connections 2023-12-12T09:21:24.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd635d7c640 1 -- 172.21.15.84:0/3447143470 >> 172.21.15.84:0/3447143470 conn(0x7fd63006c3d0 msgr2=0x7fd63006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:24.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd635d7c640 1 -- 172.21.15.84:0/3447143470 shutdown_connections 2023-12-12T09:21:24.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.419+0000 7fd635d7c640 1 -- 172.21.15.84:0/3447143470 wait complete. 2023-12-12T09:21:24.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.421+0000 7fd635d7c640 1 Processor -- start 2023-12-12T09:21:24.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.421+0000 7fd635d7c640 1 -- start start 2023-12-12T09:21:24.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.422+0000 7fd635d7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd630137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.422+0000 7fd635d7c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6301f58b0 0x7fd63013bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.422+0000 7fd635d7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6301f5d10 0x7fd63013c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.422+0000 7fd635d7c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630138470 con 0x7fd61c003970 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.422+0000 7fd635d7c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630150550 con 0x7fd6301f5d10 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.422+0000 7fd635d7c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd630137170 con 0x7fd6301f58b0 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.422+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd630137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd630137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50234/0 (socket says 172.21.15.84:50234) 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62f7fe640 1 -- 172.21.15.84:0/4273914049 learned_addr learned my addr 172.21.15.84:0/4273914049 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62f7fe640 1 -- 172.21.15.84:0/4273914049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6301f58b0 msgr2=0x7fd63013bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62f7fe640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6301f58b0 0x7fd63013bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62f7fe640 1 -- 172.21.15.84:0/4273914049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6301f5d10 msgr2=0x7fd63013c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62f7fe640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6301f5d10 0x7fd63013c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62f7fe640 1 -- 172.21.15.84:0/4273914049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd630137450 con 0x7fd61c003970 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62f7fe640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd630137f30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd620009f60 tx=0x7fd620009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:24.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62cff9640 1 -- 172.21.15.84:0/4273914049 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620034d50 con 0x7fd61c003970 2023-12-12T09:21:24.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62cff9640 1 -- 172.21.15.84:0/4273914049 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620003990 con 0x7fd61c003970 2023-12-12T09:21:24.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd62cff9640 1 -- 172.21.15.84:0/4273914049 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620003d00 con 0x7fd61c003970 2023-12-12T09:21:24.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.423+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd630137730 con 0x7fd61c003970 2023-12-12T09:21:24.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.424+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63014f7b0 con 0x7fd61c003970 2023-12-12T09:21:24.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.425+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6300673c0 con 0x7fd61c003970 2023-12-12T09:21:24.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.426+0000 7fd62cff9640 1 -- 172.21.15.84:0/4273914049 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd620004030 con 0x7fd61c003970 2023-12-12T09:21:24.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.426+0000 7fd62cff9640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd61006ae70 0x7fd61006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.427+0000 7fd62cff9640 1 -- 172.21.15.84:0/4273914049 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd6200aaed0 con 0x7fd61c003970 2023-12-12T09:21:24.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.427+0000 7fd626ffd640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd61006ae70 0x7fd61006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.427+0000 7fd626ffd640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd61006ae70 0x7fd61006d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd618001eb0 tx=0x7fd618009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:24.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.431+0000 7fd62cff9640 1 -- 172.21.15.84:0/4273914049 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd620076360 con 0x7fd61c003970 2023-12-12T09:21:24.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.672+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd63006e3b0 con 0x7fd61c003970 2023-12-12T09:21:24.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.678+0000 7fd62cff9640 1 -- 172.21.15.84:0/4273914049 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd620079980 con 0x7fd61c003970 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd61006ae70 msgr2=0x7fd61006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd61006ae70 0x7fd61006d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd618001eb0 tx=0x7fd618009040 comp rx=0 tx=0).stop 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 msgr2=0x7fd630137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd630137f30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd620009f60 tx=0x7fd620009750 comp rx=0 tx=0).stop 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 shutdown_connections 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6301f5d10 0x7fd63013c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6301f58b0 0x7fd63013bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd61006ae70 0x7fd61006d330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 --2- 172.21.15.84:0/4273914049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd61c003970 0x7fd630137f30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 >> 172.21.15.84:0/4273914049 conn(0x7fd63006c3d0 msgr2=0x7fd63013e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 shutdown_connections 2023-12-12T09:21:24.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.681+0000 7fd635d7c640 1 -- 172.21.15.84:0/4273914049 wait complete. 2023-12-12T09:21:24.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-12T09:21:24.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.903+0000 7f83450ca640 1 Processor -- start 2023-12-12T09:21:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.904+0000 7f83450ca640 1 -- start start 2023-12-12T09:21:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f83450ca640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f834015b1e0 0x7f83400cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f83450ca640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f83400c5320 0x7f83400c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f83450ca640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83400c48b0 con 0x7f83400cc2c0 2023-12-12T09:21:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f83450ca640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83400cc810 con 0x7f83400c5320 2023-12-12T09:21:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f83450ca640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400c4b20 con 0x7f834015b1e0 2023-12-12T09:21:24.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f83377fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f83400cc2c0 0x7f83400cdc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34444/0 (socket says 172.21.15.84:34444) 2023-12-12T09:21:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f83377fe640 1 -- 172.21.15.84:0/1296822024 learned_addr learned my addr 172.21.15.84:0/1296822024 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f83448c9640 1 --2- 172.21.15.84:0/1296822024 >> v2:172.21.15.84:3300/0 conn(0x7f83400c5320 0x7f83400c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f833ffff640 1 --2- 172.21.15.84:0/1296822024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f834015b1e0 0x7f83400cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.905+0000 7f833f7fe640 1 -- 172.21.15.84:0/1296822024 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220886631 0 0) 0x7f83400c48b0 con 0x7f83400cc2c0 2023-12-12T09:21:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.906+0000 7f833f7fe640 1 -- 172.21.15.84:0/1296822024 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f832c003520 con 0x7f83400cc2c0 2023-12-12T09:21:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.906+0000 7f83448c9640 1 -- 172.21.15.84:0/1296822024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f834015b1e0 msgr2=0x7f83400cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.906+0000 7f83448c9640 1 --2- 172.21.15.84:0/1296822024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f834015b1e0 0x7f83400cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.906+0000 7f83448c9640 1 -- 172.21.15.84:0/1296822024 >> v1:172.21.15.84:6789/0 conn(0x7f83400cc2c0 legacy=0x7f83400cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.906+0000 7f83448c9640 1 -- 172.21.15.84:0/1296822024 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400c4e00 con 0x7f83400c5320 2023-12-12T09:21:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.907+0000 7f83448c9640 1 --2- 172.21.15.84:0/1296822024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83400c5320 0x7f83400c57b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f83380097a0 tx=0x7f833802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45689637151adeb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.907+0000 7f833f7fe640 1 -- 172.21.15.84:0/1296822024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338031780 con 0x7f83400c5320 2023-12-12T09:21:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.907+0000 7f833f7fe640 1 -- 172.21.15.84:0/1296822024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83380318e0 con 0x7f83400c5320 2023-12-12T09:21:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.907+0000 7f833f7fe640 1 -- 172.21.15.84:0/1296822024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338031c70 con 0x7f83400c5320 2023-12-12T09:21:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.908+0000 7f83450ca640 1 -- 172.21.15.84:0/1296822024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83400c5320 msgr2=0x7f83400c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.908+0000 7f83450ca640 1 --2- 172.21.15.84:0/1296822024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83400c5320 0x7f83400c57b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f83380097a0 tx=0x7f833802b820 comp rx=0 tx=0).stop 2023-12-12T09:21:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.908+0000 7f83450ca640 1 -- 172.21.15.84:0/1296822024 shutdown_connections 2023-12-12T09:21:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.908+0000 7f83450ca640 1 --2- 172.21.15.84:0/1296822024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83400c5320 0x7f83400c57b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.908+0000 7f83450ca640 1 --2- 172.21.15.84:0/1296822024 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f834015b1e0 0x7f83400cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.908+0000 7f83450ca640 1 -- 172.21.15.84:0/1296822024 >> 172.21.15.84:0/1296822024 conn(0x7f83400b2830 msgr2=0x7f83400b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.908+0000 7f83450ca640 1 -- 172.21.15.84:0/1296822024 shutdown_connections 2023-12-12T09:21:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.908+0000 7f83450ca640 1 -- 172.21.15.84:0/1296822024 wait complete. 2023-12-12T09:21:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.909+0000 7f83450ca640 1 Processor -- start 2023-12-12T09:21:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.910+0000 7f83450ca640 1 -- start start 2023-12-12T09:21:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.910+0000 7f83450ca640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83400c5320 0x7f8340154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.910+0000 7f83450ca640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83400cc2c0 0x7f83401e5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.910+0000 7f83450ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f834015b1e0 0x7f83401e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.910+0000 7f83450ca640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83401e6a20 con 0x7f834015b1e0 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.910+0000 7f83450ca640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83401e4880 con 0x7f83400cc2c0 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.910+0000 7f83450ca640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83401e4b60 con 0x7f83400c5320 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f834015b1e0 0x7f83401e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f834015b1e0 0x7f83401e60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50254/0 (socket says 172.21.15.84:50254) 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 -- 172.21.15.84:0/3116569854 learned_addr learned my addr 172.21.15.84:0/3116569854 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 -- 172.21.15.84:0/3116569854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83400c5320 msgr2=0x7f8340154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f833ffff640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83400c5320 0x7f8340154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83377fe640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83400cc2c0 0x7f83401e5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83400c5320 0x7f8340154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 -- 172.21.15.84:0/3116569854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83400cc2c0 msgr2=0x7f83401e5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83400cc2c0 0x7f83401e5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 -- 172.21.15.84:0/3116569854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338009400 con 0x7f834015b1e0 2023-12-12T09:21:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.911+0000 7f83448c9640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f834015b1e0 0x7f83401e60b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8338034040 tx=0x7f83380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:24.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.912+0000 7f833d7fa640 1 -- 172.21.15.84:0/3116569854 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338032820 con 0x7f834015b1e0 2023-12-12T09:21:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.912+0000 7f833d7fa640 1 -- 172.21.15.84:0/3116569854 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338032980 con 0x7f834015b1e0 2023-12-12T09:21:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.912+0000 7f833d7fa640 1 -- 172.21.15.84:0/3116569854 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338032d30 con 0x7f834015b1e0 2023-12-12T09:21:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.912+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83401e4e40 con 0x7f834015b1e0 2023-12-12T09:21:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.912+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83401e65f0 con 0x7f834015b1e0 2023-12-12T09:21:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.913+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83401e46e0 con 0x7f834015b1e0 2023-12-12T09:21:24.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.914+0000 7f833d7fa640 1 -- 172.21.15.84:0/3116569854 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f833804e450 con 0x7f834015b1e0 2023-12-12T09:21:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.914+0000 7f833d7fa640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006ae40 0x7f832006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.915+0000 7f833d7fa640 1 -- 172.21.15.84:0/3116569854 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f83380ab440 con 0x7f834015b1e0 2023-12-12T09:21:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.915+0000 7f833ffff640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006ae40 0x7f832006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:24.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.915+0000 7f833ffff640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006ae40 0x7f832006d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83401f5fe0 tx=0x7f833000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:24.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:24.919+0000 7f833d7fa640 1 -- 172.21.15.84:0/3116569854 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83401e46e0 con 0x7f834015b1e0 2023-12-12T09:21:25.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.179+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f83401e46e0 con 0x7f834015b1e0 2023-12-12T09:21:25.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.184+0000 7f833d7fa640 1 -- 172.21.15.84:0/3116569854 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f83401e46e0 con 0x7f834015b1e0 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006ae40 msgr2=0x7f832006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006ae40 0x7f832006d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83401f5fe0 tx=0x7f833000b040 comp rx=0 tx=0).stop 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f834015b1e0 msgr2=0x7f83401e60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f834015b1e0 0x7f83401e60b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8338034040 tx=0x7f83380046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 shutdown_connections 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f832006ae40 0x7f832006d300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f834015b1e0 0x7f83401e60b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83400cc2c0 0x7f83401e5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 --2- 172.21.15.84:0/3116569854 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f83400c5320 0x7f8340154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 >> 172.21.15.84:0/3116569854 conn(0x7f83400b2830 msgr2=0x7f83400c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 shutdown_connections 2023-12-12T09:21:25.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.188+0000 7f83450ca640 1 -- 172.21.15.84:0/3116569854 wait complete. 2023-12-12T09:21:25.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-12T09:21:25.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.403+0000 7f886038a640 1 Processor -- start 2023-12-12T09:21:25.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.403+0000 7f886038a640 1 -- start start 2023-12-12T09:21:25.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.405+0000 7f886038a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f885806ade0 0x7f88581614f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.405+0000 7f886038a640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885806b2d0 con 0x7f885806aa00 2023-12-12T09:21:25.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.405+0000 7f886038a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885806b5b0 con 0x7f8858146500 2023-12-12T09:21:25.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.405+0000 7f886038a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8858140840 con 0x7f885806ade0 2023-12-12T09:21:25.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.405+0000 7f885e126640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f885806aa00 0x7f8858160de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34450/0 (socket says 172.21.15.84:34450) 2023-12-12T09:21:25.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.405+0000 7f885e126640 1 -- 172.21.15.84:0/735948544 learned_addr learned my addr 172.21.15.84:0/735948544 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.405+0000 7f885d925640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f885806ade0 0x7f88581614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.405+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164426826 0 0) 0x7f885806b2d0 con 0x7f885806aa00 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8848003520 con 0x7f885806aa00 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 137722321 0 0) 0x7f8848003520 con 0x7f885806aa00 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f885806ade0 msgr2=0x7f88581614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f885806ade0 0x7f88581614f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 >> v1:172.21.15.99:6789/0 conn(0x7f8858146500 legacy=0x7f885806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885806b890 con 0x7f885806aa00 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f884c0019f0 con 0x7f885806aa00 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 >> v1:172.21.15.84:6789/0 conn(0x7f885806aa00 legacy=0x7f8858160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88480039a0 0x7f8848003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480047c0 0x7f8848004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f885806ade0 0x7f8848005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858140840 con 0x7f88480039a0 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884800ba60 con 0x7f88480047c0 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884800bc20 con 0x7f885806ade0 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.406+0000 7f885e126640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88480039a0 0x7f8848003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.407+0000 7f885d925640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480047c0 0x7f8848004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.407+0000 7f885e927640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f885806ade0 0x7f8848005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.407+0000 7f885e126640 1 -- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f885806ade0 msgr2=0x7f8848005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.407+0000 7f885e126640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f885806ade0 0x7f8848005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.407+0000 7f885e126640 1 -- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480047c0 msgr2=0x7f8848004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:25.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.407+0000 7f885e126640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480047c0 0x7f8848004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.407+0000 7f885e126640 1 -- 172.21.15.84:0/735948544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848003520 con 0x7f88480039a0 2023-12-12T09:21:25.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.408+0000 7f885e126640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88480039a0 0x7f8848003dc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f884c00a720 tx=0x7f88480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e71b64edd449f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:25.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c034630 con 0x7f88480039a0 2023-12-12T09:21:25.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c02f070 con 0x7f88480039a0 2023-12-12T09:21:25.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f885d124640 1 -- 172.21.15.84:0/735948544 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0349f0 con 0x7f88480039a0 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f886038a640 1 -- 172.21.15.84:0/735948544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88480039a0 msgr2=0x7f8848003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f886038a640 1 --2- 172.21.15.84:0/735948544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88480039a0 0x7f8848003dc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f884c00a720 tx=0x7f88480057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f885e927640 1 -- 172.21.15.84:0/735948544 reap_dead start 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f886038a640 1 -- 172.21.15.84:0/735948544 shutdown_connections 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f886038a640 1 -- 172.21.15.84:0/735948544 >> 172.21.15.84:0/735948544 conn(0x7f88580cf660 msgr2=0x7f88580cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f886038a640 1 -- 172.21.15.84:0/735948544 shutdown_connections 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.409+0000 7f886038a640 1 -- 172.21.15.84:0/735948544 wait complete. 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.411+0000 7f886038a640 1 Processor -- start 2023-12-12T09:21:25.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.411+0000 7f886038a640 1 -- start start 2023-12-12T09:21:25.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f886038a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480039a0 0x7f88580ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f886038a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885815cd50 0x7f885815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f886038a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88580adea0 0x7f88580ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f886038a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580ae860 con 0x7f885815cd50 2023-12-12T09:21:25.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f886038a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885815d1d0 con 0x7f88480039a0 2023-12-12T09:21:25.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f886038a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885815e6f0 con 0x7f88580adea0 2023-12-12T09:21:25.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f885d925640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885815cd50 0x7f885815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f885d925640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885815cd50 0x7f885815e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50274/0 (socket says 172.21.15.84:50274) 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.412+0000 7f885d925640 1 -- 172.21.15.84:0/2473970681 learned_addr learned my addr 172.21.15.84:0/2473970681 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885e126640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480039a0 0x7f88580ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885d925640 1 -- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88580adea0 msgr2=0x7f88580ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885e927640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88580adea0 0x7f88580ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885d925640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88580adea0 0x7f88580ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885d925640 1 -- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480039a0 msgr2=0x7f88580ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885d925640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480039a0 0x7f88580ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885d925640 1 -- 172.21.15.84:0/2473970681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885815e9a0 con 0x7f885815cd50 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885e126640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480039a0 0x7f88580ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f885d925640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885815cd50 0x7f885815e1b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8844011590 tx=0x7f8844011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f8856ffd640 1 -- 172.21.15.84:0/2473970681 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844004220 con 0x7f885815cd50 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f8856ffd640 1 -- 172.21.15.84:0/2473970681 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8844004380 con 0x7f885815cd50 2023-12-12T09:21:25.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885815ec80 con 0x7f885815cd50 2023-12-12T09:21:25.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.413+0000 7f8856ffd640 1 -- 172.21.15.84:0/2473970681 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844015870 con 0x7f885815cd50 2023-12-12T09:21:25.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.414+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885815f240 con 0x7f885815cd50 2023-12-12T09:21:25.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.415+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885813a270 con 0x7f885815cd50 2023-12-12T09:21:25.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.415+0000 7f8856ffd640 1 -- 172.21.15.84:0/2473970681 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88440159d0 con 0x7f885815cd50 2023-12-12T09:21:25.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.416+0000 7f8856ffd640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883c06ae40 0x7f883c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.416+0000 7f8856ffd640 1 -- 172.21.15.84:0/2473970681 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f88440893f0 con 0x7f885815cd50 2023-12-12T09:21:25.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.416+0000 7f885e126640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883c06ae40 0x7f883c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.417+0000 7f885e126640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883c06ae40 0x7f883c06d300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f884c034000 tx=0x7f884c02f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:25.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.421+0000 7f8856ffd640 1 -- 172.21.15.84:0/2473970681 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8844054740 con 0x7f885815cd50 2023-12-12T09:21:25.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.683+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f88580673c0 con 0x7f885815cd50 2023-12-12T09:21:25.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.689+0000 7f8856ffd640 1 -- 172.21.15.84:0/2473970681 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8844057d60 con 0x7f885815cd50 2023-12-12T09:21:25.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883c06ae40 msgr2=0x7f883c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883c06ae40 0x7f883c06d300 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f884c034000 tx=0x7f884c02f000 comp rx=0 tx=0).stop 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885815cd50 msgr2=0x7f885815e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885815cd50 0x7f885815e1b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8844011590 tx=0x7f8844011a50 comp rx=0 tx=0).stop 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 shutdown_connections 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f88580adea0 0x7f88580ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f883c06ae40 0x7f883c06d300 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885815cd50 0x7f885815e1b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 --2- 172.21.15.84:0/2473970681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88480039a0 0x7f88580ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 >> 172.21.15.84:0/2473970681 conn(0x7f88580cf660 msgr2=0x7f88580b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.692+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 shutdown_connections 2023-12-12T09:21:25.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.693+0000 7f886038a640 1 -- 172.21.15.84:0/2473970681 wait complete. 2023-12-12T09:21:25.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-12T09:21:25.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.915+0000 7f1b71a3d640 1 Processor -- start 2023-12-12T09:21:25.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.916+0000 7f1b71a3d640 1 -- start start 2023-12-12T09:21:25.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.917+0000 7f1b71a3d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0b47e0 0x7f1b6c071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.917+0000 7f1b71a3d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b6c0ce550 0x7f1b6c0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b71a3d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6c0cea30 con 0x7f1b6c143d20 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b71a3d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6c0702b0 con 0x7f1b6c0ce550 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b71a3d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c070590 con 0x7f1b6c0b47e0 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b6b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b6c0ce550 0x7f1b6c0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b6affd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1b6c143d20 0x7f1b6c0b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41408/0 (socket says 172.21.15.84:41408) 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b6affd640 1 -- 172.21.15.84:0/3827375800 learned_addr learned my addr 172.21.15.84:0/3827375800 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b6a7fc640 1 --2- 172.21.15.84:0/3827375800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0b47e0 0x7f1b6c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b6b7fe640 1 -- 172.21.15.84:0/3827375800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0b47e0 msgr2=0x7f1b6c071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b6b7fe640 1 --2- 172.21.15.84:0/3827375800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0b47e0 0x7f1b6c071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b6b7fe640 1 -- 172.21.15.84:0/3827375800 >> v1:172.21.15.84:6789/0 conn(0x7f1b6c143d20 legacy=0x7f1b6c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b6b7fe640 1 -- 172.21.15.84:0/3827375800 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c070870 con 0x7f1b6c0ce550 2023-12-12T09:21:25.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.918+0000 7f1b69ffb640 1 -- 172.21.15.84:0/3827375800 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500524677 0 0) 0x7f1b6c0cea30 con 0x7f1b6c143d20 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.919+0000 7f1b6b7fe640 1 --2- 172.21.15.84:0/3827375800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c0ce550 0x7f1b6c0715b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1b640097a0 tx=0x7f1b6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74abe31b2ee8785f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b69ffb640 1 -- 172.21.15.84:0/3827375800 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64031830 con 0x7f1b6c0ce550 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b69ffb640 1 -- 172.21.15.84:0/3827375800 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64031990 con 0x7f1b6c0ce550 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b69ffb640 1 -- 172.21.15.84:0/3827375800 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64031d20 con 0x7f1b6c0ce550 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b71a3d640 1 -- 172.21.15.84:0/3827375800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c0ce550 msgr2=0x7f1b6c0715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/3827375800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c0ce550 0x7f1b6c0715b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1b640097a0 tx=0x7f1b6402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b71a3d640 1 -- 172.21.15.84:0/3827375800 shutdown_connections 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/3827375800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c0ce550 0x7f1b6c0715b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/3827375800 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0b47e0 0x7f1b6c071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b71a3d640 1 -- 172.21.15.84:0/3827375800 >> 172.21.15.84:0/3827375800 conn(0x7f1b6c06c3d0 msgr2=0x7f1b6c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b71a3d640 1 -- 172.21.15.84:0/3827375800 shutdown_connections 2023-12-12T09:21:25.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.920+0000 7f1b71a3d640 1 -- 172.21.15.84:0/3827375800 wait complete. 2023-12-12T09:21:25.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.922+0000 7f1b71a3d640 1 Processor -- start 2023-12-12T09:21:25.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.922+0000 7f1b71a3d640 1 -- start start 2023-12-12T09:21:25.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.923+0000 7f1b71a3d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b6c0b47e0 0x7f1b6c138b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.923+0000 7f1b71a3d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0ce550 0x7f1b6c137230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.923+0000 7f1b71a3d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c143d20 0x7f1b6c14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.923+0000 7f1b71a3d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c1391c0 con 0x7f1b6c143d20 2023-12-12T09:21:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.923+0000 7f1b71a3d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c13b520 con 0x7f1b6c0b47e0 2023-12-12T09:21:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.923+0000 7f1b71a3d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c14d970 con 0x7f1b6c0ce550 2023-12-12T09:21:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.923+0000 7f1b6b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c143d20 0x7f1b6c14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c143d20 0x7f1b6c14d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55376/0 (socket says 172.21.15.84:55376) 2023-12-12T09:21:25.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6b7fe640 1 -- 172.21.15.84:0/4251835744 learned_addr learned my addr 172.21.15.84:0/4251835744 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6affd640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b6c0b47e0 0x7f1b6c138b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6a7fc640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0ce550 0x7f1b6c137230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6b7fe640 1 -- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0ce550 msgr2=0x7f1b6c137230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6b7fe640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0ce550 0x7f1b6c137230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6b7fe640 1 -- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b6c0b47e0 msgr2=0x7f1b6c138b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6b7fe640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b6c0b47e0 0x7f1b6c138b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6b7fe640 1 -- 172.21.15.84:0/4251835744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b64009400 con 0x7f1b6c143d20 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6affd640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b6c0b47e0 0x7f1b6c138b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b6b7fe640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c143d20 0x7f1b6c14d430 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1b640098c0 tx=0x7f1b640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.924+0000 7f1b63fff640 1 -- 172.21.15.84:0/4251835744 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64004230 con 0x7f1b6c143d20 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.925+0000 7f1b63fff640 1 -- 172.21.15.84:0/4251835744 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64004390 con 0x7f1b6c143d20 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.925+0000 7f1b63fff640 1 -- 172.21.15.84:0/4251835744 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6403a8a0 con 0x7f1b6c143d20 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.925+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c13acc0 con 0x7f1b6c143d20 2023-12-12T09:21:25.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.925+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c13b770 con 0x7f1b6c143d20 2023-12-12T09:21:25.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.926+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c13b930 con 0x7f1b6c143d20 2023-12-12T09:21:25.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.927+0000 7f1b63fff640 1 -- 172.21.15.84:0/4251835744 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b6403aa00 con 0x7f1b6c143d20 2023-12-12T09:21:25.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.927+0000 7f1b63fff640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b4c06ae40 0x7f1b4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:25.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.928+0000 7f1b63fff640 1 -- 172.21.15.84:0/4251835744 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1b640abde0 con 0x7f1b6c143d20 2023-12-12T09:21:25.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.928+0000 7f1b6affd640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b4c06ae40 0x7f1b4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:25.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.928+0000 7f1b6affd640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b4c06ae40 0x7f1b4c06d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007fd0 tx=0x7f1b5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:25.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:25.932+0000 7f1b63fff640 1 -- 172.21.15.84:0/4251835744 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b640771c0 con 0x7f1b6c143d20 2023-12-12T09:21:26.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.195+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f1b6c0673c0 con 0x7f1b6c143d20 2023-12-12T09:21:26.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.200+0000 7f1b63fff640 1 -- 172.21.15.84:0/4251835744 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1b6403acb0 con 0x7f1b6c143d20 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b4c06ae40 msgr2=0x7f1b4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b4c06ae40 0x7f1b4c06d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007fd0 tx=0x7f1b5c009040 comp rx=0 tx=0).stop 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c143d20 msgr2=0x7f1b6c14d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c143d20 0x7f1b6c14d430 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1b640098c0 tx=0x7f1b640046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 shutdown_connections 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b4c06ae40 0x7f1b4c06d300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b6c143d20 0x7f1b6c14d430 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b6c0ce550 0x7f1b6c137230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 --2- 172.21.15.84:0/4251835744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b6c0b47e0 0x7f1b6c138b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.203+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 >> 172.21.15.84:0/4251835744 conn(0x7f1b6c06c3d0 msgr2=0x7f1b6c142fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.204+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 shutdown_connections 2023-12-12T09:21:26.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.204+0000 7f1b71a3d640 1 -- 172.21.15.84:0/4251835744 wait complete. 2023-12-12T09:21:26.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-12T09:21:26.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.430+0000 7f2d19ad3640 1 Processor -- start 2023-12-12T09:21:26.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.430+0000 7f2d19ad3640 1 -- start start 2023-12-12T09:21:26.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.432+0000 7f2d19ad3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14142f40 0x7f2d1415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.432+0000 7f2d19ad3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d140b3b60 con 0x7f2d140b4ba0 2023-12-12T09:21:26.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.432+0000 7f2d19ad3640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d140b3de0 con 0x7f2d1413ff90 2023-12-12T09:21:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.432+0000 7f2d19ad3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1415e6d0 con 0x7f2d14142f40 2023-12-12T09:21:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.432+0000 7f2d13fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2d140b4ba0 0x7f2d1415dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41416/0 (socket says 172.21.15.84:41416) 2023-12-12T09:21:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.432+0000 7f2d13fff640 1 -- 172.21.15.84:0/2551915216 learned_addr learned my addr 172.21.15.84:0/2551915216 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d0bfff640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14142f40 0x7f2d1415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510758371 0 0) 0x7f2d140b3b60 con 0x7f2d140b4ba0 2023-12-12T09:21:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d00003520 con 0x7f2d140b4ba0 2023-12-12T09:21:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 475873437 0 0) 0x7f2d00003520 con 0x7f2d140b4ba0 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14142f40 msgr2=0x7f2d1415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d12ffd640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14142f40 0x7f2d1415d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 >> v1:172.21.15.99:6789/0 conn(0x7f2d1413ff90 legacy=0x7f2d14142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140b40c0 con 0x7f2d140b4ba0 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.433+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2d0c0019f0 con 0x7f2d140b4ba0 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 >> v1:172.21.15.84:6789/0 conn(0x7f2d140b4ba0 legacy=0x7f2d1415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d12ffd640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14142f40 0x7f2d000039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d12ffd640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d00003f20 0x7f2d000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d12ffd640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1415e6d0 con 0x7f2d00004d00 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0000ba60 con 0x7f2d00003f20 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0000bc20 con 0x7f2d14142f40 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d13fff640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d0bfff640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d00003f20 0x7f2d000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d13fff640 1 -- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14142f40 msgr2=0x7f2d000039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d13fff640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14142f40 0x7f2d000039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d13fff640 1 -- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d00003f20 msgr2=0x7f2d000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d13fff640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d00003f20 0x7f2d000047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.434+0000 7f2d13fff640 1 -- 172.21.15.84:0/2551915216 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d00003520 con 0x7f2d00004d00 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.435+0000 7f2d13fff640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d00005180 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00a830 tx=0x7f2d000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9e65e711f20f3a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.435+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0072d0 con 0x7f2d00004d00 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c02f070 con 0x7f2d00004d00 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d12ffd640 1 -- 172.21.15.84:0/2551915216 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c007730 con 0x7f2d00004d00 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2551915216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 msgr2=0x7f2d00005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d19ad3640 1 --2- 172.21.15.84:0/2551915216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d00005180 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00a830 tx=0x7f2d000057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d13fff640 1 -- 172.21.15.84:0/2551915216 reap_dead start 2023-12-12T09:21:26.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2551915216 shutdown_connections 2023-12-12T09:21:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2551915216 >> 172.21.15.84:0/2551915216 conn(0x7f2d1406c3d0 msgr2=0x7f2d1406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2551915216 shutdown_connections 2023-12-12T09:21:26.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.436+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2551915216 wait complete. 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.438+0000 7f2d19ad3640 1 Processor -- start 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.438+0000 7f2d19ad3640 1 -- start start 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d19ad3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d14133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d19ad3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d140af1d0 0x7f2d140af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d19ad3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14154890 0x7f2d14154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d19ad3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140afb90 con 0x7f2d00004d00 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d19ad3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d141561f0 con 0x7f2d140af1d0 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d19ad3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d141555e0 con 0x7f2d14154890 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d14133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d14133830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55400/0 (socket says 172.21.15.84:55400) 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.439+0000 7f2d137fe640 1 -- 172.21.15.84:0/2748044158 learned_addr learned my addr 172.21.15.84:0/2748044158 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:26.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d137fe640 1 -- 172.21.15.84:0/2748044158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14154890 msgr2=0x7f2d14154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d137fe640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14154890 0x7f2d14154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d137fe640 1 -- 172.21.15.84:0/2748044158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d140af1d0 msgr2=0x7f2d140af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d137fe640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d140af1d0 0x7f2d140af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d137fe640 1 -- 172.21.15.84:0/2748044158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d141558c0 con 0x7f2d00004d00 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d137fe640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d14133830 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c480 tx=0x7f2d0400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d10ff9640 1 -- 172.21.15.84:0/2748044158 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040052d0 con 0x7f2d00004d00 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d10ff9640 1 -- 172.21.15.84:0/2748044158 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d04005470 con 0x7f2d00004d00 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d14155ba0 con 0x7f2d00004d00 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d10ff9640 1 -- 172.21.15.84:0/2748044158 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04003830 con 0x7f2d00004d00 2023-12-12T09:21:26.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.440+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d14133d70 con 0x7f2d00004d00 2023-12-12T09:21:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.441+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d140673c0 con 0x7f2d00004d00 2023-12-12T09:21:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.442+0000 7f2d10ff9640 1 -- 172.21.15.84:0/2748044158 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d04003990 con 0x7f2d00004d00 2023-12-12T09:21:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.443+0000 7f2d10ff9640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2cf406ae70 0x7f2cf406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.443+0000 7f2d10ff9640 1 -- 172.21.15.84:0/2748044158 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2d040889a0 con 0x7f2d00004d00 2023-12-12T09:21:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.443+0000 7f2d0bfff640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2cf406ae70 0x7f2cf406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.444+0000 7f2d0bfff640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2cf406ae70 0x7f2cf406d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2d140af160 tx=0x7f2cfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:26.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.447+0000 7f2d10ff9640 1 -- 172.21.15.84:0/2748044158 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d04053be0 con 0x7f2d00004d00 2023-12-12T09:21:26.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.710+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2d14161b90 con 0x7f2d00004d00 2023-12-12T09:21:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.714+0000 7f2d10ff9640 1 -- 172.21.15.84:0/2748044158 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2d04017070 con 0x7f2d00004d00 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.717+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2cf406ae70 msgr2=0x7f2cf406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.717+0000 7f2d19ad3640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2cf406ae70 0x7f2cf406d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2d140af160 tx=0x7f2cfc008040 comp rx=0 tx=0).stop 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.717+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 msgr2=0x7f2d14133830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.717+0000 7f2d19ad3640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d14133830 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c480 tx=0x7f2d0400c940 comp rx=0 tx=0).stop 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.717+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 shutdown_connections 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.717+0000 7f2d19ad3640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2d14154890 0x7f2d14154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.717+0000 7f2d19ad3640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d140af1d0 0x7f2d140af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.717+0000 7f2d19ad3640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2cf406ae70 0x7f2cf406d330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.718+0000 7f2d19ad3640 1 --2- 172.21.15.84:0/2748044158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d00004d00 0x7f2d14133830 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.718+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 >> 172.21.15.84:0/2748044158 conn(0x7f2d1406c3d0 msgr2=0x7f2d14160c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:26.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.718+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 shutdown_connections 2023-12-12T09:21:26.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.718+0000 7f2d19ad3640 1 -- 172.21.15.84:0/2748044158 wait complete. 2023-12-12T09:21:26.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.955+0000 7f04189dc640 1 Processor -- start 2023-12-12T09:21:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.955+0000 7f04189dc640 1 -- start start 2023-12-12T09:21:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.957+0000 7f04189dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04140b47e0 0x7f0414071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.957+0000 7f04189dc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f04140ce550 0x7f04140715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.957+0000 7f04189dc640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04140cea30 con 0x7f0414143d20 2023-12-12T09:21:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.957+0000 7f04189dc640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04140702b0 con 0x7f04140ce550 2023-12-12T09:21:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.957+0000 7f04189dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0414070590 con 0x7f04140b47e0 2023-12-12T09:21:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.957+0000 7f041259c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0414143d20 0x7f04140b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41420/0 (socket says 172.21.15.84:41420) 2023-12-12T09:21:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.957+0000 7f041259c640 1 -- 172.21.15.84:0/3163592343 learned_addr learned my addr 172.21.15.84:0/3163592343 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666619176 0 0) 0x7f04140cea30 con 0x7f0414143d20 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03fc003520 con 0x7f0414143d20 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f0411d9b640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04140b47e0 0x7f0414071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f0412d9d640 1 --2- 172.21.15.84:0/3163592343 >> v2:172.21.15.99:3300/0 conn(0x7f04140ce550 0x7f04140715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2993342742 0 0) 0x7f03fc003520 con 0x7f0414143d20 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04140b47e0 msgr2=0x7f0414071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04140b47e0 0x7f0414071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 >> v2:172.21.15.99:3300/0 conn(0x7f04140ce550 msgr2=0x7f04140715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 --2- 172.21.15.84:0/3163592343 >> v2:172.21.15.99:3300/0 conn(0x7f04140ce550 0x7f04140715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0414070870 con 0x7f0414143d20 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f0404001670 con 0x7f0414143d20 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 >> v1:172.21.15.84:6789/0 conn(0x7f0414143d20 legacy=0x7f04140b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc003970 0x7f03fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03fc0047c0 0x7f03fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04140b47e0 0x7f03fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04140702b0 con 0x7f03fc0047c0 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0414070590 con 0x7f03fc003970 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc00ba80 con 0x7f04140b47e0 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.958+0000 7f0411d9b640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03fc0047c0 0x7f03fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.959+0000 7f0411d9b640 1 -- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04140b47e0 msgr2=0x7f03fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.959+0000 7f0411d9b640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04140b47e0 0x7f03fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.959+0000 7f041259c640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc003970 0x7f03fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.959+0000 7f0411d9b640 1 -- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc003970 msgr2=0x7f03fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.959+0000 7f0411d9b640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc003970 0x7f03fc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.959+0000 7f0411d9b640 1 -- 172.21.15.84:0/3163592343 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc003520 con 0x7f03fc0047c0 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.960+0000 7f0411d9b640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03fc0047c0 0x7f03fc004c40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f040800ba00 tx=0x7f03fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49fca2adaa6e5d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.960+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408032630 con 0x7f03fc0047c0 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.960+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0408032790 con 0x7f03fc0047c0 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.960+0000 7f041159a640 1 -- 172.21.15.84:0/3163592343 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408032b20 con 0x7f03fc0047c0 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.961+0000 7f04189dc640 1 -- 172.21.15.84:0/3163592343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03fc0047c0 msgr2=0x7f03fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.961+0000 7f04189dc640 1 --2- 172.21.15.84:0/3163592343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03fc0047c0 0x7f03fc004c40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f040800ba00 tx=0x7f03fc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.961+0000 7f0412d9d640 1 -- 172.21.15.84:0/3163592343 reap_dead start 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.961+0000 7f04189dc640 1 -- 172.21.15.84:0/3163592343 shutdown_connections 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.961+0000 7f04189dc640 1 -- 172.21.15.84:0/3163592343 >> 172.21.15.84:0/3163592343 conn(0x7f041406c3d0 msgr2=0x7f041406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.961+0000 7f04189dc640 1 -- 172.21.15.84:0/3163592343 shutdown_connections 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.961+0000 7f04189dc640 1 -- 172.21.15.84:0/3163592343 wait complete. 2023-12-12T09:21:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.963+0000 7f04189dc640 1 Processor -- start 2023-12-12T09:21:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.963+0000 7f04189dc640 1 -- start start 2023-12-12T09:21:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f04189dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc0047c0 0x7f0414149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f04189dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04141496b0 0x7f0414149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f04189dc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414147fd0 0x7f0414148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f04189dc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0414142f90 con 0x7f0414147fd0 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f04189dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0414147210 con 0x7f03fc0047c0 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f04189dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04141474f0 con 0x7f04141496b0 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0412d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414147fd0 0x7f0414148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0412d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414147fd0 0x7f0414148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55424/0 (socket says 172.21.15.84:55424) 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0412d9d640 1 -- 172.21.15.84:0/247056029 learned_addr learned my addr 172.21.15.84:0/247056029 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f041259c640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc0047c0 0x7f0414149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0411d9b640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04141496b0 0x7f0414149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0412d9d640 1 -- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04141496b0 msgr2=0x7f0414149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0412d9d640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04141496b0 0x7f0414149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0412d9d640 1 -- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc0047c0 msgr2=0x7f0414149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0412d9d640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc0047c0 0x7f0414149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0412d9d640 1 -- 172.21.15.84:0/247056029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04141477d0 con 0x7f0414147fd0 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.964+0000 7f0411d9b640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04141496b0 0x7f0414149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.965+0000 7f0412d9d640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414147fd0 0x7f0414148430 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f04140744b0 tx=0x7f040c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.965+0000 7f0402ffd640 1 -- 172.21.15.84:0/247056029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00ed90 con 0x7f0414147fd0 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.965+0000 7f0402ffd640 1 -- 172.21.15.84:0/247056029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c014420 con 0x7f0414147fd0 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.965+0000 7f0402ffd640 1 -- 172.21.15.84:0/247056029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0147d0 con 0x7f0414147fd0 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.965+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0414147ab0 con 0x7f0414147fd0 2023-12-12T09:21:26.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.965+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04141e5f80 con 0x7f0414147fd0 2023-12-12T09:21:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.966+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04140673c0 con 0x7f0414147fd0 2023-12-12T09:21:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.967+0000 7f0402ffd640 1 -- 172.21.15.84:0/247056029 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f040c014930 con 0x7f0414147fd0 2023-12-12T09:21:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.968+0000 7f0402ffd640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03f406ae70 0x7f03f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.968+0000 7f0402ffd640 1 -- 172.21.15.84:0/247056029 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f040c0898d0 con 0x7f0414147fd0 2023-12-12T09:21:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.968+0000 7f041259c640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03f406ae70 0x7f03f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:26.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.969+0000 7f041259c640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03f406ae70 0x7f03f406d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0404001eb0 tx=0x7f0404009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:26.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:26.972+0000 7f0402ffd640 1 -- 172.21.15.84:0/247056029 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f040c054c20 con 0x7f0414147fd0 2023-12-12T09:21:27.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.166+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f041406e3b0 con 0x7f0414147fd0 2023-12-12T09:21:27.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.167+0000 7f0402ffd640 1 -- 172.21.15.84:0/247056029 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12978 (secure 0 0 0) 0x7f040c058240 con 0x7f0414147fd0 2023-12-12T09:21:27.168 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:27.168 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:23.181539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:27.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03f406ae70 msgr2=0x7f03f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03f406ae70 0x7f03f406d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0404001eb0 tx=0x7f0404009040 comp rx=0 tx=0).stop 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414147fd0 msgr2=0x7f0414148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414147fd0 0x7f0414148430 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f04140744b0 tx=0x7f040c00e4b0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 shutdown_connections 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03f406ae70 0x7f03f406d330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0414147fd0 0x7f0414148430 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04141496b0 0x7f0414149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 --2- 172.21.15.84:0/247056029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03fc0047c0 0x7f0414149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 >> 172.21.15.84:0/247056029 conn(0x7f041406c3d0 msgr2=0x7f041413ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 shutdown_connections 2023-12-12T09:21:27.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.170+0000 7f04189dc640 1 -- 172.21.15.84:0/247056029 wait complete. 2023-12-12T09:21:27.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:21:27.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:21:27.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.394+0000 7fdb2c578640 1 Processor -- start 2023-12-12T09:21:27.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.394+0000 7fdb2c578640 1 -- start start 2023-12-12T09:21:27.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.395+0000 7fdb2c578640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 0x7fdb240ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.395+0000 7fdb2c578640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb240ce260 con 0x7fdb2415be60 2023-12-12T09:21:27.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.395+0000 7fdb2c578640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb240cd930 con 0x7fdb240b40d0 2023-12-12T09:21:27.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.395+0000 7fdb2c578640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2406e480 con 0x7fdb2406dff0 2023-12-12T09:21:27.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb2ab15640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fdb2415be60 0x7fdb2413e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41424/0 (socket says 172.21.15.84:41424) 2023-12-12T09:21:27.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb2ab15640 1 -- 172.21.15.84:0/295400137 learned_addr learned my addr 172.21.15.84:0/295400137 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29b13640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 0x7fdb240ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212125435 0 0) 0x7fdb240ce260 con 0x7fdb2415be60 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb10003520 con 0x7fdb2415be60 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1115228738 0 0) 0x7fdb10003520 con 0x7fdb2415be60 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 msgr2=0x7fdb240ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 0x7fdb240ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 >> v1:172.21.15.99:6789/0 conn(0x7fdb240b40d0 legacy=0x7fdb240b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240cdc10 con 0x7fdb2415be60 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fdb1c0019f0 con 0x7fdb2415be60 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 >> v1:172.21.15.84:6789/0 conn(0x7fdb2415be60 legacy=0x7fdb2413e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.396+0000 7fdb29312640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 0x7fdb100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb29312640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10003f70 0x7fdb100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb29312640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb10004d00 0x7fdb10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2406e480 con 0x7fdb10004d00 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1000bac0 con 0x7fdb10003f70 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1000bc80 con 0x7fdb2406dff0 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb2ab15640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb10004d00 0x7fdb10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb2a314640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 0x7fdb100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb2ab15640 1 -- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 msgr2=0x7fdb100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb2ab15640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 0x7fdb100039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb2ab15640 1 -- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10003f70 msgr2=0x7fdb100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb29b13640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10003f70 0x7fdb100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb2ab15640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10003f70 0x7fdb100047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb2ab15640 1 -- 172.21.15.84:0/295400137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10003520 con 0x7fdb10004d00 2023-12-12T09:21:27.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.397+0000 7fdb2a314640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb2406dff0 0x7fdb100039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:27.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.398+0000 7fdb2ab15640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb10004d00 0x7fdb10005180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a760 tx=0x7fdb100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e569508034a68274 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c034630 con 0x7fdb10004d00 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c02f070 con 0x7fdb10004d00 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb29312640 1 -- 172.21.15.84:0/295400137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c034a50 con 0x7fdb10004d00 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb2c578640 1 -- 172.21.15.84:0/295400137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb10004d00 msgr2=0x7fdb10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb2c578640 1 --2- 172.21.15.84:0/295400137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb10004d00 0x7fdb10005180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a760 tx=0x7fdb100057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb2ab15640 1 -- 172.21.15.84:0/295400137 reap_dead start 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb2c578640 1 -- 172.21.15.84:0/295400137 shutdown_connections 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb2c578640 1 -- 172.21.15.84:0/295400137 >> 172.21.15.84:0/295400137 conn(0x7fdb240b0ac0 msgr2=0x7fdb240b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb2c578640 1 -- 172.21.15.84:0/295400137 shutdown_connections 2023-12-12T09:21:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.399+0000 7fdb2c578640 1 -- 172.21.15.84:0/295400137 wait complete. 2023-12-12T09:21:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.401+0000 7fdb2c578640 1 Processor -- start 2023-12-12T09:21:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.401+0000 7fdb2c578640 1 -- start start 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.402+0000 7fdb2c578640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10004d00 0x7fdb2413a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.402+0000 7fdb2c578640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2412e4e0 0x7fdb24140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.402+0000 7fdb2c578640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb241eede0 0x7fdb241ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.402+0000 7fdb2c578640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2413b390 con 0x7fdb2412e4e0 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.402+0000 7fdb2c578640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2413a710 con 0x7fdb10004d00 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.402+0000 7fdb2c578640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2413a9f0 con 0x7fdb241eede0 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.402+0000 7fdb29b13640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2412e4e0 0x7fdb24140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb29b13640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2412e4e0 0x7fdb24140e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55436/0 (socket says 172.21.15.84:55436) 2023-12-12T09:21:27.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb29b13640 1 -- 172.21.15.84:0/4115255874 learned_addr learned my addr 172.21.15.84:0/4115255874 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb2a314640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10004d00 0x7fdb2413a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb2ab15640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb241eede0 0x7fdb241ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb29b13640 1 -- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb241eede0 msgr2=0x7fdb241ef270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb29b13640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb241eede0 0x7fdb241ef270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb29b13640 1 -- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10004d00 msgr2=0x7fdb2413a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb29b13640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10004d00 0x7fdb2413a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb29b13640 1 -- 172.21.15.84:0/4115255874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2413acd0 con 0x7fdb2412e4e0 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb2a314640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10004d00 0x7fdb2413a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.403+0000 7fdb29b13640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2412e4e0 0x7fdb24140e40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdb14010860 tx=0x7fdb14010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.404+0000 7fdb1affd640 1 -- 172.21.15.84:0/4115255874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14009610 con 0x7fdb2412e4e0 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.404+0000 7fdb1affd640 1 -- 172.21.15.84:0/4115255874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400eb60 con 0x7fdb2412e4e0 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.404+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2413afb0 con 0x7fdb2412e4e0 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.404+0000 7fdb1affd640 1 -- 172.21.15.84:0/4115255874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1401c400 con 0x7fdb2412e4e0 2023-12-12T09:21:27.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.404+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb24141380 con 0x7fdb2412e4e0 2023-12-12T09:21:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.405+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb240673c0 con 0x7fdb2412e4e0 2023-12-12T09:21:27.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.406+0000 7fdb1affd640 1 -- 172.21.15.84:0/4115255874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb1401c560 con 0x7fdb2412e4e0 2023-12-12T09:21:27.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.407+0000 7fdb1affd640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdb0806ae40 0x7fdb0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.407+0000 7fdb1affd640 1 -- 172.21.15.84:0/4115255874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdb14089910 con 0x7fdb2412e4e0 2023-12-12T09:21:27.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.407+0000 7fdb2a314640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdb0806ae40 0x7fdb0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.408+0000 7fdb2a314640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdb0806ae40 0x7fdb0806d300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb20000c00 tx=0x7fdb20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:27.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.411+0000 7fdb1affd640 1 -- 172.21.15.84:0/4115255874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb14054d10 con 0x7fdb2412e4e0 2023-12-12T09:21:27.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.599+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb240cc070 con 0x7fdb2412e4e0 2023-12-12T09:21:27.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.600+0000 7fdb1affd640 1 -- 172.21.15.84:0/4115255874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb14058330 con 0x7fdb2412e4e0 2023-12-12T09:21:27.600 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:21:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdb0806ae40 msgr2=0x7fdb0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdb0806ae40 0x7fdb0806d300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb20000c00 tx=0x7fdb20009040 comp rx=0 tx=0).stop 2023-12-12T09:21:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2412e4e0 msgr2=0x7fdb24140e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2412e4e0 0x7fdb24140e40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdb14010860 tx=0x7fdb14010d20 comp rx=0 tx=0).stop 2023-12-12T09:21:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 shutdown_connections 2023-12-12T09:21:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdb241eede0 0x7fdb241ef270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdb0806ae40 0x7fdb0806d300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb2412e4e0 0x7fdb24140e40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.602+0000 7fdb2c578640 1 --2- 172.21.15.84:0/4115255874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb10004d00 0x7fdb2413a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.603+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 >> 172.21.15.84:0/4115255874 conn(0x7fdb240b0ac0 msgr2=0x7fdb240afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:27.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.603+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 shutdown_connections 2023-12-12T09:21:27.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.603+0000 7fdb2c578640 1 -- 172.21.15.84:0/4115255874 wait complete. 2023-12-12T09:21:27.622 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:21:27.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:21:27.638 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:21:27.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.815+0000 7fc47be1e640 1 Processor -- start 2023-12-12T09:21:27.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.815+0000 7fc47be1e640 1 -- start start 2023-12-12T09:21:27.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.816+0000 7fc47be1e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc474071bb0 0x7fc474071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.816+0000 7fc47be1e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47413dae0 0x7fc47413f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.816+0000 7fc47be1e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4740724d0 con 0x7fc4740ce330 2023-12-12T09:21:27.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.816+0000 7fc47be1e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc474140270 con 0x7fc474071bb0 2023-12-12T09:21:27.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.816+0000 7fc47be1e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740cd850 con 0x7fc47413dae0 2023-12-12T09:21:27.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.817+0000 7fc479bba640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc474071bb0 0x7fc474071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.817+0000 7fc479bba640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc474071bb0 0x7fc474071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:40804/0 (socket says 172.21.15.84:40804) 2023-12-12T09:21:27.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.817+0000 7fc479bba640 1 -- 172.21.15.84:0/19904824 learned_addr learned my addr 172.21.15.84:0/19904824 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:27.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.817+0000 7fc47a3bb640 1 --2- 172.21.15.84:0/19904824 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47413dae0 0x7fc47413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.818+0000 7fc47a3bb640 1 -- 172.21.15.84:0/19904824 >> v2:172.21.15.99:3300/0 conn(0x7fc474071bb0 msgr2=0x7fc474071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:27.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.818+0000 7fc47a3bb640 1 --2- 172.21.15.84:0/19904824 >> v2:172.21.15.99:3300/0 conn(0x7fc474071bb0 0x7fc474071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.818+0000 7fc47a3bb640 1 -- 172.21.15.84:0/19904824 >> v1:172.21.15.99:6789/0 conn(0x7fc4740ce330 legacy=0x7fc47413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.818+0000 7fc47a3bb640 1 -- 172.21.15.84:0/19904824 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4740cdb30 con 0x7fc47413dae0 2023-12-12T09:21:27.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.819+0000 7fc47a3bb640 1 --2- 172.21.15.84:0/19904824 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47413dae0 0x7fc47413f510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009d90 tx=0x7fc46c02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b11bec947c24e1b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:27.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc478bb8640 1 -- 172.21.15.84:0/19904824 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c02cc60 con 0x7fc47413dae0 2023-12-12T09:21:27.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc478bb8640 1 -- 172.21.15.84:0/19904824 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c02cdc0 con 0x7fc47413dae0 2023-12-12T09:21:27.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc478bb8640 1 -- 172.21.15.84:0/19904824 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c034660 con 0x7fc47413dae0 2023-12-12T09:21:27.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc47be1e640 1 -- 172.21.15.84:0/19904824 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47413dae0 msgr2=0x7fc47413f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc47be1e640 1 --2- 172.21.15.84:0/19904824 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47413dae0 0x7fc47413f510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009d90 tx=0x7fc46c02beb0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc47be1e640 1 -- 172.21.15.84:0/19904824 shutdown_connections 2023-12-12T09:21:27.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc47be1e640 1 --2- 172.21.15.84:0/19904824 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc47413dae0 0x7fc47413f510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc47be1e640 1 --2- 172.21.15.84:0/19904824 >> v2:172.21.15.99:3300/0 conn(0x7fc474071bb0 0x7fc474071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc47be1e640 1 -- 172.21.15.84:0/19904824 >> 172.21.15.84:0/19904824 conn(0x7fc47406c3d0 msgr2=0x7fc47406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:27.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc47be1e640 1 -- 172.21.15.84:0/19904824 shutdown_connections 2023-12-12T09:21:27.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.820+0000 7fc47be1e640 1 -- 172.21.15.84:0/19904824 wait complete. 2023-12-12T09:21:27.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.822+0000 7fc47be1e640 1 Processor -- start 2023-12-12T09:21:27.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.822+0000 7fc47be1e640 1 -- start start 2023-12-12T09:21:27.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.823+0000 7fc47be1e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc474071bb0 0x7fc4741531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.823+0000 7fc47be1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740ce330 0x7fc4740a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.823+0000 7fc47be1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc47413b710 0x7fc47413bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.823+0000 7fc47be1e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47413a390 con 0x7fc4740ce330 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.823+0000 7fc47be1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47413a670 con 0x7fc47413b710 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.823+0000 7fc47be1e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47413a950 con 0x7fc474071bb0 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc4793b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740ce330 0x7fc4740a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc4793b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740ce330 0x7fc4740a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55440/0 (socket says 172.21.15.84:55440) 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc4793b9640 1 -- 172.21.15.84:0/1528595313 learned_addr learned my addr 172.21.15.84:0/1528595313 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc47a3bb640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc47413b710 0x7fc47413bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc479bba640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc474071bb0 0x7fc4741531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc4793b9640 1 -- 172.21.15.84:0/1528595313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc474071bb0 msgr2=0x7fc4741531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc4793b9640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc474071bb0 0x7fc4741531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc4793b9640 1 -- 172.21.15.84:0/1528595313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc47413b710 msgr2=0x7fc47413bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:27.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc4793b9640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc47413b710 0x7fc47413bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:27.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.824+0000 7fc4793b9640 1 -- 172.21.15.84:0/1528595313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c009a70 con 0x7fc4740ce330 2023-12-12T09:21:27.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.825+0000 7fc4793b9640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740ce330 0x7fc4740a8480 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc46400c450 tx=0x7fc46400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:27.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.825+0000 7fc46a7fc640 1 -- 172.21.15.84:0/1528595313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640052d0 con 0x7fc4740ce330 2023-12-12T09:21:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.825+0000 7fc46a7fc640 1 -- 172.21.15.84:0/1528595313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc464005430 con 0x7fc4740ce330 2023-12-12T09:21:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.825+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47413ac30 con 0x7fc4740ce330 2023-12-12T09:21:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.825+0000 7fc46a7fc640 1 -- 172.21.15.84:0/1528595313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464012870 con 0x7fc4740ce330 2023-12-12T09:21:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.825+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47413b1f0 con 0x7fc4740ce330 2023-12-12T09:21:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.826+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4740673c0 con 0x7fc4740ce330 2023-12-12T09:21:27.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.827+0000 7fc46a7fc640 1 -- 172.21.15.84:0/1528595313 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4640129d0 con 0x7fc4740ce330 2023-12-12T09:21:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.828+0000 7fc46a7fc640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.828+0000 7fc46a7fc640 1 -- 172.21.15.84:0/1528595313 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc464088ed0 con 0x7fc4740ce330 2023-12-12T09:21:27.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.828+0000 7fc479bba640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:27.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.829+0000 7fc479bba640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc45806ae70 0x7fc45806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc474138030 tx=0x7fc470008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:27.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:27.833+0000 7fc46a7fc640 1 -- 172.21.15.84:0/1528595313 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc464054190 con 0x7fc4740ce330 2023-12-12T09:21:28.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.023+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4740ae710 con 0x7fc4740ce330 2023-12-12T09:21:28.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.024+0000 7fc46a7fc640 1 -- 172.21.15.84:0/1528595313 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc4640577b0 con 0x7fc4740ce330 2023-12-12T09:21:28.025 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:28.025 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-12-12T09:21:28.025 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:21:28.025 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-12-12T09:21:28.025 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-12-12T09:21:28.025 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:28.025 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-12-12T09:21:28.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc45806ae70 msgr2=0x7fc45806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc45806ae70 0x7fc45806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc474138030 tx=0x7fc470008040 comp rx=0 tx=0).stop 2023-12-12T09:21:28.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740ce330 msgr2=0x7fc4740a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740ce330 0x7fc4740a8480 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc46400c450 tx=0x7fc46400c910 comp rx=0 tx=0).stop 2023-12-12T09:21:28.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 shutdown_connections 2023-12-12T09:21:28.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc47413b710 0x7fc47413bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc45806ae70 0x7fc45806d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740ce330 0x7fc4740a8480 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 --2- 172.21.15.84:0/1528595313 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc474071bb0 0x7fc4741531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 >> 172.21.15.84:0/1528595313 conn(0x7fc47406c3d0 msgr2=0x7fc47413ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:28.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.027+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 shutdown_connections 2023-12-12T09:21:28.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.028+0000 7fc47be1e640 1 -- 172.21.15.84:0/1528595313 wait complete. 2023-12-12T09:21:28.045 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T09:21:28.045 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T09:21:28.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.260+0000 7f057878a640 1 Processor -- start 2023-12-12T09:21:28.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.260+0000 7f057878a640 1 -- start start 2023-12-12T09:21:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.261+0000 7f057878a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0570071cd0 0x7f05700ac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.261+0000 7f057878a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f057006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.262+0000 7f057878a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0570070cb0 con 0x7f057006c060 2023-12-12T09:21:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.262+0000 7f057878a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0570072130 con 0x7f0570071cd0 2023-12-12T09:21:28.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.262+0000 7f057878a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0570070f50 con 0x7f057006c440 2023-12-12T09:21:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.262+0000 7f0575d25640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0570071cd0 0x7f05700ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.262+0000 7f0576526640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f057006c060 0x7f05700abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:52460/0 (socket says 172.21.15.84:52460) 2023-12-12T09:21:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.262+0000 7f0576526640 1 -- 172.21.15.84:0/2559310124 learned_addr learned my addr 172.21.15.84:0/2559310124 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.262+0000 7f0576d27640 1 --2- 172.21.15.84:0/2559310124 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f057006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.263+0000 7f0575d25640 1 -- 172.21.15.84:0/2559310124 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 msgr2=0x7f057006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.263+0000 7f0575d25640 1 --2- 172.21.15.84:0/2559310124 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f057006c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.263+0000 7f0575d25640 1 -- 172.21.15.84:0/2559310124 >> v1:172.21.15.99:6789/0 conn(0x7f057006c060 legacy=0x7f05700abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.263+0000 7f0575d25640 1 -- 172.21.15.84:0/2559310124 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057006d8c0 con 0x7f0570071cd0 2023-12-12T09:21:28.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.264+0000 7f0575d25640 1 --2- 172.21.15.84:0/2559310124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 0x7f05700ac460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f05600097a0 tx=0x7f056002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc31fc967adabc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:28.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f0575524640 1 -- 172.21.15.84:0/2559310124 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560031780 con 0x7f0570071cd0 2023-12-12T09:21:28.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f0575524640 1 -- 172.21.15.84:0/2559310124 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05600318e0 con 0x7f0570071cd0 2023-12-12T09:21:28.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f0575524640 1 -- 172.21.15.84:0/2559310124 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560031c70 con 0x7f0570071cd0 2023-12-12T09:21:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f057878a640 1 -- 172.21.15.84:0/2559310124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 msgr2=0x7f05700ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f057878a640 1 --2- 172.21.15.84:0/2559310124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 0x7f05700ac460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f05600097a0 tx=0x7f056002b820 comp rx=0 tx=0).stop 2023-12-12T09:21:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f057878a640 1 -- 172.21.15.84:0/2559310124 shutdown_connections 2023-12-12T09:21:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f057878a640 1 --2- 172.21.15.84:0/2559310124 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f057006c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f057878a640 1 --2- 172.21.15.84:0/2559310124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 0x7f05700ac460 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f057878a640 1 -- 172.21.15.84:0/2559310124 >> 172.21.15.84:0/2559310124 conn(0x7f05700b0970 msgr2=0x7f05700b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f057878a640 1 -- 172.21.15.84:0/2559310124 shutdown_connections 2023-12-12T09:21:28.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.265+0000 7f057878a640 1 -- 172.21.15.84:0/2559310124 wait complete. 2023-12-12T09:21:28.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.267+0000 7f057878a640 1 Processor -- start 2023-12-12T09:21:28.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.267+0000 7f057878a640 1 -- start start 2023-12-12T09:21:28.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.268+0000 7f057878a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057006c060 0x7f05701f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.268+0000 7f057878a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f05701f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.268+0000 7f057878a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 0x7f05700b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.268+0000 7f057878a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700b3400 con 0x7f057006c060 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.268+0000 7f057878a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701f6130 con 0x7f0570071cd0 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.268+0000 7f057878a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057009ac10 con 0x7f057006c440 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576526640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057006c060 0x7f05701f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576526640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057006c060 0x7f05701f3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55444/0 (socket says 172.21.15.84:55444) 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576526640 1 -- 172.21.15.84:0/3334597976 learned_addr learned my addr 172.21.15.84:0/3334597976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576d27640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 0x7f05700b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0575d25640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f05701f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576526640 1 -- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 msgr2=0x7f05701f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576526640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f05701f5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576526640 1 -- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 msgr2=0x7f05700b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576526640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 0x7f05700b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0576526640 1 -- 172.21.15.84:0/3334597976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560009400 con 0x7f057006c060 2023-12-12T09:21:28.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.269+0000 7f0575d25640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f05701f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:21:28.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.270+0000 7f0576526640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057006c060 0x7f05701f3f50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c480 tx=0x7f056c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:28.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.270+0000 7f0566ffd640 1 -- 172.21.15.84:0/3334597976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c005ce0 con 0x7f057006c060 2023-12-12T09:21:28.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.270+0000 7f0566ffd640 1 -- 172.21.15.84:0/3334597976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c005e40 con 0x7f057006c060 2023-12-12T09:21:28.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.270+0000 7f0566ffd640 1 -- 172.21.15.84:0/3334597976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0072f0 con 0x7f057006c060 2023-12-12T09:21:28.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.270+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057009aef0 con 0x7f057006c060 2023-12-12T09:21:28.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.270+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057009b4b0 con 0x7f057006c060 2023-12-12T09:21:28.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.271+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570067f60 con 0x7f057006c060 2023-12-12T09:21:28.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.272+0000 7f0566ffd640 1 -- 172.21.15.84:0/3334597976 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f056c007450 con 0x7f057006c060 2023-12-12T09:21:28.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.274+0000 7f0566ffd640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f055406ae40 0x7f055406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.274+0000 7f0566ffd640 1 -- 172.21.15.84:0/3334597976 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f056c0888c0 con 0x7f057006c060 2023-12-12T09:21:28.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.274+0000 7f0575d25640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f055406ae40 0x7f055406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.275+0000 7f0575d25640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f055406ae40 0x7f055406d300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0560036000 tx=0x7f056003d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:28.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.278+0000 7f0566ffd640 1 -- 172.21.15.84:0/3334597976 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f056c053c20 con 0x7f057006c060 2023-12-12T09:21:28.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.468+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f05700673c0 con 0x7f057006c060 2023-12-12T09:21:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.722+0000 7f0566ffd640 1 -- 172.21.15.84:0/3334597976 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f056c017020 con 0x7f057006c060 2023-12-12T09:21:28.723 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.726+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f055406ae40 msgr2=0x7f055406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.726+0000 7f057878a640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f055406ae40 0x7f055406d300 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0560036000 tx=0x7f056003d040 comp rx=0 tx=0).stop 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.726+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057006c060 msgr2=0x7f05701f3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.726+0000 7f057878a640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057006c060 0x7f05701f3f50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c480 tx=0x7f056c00c940 comp rx=0 tx=0).stop 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.727+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 shutdown_connections 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.727+0000 7f057878a640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0570071cd0 0x7f05700b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.727+0000 7f057878a640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f057006c440 0x7f05701f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.727+0000 7f057878a640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f055406ae40 0x7f055406d300 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.727+0000 7f057878a640 1 --2- 172.21.15.84:0/3334597976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f057006c060 0x7f05701f3f50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.727+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 >> 172.21.15.84:0/3334597976 conn(0x7f05700b0970 msgr2=0x7f057015f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.727+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 shutdown_connections 2023-12-12T09:21:28.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.727+0000 7f057878a640 1 -- 172.21.15.84:0/3334597976 wait complete. 2023-12-12T09:21:28.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:21:28.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.952+0000 7fafb0e94640 1 Processor -- start 2023-12-12T09:21:28.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.953+0000 7fafb0e94640 1 -- start start 2023-12-12T09:21:28.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.954+0000 7fafb0e94640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fafac15d990 0x7fafac0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.954+0000 7fafb0e94640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fafac0b1900 0x7fafac0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.954+0000 7fafb0e94640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0b0460 con 0x7fafac0cfd80 2023-12-12T09:21:28.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.954+0000 7fafb0e94640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafac0afe80 con 0x7fafac0b1900 2023-12-12T09:21:28.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.954+0000 7fafb0e94640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0d1e20 con 0x7fafac15d990 2023-12-12T09:21:28.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.954+0000 7fafaa59c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fafac0cfd80 0x7fafac15d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41438/0 (socket says 172.21.15.84:41438) 2023-12-12T09:21:28.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.954+0000 7fafaa59c640 1 -- 172.21.15.84:0/1617213079 learned_addr learned my addr 172.21.15.84:0/1617213079 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafaad9d640 1 --2- 172.21.15.84:0/1617213079 >> v2:172.21.15.99:3300/0 conn(0x7fafac0b1900 0x7fafac0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa9d9b640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fafac15d990 0x7fafac0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319154750 0 0) 0x7fafac0b0460 con 0x7fafac0cfd80 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf8c003520 con 0x7fafac0cfd80 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931369116 0 0) 0x7faf8c003520 con 0x7fafac0cfd80 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fafac15d990 msgr2=0x7fafac0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fafac15d990 0x7fafac0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 >> v2:172.21.15.99:3300/0 conn(0x7fafac0b1900 msgr2=0x7fafac0ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 --2- 172.21.15.84:0/1617213079 >> v2:172.21.15.99:3300/0 conn(0x7fafac0b1900 0x7fafac0ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0b00f0 con 0x7fafac0cfd80 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7faf9c001670 con 0x7fafac0cfd80 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 >> v1:172.21.15.84:6789/0 conn(0x7fafac0cfd80 legacy=0x7fafac15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c003970 0x7faf8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fafac15d990 0x7faf8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c004d00 0x7faf8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0afe80 con 0x7faf8c003970 2023-12-12T09:21:28.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0d1e20 con 0x7faf8c004d00 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.955+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c00b980 con 0x7fafac15d990 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.956+0000 7fafaa59c640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c003970 0x7faf8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.956+0000 7fafaad9d640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c004d00 0x7faf8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.956+0000 7fafaa59c640 1 -- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fafac15d990 msgr2=0x7faf8c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.956+0000 7fafaa59c640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fafac15d990 0x7faf8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.956+0000 7fafaa59c640 1 -- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c004d00 msgr2=0x7faf8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.956+0000 7fafaa59c640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c004d00 0x7faf8c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.956+0000 7fafaa59c640 1 -- 172.21.15.84:0/1617213079 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c003520 con 0x7faf8c003970 2023-12-12T09:21:28.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.956+0000 7fafaad9d640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf8c004d00 0x7faf8c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:28.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.957+0000 7fafaa59c640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c003970 0x7faf8c003d90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c290 tx=0x7faf8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76047a0ee7c2b6a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:28.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.957+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c005ad0 con 0x7faf8c003970 2023-12-12T09:21:28.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.957+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c005c30 con 0x7faf8c003970 2023-12-12T09:21:28.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.957+0000 7fafa959a640 1 -- 172.21.15.84:0/1617213079 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c02c8d0 con 0x7faf8c003970 2023-12-12T09:21:28.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.958+0000 7fafb0e94640 1 -- 172.21.15.84:0/1617213079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c003970 msgr2=0x7faf8c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.958+0000 7fafb0e94640 1 --2- 172.21.15.84:0/1617213079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c003970 0x7faf8c003d90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c290 tx=0x7faf8c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.958+0000 7fafaad9d640 1 -- 172.21.15.84:0/1617213079 reap_dead start 2023-12-12T09:21:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.958+0000 7fafb0e94640 1 -- 172.21.15.84:0/1617213079 shutdown_connections 2023-12-12T09:21:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.958+0000 7fafb0e94640 1 -- 172.21.15.84:0/1617213079 >> 172.21.15.84:0/1617213079 conn(0x7fafac09c480 msgr2=0x7fafac0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.958+0000 7fafb0e94640 1 -- 172.21.15.84:0/1617213079 shutdown_connections 2023-12-12T09:21:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.958+0000 7fafb0e94640 1 -- 172.21.15.84:0/1617213079 wait complete. 2023-12-12T09:21:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.960+0000 7fafb0e94640 1 Processor -- start 2023-12-12T09:21:28.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.960+0000 7fafb0e94640 1 -- start start 2023-12-12T09:21:28.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafb0e94640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf8c003970 0x7fafac15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafb0e94640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0b2d20 0x7fafac0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafb0e94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafac0b6eb0 0x7fafac0b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafb0e94640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0b78a0 con 0x7fafac0b6eb0 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafb0e94640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0c6e00 con 0x7fafac0b2d20 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafb0e94640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0c70e0 con 0x7faf8c003970 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafac0b6eb0 0x7fafac0b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafac0b6eb0 0x7fafac0b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55476/0 (socket says 172.21.15.84:55476) 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaad9d640 1 -- 172.21.15.84:0/2848807726 learned_addr learned my addr 172.21.15.84:0/2848807726 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaa59c640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf8c003970 0x7fafac15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafa9d9b640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0b2d20 0x7fafac0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaad9d640 1 -- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf8c003970 msgr2=0x7fafac15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaad9d640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf8c003970 0x7fafac15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaad9d640 1 -- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0b2d20 msgr2=0x7fafac0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaad9d640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0b2d20 0x7fafac0cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:28.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafaad9d640 1 -- 172.21.15.84:0/2848807726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0c73c0 con 0x7fafac0b6eb0 2023-12-12T09:21:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.961+0000 7fafa9d9b640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0b2d20 0x7fafac0cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.962+0000 7fafaad9d640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafac0b6eb0 0x7fafac0b7360 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fafac0cdad0 tx=0x7fafa4010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.962+0000 7fafa2ffd640 1 -- 172.21.15.84:0/2848807726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400e8a0 con 0x7fafac0b6eb0 2023-12-12T09:21:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.962+0000 7fafa2ffd640 1 -- 172.21.15.84:0/2848807726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400ea00 con 0x7fafac0b6eb0 2023-12-12T09:21:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.962+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac0c76a0 con 0x7fafac0b6eb0 2023-12-12T09:21:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.962+0000 7fafa2ffd640 1 -- 172.21.15.84:0/2848807726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa400ed70 con 0x7fafac0b6eb0 2023-12-12T09:21:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.962+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac0ccee0 con 0x7fafac0b6eb0 2023-12-12T09:21:28.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.963+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac072b80 con 0x7fafac0b6eb0 2023-12-12T09:21:28.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.965+0000 7fafa2ffd640 1 -- 172.21.15.84:0/2848807726 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafa4020410 con 0x7fafac0b6eb0 2023-12-12T09:21:28.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.966+0000 7fafa2ffd640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf9006ae70 0x7faf9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:28.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.966+0000 7fafa2ffd640 1 -- 172.21.15.84:0/2848807726 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fafa40896d0 con 0x7fafac0b6eb0 2023-12-12T09:21:28.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.966+0000 7fafaa59c640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf9006ae70 0x7faf9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:28.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.967+0000 7fafaa59c640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf9006ae70 0x7faf9006d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf9c034000 tx=0x7faf9c007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:28.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:28.970+0000 7fafa2ffd640 1 -- 172.21.15.84:0/2848807726 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafa4054900 con 0x7fafac0b6eb0 2023-12-12T09:21:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.158+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fafac0673c0 con 0x7fafac0b6eb0 2023-12-12T09:21:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.729+0000 7fafa2ffd640 1 -- 172.21.15.84:0/2848807726 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7fafa4000e60 con 0x7fafac0b6eb0 2023-12-12T09:21:29.729 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-12-12T09:21:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf9006ae70 msgr2=0x7faf9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:29.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf9006ae70 0x7faf9006d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf9c034000 tx=0x7faf9c007000 comp rx=0 tx=0).stop 2023-12-12T09:21:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafac0b6eb0 msgr2=0x7fafac0b7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafac0b6eb0 0x7fafac0b7360 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fafac0cdad0 tx=0x7fafa4010c20 comp rx=0 tx=0).stop 2023-12-12T09:21:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 shutdown_connections 2023-12-12T09:21:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf9006ae70 0x7faf9006d330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fafac0b6eb0 0x7fafac0b7360 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fafac0b2d20 0x7fafac0cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 --2- 172.21.15.84:0/2848807726 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf8c003970 0x7fafac15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.732+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 >> 172.21.15.84:0/2848807726 conn(0x7fafac09c480 msgr2=0x7fafac0b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.733+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 shutdown_connections 2023-12-12T09:21:29.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.733+0000 7fafb0e94640 1 -- 172.21.15.84:0/2848807726 wait complete. 2023-12-12T09:21:29.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T09:21:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.953+0000 7fab912ad640 1 Processor -- start 2023-12-12T09:21:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.953+0000 7fab912ad640 1 -- start start 2023-12-12T09:21:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.955+0000 7fab912ad640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab8c0b2f70 0x7fab8c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.955+0000 7fab912ad640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fab8c0cf470 0x7fab8c070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.955+0000 7fab912ad640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0b21b0 con 0x7fab8c15cef0 2023-12-12T09:21:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.955+0000 7fab912ad640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c0cf920 con 0x7fab8c0cf470 2023-12-12T09:21:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.955+0000 7fab912ad640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c0b2490 con 0x7fab8c0b2f70 2023-12-12T09:21:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.955+0000 7fab8bfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fab8c15cef0 0x7fab8c06ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41440/0 (socket says 172.21.15.84:41440) 2023-12-12T09:21:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.955+0000 7fab8bfff640 1 -- 172.21.15.84:0/3661039168 learned_addr learned my addr 172.21.15.84:0/3661039168 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.955+0000 7fab90aac640 1 --2- 172.21.15.84:0/3661039168 >> v2:172.21.15.84:3300/0 conn(0x7fab8c0cf470 0x7fab8c070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.956+0000 7fab8b7fe640 1 -- 172.21.15.84:0/3661039168 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061506321 0 0) 0x7fab8c0b21b0 con 0x7fab8c15cef0 2023-12-12T09:21:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.956+0000 7fab83fff640 1 --2- 172.21.15.84:0/3661039168 >> v2:172.21.15.99:3300/0 conn(0x7fab8c0b2f70 0x7fab8c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.956+0000 7fab8b7fe640 1 -- 172.21.15.84:0/3661039168 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab78003520 con 0x7fab8c15cef0 2023-12-12T09:21:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.956+0000 7fab90aac640 1 -- 172.21.15.84:0/3661039168 >> v2:172.21.15.99:3300/0 conn(0x7fab8c0b2f70 msgr2=0x7fab8c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.956+0000 7fab90aac640 1 --2- 172.21.15.84:0/3661039168 >> v2:172.21.15.99:3300/0 conn(0x7fab8c0b2f70 0x7fab8c0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.956+0000 7fab90aac640 1 -- 172.21.15.84:0/3661039168 >> v1:172.21.15.84:6789/0 conn(0x7fab8c15cef0 legacy=0x7fab8c06ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.956+0000 7fab8b7fe640 1 -- 172.21.15.84:0/3661039168 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1725624567 0 0) 0x7fab78003520 con 0x7fab8c15cef0 2023-12-12T09:21:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.956+0000 7fab90aac640 1 -- 172.21.15.84:0/3661039168 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0b2770 con 0x7fab8c0cf470 2023-12-12T09:21:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.957+0000 7fab90aac640 1 --2- 172.21.15.84:0/3661039168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0cf470 0x7fab8c070830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fab84009d90 tx=0x7fab8402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db991615d091161a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.957+0000 7fab8b7fe640 1 -- 172.21.15.84:0/3661039168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8402cb40 con 0x7fab8c0cf470 2023-12-12T09:21:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.957+0000 7fab8b7fe640 1 -- 172.21.15.84:0/3661039168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8402cca0 con 0x7fab8c0cf470 2023-12-12T09:21:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.957+0000 7fab8b7fe640 1 -- 172.21.15.84:0/3661039168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84034660 con 0x7fab8c0cf470 2023-12-12T09:21:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.958+0000 7fab912ad640 1 -- 172.21.15.84:0/3661039168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0cf470 msgr2=0x7fab8c070830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.958+0000 7fab912ad640 1 --2- 172.21.15.84:0/3661039168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0cf470 0x7fab8c070830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fab84009d90 tx=0x7fab8402bd90 comp rx=0 tx=0).stop 2023-12-12T09:21:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.958+0000 7fab912ad640 1 -- 172.21.15.84:0/3661039168 shutdown_connections 2023-12-12T09:21:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.958+0000 7fab912ad640 1 --2- 172.21.15.84:0/3661039168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0cf470 0x7fab8c070830 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.958+0000 7fab912ad640 1 --2- 172.21.15.84:0/3661039168 >> v2:172.21.15.99:3300/0 conn(0x7fab8c0b2f70 0x7fab8c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.958+0000 7fab912ad640 1 -- 172.21.15.84:0/3661039168 >> 172.21.15.84:0/3661039168 conn(0x7fab8c06a920 msgr2=0x7fab8c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.958+0000 7fab912ad640 1 -- 172.21.15.84:0/3661039168 shutdown_connections 2023-12-12T09:21:29.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.958+0000 7fab912ad640 1 -- 172.21.15.84:0/3661039168 wait complete. 2023-12-12T09:21:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.960+0000 7fab912ad640 1 Processor -- start 2023-12-12T09:21:29.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.960+0000 7fab912ad640 1 -- start start 2023-12-12T09:21:29.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab912ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0b2f70 0x7fab8c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:29.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab912ad640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab8c0cf470 0x7fab8c1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:29.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab912ad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab8c15cef0 0x7fab8c155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:29.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab912ad640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c152010 con 0x7fab8c0b2f70 2023-12-12T09:21:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab912ad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1531c0 con 0x7fab8c15cef0 2023-12-12T09:21:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab912ad640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c152640 con 0x7fab8c0cf470 2023-12-12T09:21:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab8bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0b2f70 0x7fab8c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab8bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0b2f70 0x7fab8c150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55482/0 (socket says 172.21.15.84:55482) 2023-12-12T09:21:29.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.961+0000 7fab8bfff640 1 -- 172.21.15.84:0/129780603 learned_addr learned my addr 172.21.15.84:0/129780603 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab90aac640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab8c15cef0 0x7fab8c155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab8bfff640 1 -- 172.21.15.84:0/129780603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab8c0cf470 msgr2=0x7fab8c1f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab8bfff640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab8c0cf470 0x7fab8c1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab8bfff640 1 -- 172.21.15.84:0/129780603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab8c15cef0 msgr2=0x7fab8c155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab8bfff640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab8c15cef0 0x7fab8c155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab8bfff640 1 -- 172.21.15.84:0/129780603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009a70 con 0x7fab8c0b2f70 2023-12-12T09:21:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab8bfff640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0b2f70 0x7fab8c150c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c780 tx=0x7fab7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:29.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab897fa640 1 -- 172.21.15.84:0/129780603 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c005ab0 con 0x7fab8c0b2f70 2023-12-12T09:21:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab897fa640 1 -- 172.21.15.84:0/129780603 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c005c10 con 0x7fab8c0b2f70 2023-12-12T09:21:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab897fa640 1 -- 172.21.15.84:0/129780603 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c007070 con 0x7fab8c0b2f70 2023-12-12T09:21:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.962+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c152920 con 0x7fab8c0b2f70 2023-12-12T09:21:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.963+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c152ee0 con 0x7fab8c0b2f70 2023-12-12T09:21:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.964+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c0673c0 con 0x7fab8c0b2f70 2023-12-12T09:21:29.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.965+0000 7fab897fa640 1 -- 172.21.15.84:0/129780603 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab7c0071d0 con 0x7fab8c0b2f70 2023-12-12T09:21:29.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.966+0000 7fab897fa640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab6c06ae40 0x7fab6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:29.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.966+0000 7fab897fa640 1 -- 172.21.15.84:0/129780603 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fab7c0893b0 con 0x7fab8c0b2f70 2023-12-12T09:21:29.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.966+0000 7fab83fff640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab6c06ae40 0x7fab6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:29.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.967+0000 7fab83fff640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab6c06ae40 0x7fab6c06d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab74006fd0 tx=0x7fab74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:29.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:29.971+0000 7fab897fa640 1 -- 172.21.15.84:0/129780603 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab7c0542e0 con 0x7fab8c0b2f70 2023-12-12T09:21:30.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.190+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fab8c066da0 con 0x7fab8c0b2f70 2023-12-12T09:21:30.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.782+0000 7fab897fa640 1 -- 172.21.15.84:0/129780603 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fab7c057900 con 0x7fab8c0b2f70 2023-12-12T09:21:30.786 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 5 and data pool 6 2023-12-12T09:21:30.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.788+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab6c06ae40 msgr2=0x7fab6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:30.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.788+0000 7fab912ad640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab6c06ae40 0x7fab6c06d300 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab74006fd0 tx=0x7fab74008040 comp rx=0 tx=0).stop 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.788+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0b2f70 msgr2=0x7fab8c150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.788+0000 7fab912ad640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0b2f70 0x7fab8c150c50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00c780 tx=0x7fab7c00cc40 comp rx=0 tx=0).stop 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.789+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 shutdown_connections 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.789+0000 7fab912ad640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab8c15cef0 0x7fab8c155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.789+0000 7fab912ad640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fab8c0cf470 0x7fab8c1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.789+0000 7fab912ad640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fab6c06ae40 0x7fab6c06d300 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.789+0000 7fab912ad640 1 --2- 172.21.15.84:0/129780603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab8c0b2f70 0x7fab8c150c50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.789+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 >> 172.21.15.84:0/129780603 conn(0x7fab8c06a920 msgr2=0x7fab8c157700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.789+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 shutdown_connections 2023-12-12T09:21:30.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:30.789+0000 7fab912ad640 1 -- 172.21.15.84:0/129780603 wait complete. 2023-12-12T09:21:30.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:31.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.011+0000 7f6e09c87640 1 Processor -- start 2023-12-12T09:21:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.011+0000 7f6e09c87640 1 -- start start 2023-12-12T09:21:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.013+0000 7f6e09c87640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6e04143d20 0x7f6e040b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.013+0000 7f6e09c87640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 0x7f6e040b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.013+0000 7f6e09c87640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e040cea30 con 0x7f6e041447f0 2023-12-12T09:21:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.013+0000 7f6e09c87640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e040702b0 con 0x7f6e04143d20 2023-12-12T09:21:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.013+0000 7f6e09c87640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04070590 con 0x7f6e040ce550 2023-12-12T09:21:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.013+0000 7f6e03fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6e041447f0 0x7f6e0415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41450/0 (socket says 172.21.15.84:41450) 2023-12-12T09:21:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.013+0000 7f6e03fff640 1 -- 172.21.15.84:0/306935744 learned_addr learned my addr 172.21.15.84:0/306935744 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.013+0000 7f6e037fe640 1 --2- 172.21.15.84:0/306935744 >> v2:172.21.15.99:3300/0 conn(0x7f6e04143d20 0x7f6e040b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6dfbfff640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 0x7f6e040b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874422270 0 0) 0x7f6e040cea30 con 0x7f6e041447f0 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df0003520 con 0x7f6e041447f0 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437128295 0 0) 0x7f6df0003520 con 0x7f6e041447f0 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 msgr2=0x7f6e040b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 0x7f6e040b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 >> v2:172.21.15.99:3300/0 conn(0x7f6e04143d20 msgr2=0x7f6e040b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 --2- 172.21.15.84:0/306935744 >> v2:172.21.15.99:3300/0 conn(0x7f6e04143d20 0x7f6e040b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e04070870 con 0x7f6e041447f0 2023-12-12T09:21:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f6dfc0019f0 con 0x7f6e041447f0 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 >> v1:172.21.15.84:6789/0 conn(0x7f6e041447f0 legacy=0x7f6e0415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6df0003970 0x7f6df0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6df00047c0 0x7f6df0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 0x7f6df0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040702b0 con 0x7f6df0003970 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e04070590 con 0x7f6df00047c0 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df000ba30 con 0x7f6e040ce550 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e037fe640 1 --2- 172.21.15.84:0/306935744 >> v2:172.21.15.99:3300/0 conn(0x7f6e04143d20 0x7f6e040b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.014+0000 7f6e037fe640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6df0003970 0x7f6df0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6dfbfff640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6df00047c0 0x7f6df0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6e03fff640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 0x7f6df0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6e037fe640 1 -- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 msgr2=0x7f6df0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6e037fe640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 0x7f6df0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6e037fe640 1 -- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6df00047c0 msgr2=0x7f6df0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6e037fe640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6df00047c0 0x7f6df0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6e037fe640 1 -- 172.21.15.84:0/306935744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df0003520 con 0x7f6df0003970 2023-12-12T09:21:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6e03fff640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e040ce550 0x7f6df0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.015+0000 7f6dfbfff640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6df00047c0 0x7f6df0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:21:31.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.016+0000 7f6e037fe640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6df0003970 0x7f6df0003d90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6df4006fd0 tx=0x7f6df00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0b22006b9ed99c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.016+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4030660 con 0x7f6df0003970 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.016+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df40307c0 con 0x7f6df0003970 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.016+0000 7f6e02ffd640 1 -- 172.21.15.84:0/306935744 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4030b30 con 0x7f6df0003970 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.017+0000 7f6e09c87640 1 -- 172.21.15.84:0/306935744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6df0003970 msgr2=0x7f6df0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.017+0000 7f6e09c87640 1 --2- 172.21.15.84:0/306935744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6df0003970 0x7f6df0003d90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6df4006fd0 tx=0x7f6df00057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.017+0000 7f6e03fff640 1 -- 172.21.15.84:0/306935744 reap_dead start 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.017+0000 7f6e09c87640 1 -- 172.21.15.84:0/306935744 shutdown_connections 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.017+0000 7f6e09c87640 1 -- 172.21.15.84:0/306935744 >> 172.21.15.84:0/306935744 conn(0x7f6e0406c3d0 msgr2=0x7f6e0406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.017+0000 7f6e09c87640 1 -- 172.21.15.84:0/306935744 shutdown_connections 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.017+0000 7f6e09c87640 1 -- 172.21.15.84:0/306935744 wait complete. 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.019+0000 7f6e09c87640 1 Processor -- start 2023-12-12T09:21:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.019+0000 7f6e09c87640 1 -- start start 2023-12-12T09:21:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.020+0000 7f6e09c87640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6df0003970 0x7f6e0415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.020+0000 7f6e09c87640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040ac890 0x7f6e040acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.020+0000 7f6e09c87640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e040b3230 0x7f6e040b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.020+0000 7f6e09c87640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e040ad250 con 0x7f6e040ac890 2023-12-12T09:21:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.020+0000 7f6e09c87640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0415bfd0 con 0x7f6e040b3230 2023-12-12T09:21:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.020+0000 7f6e09c87640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0415b6a0 con 0x7f6df0003970 2023-12-12T09:21:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040ac890 0x7f6e040acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040ac890 0x7f6e040acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55506/0 (socket says 172.21.15.84:55506) 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 -- 172.21.15.84:0/2014005392 learned_addr learned my addr 172.21.15.84:0/2014005392 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6e03fff640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e040b3230 0x7f6e040b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6e037fe640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6df0003970 0x7f6e0415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 -- 172.21.15.84:0/2014005392 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6df0003970 msgr2=0x7f6e0415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6df0003970 0x7f6e0415a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 -- 172.21.15.84:0/2014005392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e040b3230 msgr2=0x7f6e040b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e040b3230 0x7f6e040b36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 -- 172.21.15.84:0/2014005392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0415b980 con 0x7f6e040ac890 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.021+0000 7f6dfbfff640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040ac890 0x7f6e040acd10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6dec006a90 tx=0x7f6dec004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.022+0000 7f6e00ff9640 1 -- 172.21.15.84:0/2014005392 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec014870 con 0x7f6e040ac890 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.022+0000 7f6e00ff9640 1 -- 172.21.15.84:0/2014005392 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec0149d0 con 0x7f6e040ac890 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.022+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0415bc60 con 0x7f6e040ac890 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.022+0000 7f6e00ff9640 1 -- 172.21.15.84:0/2014005392 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec014d60 con 0x7f6e040ac890 2023-12-12T09:21:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.022+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0415c460 con 0x7f6e040ac890 2023-12-12T09:21:31.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.023+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e040673c0 con 0x7f6e040ac890 2023-12-12T09:21:31.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.024+0000 7f6e00ff9640 1 -- 172.21.15.84:0/2014005392 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6dec015410 con 0x7f6e040ac890 2023-12-12T09:21:31.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.025+0000 7f6e00ff9640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6de406ae70 0x7f6de406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.025+0000 7f6e00ff9640 1 -- 172.21.15.84:0/2014005392 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6dec089f80 con 0x7f6e040ac890 2023-12-12T09:21:31.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.025+0000 7f6e037fe640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6de406ae70 0x7f6de406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.026+0000 7f6e037fe640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6de406ae70 0x7f6de406d330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6df4036000 tx=0x7f6df4031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.029+0000 7f6e00ff9640 1 -- 172.21.15.84:0/2014005392 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6dec054e50 con 0x7f6e040ac890 2023-12-12T09:21:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.222+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e0406e3b0 con 0x7f6e040ac890 2023-12-12T09:21:31.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.224+0000 7f6e00ff9640 1 -- 172.21.15.84:0/2014005392 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16703 (secure 0 0 0) 0x7f6dec058470 con 0x7f6e040ac890 2023-12-12T09:21:31.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:31.224 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:30.191768+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6de406ae70 msgr2=0x7f6de406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6de406ae70 0x7f6de406d330 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6df4036000 tx=0x7f6df4031000 comp rx=0 tx=0).stop 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040ac890 msgr2=0x7f6e040acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040ac890 0x7f6e040acd10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6dec006a90 tx=0x7f6dec004610 comp rx=0 tx=0).stop 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 shutdown_connections 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e040b3230 0x7f6e040b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6de406ae70 0x7f6de406d330 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e040ac890 0x7f6e040acd10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 --2- 172.21.15.84:0/2014005392 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6df0003970 0x7f6e0415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.226+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 >> 172.21.15.84:0/2014005392 conn(0x7f6e0406c3d0 msgr2=0x7f6e040afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:31.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.227+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 shutdown_connections 2023-12-12T09:21:31.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.227+0000 7f6e09c87640 1 -- 172.21.15.84:0/2014005392 wait complete. 2023-12-12T09:21:31.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.454+0000 7f3941690640 1 Processor -- start 2023-12-12T09:21:31.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.454+0000 7f3941690640 1 -- start start 2023-12-12T09:21:31.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.456+0000 7f3941690640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13ff90 0x7f393c142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.456+0000 7f3941690640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f393c0b4ba0 0x7f393c142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.456+0000 7f3941690640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c0b3b60 con 0x7f393c15d9a0 2023-12-12T09:21:31.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.456+0000 7f3941690640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c15e6d0 con 0x7f393c0b4ba0 2023-12-12T09:21:31.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.456+0000 7f3941690640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0b3de0 con 0x7f393c13ff90 2023-12-12T09:21:31.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.456+0000 7f393b7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f393c15d9a0 0x7f393c15de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41452/0 (socket says 172.21.15.84:41452) 2023-12-12T09:21:31.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.456+0000 7f393b7fe640 1 -- 172.21.15.84:0/210440909 learned_addr learned my addr 172.21.15.84:0/210440909 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:31.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f39327fc640 1 --2- 172.21.15.84:0/210440909 >> v2:172.21.15.99:3300/0 conn(0x7f393c0b4ba0 0x7f393c142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386111960 0 0) 0x7f393c0b3b60 con 0x7f393c15d9a0 2023-12-12T09:21:31.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393affd640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13ff90 0x7f393c142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3928003520 con 0x7f393c15d9a0 2023-12-12T09:21:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 733620601 0 0) 0x7f3928003520 con 0x7f393c15d9a0 2023-12-12T09:21:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13ff90 msgr2=0x7f393c142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13ff90 0x7f393c142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 >> v2:172.21.15.99:3300/0 conn(0x7f393c0b4ba0 msgr2=0x7f393c142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 --2- 172.21.15.84:0/210440909 >> v2:172.21.15.99:3300/0 conn(0x7f393c0b4ba0 0x7f393c142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0b40c0 con 0x7f393c15d9a0 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f39340019f0 con 0x7f393c15d9a0 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 >> v1:172.21.15.84:6789/0 conn(0x7f393c15d9a0 legacy=0x7f393c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3928003970 0x7f3928003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.457+0000 7f393a7fc640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13ff90 0x7f39280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393a7fc640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f3928005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c15e6d0 con 0x7f3928004d00 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0b3de0 con 0x7f3928003970 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392800b980 con 0x7f393c13ff90 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393b7fe640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f3928005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393b7fe640 1 -- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13ff90 msgr2=0x7f39280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393b7fe640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13ff90 0x7f39280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393b7fe640 1 -- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3928003970 msgr2=0x7f3928003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393b7fe640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3928003970 0x7f3928003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.458+0000 7f393b7fe640 1 -- 172.21.15.84:0/210440909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928003520 con 0x7f3928004d00 2023-12-12T09:21:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.459+0000 7f393b7fe640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f3928005180 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f393400a790 tx=0x7f39280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b80bb7c93554d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.459+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934034630 con 0x7f3928004d00 2023-12-12T09:21:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.459+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393402f070 con 0x7f3928004d00 2023-12-12T09:21:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.459+0000 7f393a7fc640 1 -- 172.21.15.84:0/210440909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340349f0 con 0x7f3928004d00 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.460+0000 7f3941690640 1 -- 172.21.15.84:0/210440909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 msgr2=0x7f3928005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.460+0000 7f3941690640 1 --2- 172.21.15.84:0/210440909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f3928005180 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f393400a790 tx=0x7f39280057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.460+0000 7f393b7fe640 1 -- 172.21.15.84:0/210440909 reap_dead start 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.460+0000 7f3941690640 1 -- 172.21.15.84:0/210440909 shutdown_connections 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.460+0000 7f3941690640 1 -- 172.21.15.84:0/210440909 >> 172.21.15.84:0/210440909 conn(0x7f393c06c3d0 msgr2=0x7f393c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.460+0000 7f3941690640 1 -- 172.21.15.84:0/210440909 shutdown_connections 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.460+0000 7f3941690640 1 -- 172.21.15.84:0/210440909 wait complete. 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.462+0000 7f3941690640 1 Processor -- start 2023-12-12T09:21:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.462+0000 7f3941690640 1 -- start start 2023-12-12T09:21:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f3941690640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f393c13bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f3941690640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f393c139c00 0x7f393c1f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f3941690640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13a080 0x7f393c1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f3941690640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c138db0 con 0x7f3928004d00 2023-12-12T09:21:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f3941690640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c137f50 con 0x7f393c139c00 2023-12-12T09:21:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f3941690640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c1381a0 con 0x7f393c13a080 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f393affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f393c13bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f393affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f393c13bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55530/0 (socket says 172.21.15.84:55530) 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f393affd640 1 -- 172.21.15.84:0/675015820 learned_addr learned my addr 172.21.15.84:0/675015820 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f393affd640 1 -- 172.21.15.84:0/675015820 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13a080 msgr2=0x7f393c1f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f393affd640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13a080 0x7f393c1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f393affd640 1 -- 172.21.15.84:0/675015820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f393c139c00 msgr2=0x7f393c1f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f393affd640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f393c139c00 0x7f393c1f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.463+0000 7f393affd640 1 -- 172.21.15.84:0/675015820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c138480 con 0x7f3928004d00 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.464+0000 7f393affd640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f393c13bee0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f392c00e780 tx=0x7f392c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.464+0000 7f3933fff640 1 -- 172.21.15.84:0/675015820 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c00ee90 con 0x7f3928004d00 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.464+0000 7f3933fff640 1 -- 172.21.15.84:0/675015820 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c00c8c0 con 0x7f3928004d00 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.464+0000 7f3933fff640 1 -- 172.21.15.84:0/675015820 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c00cc70 con 0x7f3928004d00 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.464+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c138760 con 0x7f3928004d00 2023-12-12T09:21:31.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.464+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c13c420 con 0x7f3928004d00 2023-12-12T09:21:31.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.465+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c15d7c0 con 0x7f3928004d00 2023-12-12T09:21:31.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.466+0000 7f3933fff640 1 -- 172.21.15.84:0/675015820 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f392c013470 con 0x7f3928004d00 2023-12-12T09:21:31.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.467+0000 7f3933fff640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f391c06ae70 0x7f391c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.467+0000 7f3933fff640 1 -- 172.21.15.84:0/675015820 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f392c0897c0 con 0x7f3928004d00 2023-12-12T09:21:31.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.467+0000 7f39327fc640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f391c06ae70 0x7f391c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.468+0000 7f39327fc640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f391c06ae70 0x7f391c06d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3924006a90 tx=0x7f3924006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.471+0000 7f3933fff640 1 -- 172.21.15.84:0/675015820 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f392c054690 con 0x7f3928004d00 2023-12-12T09:21:31.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.659+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f393c15d520 con 0x7f3928004d00 2023-12-12T09:21:31.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.663+0000 7f3933fff640 1 -- 172.21.15.84:0/675015820 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16703 (secure 0 0 0) 0x7f392c057cb0 con 0x7f3928004d00 2023-12-12T09:21:31.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:31.663 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:30.191768+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f391c06ae70 msgr2=0x7f391c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f391c06ae70 0x7f391c06d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3924006a90 tx=0x7f3924006a20 comp rx=0 tx=0).stop 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 msgr2=0x7f393c13bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f393c13bee0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f392c00e780 tx=0x7f392c00ec40 comp rx=0 tx=0).stop 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 shutdown_connections 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f393c13a080 0x7f393c1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f393c139c00 0x7f393c1f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f391c06ae70 0x7f391c06d330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 --2- 172.21.15.84:0/675015820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928004d00 0x7f393c13bee0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.665+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 >> 172.21.15.84:0/675015820 conn(0x7f393c06c3d0 msgr2=0x7f393c15f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.666+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 shutdown_connections 2023-12-12T09:21:31.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.666+0000 7f3941690640 1 -- 172.21.15.84:0/675015820 wait complete. 2023-12-12T09:21:31.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T09:21:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.900+0000 7f196e032640 1 Processor -- start 2023-12-12T09:21:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.900+0000 7f196e032640 1 -- start start 2023-12-12T09:21:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.901+0000 7f196e032640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19680cfa70 0x7f19680cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.901+0000 7f196e032640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196806f030 con 0x7f1968160ce0 2023-12-12T09:21:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.901+0000 7f196e032640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196806e420 con 0x7f196815d480 2023-12-12T09:21:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.901+0000 7f196e032640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196806e700 con 0x7f19680cfa70 2023-12-12T09:21:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.901+0000 7f196c82f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f19680cfa70 0x7f19680cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.901+0000 7f196d030640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1968160ce0 0x7f19681610c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41468/0 (socket says 172.21.15.84:41468) 2023-12-12T09:21:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.901+0000 7f196d030640 1 -- 172.21.15.84:0/2204444667 learned_addr learned my addr 172.21.15.84:0/2204444667 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.902+0000 7f196c82f640 1 -- 172.21.15.84:0/2204444667 >> v1:172.21.15.99:6789/0 conn(0x7f196815d480 legacy=0x7f196815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.902+0000 7f196c82f640 1 -- 172.21.15.84:0/2204444667 >> v1:172.21.15.84:6789/0 conn(0x7f1968160ce0 legacy=0x7f19681610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.902+0000 7f196c82f640 1 -- 172.21.15.84:0/2204444667 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196806e9e0 con 0x7f19680cfa70 2023-12-12T09:21:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.902+0000 7f195ffff640 1 -- 172.21.15.84:0/2204444667 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722091826 0 0) 0x7f196806f030 con 0x7f1968160ce0 2023-12-12T09:21:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.903+0000 7f196c82f640 1 --2- 172.21.15.84:0/2204444667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19680cfa70 0x7f19680cff20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f19580097a0 tx=0x7f195802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd473f31ebf24deb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.903+0000 7f195ffff640 1 -- 172.21.15.84:0/2204444667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958031830 con 0x7f19680cfa70 2023-12-12T09:21:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.903+0000 7f195ffff640 1 -- 172.21.15.84:0/2204444667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1958031990 con 0x7f19680cfa70 2023-12-12T09:21:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.903+0000 7f195ffff640 1 -- 172.21.15.84:0/2204444667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958031d20 con 0x7f19680cfa70 2023-12-12T09:21:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.904+0000 7f196e032640 1 -- 172.21.15.84:0/2204444667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19680cfa70 msgr2=0x7f19680cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.904+0000 7f196e032640 1 --2- 172.21.15.84:0/2204444667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19680cfa70 0x7f19680cff20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f19580097a0 tx=0x7f195802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.904+0000 7f196e032640 1 -- 172.21.15.84:0/2204444667 shutdown_connections 2023-12-12T09:21:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.904+0000 7f196e032640 1 --2- 172.21.15.84:0/2204444667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19680cfa70 0x7f19680cff20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.904+0000 7f196e032640 1 -- 172.21.15.84:0/2204444667 >> 172.21.15.84:0/2204444667 conn(0x7f19680b27a0 msgr2=0x7f19680b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.904+0000 7f196e032640 1 -- 172.21.15.84:0/2204444667 shutdown_connections 2023-12-12T09:21:31.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.904+0000 7f196e032640 1 -- 172.21.15.84:0/2204444667 wait complete. 2023-12-12T09:21:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.906+0000 7f196e032640 1 Processor -- start 2023-12-12T09:21:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.906+0000 7f196e032640 1 -- start start 2023-12-12T09:21:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196e032640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19680cfa70 0x7f196815fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196e032640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f196815d480 0x7f196806ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196e032640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1968160ce0 0x7f196806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196e032640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196809dc70 con 0x7f196815d480 2023-12-12T09:21:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196e032640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196809e510 con 0x7f19680cfa70 2023-12-12T09:21:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196e032640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196809e9a0 con 0x7f1968160ce0 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196c82f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f196815d480 0x7f196806ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196c82f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f196815d480 0x7f196806ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55548/0 (socket says 172.21.15.84:55548) 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.907+0000 7f196c82f640 1 -- 172.21.15.84:0/1294592839 learned_addr learned my addr 172.21.15.84:0/1294592839 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196d030640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19680cfa70 0x7f196815fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196c82f640 1 -- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1968160ce0 msgr2=0x7f196806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196d831640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1968160ce0 0x7f196806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196c82f640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1968160ce0 0x7f196806cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196c82f640 1 -- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19680cfa70 msgr2=0x7f196815fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196c82f640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19680cfa70 0x7f196815fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196c82f640 1 -- 172.21.15.84:0/1294592839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958009400 con 0x7f196815d480 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196d030640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19680cfa70 0x7f196815fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196c82f640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f196815d480 0x7f196806ca70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1958000c00 tx=0x7f19580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f195dffb640 1 -- 172.21.15.84:0/1294592839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958004230 con 0x7f196815d480 2023-12-12T09:21:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f195dffb640 1 -- 172.21.15.84:0/1294592839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1958004390 con 0x7f196815d480 2023-12-12T09:21:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f195dffb640 1 -- 172.21.15.84:0/1294592839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195803a940 con 0x7f196815d480 2023-12-12T09:21:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1968160060 con 0x7f196815d480 2023-12-12T09:21:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.908+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196809dec0 con 0x7f196815d480 2023-12-12T09:21:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.909+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196809e680 con 0x7f196815d480 2023-12-12T09:21:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.911+0000 7f195dffb640 1 -- 172.21.15.84:0/1294592839 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f195803aaa0 con 0x7f196815d480 2023-12-12T09:21:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.911+0000 7f195dffb640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f194c06ae40 0x7f194c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.911+0000 7f195dffb640 1 -- 172.21.15.84:0/1294592839 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f19580abe00 con 0x7f196815d480 2023-12-12T09:21:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.912+0000 7f196d030640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f194c06ae40 0x7f194c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:31.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.912+0000 7f196d030640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f194c06ae40 0x7f194c06d300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1964000f60 tx=0x7f1964009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:31.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:31.916+0000 7f195dffb640 1 -- 172.21.15.84:0/1294592839 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1958076e00 con 0x7f196815d480 2023-12-12T09:21:32.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.152+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f196804e840 con 0x7f196815d480 2023-12-12T09:21:32.485 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-12-12T09:21:32.484+0000 7f4fab9b3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:21:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.794+0000 7f195dffb640 1 -- 172.21.15.84:0/1294592839 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f195807a420 con 0x7f196815d480 2023-12-12T09:21:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f194c06ae40 msgr2=0x7f194c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f194c06ae40 0x7f194c06d300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1964000f60 tx=0x7f1964009040 comp rx=0 tx=0).stop 2023-12-12T09:21:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f196815d480 msgr2=0x7f196806ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f196815d480 0x7f196806ca70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1958000c00 tx=0x7f19580046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 shutdown_connections 2023-12-12T09:21:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1968160ce0 0x7f196806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f194c06ae40 0x7f194c06d300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f196815d480 0x7f196806ca70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:32.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 --2- 172.21.15.84:0/1294592839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19680cfa70 0x7f196815fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 >> 172.21.15.84:0/1294592839 conn(0x7f19680b27a0 msgr2=0x7f19680c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.798+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 shutdown_connections 2023-12-12T09:21:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:32.799+0000 7f196e032640 1 -- 172.21.15.84:0/1294592839 wait complete. 2023-12-12T09:21:32.820 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:21:32.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T09:21:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.038+0000 7fdbd6823640 1 Processor -- start 2023-12-12T09:21:33.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.038+0000 7fdbd6823640 1 -- start start 2023-12-12T09:21:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.039+0000 7fdbd6823640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd01609f0 0x7fdbd00d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.039+0000 7fdbd6823640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbd00b2610 0x7fdbd00b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.039+0000 7fdbd6823640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd00d3dc0 con 0x7fdbd00b1ee0 2023-12-12T09:21:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.039+0000 7fdbd6823640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd00b2ad0 con 0x7fdbd00b2610 2023-12-12T09:21:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.039+0000 7fdbd6823640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00b2db0 con 0x7fdbd01609f0 2023-12-12T09:21:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.040+0000 7fdbcf7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbd00b2610 0x7fdbd00b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.040+0000 7fdbcf7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdbd00b2610 0x7fdbd00b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55550/0 (socket says 172.21.15.84:55550) 2023-12-12T09:21:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.040+0000 7fdbcf7fe640 1 -- 172.21.15.84:0/1988586031 learned_addr learned my addr 172.21.15.84:0/1988586031 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.040+0000 7fdbcffff640 1 --2- 172.21.15.84:0/1988586031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd01609f0 0x7fdbd00d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.040+0000 7fdbcf7fe640 1 -- 172.21.15.84:0/1988586031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd01609f0 msgr2=0x7fdbd00d3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.040+0000 7fdbcf7fe640 1 --2- 172.21.15.84:0/1988586031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd01609f0 0x7fdbd00d3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.040+0000 7fdbcf7fe640 1 -- 172.21.15.84:0/1988586031 >> v1:172.21.15.99:6789/0 conn(0x7fdbd00b1ee0 legacy=0x7fdbd00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.040+0000 7fdbcf7fe640 1 -- 172.21.15.84:0/1988586031 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd00b3090 con 0x7fdbd00b2610 2023-12-12T09:21:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.041+0000 7fdbcf7fe640 1 --2- 172.21.15.84:0/1988586031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b35b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009870 tx=0x7fdbb802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb857105fd6b8b46 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbceffd640 1 -- 172.21.15.84:0/1988586031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8031640 con 0x7fdbd00b2610 2023-12-12T09:21:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbceffd640 1 -- 172.21.15.84:0/1988586031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb80317a0 con 0x7fdbd00b2610 2023-12-12T09:21:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbceffd640 1 -- 172.21.15.84:0/1988586031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8031b30 con 0x7fdbd00b2610 2023-12-12T09:21:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbd6823640 1 -- 172.21.15.84:0/1988586031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 msgr2=0x7fdbd00b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbd6823640 1 --2- 172.21.15.84:0/1988586031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b35b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009870 tx=0x7fdbb802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbd6823640 1 -- 172.21.15.84:0/1988586031 shutdown_connections 2023-12-12T09:21:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbd6823640 1 --2- 172.21.15.84:0/1988586031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b35b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbd6823640 1 --2- 172.21.15.84:0/1988586031 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd01609f0 0x7fdbd00d3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.042+0000 7fdbd6823640 1 -- 172.21.15.84:0/1988586031 >> 172.21.15.84:0/1988586031 conn(0x7fdbd009c3d0 msgr2=0x7fdbd00d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.043+0000 7fdbd6823640 1 -- 172.21.15.84:0/1988586031 shutdown_connections 2023-12-12T09:21:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.043+0000 7fdbd6823640 1 -- 172.21.15.84:0/1988586031 wait complete. 2023-12-12T09:21:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.044+0000 7fdbd6823640 1 Processor -- start 2023-12-12T09:21:33.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.044+0000 7fdbd6823640 1 -- start start 2023-12-12T09:21:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.045+0000 7fdbd6823640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd00b1ee0 0x7fdbd00c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.045+0000 7fdbd6823640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.045+0000 7fdbd6823640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbd01609f0 0x7fdbd00b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.045+0000 7fdbd6823640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00b8ee0 con 0x7fdbd00b2610 2023-12-12T09:21:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.045+0000 7fdbd6823640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00b8640 con 0x7fdbd01609f0 2023-12-12T09:21:33.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.045+0000 7fdbd6823640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd00b8920 con 0x7fdbd00b1ee0 2023-12-12T09:21:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55560/0 (socket says 172.21.15.84:55560) 2023-12-12T09:21:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 -- 172.21.15.84:0/236747436 learned_addr learned my addr 172.21.15.84:0/236747436 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 -- 172.21.15.84:0/236747436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd00b1ee0 msgr2=0x7fdbd00c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd00b1ee0 0x7fdbd00c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 -- 172.21.15.84:0/236747436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbd01609f0 msgr2=0x7fdbd00b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbd4dc0640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbd01609f0 0x7fdbd00b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:33.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbd01609f0 0x7fdbd00b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 -- 172.21.15.84:0/236747436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb80094d0 con 0x7fdbd00b2610 2023-12-12T09:21:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbd4dc0640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbd01609f0 0x7fdbd00b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.046+0000 7fdbcf7fe640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b7b60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009870 tx=0x7fdbb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.047+0000 7fdbccff9640 1 -- 172.21.15.84:0/236747436 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb803ac60 con 0x7fdbd00b2610 2023-12-12T09:21:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.047+0000 7fdbccff9640 1 -- 172.21.15.84:0/236747436 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb803adc0 con 0x7fdbd00b2610 2023-12-12T09:21:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.047+0000 7fdbccff9640 1 -- 172.21.15.84:0/236747436 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8044630 con 0x7fdbd00b2610 2023-12-12T09:21:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.047+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd00b8c00 con 0x7fdbd00b2610 2023-12-12T09:21:33.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.047+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd00ca6b0 con 0x7fdbd00b2610 2023-12-12T09:21:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.048+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd00afd30 con 0x7fdbd00b2610 2023-12-12T09:21:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.049+0000 7fdbccff9640 1 -- 172.21.15.84:0/236747436 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbb802f050 con 0x7fdbd00b2610 2023-12-12T09:21:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.050+0000 7fdbccff9640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdbb006ae40 0x7fdbb006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.050+0000 7fdbccff9640 1 -- 172.21.15.84:0/236747436 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdbb80ab680 con 0x7fdbd00b2610 2023-12-12T09:21:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.050+0000 7fdbcffff640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdbb006ae40 0x7fdbb006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:33.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.051+0000 7fdbcffff640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdbb006ae40 0x7fdbb006d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00070b0 tx=0x7fdbc0007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:33.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.055+0000 7fdbccff9640 1 -- 172.21.15.84:0/236747436 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdbd00afd30 con 0x7fdbd00b2610 2023-12-12T09:21:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.286+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdbd00afd30 con 0x7fdbd00b2610 2023-12-12T09:21:33.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.805+0000 7fdbccff9640 1 -- 172.21.15.84:0/236747436 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdbd00afd30 con 0x7fdbd00b2610 2023-12-12T09:21:33.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdbb006ae40 msgr2=0x7fdbb006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdbb006ae40 0x7fdbb006d300 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00070b0 tx=0x7fdbc0007040 comp rx=0 tx=0).stop 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 msgr2=0x7fdbd00b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b7b60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009870 tx=0x7fdbb80046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 shutdown_connections 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdbd01609f0 0x7fdbd00b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdbb006ae40 0x7fdbb006d300 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbd00b2610 0x7fdbd00b7b60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 --2- 172.21.15.84:0/236747436 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdbd00b1ee0 0x7fdbd00c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 >> 172.21.15.84:0/236747436 conn(0x7fdbd009c3d0 msgr2=0x7fdbd00cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 shutdown_connections 2023-12-12T09:21:33.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:33.809+0000 7fdbd6823640 1 -- 172.21.15.84:0/236747436 wait complete. 2023-12-12T09:21:33.829 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T09:21:33.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:21:34.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.029+0000 7fcf7e294640 1 Processor -- start 2023-12-12T09:21:34.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.029+0000 7fcf7e294640 1 -- start start 2023-12-12T09:21:34.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf7e294640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf780b4990 0x7fcf7815d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf7e294640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7815dc60 0x7fcf780ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf7e294640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780b3c80 con 0x7fcf781429a0 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf7e294640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf78143820 con 0x7fcf780b4990 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf7e294640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7815e6c0 con 0x7fcf7815dc60 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf6ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf780b4990 0x7fcf7815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf6ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf780b4990 0x7fcf7815d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55574/0 (socket says 172.21.15.84:55574) 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf6ffff640 1 -- 172.21.15.84:0/2884630520 learned_addr learned my addr 172.21.15.84:0/2884630520 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf6ffff640 1 -- 172.21.15.84:0/2884630520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7815dc60 msgr2=0x7fcf780ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf6ffff640 1 --2- 172.21.15.84:0/2884630520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7815dc60 0x7fcf780ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf6ffff640 1 -- 172.21.15.84:0/2884630520 >> v1:172.21.15.99:6789/0 conn(0x7fcf781429a0 legacy=0x7fcf78142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:34.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.031+0000 7fcf6ffff640 1 -- 172.21.15.84:0/2884630520 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780b4500 con 0x7fcf780b4990 2023-12-12T09:21:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.033+0000 7fcf6ffff640 1 --2- 172.21.15.84:0/2884630520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b4990 0x7fcf7815d720 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ed6f309689b6ba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.033+0000 7fcf777fe640 1 -- 172.21.15.84:0/2884630520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60031640 con 0x7fcf780b4990 2023-12-12T09:21:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.033+0000 7fcf777fe640 1 -- 172.21.15.84:0/2884630520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf600317a0 con 0x7fcf780b4990 2023-12-12T09:21:34.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.033+0000 7fcf777fe640 1 -- 172.21.15.84:0/2884630520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60031b30 con 0x7fcf780b4990 2023-12-12T09:21:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.034+0000 7fcf7e294640 1 -- 172.21.15.84:0/2884630520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b4990 msgr2=0x7fcf7815d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.034+0000 7fcf7e294640 1 --2- 172.21.15.84:0/2884630520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b4990 0x7fcf7815d720 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.034+0000 7fcf7e294640 1 -- 172.21.15.84:0/2884630520 shutdown_connections 2023-12-12T09:21:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.034+0000 7fcf7e294640 1 --2- 172.21.15.84:0/2884630520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf7815dc60 0x7fcf780ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.034+0000 7fcf7e294640 1 --2- 172.21.15.84:0/2884630520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf780b4990 0x7fcf7815d720 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.034+0000 7fcf7e294640 1 -- 172.21.15.84:0/2884630520 >> 172.21.15.84:0/2884630520 conn(0x7fcf7806c4f0 msgr2=0x7fcf7806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.034+0000 7fcf7e294640 1 -- 172.21.15.84:0/2884630520 shutdown_connections 2023-12-12T09:21:34.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.034+0000 7fcf7e294640 1 -- 172.21.15.84:0/2884630520 wait complete. 2023-12-12T09:21:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.036+0000 7fcf7e294640 1 Processor -- start 2023-12-12T09:21:34.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.036+0000 7fcf7e294640 1 -- start start 2023-12-12T09:21:34.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf7e294640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf780b4990 0x7fcf7813abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf7e294640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf781429a0 0x7fcf78145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf7e294640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7815dc60 0x7fcf780af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf7e294640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78140d00 con 0x7fcf781429a0 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf7e294640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78145f40 con 0x7fcf7815dc60 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf7e294640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78145c60 con 0x7fcf780b4990 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf6ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf781429a0 0x7fcf78145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf6ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf781429a0 0x7fcf78145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55580/0 (socket says 172.21.15.84:55580) 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf6ffff640 1 -- 172.21.15.84:0/882534981 learned_addr learned my addr 172.21.15.84:0/882534981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf6ffff640 1 -- 172.21.15.84:0/882534981 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf780b4990 msgr2=0x7fcf7813abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf6ffff640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf780b4990 0x7fcf7813abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf6ffff640 1 -- 172.21.15.84:0/882534981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7815dc60 msgr2=0x7fcf780af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf6ffff640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7815dc60 0x7fcf780af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.037+0000 7fcf6ffff640 1 -- 172.21.15.84:0/882534981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600094d0 con 0x7fcf781429a0 2023-12-12T09:21:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.038+0000 7fcf6ffff640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf781429a0 0x7fcf78145380 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcf60000c00 tx=0x7fcf600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.038+0000 7fcf757fa640 1 -- 172.21.15.84:0/882534981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6003ac60 con 0x7fcf781429a0 2023-12-12T09:21:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.038+0000 7fcf757fa640 1 -- 172.21.15.84:0/882534981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6003ade0 con 0x7fcf781429a0 2023-12-12T09:21:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.038+0000 7fcf757fa640 1 -- 172.21.15.84:0/882534981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60044630 con 0x7fcf781429a0 2023-12-12T09:21:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.038+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf78140640 con 0x7fcf781429a0 2023-12-12T09:21:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.038+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7813b120 con 0x7fcf781429a0 2023-12-12T09:21:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.039+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf781404a0 con 0x7fcf781429a0 2023-12-12T09:21:34.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.040+0000 7fcf757fa640 1 -- 172.21.15.84:0/882534981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf6002f050 con 0x7fcf781429a0 2023-12-12T09:21:34.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.041+0000 7fcf757fa640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcf5806ae40 0x7fcf5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.041+0000 7fcf757fa640 1 -- 172.21.15.84:0/882534981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf600ab930 con 0x7fcf781429a0 2023-12-12T09:21:34.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.041+0000 7fcf77fff640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcf5806ae40 0x7fcf5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.042+0000 7fcf77fff640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcf5806ae40 0x7fcf5806d300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf68003cc0 tx=0x7fcf680079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.045+0000 7fcf757fa640 1 -- 172.21.15.84:0/882534981 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf781404a0 con 0x7fcf781429a0 2023-12-12T09:21:34.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.272+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf781404a0 con 0x7fcf781429a0 2023-12-12T09:21:34.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.273+0000 7fcf757fa640 1 -- 172.21.15.84:0/882534981 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fcf781404a0 con 0x7fcf781429a0 2023-12-12T09:21:34.274 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:34.274 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6834/3349912921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3349912921},{"type":"v1","addr":"172.21.15.99:6834","nonce":3349912921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3102874305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6833","nonce":3102874305},{"type":"v1","addr":"172.21.15.99:6835","nonce":3102874305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2816609542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2816609542},{"type":"v1","addr":"172.21.15.84:6837","nonce":2816609542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:21:30.192583+0000","modified":"2023-12-12T09:21:33.287292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6836/1717242900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1717242900},{"type":"v1","addr":"172.21.15.84:6836","nonce":1717242900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:21:34.274 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-12-12T09:21:34.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcf5806ae40 msgr2=0x7fcf5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcf5806ae40 0x7fcf5806d300 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf68003cc0 tx=0x7fcf680079b0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf781429a0 msgr2=0x7fcf78145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf781429a0 0x7fcf78145380 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcf60000c00 tx=0x7fcf600046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 shutdown_connections 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf7815dc60 0x7fcf780af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcf5806ae40 0x7fcf5806d300 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf781429a0 0x7fcf78145380 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 --2- 172.21.15.84:0/882534981 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcf780b4990 0x7fcf7813abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 >> 172.21.15.84:0/882534981 conn(0x7fcf7806c4f0 msgr2=0x7fcf7813f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 shutdown_connections 2023-12-12T09:21:34.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.276+0000 7fcf7e294640 1 -- 172.21.15.84:0/882534981 wait complete. 2023-12-12T09:21:34.294 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:34.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.502+0000 7f3750a07640 1 Processor -- start 2023-12-12T09:21:34.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.502+0000 7f3750a07640 1 -- start start 2023-12-12T09:21:34.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.504+0000 7f3750a07640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f374c0b47e0 0x7f374c071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.504+0000 7f3750a07640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c0cea30 con 0x7f374c143d20 2023-12-12T09:21:34.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.504+0000 7f3750a07640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c0702b0 con 0x7f374c0ce550 2023-12-12T09:21:34.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.504+0000 7f3750a07640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c070590 con 0x7f374c0b47e0 2023-12-12T09:21:34.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.504+0000 7f374a59c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f374c143d20 0x7f374c0b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41482/0 (socket says 172.21.15.84:41482) 2023-12-12T09:21:34.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.504+0000 7f374a59c640 1 -- 172.21.15.84:0/3549301909 learned_addr learned my addr 172.21.15.84:0/3549301909 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f3749d9b640 1 --2- 172.21.15.84:0/3549301909 >> v2:172.21.15.99:3300/0 conn(0x7f374c0b47e0 0x7f374c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644096506 0 0) 0x7f374c0cea30 con 0x7f374c143d20 2023-12-12T09:21:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3734003520 con 0x7f374c143d20 2023-12-12T09:21:34.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 769677338 0 0) 0x7f3734003520 con 0x7f374c143d20 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 >> v2:172.21.15.99:3300/0 conn(0x7f374c0b47e0 msgr2=0x7f374c071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 --2- 172.21.15.84:0/3549301909 >> v2:172.21.15.99:3300/0 conn(0x7f374c0b47e0 0x7f374c071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 >> v1:172.21.15.99:6789/0 conn(0x7f374c0ce550 legacy=0x7f374c0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c070870 con 0x7f374c143d20 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f373c001670 con 0x7f374c143d20 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 >> v1:172.21.15.84:6789/0 conn(0x7f374c143d20 legacy=0x7f374c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37340039c0 0x7f3734003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f3734004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3734005180 0x7f373400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c070590 con 0x7f37340047c0 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373400c080 con 0x7f37340039c0 2023-12-12T09:21:34.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.505+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373400c240 con 0x7f3734005180 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f3749d9b640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f3734004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f374a59c640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37340039c0 0x7f3734003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f3749d9b640 1 -- 172.21.15.84:0/3549301909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3734005180 msgr2=0x7f373400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f3749d9b640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3734005180 0x7f373400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f3749d9b640 1 -- 172.21.15.84:0/3549301909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37340039c0 msgr2=0x7f3734003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f3749d9b640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37340039c0 0x7f3734003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f3749d9b640 1 -- 172.21.15.84:0/3549301909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734003520 con 0x7f37340047c0 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f374ad9d640 1 -- 172.21.15.84:0/3549301909 reap_dead start 2023-12-12T09:21:34.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.506+0000 7f374a59c640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37340039c0 0x7f3734003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.507+0000 7f3749d9b640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f3734004c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3740009ac0 tx=0x7f37340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735cb065c710ee10 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.507+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374002c6b0 con 0x7f37340047c0 2023-12-12T09:21:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.507+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374002c810 con 0x7f37340047c0 2023-12-12T09:21:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.507+0000 7f374959a640 1 -- 172.21.15.84:0/3549301909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374002cba0 con 0x7f37340047c0 2023-12-12T09:21:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.508+0000 7f3750a07640 1 -- 172.21.15.84:0/3549301909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 msgr2=0x7f3734004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.508+0000 7f3750a07640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f3734004c40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3740009ac0 tx=0x7f37340057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.508+0000 7f3750a07640 1 -- 172.21.15.84:0/3549301909 shutdown_connections 2023-12-12T09:21:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.508+0000 7f3750a07640 1 --2- 172.21.15.84:0/3549301909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f3734004c40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.508+0000 7f3750a07640 1 -- 172.21.15.84:0/3549301909 >> 172.21.15.84:0/3549301909 conn(0x7f374c06c3d0 msgr2=0x7f374c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.508+0000 7f3750a07640 1 -- 172.21.15.84:0/3549301909 shutdown_connections 2023-12-12T09:21:34.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.508+0000 7f3750a07640 1 -- 172.21.15.84:0/3549301909 wait complete. 2023-12-12T09:21:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.510+0000 7f3750a07640 1 Processor -- start 2023-12-12T09:21:34.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.510+0000 7f3750a07640 1 -- start start 2023-12-12T09:21:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f3750a07640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f374c0acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f3750a07640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f374c13e670 0x7f374c0b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f3750a07640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f374c13eaf0 0x7f374c0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f3750a07640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0b2a30 con 0x7f37340047c0 2023-12-12T09:21:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f3750a07640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0b2d10 con 0x7f374c13eaf0 2023-12-12T09:21:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f3750a07640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c13c210 con 0x7f374c13e670 2023-12-12T09:21:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f374a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f374c0acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f374a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f374c0acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55608/0 (socket says 172.21.15.84:55608) 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.511+0000 7f374a59c640 1 -- 172.21.15.84:0/4163792547 learned_addr learned my addr 172.21.15.84:0/4163792547 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f374a59c640 1 -- 172.21.15.84:0/4163792547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f374c13e670 msgr2=0x7f374c0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f374a59c640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f374c13e670 0x7f374c0b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f374a59c640 1 -- 172.21.15.84:0/4163792547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f374c13eaf0 msgr2=0x7f374c0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f374a59c640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f374c13eaf0 0x7f374c0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f374a59c640 1 -- 172.21.15.84:0/4163792547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c13c4f0 con 0x7f37340047c0 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f374a59c640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f374c0acb00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f373c00d770 tx=0x7f373c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f373affd640 1 -- 172.21.15.84:0/4163792547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0072d0 con 0x7f37340047c0 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f373affd640 1 -- 172.21.15.84:0/4163792547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c007430 con 0x7f37340047c0 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f373affd640 1 -- 172.21.15.84:0/4163792547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0047e0 con 0x7f37340047c0 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c0b3c10 con 0x7f37340047c0 2023-12-12T09:21:34.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.512+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c0ad040 con 0x7f37340047c0 2023-12-12T09:21:34.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.513+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c13c010 con 0x7f37340047c0 2023-12-12T09:21:34.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.514+0000 7f373affd640 1 -- 172.21.15.84:0/4163792547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f373c004940 con 0x7f37340047c0 2023-12-12T09:21:34.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.515+0000 7f373affd640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f372c06ae40 0x7f372c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.515+0000 7f373affd640 1 -- 172.21.15.84:0/4163792547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f373c088ef0 con 0x7f37340047c0 2023-12-12T09:21:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.516+0000 7f3749d9b640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f372c06ae40 0x7f372c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.516+0000 7f3749d9b640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f372c06ae40 0x7f372c06d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3740036000 tx=0x7f374002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.520+0000 7f373affd640 1 -- 172.21.15.84:0/4163792547 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f373c057980 con 0x7f37340047c0 2023-12-12T09:21:34.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.710+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f374c0673c0 con 0x7f37340047c0 2023-12-12T09:21:34.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.712+0000 7f373affd640 1 -- 172.21.15.84:0/4163792547 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16690 (secure 0 0 0) 0x7f373c019020 con 0x7f37340047c0 2023-12-12T09:21:34.713 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:34.713 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":41,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:31.781117+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:34.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f372c06ae40 msgr2=0x7f372c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f372c06ae40 0x7f372c06d300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3740036000 tx=0x7f374002e000 comp rx=0 tx=0).stop 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 msgr2=0x7f374c0acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f374c0acb00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f373c00d770 tx=0x7f373c00db70 comp rx=0 tx=0).stop 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 shutdown_connections 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f374c13eaf0 0x7f374c0b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f374c13e670 0x7f374c0b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f372c06ae40 0x7f372c06d300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 --2- 172.21.15.84:0/4163792547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f37340047c0 0x7f374c0acb00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 >> 172.21.15.84:0/4163792547 conn(0x7f374c06c3d0 msgr2=0x7f374c0ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 shutdown_connections 2023-12-12T09:21:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.715+0000 7f3750a07640 1 -- 172.21.15.84:0/4163792547 wait complete. 2023-12-12T09:21:34.735 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:21:34.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:21:34.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.939+0000 7f19b815a640 1 Processor -- start 2023-12-12T09:21:34.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.939+0000 7f19b815a640 1 -- start start 2023-12-12T09:21:34.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.941+0000 7f19b815a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b0071bb0 0x7f19b0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.941+0000 7f19b815a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19b00ce330 0x7f19b013d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.941+0000 7f19b815a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b00724d0 con 0x7f19b00ce790 2023-12-12T09:21:34.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.941+0000 7f19b815a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b0140270 con 0x7f19b00ce330 2023-12-12T09:21:34.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.941+0000 7f19b815a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00cd850 con 0x7f19b0071bb0 2023-12-12T09:21:34.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.941+0000 7f19b56f5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19b00ce330 0x7f19b013d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.942+0000 7f19b5ef6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b0071bb0 0x7f19b0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.942+0000 7f19b66f7640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f19b00ce790 0x7f19b013f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:52510/0 (socket says 172.21.15.84:52510) 2023-12-12T09:21:34.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.942+0000 7f19b56f5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19b00ce330 0x7f19b013d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:40972/0 (socket says 172.21.15.84:40972) 2023-12-12T09:21:34.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.942+0000 7f19b66f7640 1 -- 172.21.15.84:0/3607075267 learned_addr learned my addr 172.21.15.84:0/3607075267 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:34.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.942+0000 7f19b4ef4640 1 -- 172.21.15.84:0/3607075267 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611339466 0 0) 0x7f19b00724d0 con 0x7f19b00ce790 2023-12-12T09:21:34.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.942+0000 7f19b4ef4640 1 -- 172.21.15.84:0/3607075267 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c003520 con 0x7f19b00ce790 2023-12-12T09:21:34.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.943+0000 7f19b5ef6640 1 -- 172.21.15.84:0/3607075267 >> v2:172.21.15.99:3300/0 conn(0x7f19b00ce330 msgr2=0x7f19b013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:34.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.943+0000 7f19b5ef6640 1 --2- 172.21.15.84:0/3607075267 >> v2:172.21.15.99:3300/0 conn(0x7f19b00ce330 0x7f19b013d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.943+0000 7f19b5ef6640 1 -- 172.21.15.84:0/3607075267 >> v1:172.21.15.99:6789/0 conn(0x7f19b00ce790 legacy=0x7f19b013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.943+0000 7f19b5ef6640 1 -- 172.21.15.84:0/3607075267 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b00cdb30 con 0x7f19b0071bb0 2023-12-12T09:21:34.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.943+0000 7f19b56f5640 1 --2- 172.21.15.84:0/3607075267 >> v2:172.21.15.99:3300/0 conn(0x7f19b00ce330 0x7f19b013d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:21:34.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.944+0000 7f19b5ef6640 1 --2- 172.21.15.84:0/3607075267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b0071bb0 0x7f19b0071f90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00ba40 tx=0x7f19ac02e080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c608c5c03bbdc51f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.944+0000 7f19b4ef4640 1 -- 172.21.15.84:0/3607075267 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac02ee30 con 0x7f19b0071bb0 2023-12-12T09:21:34.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b4ef4640 1 -- 172.21.15.84:0/3607075267 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac036440 con 0x7f19b0071bb0 2023-12-12T09:21:34.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b4ef4640 1 -- 172.21.15.84:0/3607075267 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0367b0 con 0x7f19b0071bb0 2023-12-12T09:21:34.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b815a640 1 -- 172.21.15.84:0/3607075267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b0071bb0 msgr2=0x7f19b0071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b815a640 1 --2- 172.21.15.84:0/3607075267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b0071bb0 0x7f19b0071f90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00ba40 tx=0x7f19ac02e080 comp rx=0 tx=0).stop 2023-12-12T09:21:34.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b815a640 1 -- 172.21.15.84:0/3607075267 shutdown_connections 2023-12-12T09:21:34.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b815a640 1 --2- 172.21.15.84:0/3607075267 >> v2:172.21.15.99:3300/0 conn(0x7f19b00ce330 0x7f19b013d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b815a640 1 --2- 172.21.15.84:0/3607075267 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b0071bb0 0x7f19b0071f90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b815a640 1 -- 172.21.15.84:0/3607075267 >> 172.21.15.84:0/3607075267 conn(0x7f19b006c3d0 msgr2=0x7f19b006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:34.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b815a640 1 -- 172.21.15.84:0/3607075267 shutdown_connections 2023-12-12T09:21:34.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.945+0000 7f19b815a640 1 -- 172.21.15.84:0/3607075267 wait complete. 2023-12-12T09:21:34.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.947+0000 7f19b815a640 1 Processor -- start 2023-12-12T09:21:34.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.947+0000 7f19b815a640 1 -- start start 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b815a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19b0071bb0 0x7f19b0150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b815a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b00ce330 0x7f19b0155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b815a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b00ce790 0x7f19b0155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b815a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01569b0 con 0x7f19b00ce330 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b815a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0155da0 con 0x7f19b0071bb0 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b815a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0156080 con 0x7f19b00ce790 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b56f5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b00ce330 0x7f19b0155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b56f5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b00ce330 0x7f19b0155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55610/0 (socket says 172.21.15.84:55610) 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.948+0000 7f19b56f5640 1 -- 172.21.15.84:0/4228804768 learned_addr learned my addr 172.21.15.84:0/4228804768 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b5ef6640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19b0071bb0 0x7f19b0150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b66f7640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b00ce790 0x7f19b0155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b56f5640 1 -- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b00ce790 msgr2=0x7f19b0155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b56f5640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b00ce790 0x7f19b0155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b56f5640 1 -- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19b0071bb0 msgr2=0x7f19b0150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b56f5640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19b0071bb0 0x7f19b0150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b56f5640 1 -- 172.21.15.84:0/4228804768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009400 con 0x7f19b00ce330 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b5ef6640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19b0071bb0 0x7f19b0150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19b56f5640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b00ce330 0x7f19b0155020 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f19a000ebe0 tx=0x7f19a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19a67fc640 1 -- 172.21.15.84:0/4228804768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0009760 con 0x7f19b00ce330 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19a67fc640 1 -- 172.21.15.84:0/4228804768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a000cc30 con 0x7f19b00ce330 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.949+0000 7f19a67fc640 1 -- 172.21.15.84:0/4228804768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a000eee0 con 0x7f19b00ce330 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.950+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac00b6a0 con 0x7f19b00ce330 2023-12-12T09:21:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.950+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b0156640 con 0x7f19b00ce330 2023-12-12T09:21:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.951+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b00673c0 con 0x7f19b00ce330 2023-12-12T09:21:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.952+0000 7f19a67fc640 1 -- 172.21.15.84:0/4228804768 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19a0013470 con 0x7f19b00ce330 2023-12-12T09:21:34.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.952+0000 7f19a67fc640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f199406ae40 0x7f199406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.952+0000 7f19a67fc640 1 -- 172.21.15.84:0/4228804768 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f19a0089aa0 con 0x7f19b00ce330 2023-12-12T09:21:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.953+0000 7f19b5ef6640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f199406ae40 0x7f199406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:34.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.953+0000 7f19b5ef6640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f199406ae40 0x7f199406d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f19ac038000 tx=0x7f19ac032000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:34.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:34.957+0000 7f19a67fc640 1 -- 172.21.15.84:0/4228804768 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19a0054a10 con 0x7f19b00ce330 2023-12-12T09:21:35.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.132+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19b00cd4d0 con 0x7f199406ae40 2023-12-12T09:21:35.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.148+0000 7f19a67fc640 1 -- 172.21.15.84:0/4228804768 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281687 (secure 0 0 0) 0x7f19ac0044e0 con 0x7f199406ae40 2023-12-12T09:21:35.152 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:21:35.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f199406ae40 msgr2=0x7f199406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f199406ae40 0x7f199406d300 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f19ac038000 tx=0x7f19ac032000 comp rx=0 tx=0).stop 2023-12-12T09:21:35.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b00ce330 msgr2=0x7f19b0155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b00ce330 0x7f19b0155020 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f19a000ebe0 tx=0x7f19a000c520 comp rx=0 tx=0).stop 2023-12-12T09:21:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 shutdown_connections 2023-12-12T09:21:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f19b00ce790 0x7f19b0155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f199406ae40 0x7f199406d300 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19b00ce330 0x7f19b0155020 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 --2- 172.21.15.84:0/4228804768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19b0071bb0 0x7f19b0150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 >> 172.21.15.84:0/4228804768 conn(0x7f19b006c3d0 msgr2=0x7f19b013f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 shutdown_connections 2023-12-12T09:21:35.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.154+0000 7f19b815a640 1 -- 172.21.15.84:0/4228804768 wait complete. 2023-12-12T09:21:35.172 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-12-12T09:21:35.111981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220748,"kb_used_data":4588,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753972,"statfs":{"total":773094113280,"available":772868067328,"internally_reserved":0,"allocated":4698112,"data_stored":2673937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001663"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752887+0000","last_change":"2023-12-12T09:21:29.752887+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752887+0000","last_undegraded":"2023-12-12T09:21:29.752887+0000","last_fullsized":"2023-12-12T09:21:29.752887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753299+0000","last_change":"2023-12-12T09:21:29.753299+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753299+0000","last_undegraded":"2023-12-12T09:21:29.753299+0000","last_fullsized":"2023-12-12T09:21:29.753299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746064+0000","last_change":"2023-12-12T09:21:29.746064+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746064+0000","last_undegraded":"2023-12-12T09:21:29.746064+0000","last_fullsized":"2023-12-12T09:21:29.746064+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748904+0000","last_change":"2023-12-12T09:21:29.748904+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748904+0000","last_undegraded":"2023-12-12T09:21:29.748904+0000","last_fullsized":"2023-12-12T09:21:29.748904+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748889+0000","last_change":"2023-12-12T09:21:29.748889+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748889+0000","last_undegraded":"2023-12-12T09:21:29.748889+0000","last_fullsized":"2023-12-12T09:21:29.748889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.742932+0000","last_change":"2023-12-12T09:21:29.742932+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.742932+0000","last_undegraded":"2023-12-12T09:21:29.742932+0000","last_fullsized":"2023-12-12T09:21:29.742932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751241+0000","last_change":"2023-12-12T09:21:29.751241+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751241+0000","last_undegraded":"2023-12-12T09:21:29.751241+0000","last_fullsized":"2023-12-12T09:21:29.751241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745304+0000","last_change":"2023-12-12T09:21:29.745304+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745304+0000","last_undegraded":"2023-12-12T09:21:29.745304+0000","last_fullsized":"2023-12-12T09:21:29.745304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747247+0000","last_change":"2023-12-12T09:21:29.747247+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747247+0000","last_undegraded":"2023-12-12T09:21:29.747247+0000","last_fullsized":"2023-12-12T09:21:29.747247+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751045+0000","last_change":"2023-12-12T09:21:29.751045+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751045+0000","last_undegraded":"2023-12-12T09:21:29.751045+0000","last_fullsized":"2023-12-12T09:21:29.751045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753704+0000","last_change":"2023-12-12T09:21:29.753704+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753704+0000","last_undegraded":"2023-12-12T09:21:29.753704+0000","last_fullsized":"2023-12-12T09:21:29.753704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746503+0000","last_change":"2023-12-12T09:21:29.746503+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746503+0000","last_undegraded":"2023-12-12T09:21:29.746503+0000","last_fullsized":"2023-12-12T09:21:29.746503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752576+0000","last_change":"2023-12-12T09:21:29.752576+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752576+0000","last_undegraded":"2023-12-12T09:21:29.752576+0000","last_fullsized":"2023-12-12T09:21:29.752576+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747304+0000","last_change":"2023-12-12T09:21:29.747304+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747304+0000","last_undegraded":"2023-12-12T09:21:29.747304+0000","last_fullsized":"2023-12-12T09:21:29.747304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.750619+0000","last_change":"2023-12-12T09:21:29.750619+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.750619+0000","last_undegraded":"2023-12-12T09:21:29.750619+0000","last_fullsized":"2023-12-12T09:21:29.750619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.755608+0000","last_change":"2023-12-12T09:21:29.755608+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.755608+0000","last_undegraded":"2023-12-12T09:21:29.755608+0000","last_fullsized":"2023-12-12T09:21:29.755608+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.761365+0000","last_change":"2023-12-12T09:21:29.761365+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.761365+0000","last_undegraded":"2023-12-12T09:21:29.761365+0000","last_fullsized":"2023-12-12T09:21:29.761365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.739664+0000","last_change":"2023-12-12T09:21:29.739664+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.739664+0000","last_undegraded":"2023-12-12T09:21:29.739664+0000","last_fullsized":"2023-12-12T09:21:29.739664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747841+0000","last_change":"2023-12-12T09:21:29.747841+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747841+0000","last_undegraded":"2023-12-12T09:21:29.747841+0000","last_fullsized":"2023-12-12T09:21:29.747841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.737990+0000","last_change":"2023-12-12T09:21:29.737990+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.737990+0000","last_undegraded":"2023-12-12T09:21:29.737990+0000","last_fullsized":"2023-12-12T09:21:29.737990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751867+0000","last_change":"2023-12-12T09:21:29.751867+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751867+0000","last_undegraded":"2023-12-12T09:21:29.751867+0000","last_fullsized":"2023-12-12T09:21:29.751867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743001+0000","last_change":"2023-12-12T09:21:29.743001+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743001+0000","last_undegraded":"2023-12-12T09:21:29.743001+0000","last_fullsized":"2023-12-12T09:21:29.743001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.762091+0000","last_change":"2023-12-12T09:21:29.762091+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.762091+0000","last_undegraded":"2023-12-12T09:21:29.762091+0000","last_fullsized":"2023-12-12T09:21:29.762091+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747563+0000","last_change":"2023-12-12T09:21:29.747563+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747563+0000","last_undegraded":"2023-12-12T09:21:29.747563+0000","last_fullsized":"2023-12-12T09:21:29.747563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746701+0000","last_change":"2023-12-12T09:21:29.746701+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746701+0000","last_undegraded":"2023-12-12T09:21:29.746701+0000","last_fullsized":"2023-12-12T09:21:29.746701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743321+0000","last_change":"2023-12-12T09:21:29.743321+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743321+0000","last_undegraded":"2023-12-12T09:21:29.743321+0000","last_fullsized":"2023-12-12T09:21:29.743321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747628+0000","last_change":"2023-12-12T09:21:29.747628+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747628+0000","last_undegraded":"2023-12-12T09:21:29.747628+0000","last_fullsized":"2023-12-12T09:21:29.747628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752376+0000","last_change":"2023-12-12T09:21:29.752376+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752376+0000","last_undegraded":"2023-12-12T09:21:29.752376+0000","last_fullsized":"2023-12-12T09:21:29.752376+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.738106+0000","last_change":"2023-12-12T09:21:29.738106+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.738106+0000","last_undegraded":"2023-12-12T09:21:29.738106+0000","last_fullsized":"2023-12-12T09:21:29.738106+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.737984+0000","last_change":"2023-12-12T09:21:29.737984+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.737984+0000","last_undegraded":"2023-12-12T09:21:29.737984+0000","last_fullsized":"2023-12-12T09:21:29.737984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.761597+0000","last_change":"2023-12-12T09:21:29.761597+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.761597+0000","last_undegraded":"2023-12-12T09:21:29.761597+0000","last_fullsized":"2023-12-12T09:21:29.761597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.742169+0000","last_change":"2023-12-12T09:21:29.742169+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.742169+0000","last_undegraded":"2023-12-12T09:21:29.742169+0000","last_fullsized":"2023-12-12T09:21:29.742169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.756044+0000","last_change":"2023-12-12T09:21:29.756044+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.756044+0000","last_undegraded":"2023-12-12T09:21:29.756044+0000","last_fullsized":"2023-12-12T09:21:29.756044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.763114+0000","last_change":"2023-12-12T09:21:29.759176+0000","last_active":"2023-12-12T09:21:29.763114+0000","last_peered":"2023-12-12T09:21:29.763114+0000","last_clean":"2023-12-12T09:21:29.763114+0000","last_became_active":"2023-12-12T09:21:29.758919+0000","last_became_peered":"2023-12-12T09:21:29.758919+0000","last_unstale":"2023-12-12T09:21:29.763114+0000","last_undegraded":"2023-12-12T09:21:29.763114+0000","last_fullsized":"2023-12-12T09:21:29.763114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:56:43.218212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744341+0000","last_change":"2023-12-12T09:21:29.744341+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744341+0000","last_undegraded":"2023-12-12T09:21:29.744341+0000","last_fullsized":"2023-12-12T09:21:29.744341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.769771+0000","last_change":"2023-12-12T09:21:29.768735+0000","last_active":"2023-12-12T09:21:29.769771+0000","last_peered":"2023-12-12T09:21:29.769771+0000","last_clean":"2023-12-12T09:21:29.769771+0000","last_became_active":"2023-12-12T09:21:29.768270+0000","last_became_peered":"2023-12-12T09:21:29.768270+0000","last_unstale":"2023-12-12T09:21:29.769771+0000","last_undegraded":"2023-12-12T09:21:29.769771+0000","last_fullsized":"2023-12-12T09:21:29.769771+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748510+0000","last_change":"2023-12-12T09:21:29.748510+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748510+0000","last_undegraded":"2023-12-12T09:21:29.748510+0000","last_fullsized":"2023-12-12T09:21:29.748510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767752+0000","last_change":"2023-12-12T09:21:29.761602+0000","last_active":"2023-12-12T09:21:29.767752+0000","last_peered":"2023-12-12T09:21:29.767752+0000","last_clean":"2023-12-12T09:21:29.767752+0000","last_became_active":"2023-12-12T09:21:29.761302+0000","last_became_peered":"2023-12-12T09:21:29.761302+0000","last_unstale":"2023-12-12T09:21:29.767752+0000","last_undegraded":"2023-12-12T09:21:29.767752+0000","last_fullsized":"2023-12-12T09:21:29.767752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753362+0000","last_change":"2023-12-12T09:21:29.753362+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753362+0000","last_undegraded":"2023-12-12T09:21:29.753362+0000","last_fullsized":"2023-12-12T09:21:29.753362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765507+0000","last_change":"2023-12-12T09:21:29.757460+0000","last_active":"2023-12-12T09:21:29.765507+0000","last_peered":"2023-12-12T09:21:29.765507+0000","last_clean":"2023-12-12T09:21:29.765507+0000","last_became_active":"2023-12-12T09:21:29.757144+0000","last_became_peered":"2023-12-12T09:21:29.757144+0000","last_unstale":"2023-12-12T09:21:29.765507+0000","last_undegraded":"2023-12-12T09:21:29.765507+0000","last_fullsized":"2023-12-12T09:21:29.765507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:23.634688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753891+0000","last_change":"2023-12-12T09:21:29.753891+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753891+0000","last_undegraded":"2023-12-12T09:21:29.753891+0000","last_fullsized":"2023-12-12T09:21:29.753891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767265+0000","last_change":"2023-12-12T09:21:29.764003+0000","last_active":"2023-12-12T09:21:29.767265+0000","last_peered":"2023-12-12T09:21:29.767265+0000","last_clean":"2023-12-12T09:21:29.767265+0000","last_became_active":"2023-12-12T09:21:29.763739+0000","last_became_peered":"2023-12-12T09:21:29.763739+0000","last_unstale":"2023-12-12T09:21:29.767265+0000","last_undegraded":"2023-12-12T09:21:29.767265+0000","last_fullsized":"2023-12-12T09:21:29.767265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749833+0000","last_change":"2023-12-12T09:21:29.749833+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749833+0000","last_undegraded":"2023-12-12T09:21:29.749833+0000","last_fullsized":"2023-12-12T09:21:29.749833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.773858+0000","last_change":"2023-12-12T09:21:29.772599+0000","last_active":"2023-12-12T09:21:29.773858+0000","last_peered":"2023-12-12T09:21:29.773858+0000","last_clean":"2023-12-12T09:21:29.773858+0000","last_became_active":"2023-12-12T09:21:29.772099+0000","last_became_peered":"2023-12-12T09:21:29.772099+0000","last_unstale":"2023-12-12T09:21:29.773858+0000","last_undegraded":"2023-12-12T09:21:29.773858+0000","last_fullsized":"2023-12-12T09:21:29.773858+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:52.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.741323+0000","last_change":"2023-12-12T09:21:29.741323+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.741323+0000","last_undegraded":"2023-12-12T09:21:29.741323+0000","last_fullsized":"2023-12-12T09:21:29.741323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.770570+0000","last_change":"2023-12-12T09:21:29.767795+0000","last_active":"2023-12-12T09:21:29.770570+0000","last_peered":"2023-12-12T09:21:29.770570+0000","last_clean":"2023-12-12T09:21:29.770570+0000","last_became_active":"2023-12-12T09:21:29.767472+0000","last_became_peered":"2023-12-12T09:21:29.767472+0000","last_unstale":"2023-12-12T09:21:29.770570+0000","last_undegraded":"2023-12-12T09:21:29.770570+0000","last_fullsized":"2023-12-12T09:21:29.770570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752364+0000","last_change":"2023-12-12T09:21:29.752364+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752364+0000","last_undegraded":"2023-12-12T09:21:29.752364+0000","last_fullsized":"2023-12-12T09:21:29.752364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766968+0000","last_change":"2023-12-12T09:21:29.760059+0000","last_active":"2023-12-12T09:21:29.766968+0000","last_peered":"2023-12-12T09:21:29.766968+0000","last_clean":"2023-12-12T09:21:29.766968+0000","last_became_active":"2023-12-12T09:21:29.759181+0000","last_became_peered":"2023-12-12T09:21:29.759181+0000","last_unstale":"2023-12-12T09:21:29.766968+0000","last_undegraded":"2023-12-12T09:21:29.766968+0000","last_fullsized":"2023-12-12T09:21:29.766968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747442+0000","last_change":"2023-12-12T09:21:29.747442+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747442+0000","last_undegraded":"2023-12-12T09:21:29.747442+0000","last_fullsized":"2023-12-12T09:21:29.747442+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767422+0000","last_change":"2023-12-12T09:21:29.765362+0000","last_active":"2023-12-12T09:21:29.767422+0000","last_peered":"2023-12-12T09:21:29.767422+0000","last_clean":"2023-12-12T09:21:29.767422+0000","last_became_active":"2023-12-12T09:21:29.765103+0000","last_became_peered":"2023-12-12T09:21:29.765103+0000","last_unstale":"2023-12-12T09:21:29.767422+0000","last_undegraded":"2023-12-12T09:21:29.767422+0000","last_fullsized":"2023-12-12T09:21:29.767422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:21.696885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759796+0000","last_change":"2023-12-12T09:21:29.759796+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759796+0000","last_undegraded":"2023-12-12T09:21:29.759796+0000","last_fullsized":"2023-12-12T09:21:29.759796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772542+0000","last_change":"2023-12-12T09:21:29.768355+0000","last_active":"2023-12-12T09:21:29.772542+0000","last_peered":"2023-12-12T09:21:29.772542+0000","last_clean":"2023-12-12T09:21:29.772542+0000","last_became_active":"2023-12-12T09:21:29.768018+0000","last_became_peered":"2023-12-12T09:21:29.768018+0000","last_unstale":"2023-12-12T09:21:29.772542+0000","last_undegraded":"2023-12-12T09:21:29.772542+0000","last_fullsized":"2023-12-12T09:21:29.772542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748560+0000","last_change":"2023-12-12T09:21:29.748560+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748560+0000","last_undegraded":"2023-12-12T09:21:29.748560+0000","last_fullsized":"2023-12-12T09:21:29.748560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772547+0000","last_change":"2023-12-12T09:21:29.768295+0000","last_active":"2023-12-12T09:21:29.772547+0000","last_peered":"2023-12-12T09:21:29.772547+0000","last_clean":"2023-12-12T09:21:29.772547+0000","last_became_active":"2023-12-12T09:21:29.767583+0000","last_became_peered":"2023-12-12T09:21:29.767583+0000","last_unstale":"2023-12-12T09:21:29.772547+0000","last_undegraded":"2023-12-12T09:21:29.772547+0000","last_fullsized":"2023-12-12T09:21:29.772547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:23.634688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746033+0000","last_change":"2023-12-12T09:21:29.746033+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746033+0000","last_undegraded":"2023-12-12T09:21:29.746033+0000","last_fullsized":"2023-12-12T09:21:29.746033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.769595+0000","last_change":"2023-12-12T09:21:29.766850+0000","last_active":"2023-12-12T09:21:29.769595+0000","last_peered":"2023-12-12T09:21:29.769595+0000","last_clean":"2023-12-12T09:21:29.769595+0000","last_became_active":"2023-12-12T09:21:29.766432+0000","last_became_peered":"2023-12-12T09:21:29.766432+0000","last_unstale":"2023-12-12T09:21:29.769595+0000","last_undegraded":"2023-12-12T09:21:29.769595+0000","last_fullsized":"2023-12-12T09:21:29.769595+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:23.231125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753393+0000","last_change":"2023-12-12T09:21:29.753393+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753393+0000","last_undegraded":"2023-12-12T09:21:29.753393+0000","last_fullsized":"2023-12-12T09:21:29.753393+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766260+0000","last_change":"2023-12-12T09:21:29.762250+0000","last_active":"2023-12-12T09:21:29.766260+0000","last_peered":"2023-12-12T09:21:29.766260+0000","last_clean":"2023-12-12T09:21:29.766260+0000","last_became_active":"2023-12-12T09:21:29.761642+0000","last_became_peered":"2023-12-12T09:21:29.761642+0000","last_unstale":"2023-12-12T09:21:29.766260+0000","last_undegraded":"2023-12-12T09:21:29.766260+0000","last_fullsized":"2023-12-12T09:21:29.766260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:39:48.191760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745130+0000","last_change":"2023-12-12T09:21:29.745130+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745130+0000","last_undegraded":"2023-12-12T09:21:29.745130+0000","last_fullsized":"2023-12-12T09:21:29.745130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.770490+0000","last_change":"2023-12-12T09:21:29.763371+0000","last_active":"2023-12-12T09:21:29.770490+0000","last_peered":"2023-12-12T09:21:29.770490+0000","last_clean":"2023-12-12T09:21:29.770490+0000","last_became_active":"2023-12-12T09:21:29.763082+0000","last_became_peered":"2023-12-12T09:21:29.763082+0000","last_unstale":"2023-12-12T09:21:29.770490+0000","last_undegraded":"2023-12-12T09:21:29.770490+0000","last_fullsized":"2023-12-12T09:21:29.770490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.756200+0000","last_change":"2023-12-12T09:21:29.756200+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.756200+0000","last_undegraded":"2023-12-12T09:21:29.756200+0000","last_fullsized":"2023-12-12T09:21:29.756200+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.762480+0000","last_change":"2023-12-12T09:21:29.753760+0000","last_active":"2023-12-12T09:21:29.762480+0000","last_peered":"2023-12-12T09:21:29.762480+0000","last_clean":"2023-12-12T09:21:29.762480+0000","last_became_active":"2023-12-12T09:21:29.753342+0000","last_became_peered":"2023-12-12T09:21:29.753342+0000","last_unstale":"2023-12-12T09:21:29.762480+0000","last_undegraded":"2023-12-12T09:21:29.762480+0000","last_fullsized":"2023-12-12T09:21:29.762480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:33:15.269572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749552+0000","last_change":"2023-12-12T09:21:29.749552+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749552+0000","last_undegraded":"2023-12-12T09:21:29.749552+0000","last_fullsized":"2023-12-12T09:21:29.749552+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774011+0000","last_change":"2023-12-12T09:21:29.772645+0000","last_active":"2023-12-12T09:21:29.774011+0000","last_peered":"2023-12-12T09:21:29.774011+0000","last_clean":"2023-12-12T09:21:29.774011+0000","last_became_active":"2023-12-12T09:21:29.772381+0000","last_became_peered":"2023-12-12T09:21:29.772381+0000","last_unstale":"2023-12-12T09:21:29.774011+0000","last_undegraded":"2023-12-12T09:21:29.774011+0000","last_fullsized":"2023-12-12T09:21:29.774011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:10.745369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.750335+0000","last_change":"2023-12-12T09:21:29.750335+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.750335+0000","last_undegraded":"2023-12-12T09:21:29.750335+0000","last_fullsized":"2023-12-12T09:21:29.750335+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772512+0000","last_change":"2023-12-12T09:21:29.768150+0000","last_active":"2023-12-12T09:21:29.772512+0000","last_peered":"2023-12-12T09:21:29.772512+0000","last_clean":"2023-12-12T09:21:29.772512+0000","last_became_active":"2023-12-12T09:21:29.767829+0000","last_became_peered":"2023-12-12T09:21:29.767829+0000","last_unstale":"2023-12-12T09:21:29.772512+0000","last_undegraded":"2023-12-12T09:21:29.772512+0000","last_fullsized":"2023-12-12T09:21:29.772512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:11:11.483705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753153+0000","last_change":"2023-12-12T09:21:29.753153+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753153+0000","last_undegraded":"2023-12-12T09:21:29.753153+0000","last_fullsized":"2023-12-12T09:21:29.753153+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766772+0000","last_change":"2023-12-12T09:21:29.761367+0000","last_active":"2023-12-12T09:21:29.766772+0000","last_peered":"2023-12-12T09:21:29.766772+0000","last_clean":"2023-12-12T09:21:29.766772+0000","last_became_active":"2023-12-12T09:21:29.761014+0000","last_became_peered":"2023-12-12T09:21:29.761014+0000","last_unstale":"2023-12-12T09:21:29.766772+0000","last_undegraded":"2023-12-12T09:21:29.766772+0000","last_fullsized":"2023-12-12T09:21:29.766772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:11:11.483705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749319+0000","last_change":"2023-12-12T09:21:29.749319+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749319+0000","last_undegraded":"2023-12-12T09:21:29.749319+0000","last_fullsized":"2023-12-12T09:21:29.749319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774226+0000","last_change":"2023-12-12T09:21:29.770091+0000","last_active":"2023-12-12T09:21:29.774226+0000","last_peered":"2023-12-12T09:21:29.774226+0000","last_clean":"2023-12-12T09:21:29.774226+0000","last_became_active":"2023-12-12T09:21:29.769239+0000","last_became_peered":"2023-12-12T09:21:29.769239+0000","last_unstale":"2023-12-12T09:21:29.774226+0000","last_undegraded":"2023-12-12T09:21:29.774226+0000","last_fullsized":"2023-12-12T09:21:29.774226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:38:17.785181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745981+0000","last_change":"2023-12-12T09:21:29.745981+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745981+0000","last_undegraded":"2023-12-12T09:21:29.745981+0000","last_fullsized":"2023-12-12T09:21:29.745981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766694+0000","last_change":"2023-12-12T09:21:29.760344+0000","last_active":"2023-12-12T09:21:29.766694+0000","last_peered":"2023-12-12T09:21:29.766694+0000","last_clean":"2023-12-12T09:21:29.766694+0000","last_became_active":"2023-12-12T09:21:29.760057+0000","last_became_peered":"2023-12-12T09:21:29.760057+0000","last_unstale":"2023-12-12T09:21:29.766694+0000","last_undegraded":"2023-12-12T09:21:29.766694+0000","last_fullsized":"2023-12-12T09:21:29.766694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.754999+0000","last_change":"2023-12-12T09:21:29.754999+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.754999+0000","last_undegraded":"2023-12-12T09:21:29.754999+0000","last_fullsized":"2023-12-12T09:21:29.754999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.759970+0000","last_change":"2023-12-12T09:21:29.756282+0000","last_active":"2023-12-12T09:21:29.759970+0000","last_peered":"2023-12-12T09:21:29.759970+0000","last_clean":"2023-12-12T09:21:29.759970+0000","last_became_active":"2023-12-12T09:21:29.755942+0000","last_became_peered":"2023-12-12T09:21:29.755942+0000","last_unstale":"2023-12-12T09:21:29.759970+0000","last_undegraded":"2023-12-12T09:21:29.759970+0000","last_fullsized":"2023-12-12T09:21:29.759970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:13.499674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744828+0000","last_change":"2023-12-12T09:21:29.744828+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744828+0000","last_undegraded":"2023-12-12T09:21:29.744828+0000","last_fullsized":"2023-12-12T09:21:29.744828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.758268+0000","last_change":"2023-12-12T09:21:29.752853+0000","last_active":"2023-12-12T09:21:29.758268+0000","last_peered":"2023-12-12T09:21:29.758268+0000","last_clean":"2023-12-12T09:21:29.758268+0000","last_became_active":"2023-12-12T09:21:29.752575+0000","last_became_peered":"2023-12-12T09:21:29.752575+0000","last_unstale":"2023-12-12T09:21:29.758268+0000","last_undegraded":"2023-12-12T09:21:29.758268+0000","last_fullsized":"2023-12-12T09:21:29.758268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:20.436895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.754111+0000","last_change":"2023-12-12T09:21:29.754111+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.754111+0000","last_undegraded":"2023-12-12T09:21:29.754111+0000","last_fullsized":"2023-12-12T09:21:29.754111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774690+0000","last_change":"2023-12-12T09:21:29.772886+0000","last_active":"2023-12-12T09:21:29.774690+0000","last_peered":"2023-12-12T09:21:29.774690+0000","last_clean":"2023-12-12T09:21:29.774690+0000","last_became_active":"2023-12-12T09:21:29.772078+0000","last_became_peered":"2023-12-12T09:21:29.772078+0000","last_unstale":"2023-12-12T09:21:29.774690+0000","last_undegraded":"2023-12-12T09:21:29.774690+0000","last_fullsized":"2023-12-12T09:21:29.774690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:26.564928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749019+0000","last_change":"2023-12-12T09:21:29.749019+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749019+0000","last_undegraded":"2023-12-12T09:21:29.749019+0000","last_fullsized":"2023-12-12T09:21:29.749019+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.748077+0000","last_change":"2023-12-12T09:21:29.746023+0000","last_active":"2023-12-12T09:21:29.748077+0000","last_peered":"2023-12-12T09:21:29.748077+0000","last_clean":"2023-12-12T09:21:29.748077+0000","last_became_active":"2023-12-12T09:21:29.745607+0000","last_became_peered":"2023-12-12T09:21:29.745607+0000","last_unstale":"2023-12-12T09:21:29.748077+0000","last_undegraded":"2023-12-12T09:21:29.748077+0000","last_fullsized":"2023-12-12T09:21:29.748077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:30.153095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743492+0000","last_change":"2023-12-12T09:21:29.743492+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743492+0000","last_undegraded":"2023-12-12T09:21:29.743492+0000","last_fullsized":"2023-12-12T09:21:29.743492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772410+0000","last_change":"2023-12-12T09:21:29.767517+0000","last_active":"2023-12-12T09:21:29.772410+0000","last_peered":"2023-12-12T09:21:29.772410+0000","last_clean":"2023-12-12T09:21:29.772410+0000","last_became_active":"2023-12-12T09:21:29.767194+0000","last_became_peered":"2023-12-12T09:21:29.767194+0000","last_unstale":"2023-12-12T09:21:29.772410+0000","last_undegraded":"2023-12-12T09:21:29.772410+0000","last_fullsized":"2023-12-12T09:21:29.772410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759355+0000","last_change":"2023-12-12T09:21:29.759355+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759355+0000","last_undegraded":"2023-12-12T09:21:29.759355+0000","last_fullsized":"2023-12-12T09:21:29.759355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.761531+0000","last_change":"2023-12-12T09:21:29.760226+0000","last_active":"2023-12-12T09:21:29.761531+0000","last_peered":"2023-12-12T09:21:29.761531+0000","last_clean":"2023-12-12T09:21:29.761531+0000","last_became_active":"2023-12-12T09:21:29.759388+0000","last_became_peered":"2023-12-12T09:21:29.759388+0000","last_unstale":"2023-12-12T09:21:29.761531+0000","last_undegraded":"2023-12-12T09:21:29.761531+0000","last_fullsized":"2023-12-12T09:21:29.761531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:30.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752797+0000","last_change":"2023-12-12T09:21:29.752797+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752797+0000","last_undegraded":"2023-12-12T09:21:29.752797+0000","last_fullsized":"2023-12-12T09:21:29.752797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767698+0000","last_change":"2023-12-12T09:21:29.765291+0000","last_active":"2023-12-12T09:21:29.767698+0000","last_peered":"2023-12-12T09:21:29.767698+0000","last_clean":"2023-12-12T09:21:29.767698+0000","last_became_active":"2023-12-12T09:21:29.764996+0000","last_became_peered":"2023-12-12T09:21:29.764996+0000","last_unstale":"2023-12-12T09:21:29.767698+0000","last_undegraded":"2023-12-12T09:21:29.767698+0000","last_fullsized":"2023-12-12T09:21:29.767698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746955+0000","last_change":"2023-12-12T09:21:29.746955+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746955+0000","last_undegraded":"2023-12-12T09:21:29.746955+0000","last_fullsized":"2023-12-12T09:21:29.746955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.763737+0000","last_change":"2023-12-12T09:21:29.759411+0000","last_active":"2023-12-12T09:21:29.763737+0000","last_peered":"2023-12-12T09:21:29.763737+0000","last_clean":"2023-12-12T09:21:29.763737+0000","last_became_active":"2023-12-12T09:21:29.759110+0000","last_became_peered":"2023-12-12T09:21:29.759110+0000","last_unstale":"2023-12-12T09:21:29.763737+0000","last_undegraded":"2023-12-12T09:21:29.763737+0000","last_fullsized":"2023-12-12T09:21:29.763737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:51:23.303195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745070+0000","last_change":"2023-12-12T09:21:29.745070+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745070+0000","last_undegraded":"2023-12-12T09:21:29.745070+0000","last_fullsized":"2023-12-12T09:21:29.745070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766374+0000","last_change":"2023-12-12T09:21:29.764220+0000","last_active":"2023-12-12T09:21:29.766374+0000","last_peered":"2023-12-12T09:21:29.766374+0000","last_clean":"2023-12-12T09:21:29.766374+0000","last_became_active":"2023-12-12T09:21:29.763979+0000","last_became_peered":"2023-12-12T09:21:29.763979+0000","last_unstale":"2023-12-12T09:21:29.766374+0000","last_undegraded":"2023-12-12T09:21:29.766374+0000","last_fullsized":"2023-12-12T09:21:29.766374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:26.564928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744936+0000","last_change":"2023-12-12T09:21:29.744936+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744936+0000","last_undegraded":"2023-12-12T09:21:29.744936+0000","last_fullsized":"2023-12-12T09:21:29.744936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765582+0000","last_change":"2023-12-12T09:21:29.759573+0000","last_active":"2023-12-12T09:21:29.765582+0000","last_peered":"2023-12-12T09:21:29.765582+0000","last_clean":"2023-12-12T09:21:29.765582+0000","last_became_active":"2023-12-12T09:21:29.757748+0000","last_became_peered":"2023-12-12T09:21:29.757748+0000","last_unstale":"2023-12-12T09:21:29.765582+0000","last_undegraded":"2023-12-12T09:21:29.765582+0000","last_fullsized":"2023-12-12T09:21:29.765582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759489+0000","last_change":"2023-12-12T09:21:29.759489+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759489+0000","last_undegraded":"2023-12-12T09:21:29.759489+0000","last_fullsized":"2023-12-12T09:21:29.759489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765820+0000","last_change":"2023-12-12T09:21:29.760420+0000","last_active":"2023-12-12T09:21:29.765820+0000","last_peered":"2023-12-12T09:21:29.765820+0000","last_clean":"2023-12-12T09:21:29.765820+0000","last_became_active":"2023-12-12T09:21:29.760160+0000","last_became_peered":"2023-12-12T09:21:29.760160+0000","last_unstale":"2023-12-12T09:21:29.765820+0000","last_undegraded":"2023-12-12T09:21:29.765820+0000","last_fullsized":"2023-12-12T09:21:29.765820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:22:56.218371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753889+0000","last_change":"2023-12-12T09:21:29.753889+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753889+0000","last_undegraded":"2023-12-12T09:21:29.753889+0000","last_fullsized":"2023-12-12T09:21:29.753889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774692+0000","last_change":"2023-12-12T09:21:29.773445+0000","last_active":"2023-12-12T09:21:29.774692+0000","last_peered":"2023-12-12T09:21:29.774692+0000","last_clean":"2023-12-12T09:21:29.774692+0000","last_became_active":"2023-12-12T09:21:29.773170+0000","last_became_peered":"2023-12-12T09:21:29.773170+0000","last_unstale":"2023-12-12T09:21:29.774692+0000","last_undegraded":"2023-12-12T09:21:29.774692+0000","last_fullsized":"2023-12-12T09:21:29.774692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:57:32.531602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:21:28.739826+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:21:28.739826+0000","last_peered":"2023-12-12T09:21:28.739826+0000","last_clean":"2023-12-12T09:21:28.739826+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:21:28.739826+0000","last_undegraded":"2023-12-12T09:21:28.739826+0000","last_fullsized":"2023-12-12T09:21:28.739826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1028096,"data_stored":774545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":0.72299999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.77100000000000002}]},{"osd":2,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.89400000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.626}]},{"osd":4,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.2930000000000001,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.92100000000000004}]},{"osd":6,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.95499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.091}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.90800000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.1240000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1850000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.94799999999999995}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.28}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.4830000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.626},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.91900000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.246}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.008}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.083}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.375},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.4359999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.1639999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.1379999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.01}]},{"osd":2,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.876},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.4610000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.331}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.571},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.5169999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.222},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.756}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.615},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.4199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.415},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.147}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.552}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.5720000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.5900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.62},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":0.95799999999999996}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.0580000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.21,"5min":2.21,"15min":2.21},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.4239999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.169},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.3480000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.2150000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.141},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.387}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.2949999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.353},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3180000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.581}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.5269999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.839}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1040384,"data_stored":781140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.054},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.097}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.276}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.2470000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.333}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.145}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.363},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3959999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:21:35.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:21:35.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.423+0000 7f7b2346b640 1 Processor -- start 2023-12-12T09:21:35.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.423+0000 7f7b2346b640 1 -- start start 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.425+0000 7f7b2346b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.425+0000 7f7b2346b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b1c0ce550 0x7f7b1c0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.425+0000 7f7b2346b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c0cea30 con 0x7f7b1c143d20 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.425+0000 7f7b2346b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0702b0 con 0x7f7b1c0ce550 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.425+0000 7f7b2346b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c070590 con 0x7f7b1c0b47e0 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.425+0000 7f7b21a08640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b1c0ce550 0x7f7b1c0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.425+0000 7f7b21a08640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7b1c0ce550 0x7f7b1c0715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55626/0 (socket says 172.21.15.84:55626) 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.425+0000 7f7b21a08640 1 -- 172.21.15.84:0/73167933 learned_addr learned my addr 172.21.15.84:0/73167933 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.426+0000 7f7b20a06640 1 --2- 172.21.15.84:0/73167933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.426+0000 7f7b21a08640 1 -- 172.21.15.84:0/73167933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 msgr2=0x7f7b1c071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.426+0000 7f7b21a08640 1 --2- 172.21.15.84:0/73167933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.426+0000 7f7b21a08640 1 -- 172.21.15.84:0/73167933 >> v1:172.21.15.99:6789/0 conn(0x7f7b1c143d20 legacy=0x7f7b1c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:35.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.426+0000 7f7b21a08640 1 -- 172.21.15.84:0/73167933 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c070870 con 0x7f7b1c0ce550 2023-12-12T09:21:35.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.426+0000 7f7b20a06640 1 --2- 172.21.15.84:0/73167933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:35.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.427+0000 7f7b21a08640 1 --2- 172.21.15.84:0/73167933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0715b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009e50 tx=0x7f7b1402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddd12be6282acb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.427+0000 7f7b13fff640 1 -- 172.21.15.84:0/73167933 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402ca70 con 0x7f7b1c0ce550 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.427+0000 7f7b13fff640 1 -- 172.21.15.84:0/73167933 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1402cbd0 con 0x7f7b1c0ce550 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.427+0000 7f7b13fff640 1 -- 172.21.15.84:0/73167933 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b140343f0 con 0x7f7b1c0ce550 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.428+0000 7f7b2346b640 1 -- 172.21.15.84:0/73167933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 msgr2=0x7f7b1c0715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.428+0000 7f7b2346b640 1 --2- 172.21.15.84:0/73167933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0715b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009e50 tx=0x7f7b1402bed0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.428+0000 7f7b2346b640 1 -- 172.21.15.84:0/73167933 shutdown_connections 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.428+0000 7f7b2346b640 1 --2- 172.21.15.84:0/73167933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0715b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.428+0000 7f7b2346b640 1 --2- 172.21.15.84:0/73167933 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.428+0000 7f7b2346b640 1 -- 172.21.15.84:0/73167933 >> 172.21.15.84:0/73167933 conn(0x7f7b1c06c3d0 msgr2=0x7f7b1c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.428+0000 7f7b2346b640 1 -- 172.21.15.84:0/73167933 shutdown_connections 2023-12-12T09:21:35.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.428+0000 7f7b2346b640 1 -- 172.21.15.84:0/73167933 wait complete. 2023-12-12T09:21:35.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.430+0000 7f7b2346b640 1 Processor -- start 2023-12-12T09:21:35.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.430+0000 7f7b2346b640 1 -- start start 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b2346b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b2346b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b2346b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1c143d20 0x7f7b1c13cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b2346b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0ad320 con 0x7f7b1c0ce550 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b2346b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0aca80 con 0x7f7b1c143d20 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b2346b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0acd60 con 0x7f7b1c0b47e0 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b20a06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b20a06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55632/0 (socket says 172.21.15.84:55632) 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.431+0000 7f7b20a06640 1 -- 172.21.15.84:0/70343801 learned_addr learned my addr 172.21.15.84:0/70343801 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b21207640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b21a08640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1c143d20 0x7f7b1c13cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b20a06640 1 -- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 msgr2=0x7f7b1c159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b20a06640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b20a06640 1 -- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1c143d20 msgr2=0x7f7b1c13cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b20a06640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1c143d20 0x7f7b1c13cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b20a06640 1 -- 172.21.15.84:0/70343801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009b30 con 0x7f7b1c0ce550 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b21207640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b20a06640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0ac080 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c7f0 tx=0x7f7b0c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b11ffb640 1 -- 172.21.15.84:0/70343801 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c007a30 con 0x7f7b1c0ce550 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b11ffb640 1 -- 172.21.15.84:0/70343801 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c007b90 con 0x7f7b1c0ce550 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b11ffb640 1 -- 172.21.15.84:0/70343801 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c00ce40 con 0x7f7b1c0ce550 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.432+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c0ad040 con 0x7f7b1c0ce550 2023-12-12T09:21:35.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.433+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c15a000 con 0x7f7b1c0ce550 2023-12-12T09:21:35.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.434+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c0673c0 con 0x7f7b1c0ce550 2023-12-12T09:21:35.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.435+0000 7f7b11ffb640 1 -- 172.21.15.84:0/70343801 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b0c0113f0 con 0x7f7b1c0ce550 2023-12-12T09:21:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.436+0000 7f7b11ffb640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b0006ae40 0x7f7b0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.436+0000 7f7b11ffb640 1 -- 172.21.15.84:0/70343801 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7b0c0898b0 con 0x7f7b1c0ce550 2023-12-12T09:21:35.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.436+0000 7f7b21207640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b0006ae40 0x7f7b0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.437+0000 7f7b21207640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b0006ae40 0x7f7b0006d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c143120 tx=0x7f7b18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:35.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.440+0000 7f7b11ffb640 1 -- 172.21.15.84:0/70343801 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b0c054810 con 0x7f7b1c0ce550 2023-12-12T09:21:35.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.620+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b1c13ff50 con 0x7f7b0006ae40 2023-12-12T09:21:35.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.640+0000 7f7b11ffb640 1 -- 172.21.15.84:0/70343801 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281687 (secure 0 0 0) 0x7f7b1c13ff50 con 0x7f7b0006ae40 2023-12-12T09:21:35.645 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:35.647 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:21:35.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b0006ae40 msgr2=0x7f7b0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b0006ae40 0x7f7b0006d300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c143120 tx=0x7f7b18008040 comp rx=0 tx=0).stop 2023-12-12T09:21:35.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 msgr2=0x7f7b1c0ac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0ac080 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00c7f0 tx=0x7f7b0c00cbf0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 shutdown_connections 2023-12-12T09:21:35.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1c143d20 0x7f7b1c13cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b0006ae40 0x7f7b0006d300 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b1c0ce550 0x7f7b1c0ac080 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 --2- 172.21.15.84:0/70343801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7b1c0b47e0 0x7f7b1c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 >> 172.21.15.84:0/70343801 conn(0x7f7b1c06c3d0 msgr2=0x7f7b1c140930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:35.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 shutdown_connections 2023-12-12T09:21:35.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.647+0000 7f7b2346b640 1 -- 172.21.15.84:0/70343801 wait complete. 2023-12-12T09:21:35.665 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-12-12T09:21:35.111981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220748,"kb_used_data":4588,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753972,"statfs":{"total":773094113280,"available":772868067328,"internally_reserved":0,"allocated":4698112,"data_stored":2673937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001663"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752887+0000","last_change":"2023-12-12T09:21:29.752887+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752887+0000","last_undegraded":"2023-12-12T09:21:29.752887+0000","last_fullsized":"2023-12-12T09:21:29.752887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753299+0000","last_change":"2023-12-12T09:21:29.753299+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753299+0000","last_undegraded":"2023-12-12T09:21:29.753299+0000","last_fullsized":"2023-12-12T09:21:29.753299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746064+0000","last_change":"2023-12-12T09:21:29.746064+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746064+0000","last_undegraded":"2023-12-12T09:21:29.746064+0000","last_fullsized":"2023-12-12T09:21:29.746064+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748904+0000","last_change":"2023-12-12T09:21:29.748904+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748904+0000","last_undegraded":"2023-12-12T09:21:29.748904+0000","last_fullsized":"2023-12-12T09:21:29.748904+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748889+0000","last_change":"2023-12-12T09:21:29.748889+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748889+0000","last_undegraded":"2023-12-12T09:21:29.748889+0000","last_fullsized":"2023-12-12T09:21:29.748889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.742932+0000","last_change":"2023-12-12T09:21:29.742932+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.742932+0000","last_undegraded":"2023-12-12T09:21:29.742932+0000","last_fullsized":"2023-12-12T09:21:29.742932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751241+0000","last_change":"2023-12-12T09:21:29.751241+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751241+0000","last_undegraded":"2023-12-12T09:21:29.751241+0000","last_fullsized":"2023-12-12T09:21:29.751241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745304+0000","last_change":"2023-12-12T09:21:29.745304+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745304+0000","last_undegraded":"2023-12-12T09:21:29.745304+0000","last_fullsized":"2023-12-12T09:21:29.745304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747247+0000","last_change":"2023-12-12T09:21:29.747247+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747247+0000","last_undegraded":"2023-12-12T09:21:29.747247+0000","last_fullsized":"2023-12-12T09:21:29.747247+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751045+0000","last_change":"2023-12-12T09:21:29.751045+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751045+0000","last_undegraded":"2023-12-12T09:21:29.751045+0000","last_fullsized":"2023-12-12T09:21:29.751045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753704+0000","last_change":"2023-12-12T09:21:29.753704+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753704+0000","last_undegraded":"2023-12-12T09:21:29.753704+0000","last_fullsized":"2023-12-12T09:21:29.753704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746503+0000","last_change":"2023-12-12T09:21:29.746503+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746503+0000","last_undegraded":"2023-12-12T09:21:29.746503+0000","last_fullsized":"2023-12-12T09:21:29.746503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752576+0000","last_change":"2023-12-12T09:21:29.752576+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752576+0000","last_undegraded":"2023-12-12T09:21:29.752576+0000","last_fullsized":"2023-12-12T09:21:29.752576+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747304+0000","last_change":"2023-12-12T09:21:29.747304+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747304+0000","last_undegraded":"2023-12-12T09:21:29.747304+0000","last_fullsized":"2023-12-12T09:21:29.747304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.750619+0000","last_change":"2023-12-12T09:21:29.750619+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.750619+0000","last_undegraded":"2023-12-12T09:21:29.750619+0000","last_fullsized":"2023-12-12T09:21:29.750619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.755608+0000","last_change":"2023-12-12T09:21:29.755608+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.755608+0000","last_undegraded":"2023-12-12T09:21:29.755608+0000","last_fullsized":"2023-12-12T09:21:29.755608+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.761365+0000","last_change":"2023-12-12T09:21:29.761365+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.761365+0000","last_undegraded":"2023-12-12T09:21:29.761365+0000","last_fullsized":"2023-12-12T09:21:29.761365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.739664+0000","last_change":"2023-12-12T09:21:29.739664+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.739664+0000","last_undegraded":"2023-12-12T09:21:29.739664+0000","last_fullsized":"2023-12-12T09:21:29.739664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747841+0000","last_change":"2023-12-12T09:21:29.747841+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747841+0000","last_undegraded":"2023-12-12T09:21:29.747841+0000","last_fullsized":"2023-12-12T09:21:29.747841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.737990+0000","last_change":"2023-12-12T09:21:29.737990+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.737990+0000","last_undegraded":"2023-12-12T09:21:29.737990+0000","last_fullsized":"2023-12-12T09:21:29.737990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751867+0000","last_change":"2023-12-12T09:21:29.751867+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751867+0000","last_undegraded":"2023-12-12T09:21:29.751867+0000","last_fullsized":"2023-12-12T09:21:29.751867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743001+0000","last_change":"2023-12-12T09:21:29.743001+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743001+0000","last_undegraded":"2023-12-12T09:21:29.743001+0000","last_fullsized":"2023-12-12T09:21:29.743001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.762091+0000","last_change":"2023-12-12T09:21:29.762091+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.762091+0000","last_undegraded":"2023-12-12T09:21:29.762091+0000","last_fullsized":"2023-12-12T09:21:29.762091+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747563+0000","last_change":"2023-12-12T09:21:29.747563+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747563+0000","last_undegraded":"2023-12-12T09:21:29.747563+0000","last_fullsized":"2023-12-12T09:21:29.747563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746701+0000","last_change":"2023-12-12T09:21:29.746701+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746701+0000","last_undegraded":"2023-12-12T09:21:29.746701+0000","last_fullsized":"2023-12-12T09:21:29.746701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743321+0000","last_change":"2023-12-12T09:21:29.743321+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743321+0000","last_undegraded":"2023-12-12T09:21:29.743321+0000","last_fullsized":"2023-12-12T09:21:29.743321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747628+0000","last_change":"2023-12-12T09:21:29.747628+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747628+0000","last_undegraded":"2023-12-12T09:21:29.747628+0000","last_fullsized":"2023-12-12T09:21:29.747628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752376+0000","last_change":"2023-12-12T09:21:29.752376+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752376+0000","last_undegraded":"2023-12-12T09:21:29.752376+0000","last_fullsized":"2023-12-12T09:21:29.752376+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.738106+0000","last_change":"2023-12-12T09:21:29.738106+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.738106+0000","last_undegraded":"2023-12-12T09:21:29.738106+0000","last_fullsized":"2023-12-12T09:21:29.738106+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.737984+0000","last_change":"2023-12-12T09:21:29.737984+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.737984+0000","last_undegraded":"2023-12-12T09:21:29.737984+0000","last_fullsized":"2023-12-12T09:21:29.737984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.761597+0000","last_change":"2023-12-12T09:21:29.761597+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.761597+0000","last_undegraded":"2023-12-12T09:21:29.761597+0000","last_fullsized":"2023-12-12T09:21:29.761597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.742169+0000","last_change":"2023-12-12T09:21:29.742169+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.742169+0000","last_undegraded":"2023-12-12T09:21:29.742169+0000","last_fullsized":"2023-12-12T09:21:29.742169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.756044+0000","last_change":"2023-12-12T09:21:29.756044+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.756044+0000","last_undegraded":"2023-12-12T09:21:29.756044+0000","last_fullsized":"2023-12-12T09:21:29.756044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.763114+0000","last_change":"2023-12-12T09:21:29.759176+0000","last_active":"2023-12-12T09:21:29.763114+0000","last_peered":"2023-12-12T09:21:29.763114+0000","last_clean":"2023-12-12T09:21:29.763114+0000","last_became_active":"2023-12-12T09:21:29.758919+0000","last_became_peered":"2023-12-12T09:21:29.758919+0000","last_unstale":"2023-12-12T09:21:29.763114+0000","last_undegraded":"2023-12-12T09:21:29.763114+0000","last_fullsized":"2023-12-12T09:21:29.763114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:56:43.218212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744341+0000","last_change":"2023-12-12T09:21:29.744341+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744341+0000","last_undegraded":"2023-12-12T09:21:29.744341+0000","last_fullsized":"2023-12-12T09:21:29.744341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.769771+0000","last_change":"2023-12-12T09:21:29.768735+0000","last_active":"2023-12-12T09:21:29.769771+0000","last_peered":"2023-12-12T09:21:29.769771+0000","last_clean":"2023-12-12T09:21:29.769771+0000","last_became_active":"2023-12-12T09:21:29.768270+0000","last_became_peered":"2023-12-12T09:21:29.768270+0000","last_unstale":"2023-12-12T09:21:29.769771+0000","last_undegraded":"2023-12-12T09:21:29.769771+0000","last_fullsized":"2023-12-12T09:21:29.769771+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748510+0000","last_change":"2023-12-12T09:21:29.748510+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748510+0000","last_undegraded":"2023-12-12T09:21:29.748510+0000","last_fullsized":"2023-12-12T09:21:29.748510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767752+0000","last_change":"2023-12-12T09:21:29.761602+0000","last_active":"2023-12-12T09:21:29.767752+0000","last_peered":"2023-12-12T09:21:29.767752+0000","last_clean":"2023-12-12T09:21:29.767752+0000","last_became_active":"2023-12-12T09:21:29.761302+0000","last_became_peered":"2023-12-12T09:21:29.761302+0000","last_unstale":"2023-12-12T09:21:29.767752+0000","last_undegraded":"2023-12-12T09:21:29.767752+0000","last_fullsized":"2023-12-12T09:21:29.767752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753362+0000","last_change":"2023-12-12T09:21:29.753362+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753362+0000","last_undegraded":"2023-12-12T09:21:29.753362+0000","last_fullsized":"2023-12-12T09:21:29.753362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765507+0000","last_change":"2023-12-12T09:21:29.757460+0000","last_active":"2023-12-12T09:21:29.765507+0000","last_peered":"2023-12-12T09:21:29.765507+0000","last_clean":"2023-12-12T09:21:29.765507+0000","last_became_active":"2023-12-12T09:21:29.757144+0000","last_became_peered":"2023-12-12T09:21:29.757144+0000","last_unstale":"2023-12-12T09:21:29.765507+0000","last_undegraded":"2023-12-12T09:21:29.765507+0000","last_fullsized":"2023-12-12T09:21:29.765507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:23.634688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753891+0000","last_change":"2023-12-12T09:21:29.753891+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753891+0000","last_undegraded":"2023-12-12T09:21:29.753891+0000","last_fullsized":"2023-12-12T09:21:29.753891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767265+0000","last_change":"2023-12-12T09:21:29.764003+0000","last_active":"2023-12-12T09:21:29.767265+0000","last_peered":"2023-12-12T09:21:29.767265+0000","last_clean":"2023-12-12T09:21:29.767265+0000","last_became_active":"2023-12-12T09:21:29.763739+0000","last_became_peered":"2023-12-12T09:21:29.763739+0000","last_unstale":"2023-12-12T09:21:29.767265+0000","last_undegraded":"2023-12-12T09:21:29.767265+0000","last_fullsized":"2023-12-12T09:21:29.767265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749833+0000","last_change":"2023-12-12T09:21:29.749833+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749833+0000","last_undegraded":"2023-12-12T09:21:29.749833+0000","last_fullsized":"2023-12-12T09:21:29.749833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.773858+0000","last_change":"2023-12-12T09:21:29.772599+0000","last_active":"2023-12-12T09:21:29.773858+0000","last_peered":"2023-12-12T09:21:29.773858+0000","last_clean":"2023-12-12T09:21:29.773858+0000","last_became_active":"2023-12-12T09:21:29.772099+0000","last_became_peered":"2023-12-12T09:21:29.772099+0000","last_unstale":"2023-12-12T09:21:29.773858+0000","last_undegraded":"2023-12-12T09:21:29.773858+0000","last_fullsized":"2023-12-12T09:21:29.773858+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:52.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.741323+0000","last_change":"2023-12-12T09:21:29.741323+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.741323+0000","last_undegraded":"2023-12-12T09:21:29.741323+0000","last_fullsized":"2023-12-12T09:21:29.741323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.770570+0000","last_change":"2023-12-12T09:21:29.767795+0000","last_active":"2023-12-12T09:21:29.770570+0000","last_peered":"2023-12-12T09:21:29.770570+0000","last_clean":"2023-12-12T09:21:29.770570+0000","last_became_active":"2023-12-12T09:21:29.767472+0000","last_became_peered":"2023-12-12T09:21:29.767472+0000","last_unstale":"2023-12-12T09:21:29.770570+0000","last_undegraded":"2023-12-12T09:21:29.770570+0000","last_fullsized":"2023-12-12T09:21:29.770570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752364+0000","last_change":"2023-12-12T09:21:29.752364+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752364+0000","last_undegraded":"2023-12-12T09:21:29.752364+0000","last_fullsized":"2023-12-12T09:21:29.752364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766968+0000","last_change":"2023-12-12T09:21:29.760059+0000","last_active":"2023-12-12T09:21:29.766968+0000","last_peered":"2023-12-12T09:21:29.766968+0000","last_clean":"2023-12-12T09:21:29.766968+0000","last_became_active":"2023-12-12T09:21:29.759181+0000","last_became_peered":"2023-12-12T09:21:29.759181+0000","last_unstale":"2023-12-12T09:21:29.766968+0000","last_undegraded":"2023-12-12T09:21:29.766968+0000","last_fullsized":"2023-12-12T09:21:29.766968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747442+0000","last_change":"2023-12-12T09:21:29.747442+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747442+0000","last_undegraded":"2023-12-12T09:21:29.747442+0000","last_fullsized":"2023-12-12T09:21:29.747442+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767422+0000","last_change":"2023-12-12T09:21:29.765362+0000","last_active":"2023-12-12T09:21:29.767422+0000","last_peered":"2023-12-12T09:21:29.767422+0000","last_clean":"2023-12-12T09:21:29.767422+0000","last_became_active":"2023-12-12T09:21:29.765103+0000","last_became_peered":"2023-12-12T09:21:29.765103+0000","last_unstale":"2023-12-12T09:21:29.767422+0000","last_undegraded":"2023-12-12T09:21:29.767422+0000","last_fullsized":"2023-12-12T09:21:29.767422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:21.696885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759796+0000","last_change":"2023-12-12T09:21:29.759796+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759796+0000","last_undegraded":"2023-12-12T09:21:29.759796+0000","last_fullsized":"2023-12-12T09:21:29.759796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772542+0000","last_change":"2023-12-12T09:21:29.768355+0000","last_active":"2023-12-12T09:21:29.772542+0000","last_peered":"2023-12-12T09:21:29.772542+0000","last_clean":"2023-12-12T09:21:29.772542+0000","last_became_active":"2023-12-12T09:21:29.768018+0000","last_became_peered":"2023-12-12T09:21:29.768018+0000","last_unstale":"2023-12-12T09:21:29.772542+0000","last_undegraded":"2023-12-12T09:21:29.772542+0000","last_fullsized":"2023-12-12T09:21:29.772542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748560+0000","last_change":"2023-12-12T09:21:29.748560+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748560+0000","last_undegraded":"2023-12-12T09:21:29.748560+0000","last_fullsized":"2023-12-12T09:21:29.748560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772547+0000","last_change":"2023-12-12T09:21:29.768295+0000","last_active":"2023-12-12T09:21:29.772547+0000","last_peered":"2023-12-12T09:21:29.772547+0000","last_clean":"2023-12-12T09:21:29.772547+0000","last_became_active":"2023-12-12T09:21:29.767583+0000","last_became_peered":"2023-12-12T09:21:29.767583+0000","last_unstale":"2023-12-12T09:21:29.772547+0000","last_undegraded":"2023-12-12T09:21:29.772547+0000","last_fullsized":"2023-12-12T09:21:29.772547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:23.634688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746033+0000","last_change":"2023-12-12T09:21:29.746033+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746033+0000","last_undegraded":"2023-12-12T09:21:29.746033+0000","last_fullsized":"2023-12-12T09:21:29.746033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.769595+0000","last_change":"2023-12-12T09:21:29.766850+0000","last_active":"2023-12-12T09:21:29.769595+0000","last_peered":"2023-12-12T09:21:29.769595+0000","last_clean":"2023-12-12T09:21:29.769595+0000","last_became_active":"2023-12-12T09:21:29.766432+0000","last_became_peered":"2023-12-12T09:21:29.766432+0000","last_unstale":"2023-12-12T09:21:29.769595+0000","last_undegraded":"2023-12-12T09:21:29.769595+0000","last_fullsized":"2023-12-12T09:21:29.769595+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:23.231125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753393+0000","last_change":"2023-12-12T09:21:29.753393+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753393+0000","last_undegraded":"2023-12-12T09:21:29.753393+0000","last_fullsized":"2023-12-12T09:21:29.753393+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766260+0000","last_change":"2023-12-12T09:21:29.762250+0000","last_active":"2023-12-12T09:21:29.766260+0000","last_peered":"2023-12-12T09:21:29.766260+0000","last_clean":"2023-12-12T09:21:29.766260+0000","last_became_active":"2023-12-12T09:21:29.761642+0000","last_became_peered":"2023-12-12T09:21:29.761642+0000","last_unstale":"2023-12-12T09:21:29.766260+0000","last_undegraded":"2023-12-12T09:21:29.766260+0000","last_fullsized":"2023-12-12T09:21:29.766260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:39:48.191760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745130+0000","last_change":"2023-12-12T09:21:29.745130+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745130+0000","last_undegraded":"2023-12-12T09:21:29.745130+0000","last_fullsized":"2023-12-12T09:21:29.745130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.770490+0000","last_change":"2023-12-12T09:21:29.763371+0000","last_active":"2023-12-12T09:21:29.770490+0000","last_peered":"2023-12-12T09:21:29.770490+0000","last_clean":"2023-12-12T09:21:29.770490+0000","last_became_active":"2023-12-12T09:21:29.763082+0000","last_became_peered":"2023-12-12T09:21:29.763082+0000","last_unstale":"2023-12-12T09:21:29.770490+0000","last_undegraded":"2023-12-12T09:21:29.770490+0000","last_fullsized":"2023-12-12T09:21:29.770490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.756200+0000","last_change":"2023-12-12T09:21:29.756200+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.756200+0000","last_undegraded":"2023-12-12T09:21:29.756200+0000","last_fullsized":"2023-12-12T09:21:29.756200+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.762480+0000","last_change":"2023-12-12T09:21:29.753760+0000","last_active":"2023-12-12T09:21:29.762480+0000","last_peered":"2023-12-12T09:21:29.762480+0000","last_clean":"2023-12-12T09:21:29.762480+0000","last_became_active":"2023-12-12T09:21:29.753342+0000","last_became_peered":"2023-12-12T09:21:29.753342+0000","last_unstale":"2023-12-12T09:21:29.762480+0000","last_undegraded":"2023-12-12T09:21:29.762480+0000","last_fullsized":"2023-12-12T09:21:29.762480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:33:15.269572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749552+0000","last_change":"2023-12-12T09:21:29.749552+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749552+0000","last_undegraded":"2023-12-12T09:21:29.749552+0000","last_fullsized":"2023-12-12T09:21:29.749552+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774011+0000","last_change":"2023-12-12T09:21:29.772645+0000","last_active":"2023-12-12T09:21:29.774011+0000","last_peered":"2023-12-12T09:21:29.774011+0000","last_clean":"2023-12-12T09:21:29.774011+0000","last_became_active":"2023-12-12T09:21:29.772381+0000","last_became_peered":"2023-12-12T09:21:29.772381+0000","last_unstale":"2023-12-12T09:21:29.774011+0000","last_undegraded":"2023-12-12T09:21:29.774011+0000","last_fullsized":"2023-12-12T09:21:29.774011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:10.745369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.750335+0000","last_change":"2023-12-12T09:21:29.750335+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.750335+0000","last_undegraded":"2023-12-12T09:21:29.750335+0000","last_fullsized":"2023-12-12T09:21:29.750335+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772512+0000","last_change":"2023-12-12T09:21:29.768150+0000","last_active":"2023-12-12T09:21:29.772512+0000","last_peered":"2023-12-12T09:21:29.772512+0000","last_clean":"2023-12-12T09:21:29.772512+0000","last_became_active":"2023-12-12T09:21:29.767829+0000","last_became_peered":"2023-12-12T09:21:29.767829+0000","last_unstale":"2023-12-12T09:21:29.772512+0000","last_undegraded":"2023-12-12T09:21:29.772512+0000","last_fullsized":"2023-12-12T09:21:29.772512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:11:11.483705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753153+0000","last_change":"2023-12-12T09:21:29.753153+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753153+0000","last_undegraded":"2023-12-12T09:21:29.753153+0000","last_fullsized":"2023-12-12T09:21:29.753153+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766772+0000","last_change":"2023-12-12T09:21:29.761367+0000","last_active":"2023-12-12T09:21:29.766772+0000","last_peered":"2023-12-12T09:21:29.766772+0000","last_clean":"2023-12-12T09:21:29.766772+0000","last_became_active":"2023-12-12T09:21:29.761014+0000","last_became_peered":"2023-12-12T09:21:29.761014+0000","last_unstale":"2023-12-12T09:21:29.766772+0000","last_undegraded":"2023-12-12T09:21:29.766772+0000","last_fullsized":"2023-12-12T09:21:29.766772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:11:11.483705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749319+0000","last_change":"2023-12-12T09:21:29.749319+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749319+0000","last_undegraded":"2023-12-12T09:21:29.749319+0000","last_fullsized":"2023-12-12T09:21:29.749319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774226+0000","last_change":"2023-12-12T09:21:29.770091+0000","last_active":"2023-12-12T09:21:29.774226+0000","last_peered":"2023-12-12T09:21:29.774226+0000","last_clean":"2023-12-12T09:21:29.774226+0000","last_became_active":"2023-12-12T09:21:29.769239+0000","last_became_peered":"2023-12-12T09:21:29.769239+0000","last_unstale":"2023-12-12T09:21:29.774226+0000","last_undegraded":"2023-12-12T09:21:29.774226+0000","last_fullsized":"2023-12-12T09:21:29.774226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:38:17.785181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745981+0000","last_change":"2023-12-12T09:21:29.745981+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745981+0000","last_undegraded":"2023-12-12T09:21:29.745981+0000","last_fullsized":"2023-12-12T09:21:29.745981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766694+0000","last_change":"2023-12-12T09:21:29.760344+0000","last_active":"2023-12-12T09:21:29.766694+0000","last_peered":"2023-12-12T09:21:29.766694+0000","last_clean":"2023-12-12T09:21:29.766694+0000","last_became_active":"2023-12-12T09:21:29.760057+0000","last_became_peered":"2023-12-12T09:21:29.760057+0000","last_unstale":"2023-12-12T09:21:29.766694+0000","last_undegraded":"2023-12-12T09:21:29.766694+0000","last_fullsized":"2023-12-12T09:21:29.766694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.754999+0000","last_change":"2023-12-12T09:21:29.754999+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.754999+0000","last_undegraded":"2023-12-12T09:21:29.754999+0000","last_fullsized":"2023-12-12T09:21:29.754999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.759970+0000","last_change":"2023-12-12T09:21:29.756282+0000","last_active":"2023-12-12T09:21:29.759970+0000","last_peered":"2023-12-12T09:21:29.759970+0000","last_clean":"2023-12-12T09:21:29.759970+0000","last_became_active":"2023-12-12T09:21:29.755942+0000","last_became_peered":"2023-12-12T09:21:29.755942+0000","last_unstale":"2023-12-12T09:21:29.759970+0000","last_undegraded":"2023-12-12T09:21:29.759970+0000","last_fullsized":"2023-12-12T09:21:29.759970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:13.499674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744828+0000","last_change":"2023-12-12T09:21:29.744828+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744828+0000","last_undegraded":"2023-12-12T09:21:29.744828+0000","last_fullsized":"2023-12-12T09:21:29.744828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.758268+0000","last_change":"2023-12-12T09:21:29.752853+0000","last_active":"2023-12-12T09:21:29.758268+0000","last_peered":"2023-12-12T09:21:29.758268+0000","last_clean":"2023-12-12T09:21:29.758268+0000","last_became_active":"2023-12-12T09:21:29.752575+0000","last_became_peered":"2023-12-12T09:21:29.752575+0000","last_unstale":"2023-12-12T09:21:29.758268+0000","last_undegraded":"2023-12-12T09:21:29.758268+0000","last_fullsized":"2023-12-12T09:21:29.758268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:20.436895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.754111+0000","last_change":"2023-12-12T09:21:29.754111+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.754111+0000","last_undegraded":"2023-12-12T09:21:29.754111+0000","last_fullsized":"2023-12-12T09:21:29.754111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774690+0000","last_change":"2023-12-12T09:21:29.772886+0000","last_active":"2023-12-12T09:21:29.774690+0000","last_peered":"2023-12-12T09:21:29.774690+0000","last_clean":"2023-12-12T09:21:29.774690+0000","last_became_active":"2023-12-12T09:21:29.772078+0000","last_became_peered":"2023-12-12T09:21:29.772078+0000","last_unstale":"2023-12-12T09:21:29.774690+0000","last_undegraded":"2023-12-12T09:21:29.774690+0000","last_fullsized":"2023-12-12T09:21:29.774690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:26.564928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749019+0000","last_change":"2023-12-12T09:21:29.749019+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749019+0000","last_undegraded":"2023-12-12T09:21:29.749019+0000","last_fullsized":"2023-12-12T09:21:29.749019+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.748077+0000","last_change":"2023-12-12T09:21:29.746023+0000","last_active":"2023-12-12T09:21:29.748077+0000","last_peered":"2023-12-12T09:21:29.748077+0000","last_clean":"2023-12-12T09:21:29.748077+0000","last_became_active":"2023-12-12T09:21:29.745607+0000","last_became_peered":"2023-12-12T09:21:29.745607+0000","last_unstale":"2023-12-12T09:21:29.748077+0000","last_undegraded":"2023-12-12T09:21:29.748077+0000","last_fullsized":"2023-12-12T09:21:29.748077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:30.153095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743492+0000","last_change":"2023-12-12T09:21:29.743492+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743492+0000","last_undegraded":"2023-12-12T09:21:29.743492+0000","last_fullsized":"2023-12-12T09:21:29.743492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772410+0000","last_change":"2023-12-12T09:21:29.767517+0000","last_active":"2023-12-12T09:21:29.772410+0000","last_peered":"2023-12-12T09:21:29.772410+0000","last_clean":"2023-12-12T09:21:29.772410+0000","last_became_active":"2023-12-12T09:21:29.767194+0000","last_became_peered":"2023-12-12T09:21:29.767194+0000","last_unstale":"2023-12-12T09:21:29.772410+0000","last_undegraded":"2023-12-12T09:21:29.772410+0000","last_fullsized":"2023-12-12T09:21:29.772410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759355+0000","last_change":"2023-12-12T09:21:29.759355+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759355+0000","last_undegraded":"2023-12-12T09:21:29.759355+0000","last_fullsized":"2023-12-12T09:21:29.759355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.761531+0000","last_change":"2023-12-12T09:21:29.760226+0000","last_active":"2023-12-12T09:21:29.761531+0000","last_peered":"2023-12-12T09:21:29.761531+0000","last_clean":"2023-12-12T09:21:29.761531+0000","last_became_active":"2023-12-12T09:21:29.759388+0000","last_became_peered":"2023-12-12T09:21:29.759388+0000","last_unstale":"2023-12-12T09:21:29.761531+0000","last_undegraded":"2023-12-12T09:21:29.761531+0000","last_fullsized":"2023-12-12T09:21:29.761531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:30.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752797+0000","last_change":"2023-12-12T09:21:29.752797+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752797+0000","last_undegraded":"2023-12-12T09:21:29.752797+0000","last_fullsized":"2023-12-12T09:21:29.752797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767698+0000","last_change":"2023-12-12T09:21:29.765291+0000","last_active":"2023-12-12T09:21:29.767698+0000","last_peered":"2023-12-12T09:21:29.767698+0000","last_clean":"2023-12-12T09:21:29.767698+0000","last_became_active":"2023-12-12T09:21:29.764996+0000","last_became_peered":"2023-12-12T09:21:29.764996+0000","last_unstale":"2023-12-12T09:21:29.767698+0000","last_undegraded":"2023-12-12T09:21:29.767698+0000","last_fullsized":"2023-12-12T09:21:29.767698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746955+0000","last_change":"2023-12-12T09:21:29.746955+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746955+0000","last_undegraded":"2023-12-12T09:21:29.746955+0000","last_fullsized":"2023-12-12T09:21:29.746955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.763737+0000","last_change":"2023-12-12T09:21:29.759411+0000","last_active":"2023-12-12T09:21:29.763737+0000","last_peered":"2023-12-12T09:21:29.763737+0000","last_clean":"2023-12-12T09:21:29.763737+0000","last_became_active":"2023-12-12T09:21:29.759110+0000","last_became_peered":"2023-12-12T09:21:29.759110+0000","last_unstale":"2023-12-12T09:21:29.763737+0000","last_undegraded":"2023-12-12T09:21:29.763737+0000","last_fullsized":"2023-12-12T09:21:29.763737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:51:23.303195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745070+0000","last_change":"2023-12-12T09:21:29.745070+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745070+0000","last_undegraded":"2023-12-12T09:21:29.745070+0000","last_fullsized":"2023-12-12T09:21:29.745070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766374+0000","last_change":"2023-12-12T09:21:29.764220+0000","last_active":"2023-12-12T09:21:29.766374+0000","last_peered":"2023-12-12T09:21:29.766374+0000","last_clean":"2023-12-12T09:21:29.766374+0000","last_became_active":"2023-12-12T09:21:29.763979+0000","last_became_peered":"2023-12-12T09:21:29.763979+0000","last_unstale":"2023-12-12T09:21:29.766374+0000","last_undegraded":"2023-12-12T09:21:29.766374+0000","last_fullsized":"2023-12-12T09:21:29.766374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:26.564928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744936+0000","last_change":"2023-12-12T09:21:29.744936+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744936+0000","last_undegraded":"2023-12-12T09:21:29.744936+0000","last_fullsized":"2023-12-12T09:21:29.744936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765582+0000","last_change":"2023-12-12T09:21:29.759573+0000","last_active":"2023-12-12T09:21:29.765582+0000","last_peered":"2023-12-12T09:21:29.765582+0000","last_clean":"2023-12-12T09:21:29.765582+0000","last_became_active":"2023-12-12T09:21:29.757748+0000","last_became_peered":"2023-12-12T09:21:29.757748+0000","last_unstale":"2023-12-12T09:21:29.765582+0000","last_undegraded":"2023-12-12T09:21:29.765582+0000","last_fullsized":"2023-12-12T09:21:29.765582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759489+0000","last_change":"2023-12-12T09:21:29.759489+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759489+0000","last_undegraded":"2023-12-12T09:21:29.759489+0000","last_fullsized":"2023-12-12T09:21:29.759489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765820+0000","last_change":"2023-12-12T09:21:29.760420+0000","last_active":"2023-12-12T09:21:29.765820+0000","last_peered":"2023-12-12T09:21:29.765820+0000","last_clean":"2023-12-12T09:21:29.765820+0000","last_became_active":"2023-12-12T09:21:29.760160+0000","last_became_peered":"2023-12-12T09:21:29.760160+0000","last_unstale":"2023-12-12T09:21:29.765820+0000","last_undegraded":"2023-12-12T09:21:29.765820+0000","last_fullsized":"2023-12-12T09:21:29.765820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:22:56.218371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753889+0000","last_change":"2023-12-12T09:21:29.753889+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753889+0000","last_undegraded":"2023-12-12T09:21:29.753889+0000","last_fullsized":"2023-12-12T09:21:29.753889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774692+0000","last_change":"2023-12-12T09:21:29.773445+0000","last_active":"2023-12-12T09:21:29.774692+0000","last_peered":"2023-12-12T09:21:29.774692+0000","last_clean":"2023-12-12T09:21:29.774692+0000","last_became_active":"2023-12-12T09:21:29.773170+0000","last_became_peered":"2023-12-12T09:21:29.773170+0000","last_unstale":"2023-12-12T09:21:29.774692+0000","last_undegraded":"2023-12-12T09:21:29.774692+0000","last_fullsized":"2023-12-12T09:21:29.774692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:57:32.531602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:21:28.739826+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:21:28.739826+0000","last_peered":"2023-12-12T09:21:28.739826+0000","last_clean":"2023-12-12T09:21:28.739826+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:21:28.739826+0000","last_undegraded":"2023-12-12T09:21:28.739826+0000","last_fullsized":"2023-12-12T09:21:28.739826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1028096,"data_stored":774545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":0.72299999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.77100000000000002}]},{"osd":2,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.89400000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.626}]},{"osd":4,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.2930000000000001,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.92100000000000004}]},{"osd":6,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.95499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.091}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.90800000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.1240000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1850000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.94799999999999995}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.28}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.4830000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.626},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.91900000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.246}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.008}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.083}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.375},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.4359999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.1639999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.1379999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.01}]},{"osd":2,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.876},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.4610000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.331}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.571},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.5169999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.222},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.756}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.615},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.4199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.415},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.147}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.552}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.5720000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.5900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.62},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":0.95799999999999996}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.0580000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.21,"5min":2.21,"15min":2.21},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.4239999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.169},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.3480000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.2150000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.141},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.387}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.2949999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.353},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3180000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.581}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.5269999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.839}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1040384,"data_stored":781140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.054},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.097}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.276}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.2470000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.333}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.145}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.363},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3959999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:21:35.669 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:21:35.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.919+0000 7f7c07f05640 1 Processor -- start 2023-12-12T09:21:35.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.919+0000 7f7c07f05640 1 -- start start 2023-12-12T09:21:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.921+0000 7f7c07f05640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 0x7f7c00071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.921+0000 7f7c07f05640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c0013dae0 0x7f7c0013f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.921+0000 7f7c07f05640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c000724d0 con 0x7f7c000ce330 2023-12-12T09:21:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.921+0000 7f7c07f05640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c00140270 con 0x7f7c0013dae0 2023-12-12T09:21:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.921+0000 7f7c07f05640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000cd850 con 0x7f7c00071bb0 2023-12-12T09:21:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.921+0000 7f7c064a2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c0013dae0 0x7f7c0013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.921+0000 7f7c064a2640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c0013dae0 0x7f7c0013f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54754/0 (socket says 172.21.15.84:54754) 2023-12-12T09:21:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.921+0000 7f7c064a2640 1 -- 172.21.15.84:0/2798896037 learned_addr learned my addr 172.21.15.84:0/2798896037 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.922+0000 7f7c05ca1640 1 --2- 172.21.15.84:0/2798896037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 0x7f7c00071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.922+0000 7f7c064a2640 1 -- 172.21.15.84:0/2798896037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 msgr2=0x7f7c00071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.922+0000 7f7c064a2640 1 --2- 172.21.15.84:0/2798896037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 0x7f7c00071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.922+0000 7f7c064a2640 1 -- 172.21.15.84:0/2798896037 >> v1:172.21.15.99:6789/0 conn(0x7f7c000ce330 legacy=0x7f7c0013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.922+0000 7f7c064a2640 1 -- 172.21.15.84:0/2798896037 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000cdb30 con 0x7f7c0013dae0 2023-12-12T09:21:35.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.923+0000 7f7c064a2640 1 --2- 172.21.15.84:0/2798896037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c0013dae0 0x7f7c0013f510 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009e50 tx=0x7f7bf802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24deb9d7a17ba7e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:35.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.923+0000 7f7c04c9f640 1 -- 172.21.15.84:0/2798896037 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf802ca70 con 0x7f7c0013dae0 2023-12-12T09:21:35.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.923+0000 7f7c04c9f640 1 -- 172.21.15.84:0/2798896037 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf802cbd0 con 0x7f7c0013dae0 2023-12-12T09:21:35.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.923+0000 7f7c04c9f640 1 -- 172.21.15.84:0/2798896037 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf80343f0 con 0x7f7c0013dae0 2023-12-12T09:21:35.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.924+0000 7f7c07f05640 1 -- 172.21.15.84:0/2798896037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c0013dae0 msgr2=0x7f7c0013f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.924+0000 7f7c07f05640 1 --2- 172.21.15.84:0/2798896037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c0013dae0 0x7f7c0013f510 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009e50 tx=0x7f7bf802bed0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.924+0000 7f7c07f05640 1 -- 172.21.15.84:0/2798896037 shutdown_connections 2023-12-12T09:21:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.924+0000 7f7c07f05640 1 --2- 172.21.15.84:0/2798896037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c0013dae0 0x7f7c0013f510 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.924+0000 7f7c07f05640 1 --2- 172.21.15.84:0/2798896037 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 0x7f7c00071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.924+0000 7f7c07f05640 1 -- 172.21.15.84:0/2798896037 >> 172.21.15.84:0/2798896037 conn(0x7f7c0006c3d0 msgr2=0x7f7c0006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.924+0000 7f7c07f05640 1 -- 172.21.15.84:0/2798896037 shutdown_connections 2023-12-12T09:21:35.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.924+0000 7f7c07f05640 1 -- 172.21.15.84:0/2798896037 wait complete. 2023-12-12T09:21:35.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.925+0000 7f7c07f05640 1 Processor -- start 2023-12-12T09:21:35.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.926+0000 7f7c07f05640 1 -- start start 2023-12-12T09:21:35.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.926+0000 7f7c07f05640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 0x7f7c000b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.926+0000 7f7c07f05640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c000ce330 0x7f7c000b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c07f05640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c00136a40 0x7f7c000b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c07f05640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000b3190 con 0x7f7c00136a40 2023-12-12T09:21:35.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c07f05640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c00136fc0 con 0x7f7c000ce330 2023-12-12T09:21:35.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c07f05640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c001372a0 con 0x7f7c00071bb0 2023-12-12T09:21:35.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c00136a40 0x7f7c000b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c00136a40 0x7f7c000b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54758/0 (socket says 172.21.15.84:54758) 2023-12-12T09:21:35.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 -- 172.21.15.84:0/1204675362 learned_addr learned my addr 172.21.15.84:0/1204675362 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:35.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c05ca1640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 0x7f7c000b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 -- 172.21.15.84:0/1204675362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 msgr2=0x7f7c000b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 0x7f7c000b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 -- 172.21.15.84:0/1204675362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c000ce330 msgr2=0x7f7c000b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:35.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c000ce330 0x7f7c000b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:35.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 -- 172.21.15.84:0/1204675362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8009b30 con 0x7f7c00136a40 2023-12-12T09:21:35.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.927+0000 7f7c064a2640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c00136a40 0x7f7c000b4250 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009e50 tx=0x7f7bf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:35.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.928+0000 7f7bf67fc640 1 -- 172.21.15.84:0/1204675362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8009510 con 0x7f7c00136a40 2023-12-12T09:21:35.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.928+0000 7f7bf67fc640 1 -- 172.21.15.84:0/1204675362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf803e450 con 0x7f7c00136a40 2023-12-12T09:21:35.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.928+0000 7f7bf67fc640 1 -- 172.21.15.84:0/1204675362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf803e800 con 0x7f7c00136a40 2023-12-12T09:21:35.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.928+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c00137580 con 0x7f7c00136a40 2023-12-12T09:21:35.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.928+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c00137b40 con 0x7f7c00136a40 2023-12-12T09:21:35.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.929+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c000673c0 con 0x7f7c00136a40 2023-12-12T09:21:35.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.930+0000 7f7bf67fc640 1 -- 172.21.15.84:0/1204675362 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7bf803e960 con 0x7f7c00136a40 2023-12-12T09:21:35.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.931+0000 7f7bf67fc640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7be406ae40 0x7f7be406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:35.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.931+0000 7f7bf67fc640 1 -- 172.21.15.84:0/1204675362 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7bf80ac5c0 con 0x7f7c00136a40 2023-12-12T09:21:35.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.931+0000 7f7c05ca1640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7be406ae40 0x7f7be406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:35.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.932+0000 7f7c05ca1640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7be406ae40 0x7f7be406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00b7c0 tx=0x7f7bfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:35.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:35.935+0000 7f7bf67fc640 1 -- 172.21.15.84:0/1204675362 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7bf8077670 con 0x7f7c00136a40 2023-12-12T09:21:36.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.122+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c00137410 con 0x7f7be406ae40 2023-12-12T09:21:36.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.131+0000 7f7bf67fc640 1 -- 172.21.15.84:0/1204675362 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281687 (secure 0 0 0) 0x7f7c00137410 con 0x7f7be406ae40 2023-12-12T09:21:36.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:36.140 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:21:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7be406ae40 msgr2=0x7f7be406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7be406ae40 0x7f7be406d300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00b7c0 tx=0x7f7bfc008040 comp rx=0 tx=0).stop 2023-12-12T09:21:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c00136a40 msgr2=0x7f7c000b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c00136a40 0x7f7c000b4250 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009e50 tx=0x7f7bf8004a40 comp rx=0 tx=0).stop 2023-12-12T09:21:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 shutdown_connections 2023-12-12T09:21:36.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7be406ae40 0x7f7be406d300 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c00136a40 0x7f7c000b4250 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c000ce330 0x7f7c000b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 --2- 172.21.15.84:0/1204675362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c00071bb0 0x7f7c000b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 >> 172.21.15.84:0/1204675362 conn(0x7f7c0006c3d0 msgr2=0x7f7c0006d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 shutdown_connections 2023-12-12T09:21:36.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.138+0000 7f7c07f05640 1 -- 172.21.15.84:0/1204675362 wait complete. 2023-12-12T09:21:36.158 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-12-12T09:21:35.111981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220748,"kb_used_data":4588,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753972,"statfs":{"total":773094113280,"available":772868067328,"internally_reserved":0,"allocated":4698112,"data_stored":2673937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001663"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752887+0000","last_change":"2023-12-12T09:21:29.752887+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752887+0000","last_undegraded":"2023-12-12T09:21:29.752887+0000","last_fullsized":"2023-12-12T09:21:29.752887+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753299+0000","last_change":"2023-12-12T09:21:29.753299+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753299+0000","last_undegraded":"2023-12-12T09:21:29.753299+0000","last_fullsized":"2023-12-12T09:21:29.753299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746064+0000","last_change":"2023-12-12T09:21:29.746064+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746064+0000","last_undegraded":"2023-12-12T09:21:29.746064+0000","last_fullsized":"2023-12-12T09:21:29.746064+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748904+0000","last_change":"2023-12-12T09:21:29.748904+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748904+0000","last_undegraded":"2023-12-12T09:21:29.748904+0000","last_fullsized":"2023-12-12T09:21:29.748904+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748889+0000","last_change":"2023-12-12T09:21:29.748889+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748889+0000","last_undegraded":"2023-12-12T09:21:29.748889+0000","last_fullsized":"2023-12-12T09:21:29.748889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.742932+0000","last_change":"2023-12-12T09:21:29.742932+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.742932+0000","last_undegraded":"2023-12-12T09:21:29.742932+0000","last_fullsized":"2023-12-12T09:21:29.742932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751241+0000","last_change":"2023-12-12T09:21:29.751241+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751241+0000","last_undegraded":"2023-12-12T09:21:29.751241+0000","last_fullsized":"2023-12-12T09:21:29.751241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745304+0000","last_change":"2023-12-12T09:21:29.745304+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745304+0000","last_undegraded":"2023-12-12T09:21:29.745304+0000","last_fullsized":"2023-12-12T09:21:29.745304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747247+0000","last_change":"2023-12-12T09:21:29.747247+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747247+0000","last_undegraded":"2023-12-12T09:21:29.747247+0000","last_fullsized":"2023-12-12T09:21:29.747247+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751045+0000","last_change":"2023-12-12T09:21:29.751045+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751045+0000","last_undegraded":"2023-12-12T09:21:29.751045+0000","last_fullsized":"2023-12-12T09:21:29.751045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753704+0000","last_change":"2023-12-12T09:21:29.753704+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753704+0000","last_undegraded":"2023-12-12T09:21:29.753704+0000","last_fullsized":"2023-12-12T09:21:29.753704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746503+0000","last_change":"2023-12-12T09:21:29.746503+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746503+0000","last_undegraded":"2023-12-12T09:21:29.746503+0000","last_fullsized":"2023-12-12T09:21:29.746503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752576+0000","last_change":"2023-12-12T09:21:29.752576+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752576+0000","last_undegraded":"2023-12-12T09:21:29.752576+0000","last_fullsized":"2023-12-12T09:21:29.752576+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747304+0000","last_change":"2023-12-12T09:21:29.747304+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747304+0000","last_undegraded":"2023-12-12T09:21:29.747304+0000","last_fullsized":"2023-12-12T09:21:29.747304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.750619+0000","last_change":"2023-12-12T09:21:29.750619+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.750619+0000","last_undegraded":"2023-12-12T09:21:29.750619+0000","last_fullsized":"2023-12-12T09:21:29.750619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.755608+0000","last_change":"2023-12-12T09:21:29.755608+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.755608+0000","last_undegraded":"2023-12-12T09:21:29.755608+0000","last_fullsized":"2023-12-12T09:21:29.755608+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.761365+0000","last_change":"2023-12-12T09:21:29.761365+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.761365+0000","last_undegraded":"2023-12-12T09:21:29.761365+0000","last_fullsized":"2023-12-12T09:21:29.761365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.739664+0000","last_change":"2023-12-12T09:21:29.739664+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.739664+0000","last_undegraded":"2023-12-12T09:21:29.739664+0000","last_fullsized":"2023-12-12T09:21:29.739664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747841+0000","last_change":"2023-12-12T09:21:29.747841+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747841+0000","last_undegraded":"2023-12-12T09:21:29.747841+0000","last_fullsized":"2023-12-12T09:21:29.747841+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.737990+0000","last_change":"2023-12-12T09:21:29.737990+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.737990+0000","last_undegraded":"2023-12-12T09:21:29.737990+0000","last_fullsized":"2023-12-12T09:21:29.737990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.751867+0000","last_change":"2023-12-12T09:21:29.751867+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.751867+0000","last_undegraded":"2023-12-12T09:21:29.751867+0000","last_fullsized":"2023-12-12T09:21:29.751867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743001+0000","last_change":"2023-12-12T09:21:29.743001+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743001+0000","last_undegraded":"2023-12-12T09:21:29.743001+0000","last_fullsized":"2023-12-12T09:21:29.743001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.762091+0000","last_change":"2023-12-12T09:21:29.762091+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.762091+0000","last_undegraded":"2023-12-12T09:21:29.762091+0000","last_fullsized":"2023-12-12T09:21:29.762091+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747563+0000","last_change":"2023-12-12T09:21:29.747563+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747563+0000","last_undegraded":"2023-12-12T09:21:29.747563+0000","last_fullsized":"2023-12-12T09:21:29.747563+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746701+0000","last_change":"2023-12-12T09:21:29.746701+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746701+0000","last_undegraded":"2023-12-12T09:21:29.746701+0000","last_fullsized":"2023-12-12T09:21:29.746701+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743321+0000","last_change":"2023-12-12T09:21:29.743321+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743321+0000","last_undegraded":"2023-12-12T09:21:29.743321+0000","last_fullsized":"2023-12-12T09:21:29.743321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747628+0000","last_change":"2023-12-12T09:21:29.747628+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747628+0000","last_undegraded":"2023-12-12T09:21:29.747628+0000","last_fullsized":"2023-12-12T09:21:29.747628+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752376+0000","last_change":"2023-12-12T09:21:29.752376+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752376+0000","last_undegraded":"2023-12-12T09:21:29.752376+0000","last_fullsized":"2023-12-12T09:21:29.752376+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.738106+0000","last_change":"2023-12-12T09:21:29.738106+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.738106+0000","last_undegraded":"2023-12-12T09:21:29.738106+0000","last_fullsized":"2023-12-12T09:21:29.738106+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.737984+0000","last_change":"2023-12-12T09:21:29.737984+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.737984+0000","last_undegraded":"2023-12-12T09:21:29.737984+0000","last_fullsized":"2023-12-12T09:21:29.737984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.761597+0000","last_change":"2023-12-12T09:21:29.761597+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.761597+0000","last_undegraded":"2023-12-12T09:21:29.761597+0000","last_fullsized":"2023-12-12T09:21:29.761597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.742169+0000","last_change":"2023-12-12T09:21:29.742169+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.742169+0000","last_undegraded":"2023-12-12T09:21:29.742169+0000","last_fullsized":"2023-12-12T09:21:29.742169+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.756044+0000","last_change":"2023-12-12T09:21:29.756044+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.756044+0000","last_undegraded":"2023-12-12T09:21:29.756044+0000","last_fullsized":"2023-12-12T09:21:29.756044+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.763114+0000","last_change":"2023-12-12T09:21:29.759176+0000","last_active":"2023-12-12T09:21:29.763114+0000","last_peered":"2023-12-12T09:21:29.763114+0000","last_clean":"2023-12-12T09:21:29.763114+0000","last_became_active":"2023-12-12T09:21:29.758919+0000","last_became_peered":"2023-12-12T09:21:29.758919+0000","last_unstale":"2023-12-12T09:21:29.763114+0000","last_undegraded":"2023-12-12T09:21:29.763114+0000","last_fullsized":"2023-12-12T09:21:29.763114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:56:43.218212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744341+0000","last_change":"2023-12-12T09:21:29.744341+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744341+0000","last_undegraded":"2023-12-12T09:21:29.744341+0000","last_fullsized":"2023-12-12T09:21:29.744341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.769771+0000","last_change":"2023-12-12T09:21:29.768735+0000","last_active":"2023-12-12T09:21:29.769771+0000","last_peered":"2023-12-12T09:21:29.769771+0000","last_clean":"2023-12-12T09:21:29.769771+0000","last_became_active":"2023-12-12T09:21:29.768270+0000","last_became_peered":"2023-12-12T09:21:29.768270+0000","last_unstale":"2023-12-12T09:21:29.769771+0000","last_undegraded":"2023-12-12T09:21:29.769771+0000","last_fullsized":"2023-12-12T09:21:29.769771+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748510+0000","last_change":"2023-12-12T09:21:29.748510+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748510+0000","last_undegraded":"2023-12-12T09:21:29.748510+0000","last_fullsized":"2023-12-12T09:21:29.748510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767752+0000","last_change":"2023-12-12T09:21:29.761602+0000","last_active":"2023-12-12T09:21:29.767752+0000","last_peered":"2023-12-12T09:21:29.767752+0000","last_clean":"2023-12-12T09:21:29.767752+0000","last_became_active":"2023-12-12T09:21:29.761302+0000","last_became_peered":"2023-12-12T09:21:29.761302+0000","last_unstale":"2023-12-12T09:21:29.767752+0000","last_undegraded":"2023-12-12T09:21:29.767752+0000","last_fullsized":"2023-12-12T09:21:29.767752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753362+0000","last_change":"2023-12-12T09:21:29.753362+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753362+0000","last_undegraded":"2023-12-12T09:21:29.753362+0000","last_fullsized":"2023-12-12T09:21:29.753362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765507+0000","last_change":"2023-12-12T09:21:29.757460+0000","last_active":"2023-12-12T09:21:29.765507+0000","last_peered":"2023-12-12T09:21:29.765507+0000","last_clean":"2023-12-12T09:21:29.765507+0000","last_became_active":"2023-12-12T09:21:29.757144+0000","last_became_peered":"2023-12-12T09:21:29.757144+0000","last_unstale":"2023-12-12T09:21:29.765507+0000","last_undegraded":"2023-12-12T09:21:29.765507+0000","last_fullsized":"2023-12-12T09:21:29.765507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:23.634688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753891+0000","last_change":"2023-12-12T09:21:29.753891+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753891+0000","last_undegraded":"2023-12-12T09:21:29.753891+0000","last_fullsized":"2023-12-12T09:21:29.753891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767265+0000","last_change":"2023-12-12T09:21:29.764003+0000","last_active":"2023-12-12T09:21:29.767265+0000","last_peered":"2023-12-12T09:21:29.767265+0000","last_clean":"2023-12-12T09:21:29.767265+0000","last_became_active":"2023-12-12T09:21:29.763739+0000","last_became_peered":"2023-12-12T09:21:29.763739+0000","last_unstale":"2023-12-12T09:21:29.767265+0000","last_undegraded":"2023-12-12T09:21:29.767265+0000","last_fullsized":"2023-12-12T09:21:29.767265+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749833+0000","last_change":"2023-12-12T09:21:29.749833+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749833+0000","last_undegraded":"2023-12-12T09:21:29.749833+0000","last_fullsized":"2023-12-12T09:21:29.749833+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.773858+0000","last_change":"2023-12-12T09:21:29.772599+0000","last_active":"2023-12-12T09:21:29.773858+0000","last_peered":"2023-12-12T09:21:29.773858+0000","last_clean":"2023-12-12T09:21:29.773858+0000","last_became_active":"2023-12-12T09:21:29.772099+0000","last_became_peered":"2023-12-12T09:21:29.772099+0000","last_unstale":"2023-12-12T09:21:29.773858+0000","last_undegraded":"2023-12-12T09:21:29.773858+0000","last_fullsized":"2023-12-12T09:21:29.773858+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:52.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.741323+0000","last_change":"2023-12-12T09:21:29.741323+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.741323+0000","last_undegraded":"2023-12-12T09:21:29.741323+0000","last_fullsized":"2023-12-12T09:21:29.741323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.770570+0000","last_change":"2023-12-12T09:21:29.767795+0000","last_active":"2023-12-12T09:21:29.770570+0000","last_peered":"2023-12-12T09:21:29.770570+0000","last_clean":"2023-12-12T09:21:29.770570+0000","last_became_active":"2023-12-12T09:21:29.767472+0000","last_became_peered":"2023-12-12T09:21:29.767472+0000","last_unstale":"2023-12-12T09:21:29.770570+0000","last_undegraded":"2023-12-12T09:21:29.770570+0000","last_fullsized":"2023-12-12T09:21:29.770570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752364+0000","last_change":"2023-12-12T09:21:29.752364+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752364+0000","last_undegraded":"2023-12-12T09:21:29.752364+0000","last_fullsized":"2023-12-12T09:21:29.752364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766968+0000","last_change":"2023-12-12T09:21:29.760059+0000","last_active":"2023-12-12T09:21:29.766968+0000","last_peered":"2023-12-12T09:21:29.766968+0000","last_clean":"2023-12-12T09:21:29.766968+0000","last_became_active":"2023-12-12T09:21:29.759181+0000","last_became_peered":"2023-12-12T09:21:29.759181+0000","last_unstale":"2023-12-12T09:21:29.766968+0000","last_undegraded":"2023-12-12T09:21:29.766968+0000","last_fullsized":"2023-12-12T09:21:29.766968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.747442+0000","last_change":"2023-12-12T09:21:29.747442+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.747442+0000","last_undegraded":"2023-12-12T09:21:29.747442+0000","last_fullsized":"2023-12-12T09:21:29.747442+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767422+0000","last_change":"2023-12-12T09:21:29.765362+0000","last_active":"2023-12-12T09:21:29.767422+0000","last_peered":"2023-12-12T09:21:29.767422+0000","last_clean":"2023-12-12T09:21:29.767422+0000","last_became_active":"2023-12-12T09:21:29.765103+0000","last_became_peered":"2023-12-12T09:21:29.765103+0000","last_unstale":"2023-12-12T09:21:29.767422+0000","last_undegraded":"2023-12-12T09:21:29.767422+0000","last_fullsized":"2023-12-12T09:21:29.767422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:26:21.696885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759796+0000","last_change":"2023-12-12T09:21:29.759796+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759796+0000","last_undegraded":"2023-12-12T09:21:29.759796+0000","last_fullsized":"2023-12-12T09:21:29.759796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772542+0000","last_change":"2023-12-12T09:21:29.768355+0000","last_active":"2023-12-12T09:21:29.772542+0000","last_peered":"2023-12-12T09:21:29.772542+0000","last_clean":"2023-12-12T09:21:29.772542+0000","last_became_active":"2023-12-12T09:21:29.768018+0000","last_became_peered":"2023-12-12T09:21:29.768018+0000","last_unstale":"2023-12-12T09:21:29.772542+0000","last_undegraded":"2023-12-12T09:21:29.772542+0000","last_fullsized":"2023-12-12T09:21:29.772542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.748560+0000","last_change":"2023-12-12T09:21:29.748560+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.748560+0000","last_undegraded":"2023-12-12T09:21:29.748560+0000","last_fullsized":"2023-12-12T09:21:29.748560+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772547+0000","last_change":"2023-12-12T09:21:29.768295+0000","last_active":"2023-12-12T09:21:29.772547+0000","last_peered":"2023-12-12T09:21:29.772547+0000","last_clean":"2023-12-12T09:21:29.772547+0000","last_became_active":"2023-12-12T09:21:29.767583+0000","last_became_peered":"2023-12-12T09:21:29.767583+0000","last_unstale":"2023-12-12T09:21:29.772547+0000","last_undegraded":"2023-12-12T09:21:29.772547+0000","last_fullsized":"2023-12-12T09:21:29.772547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:23.634688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746033+0000","last_change":"2023-12-12T09:21:29.746033+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746033+0000","last_undegraded":"2023-12-12T09:21:29.746033+0000","last_fullsized":"2023-12-12T09:21:29.746033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.769595+0000","last_change":"2023-12-12T09:21:29.766850+0000","last_active":"2023-12-12T09:21:29.769595+0000","last_peered":"2023-12-12T09:21:29.769595+0000","last_clean":"2023-12-12T09:21:29.769595+0000","last_became_active":"2023-12-12T09:21:29.766432+0000","last_became_peered":"2023-12-12T09:21:29.766432+0000","last_unstale":"2023-12-12T09:21:29.769595+0000","last_undegraded":"2023-12-12T09:21:29.769595+0000","last_fullsized":"2023-12-12T09:21:29.769595+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:49:23.231125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753393+0000","last_change":"2023-12-12T09:21:29.753393+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753393+0000","last_undegraded":"2023-12-12T09:21:29.753393+0000","last_fullsized":"2023-12-12T09:21:29.753393+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766260+0000","last_change":"2023-12-12T09:21:29.762250+0000","last_active":"2023-12-12T09:21:29.766260+0000","last_peered":"2023-12-12T09:21:29.766260+0000","last_clean":"2023-12-12T09:21:29.766260+0000","last_became_active":"2023-12-12T09:21:29.761642+0000","last_became_peered":"2023-12-12T09:21:29.761642+0000","last_unstale":"2023-12-12T09:21:29.766260+0000","last_undegraded":"2023-12-12T09:21:29.766260+0000","last_fullsized":"2023-12-12T09:21:29.766260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:39:48.191760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745130+0000","last_change":"2023-12-12T09:21:29.745130+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745130+0000","last_undegraded":"2023-12-12T09:21:29.745130+0000","last_fullsized":"2023-12-12T09:21:29.745130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.770490+0000","last_change":"2023-12-12T09:21:29.763371+0000","last_active":"2023-12-12T09:21:29.770490+0000","last_peered":"2023-12-12T09:21:29.770490+0000","last_clean":"2023-12-12T09:21:29.770490+0000","last_became_active":"2023-12-12T09:21:29.763082+0000","last_became_peered":"2023-12-12T09:21:29.763082+0000","last_unstale":"2023-12-12T09:21:29.770490+0000","last_undegraded":"2023-12-12T09:21:29.770490+0000","last_fullsized":"2023-12-12T09:21:29.770490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.756200+0000","last_change":"2023-12-12T09:21:29.756200+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.756200+0000","last_undegraded":"2023-12-12T09:21:29.756200+0000","last_fullsized":"2023-12-12T09:21:29.756200+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.762480+0000","last_change":"2023-12-12T09:21:29.753760+0000","last_active":"2023-12-12T09:21:29.762480+0000","last_peered":"2023-12-12T09:21:29.762480+0000","last_clean":"2023-12-12T09:21:29.762480+0000","last_became_active":"2023-12-12T09:21:29.753342+0000","last_became_peered":"2023-12-12T09:21:29.753342+0000","last_unstale":"2023-12-12T09:21:29.762480+0000","last_undegraded":"2023-12-12T09:21:29.762480+0000","last_fullsized":"2023-12-12T09:21:29.762480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:33:15.269572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749552+0000","last_change":"2023-12-12T09:21:29.749552+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749552+0000","last_undegraded":"2023-12-12T09:21:29.749552+0000","last_fullsized":"2023-12-12T09:21:29.749552+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774011+0000","last_change":"2023-12-12T09:21:29.772645+0000","last_active":"2023-12-12T09:21:29.774011+0000","last_peered":"2023-12-12T09:21:29.774011+0000","last_clean":"2023-12-12T09:21:29.774011+0000","last_became_active":"2023-12-12T09:21:29.772381+0000","last_became_peered":"2023-12-12T09:21:29.772381+0000","last_unstale":"2023-12-12T09:21:29.774011+0000","last_undegraded":"2023-12-12T09:21:29.774011+0000","last_fullsized":"2023-12-12T09:21:29.774011+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:10.745369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.750335+0000","last_change":"2023-12-12T09:21:29.750335+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.750335+0000","last_undegraded":"2023-12-12T09:21:29.750335+0000","last_fullsized":"2023-12-12T09:21:29.750335+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772512+0000","last_change":"2023-12-12T09:21:29.768150+0000","last_active":"2023-12-12T09:21:29.772512+0000","last_peered":"2023-12-12T09:21:29.772512+0000","last_clean":"2023-12-12T09:21:29.772512+0000","last_became_active":"2023-12-12T09:21:29.767829+0000","last_became_peered":"2023-12-12T09:21:29.767829+0000","last_unstale":"2023-12-12T09:21:29.772512+0000","last_undegraded":"2023-12-12T09:21:29.772512+0000","last_fullsized":"2023-12-12T09:21:29.772512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:11:11.483705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753153+0000","last_change":"2023-12-12T09:21:29.753153+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753153+0000","last_undegraded":"2023-12-12T09:21:29.753153+0000","last_fullsized":"2023-12-12T09:21:29.753153+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766772+0000","last_change":"2023-12-12T09:21:29.761367+0000","last_active":"2023-12-12T09:21:29.766772+0000","last_peered":"2023-12-12T09:21:29.766772+0000","last_clean":"2023-12-12T09:21:29.766772+0000","last_became_active":"2023-12-12T09:21:29.761014+0000","last_became_peered":"2023-12-12T09:21:29.761014+0000","last_unstale":"2023-12-12T09:21:29.766772+0000","last_undegraded":"2023-12-12T09:21:29.766772+0000","last_fullsized":"2023-12-12T09:21:29.766772+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:11:11.483705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749319+0000","last_change":"2023-12-12T09:21:29.749319+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749319+0000","last_undegraded":"2023-12-12T09:21:29.749319+0000","last_fullsized":"2023-12-12T09:21:29.749319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774226+0000","last_change":"2023-12-12T09:21:29.770091+0000","last_active":"2023-12-12T09:21:29.774226+0000","last_peered":"2023-12-12T09:21:29.774226+0000","last_clean":"2023-12-12T09:21:29.774226+0000","last_became_active":"2023-12-12T09:21:29.769239+0000","last_became_peered":"2023-12-12T09:21:29.769239+0000","last_unstale":"2023-12-12T09:21:29.774226+0000","last_undegraded":"2023-12-12T09:21:29.774226+0000","last_fullsized":"2023-12-12T09:21:29.774226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:38:17.785181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745981+0000","last_change":"2023-12-12T09:21:29.745981+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745981+0000","last_undegraded":"2023-12-12T09:21:29.745981+0000","last_fullsized":"2023-12-12T09:21:29.745981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766694+0000","last_change":"2023-12-12T09:21:29.760344+0000","last_active":"2023-12-12T09:21:29.766694+0000","last_peered":"2023-12-12T09:21:29.766694+0000","last_clean":"2023-12-12T09:21:29.766694+0000","last_became_active":"2023-12-12T09:21:29.760057+0000","last_became_peered":"2023-12-12T09:21:29.760057+0000","last_unstale":"2023-12-12T09:21:29.766694+0000","last_undegraded":"2023-12-12T09:21:29.766694+0000","last_fullsized":"2023-12-12T09:21:29.766694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.754999+0000","last_change":"2023-12-12T09:21:29.754999+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.754999+0000","last_undegraded":"2023-12-12T09:21:29.754999+0000","last_fullsized":"2023-12-12T09:21:29.754999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.759970+0000","last_change":"2023-12-12T09:21:29.756282+0000","last_active":"2023-12-12T09:21:29.759970+0000","last_peered":"2023-12-12T09:21:29.759970+0000","last_clean":"2023-12-12T09:21:29.759970+0000","last_became_active":"2023-12-12T09:21:29.755942+0000","last_became_peered":"2023-12-12T09:21:29.755942+0000","last_unstale":"2023-12-12T09:21:29.759970+0000","last_undegraded":"2023-12-12T09:21:29.759970+0000","last_fullsized":"2023-12-12T09:21:29.759970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:03:13.499674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744828+0000","last_change":"2023-12-12T09:21:29.744828+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744828+0000","last_undegraded":"2023-12-12T09:21:29.744828+0000","last_fullsized":"2023-12-12T09:21:29.744828+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.758268+0000","last_change":"2023-12-12T09:21:29.752853+0000","last_active":"2023-12-12T09:21:29.758268+0000","last_peered":"2023-12-12T09:21:29.758268+0000","last_clean":"2023-12-12T09:21:29.758268+0000","last_became_active":"2023-12-12T09:21:29.752575+0000","last_became_peered":"2023-12-12T09:21:29.752575+0000","last_unstale":"2023-12-12T09:21:29.758268+0000","last_undegraded":"2023-12-12T09:21:29.758268+0000","last_fullsized":"2023-12-12T09:21:29.758268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:20.436895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.754111+0000","last_change":"2023-12-12T09:21:29.754111+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.754111+0000","last_undegraded":"2023-12-12T09:21:29.754111+0000","last_fullsized":"2023-12-12T09:21:29.754111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774690+0000","last_change":"2023-12-12T09:21:29.772886+0000","last_active":"2023-12-12T09:21:29.774690+0000","last_peered":"2023-12-12T09:21:29.774690+0000","last_clean":"2023-12-12T09:21:29.774690+0000","last_became_active":"2023-12-12T09:21:29.772078+0000","last_became_peered":"2023-12-12T09:21:29.772078+0000","last_unstale":"2023-12-12T09:21:29.774690+0000","last_undegraded":"2023-12-12T09:21:29.774690+0000","last_fullsized":"2023-12-12T09:21:29.774690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:26.564928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.749019+0000","last_change":"2023-12-12T09:21:29.749019+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.749019+0000","last_undegraded":"2023-12-12T09:21:29.749019+0000","last_fullsized":"2023-12-12T09:21:29.749019+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.748077+0000","last_change":"2023-12-12T09:21:29.746023+0000","last_active":"2023-12-12T09:21:29.748077+0000","last_peered":"2023-12-12T09:21:29.748077+0000","last_clean":"2023-12-12T09:21:29.748077+0000","last_became_active":"2023-12-12T09:21:29.745607+0000","last_became_peered":"2023-12-12T09:21:29.745607+0000","last_unstale":"2023-12-12T09:21:29.748077+0000","last_undegraded":"2023-12-12T09:21:29.748077+0000","last_fullsized":"2023-12-12T09:21:29.748077+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:30.153095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.743492+0000","last_change":"2023-12-12T09:21:29.743492+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.743492+0000","last_undegraded":"2023-12-12T09:21:29.743492+0000","last_fullsized":"2023-12-12T09:21:29.743492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.772410+0000","last_change":"2023-12-12T09:21:29.767517+0000","last_active":"2023-12-12T09:21:29.772410+0000","last_peered":"2023-12-12T09:21:29.772410+0000","last_clean":"2023-12-12T09:21:29.772410+0000","last_became_active":"2023-12-12T09:21:29.767194+0000","last_became_peered":"2023-12-12T09:21:29.767194+0000","last_unstale":"2023-12-12T09:21:29.772410+0000","last_undegraded":"2023-12-12T09:21:29.772410+0000","last_fullsized":"2023-12-12T09:21:29.772410+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759355+0000","last_change":"2023-12-12T09:21:29.759355+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759355+0000","last_undegraded":"2023-12-12T09:21:29.759355+0000","last_fullsized":"2023-12-12T09:21:29.759355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.761531+0000","last_change":"2023-12-12T09:21:29.760226+0000","last_active":"2023-12-12T09:21:29.761531+0000","last_peered":"2023-12-12T09:21:29.761531+0000","last_clean":"2023-12-12T09:21:29.761531+0000","last_became_active":"2023-12-12T09:21:29.759388+0000","last_became_peered":"2023-12-12T09:21:29.759388+0000","last_unstale":"2023-12-12T09:21:29.761531+0000","last_undegraded":"2023-12-12T09:21:29.761531+0000","last_fullsized":"2023-12-12T09:21:29.761531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:14:30.128266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.752797+0000","last_change":"2023-12-12T09:21:29.752797+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.752797+0000","last_undegraded":"2023-12-12T09:21:29.752797+0000","last_fullsized":"2023-12-12T09:21:29.752797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.767698+0000","last_change":"2023-12-12T09:21:29.765291+0000","last_active":"2023-12-12T09:21:29.767698+0000","last_peered":"2023-12-12T09:21:29.767698+0000","last_clean":"2023-12-12T09:21:29.767698+0000","last_became_active":"2023-12-12T09:21:29.764996+0000","last_became_peered":"2023-12-12T09:21:29.764996+0000","last_unstale":"2023-12-12T09:21:29.767698+0000","last_undegraded":"2023-12-12T09:21:29.767698+0000","last_fullsized":"2023-12-12T09:21:29.767698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.746955+0000","last_change":"2023-12-12T09:21:29.746955+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.746955+0000","last_undegraded":"2023-12-12T09:21:29.746955+0000","last_fullsized":"2023-12-12T09:21:29.746955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.763737+0000","last_change":"2023-12-12T09:21:29.759411+0000","last_active":"2023-12-12T09:21:29.763737+0000","last_peered":"2023-12-12T09:21:29.763737+0000","last_clean":"2023-12-12T09:21:29.763737+0000","last_became_active":"2023-12-12T09:21:29.759110+0000","last_became_peered":"2023-12-12T09:21:29.759110+0000","last_unstale":"2023-12-12T09:21:29.763737+0000","last_undegraded":"2023-12-12T09:21:29.763737+0000","last_fullsized":"2023-12-12T09:21:29.763737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:51:23.303195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.745070+0000","last_change":"2023-12-12T09:21:29.745070+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.745070+0000","last_undegraded":"2023-12-12T09:21:29.745070+0000","last_fullsized":"2023-12-12T09:21:29.745070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.766374+0000","last_change":"2023-12-12T09:21:29.764220+0000","last_active":"2023-12-12T09:21:29.766374+0000","last_peered":"2023-12-12T09:21:29.766374+0000","last_clean":"2023-12-12T09:21:29.766374+0000","last_became_active":"2023-12-12T09:21:29.763979+0000","last_became_peered":"2023-12-12T09:21:29.763979+0000","last_unstale":"2023-12-12T09:21:29.766374+0000","last_undegraded":"2023-12-12T09:21:29.766374+0000","last_fullsized":"2023-12-12T09:21:29.766374+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:03:26.564928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.744936+0000","last_change":"2023-12-12T09:21:29.744936+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.744936+0000","last_undegraded":"2023-12-12T09:21:29.744936+0000","last_fullsized":"2023-12-12T09:21:29.744936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765582+0000","last_change":"2023-12-12T09:21:29.759573+0000","last_active":"2023-12-12T09:21:29.765582+0000","last_peered":"2023-12-12T09:21:29.765582+0000","last_clean":"2023-12-12T09:21:29.765582+0000","last_became_active":"2023-12-12T09:21:29.757748+0000","last_became_peered":"2023-12-12T09:21:29.757748+0000","last_unstale":"2023-12-12T09:21:29.765582+0000","last_undegraded":"2023-12-12T09:21:29.765582+0000","last_fullsized":"2023-12-12T09:21:29.765582+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.759489+0000","last_change":"2023-12-12T09:21:29.759489+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.759489+0000","last_undegraded":"2023-12-12T09:21:29.759489+0000","last_fullsized":"2023-12-12T09:21:29.759489+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.765820+0000","last_change":"2023-12-12T09:21:29.760420+0000","last_active":"2023-12-12T09:21:29.765820+0000","last_peered":"2023-12-12T09:21:29.765820+0000","last_clean":"2023-12-12T09:21:29.765820+0000","last_became_active":"2023-12-12T09:21:29.760160+0000","last_became_peered":"2023-12-12T09:21:29.760160+0000","last_unstale":"2023-12-12T09:21:29.765820+0000","last_undegraded":"2023-12-12T09:21:29.765820+0000","last_fullsized":"2023-12-12T09:21:29.765820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:22:56.218371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-12-12T09:21:29.753889+0000","last_change":"2023-12-12T09:21:29.753889+0000","last_active":"2023-12-12T09:21:29.722620+0000","last_peered":"2023-12-12T09:21:29.722620+0000","last_clean":"2023-12-12T09:21:29.722620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:21:29.753889+0000","last_undegraded":"2023-12-12T09:21:29.753889+0000","last_fullsized":"2023-12-12T09:21:29.753889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-12T09:21:29.774692+0000","last_change":"2023-12-12T09:21:29.773445+0000","last_active":"2023-12-12T09:21:29.774692+0000","last_peered":"2023-12-12T09:21:29.774692+0000","last_clean":"2023-12-12T09:21:29.774692+0000","last_became_active":"2023-12-12T09:21:29.773170+0000","last_became_peered":"2023-12-12T09:21:29.773170+0000","last_unstale":"2023-12-12T09:21:29.774692+0000","last_undegraded":"2023-12-12T09:21:29.774692+0000","last_fullsized":"2023-12-12T09:21:29.774692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:57:32.531602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T09:21:28.739826+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:21:28.739826+0000","last_peered":"2023-12-12T09:21:28.739826+0000","last_clean":"2023-12-12T09:21:28.739826+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:21:28.739826+0000","last_undegraded":"2023-12-12T09:21:28.739826+0000","last_fullsized":"2023-12-12T09:21:28.739826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1028096,"data_stored":774545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":0.72299999999999998}]},{"osd":1,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.81599999999999995},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.77100000000000002}]},{"osd":2,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.89400000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.626}]},{"osd":4,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.2930000000000001,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":0.92100000000000004}]},{"osd":6,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.95499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.091}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.90800000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.1240000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1850000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.94799999999999995}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.28}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.4830000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.626},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.91900000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.246}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.008}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.083}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.375},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.4359999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.212}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.1639999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.1379999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.01}]},{"osd":2,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.876},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.4610000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.331}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.571},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.5169999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.222},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.756}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.615},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.4199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.75900000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.415},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.147}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.552}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.5720000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.5900000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.62},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":0.95799999999999996}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.0580000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.21,"5min":2.21,"15min":2.21},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.4239999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.1319999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.169},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.3480000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":184177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.2150000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.141},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.387}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.2949999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.353},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3180000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.581}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.5269999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.839}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1040384,"data_stored":781140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.054},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.097}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.276}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.2470000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.333}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.145}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.89300000000000002}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.363},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3959999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:21:36.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.752887+0000', 'last_change': '2023-12-12T09:21:29.752887+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.752887+0000', 'last_undegraded': '2023-12-12T09:21:29.752887+0000', 'last_fullsized': '2023-12-12T09:21:29.752887+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.753299+0000', 'last_change': '2023-12-12T09:21:29.753299+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.753299+0000', 'last_undegraded': '2023-12-12T09:21:29.753299+0000', 'last_fullsized': '2023-12-12T09:21:29.753299+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.746064+0000', 'last_change': '2023-12-12T09:21:29.746064+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.746064+0000', 'last_undegraded': '2023-12-12T09:21:29.746064+0000', 'last_fullsized': '2023-12-12T09:21:29.746064+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.748904+0000', 'last_change': '2023-12-12T09:21:29.748904+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.748904+0000', 'last_undegraded': '2023-12-12T09:21:29.748904+0000', 'last_fullsized': '2023-12-12T09:21:29.748904+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-12-12T09:21:36.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.748889+0000', 'last_change': '2023-12-12T09:21:29.748889+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.748889+0000', 'last_undegraded': '2023-12-12T09:21:29.748889+0000', 'last_fullsized': '2023-12-12T09:21:29.748889+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:21:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-12-12T09:21:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.742932+0000', 'last_change': '2023-12-12T09:21:29.742932+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.742932+0000', 'last_undegraded': '2023-12-12T09:21:29.742932+0000', 'last_fullsized': '2023-12-12T09:21:29.742932+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:21:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-12-12T09:21:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.751241+0000', 'last_change': '2023-12-12T09:21:29.751241+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.751241+0000', 'last_undegraded': '2023-12-12T09:21:29.751241+0000', 'last_fullsized': '2023-12-12T09:21:29.751241+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-12-12T09:21:36.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.745304+0000', 'last_change': '2023-12-12T09:21:29.745304+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.745304+0000', 'last_undegraded': '2023-12-12T09:21:29.745304+0000', 'last_fullsized': '2023-12-12T09:21:29.745304+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.747247+0000', 'last_change': '2023-12-12T09:21:29.747247+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.747247+0000', 'last_undegraded': '2023-12-12T09:21:29.747247+0000', 'last_fullsized': '2023-12-12T09:21:29.747247+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.751045+0000', 'last_change': '2023-12-12T09:21:29.751045+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.751045+0000', 'last_undegraded': '2023-12-12T09:21:29.751045+0000', 'last_fullsized': '2023-12-12T09:21:29.751045+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.753704+0000', 'last_change': '2023-12-12T09:21:29.753704+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.753704+0000', 'last_undegraded': '2023-12-12T09:21:29.753704+0000', 'last_fullsized': '2023-12-12T09:21:29.753704+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.746503+0000', 'last_change': '2023-12-12T09:21:29.746503+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.746503+0000', 'last_undegraded': '2023-12-12T09:21:29.746503+0000', 'last_fullsized': '2023-12-12T09:21:29.746503+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-12-12T09:21:36.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.752576+0000', 'last_change': '2023-12-12T09:21:29.752576+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.752576+0000', 'last_undegraded': '2023-12-12T09:21:29.752576+0000', 'last_fullsized': '2023-12-12T09:21:29.752576+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.747304+0000', 'last_change': '2023-12-12T09:21:29.747304+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.747304+0000', 'last_undegraded': '2023-12-12T09:21:29.747304+0000', 'last_fullsized': '2023-12-12T09:21:29.747304+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.750619+0000', 'last_change': '2023-12-12T09:21:29.750619+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.750619+0000', 'last_undegraded': '2023-12-12T09:21:29.750619+0000', 'last_fullsized': '2023-12-12T09:21:29.750619+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.755608+0000', 'last_change': '2023-12-12T09:21:29.755608+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.755608+0000', 'last_undegraded': '2023-12-12T09:21:29.755608+0000', 'last_fullsized': '2023-12-12T09:21:29.755608+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.761365+0000', 'last_change': '2023-12-12T09:21:29.761365+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.761365+0000', 'last_undegraded': '2023-12-12T09:21:29.761365+0000', 'last_fullsized': '2023-12-12T09:21:29.761365+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.739664+0000', 'last_change': '2023-12-12T09:21:29.739664+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.739664+0000', 'last_undegraded': '2023-12-12T09:21:29.739664+0000', 'last_fullsized': '2023-12-12T09:21:29.739664+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:21:36.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.747841+0000', 'last_change': '2023-12-12T09:21:29.747841+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.747841+0000', 'last_undegraded': '2023-12-12T09:21:29.747841+0000', 'last_fullsized': '2023-12-12T09:21:29.747841+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.737990+0000', 'last_change': '2023-12-12T09:21:29.737990+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.737990+0000', 'last_undegraded': '2023-12-12T09:21:29.737990+0000', 'last_fullsized': '2023-12-12T09:21:29.737990+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.751867+0000', 'last_change': '2023-12-12T09:21:29.751867+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.751867+0000', 'last_undegraded': '2023-12-12T09:21:29.751867+0000', 'last_fullsized': '2023-12-12T09:21:29.751867+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.743001+0000', 'last_change': '2023-12-12T09:21:29.743001+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.743001+0000', 'last_undegraded': '2023-12-12T09:21:29.743001+0000', 'last_fullsized': '2023-12-12T09:21:29.743001+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.762091+0000', 'last_change': '2023-12-12T09:21:29.762091+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.762091+0000', 'last_undegraded': '2023-12-12T09:21:29.762091+0000', 'last_fullsized': '2023-12-12T09:21:29.762091+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-12-12T09:21:36.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.747563+0000', 'last_change': '2023-12-12T09:21:29.747563+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.747563+0000', 'last_undegraded': '2023-12-12T09:21:29.747563+0000', 'last_fullsized': '2023-12-12T09:21:29.747563+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.746701+0000', 'last_change': '2023-12-12T09:21:29.746701+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.746701+0000', 'last_undegraded': '2023-12-12T09:21:29.746701+0000', 'last_fullsized': '2023-12-12T09:21:29.746701+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.743321+0000', 'last_change': '2023-12-12T09:21:29.743321+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.743321+0000', 'last_undegraded': '2023-12-12T09:21:29.743321+0000', 'last_fullsized': '2023-12-12T09:21:29.743321+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.747628+0000', 'last_change': '2023-12-12T09:21:29.747628+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.747628+0000', 'last_undegraded': '2023-12-12T09:21:29.747628+0000', 'last_fullsized': '2023-12-12T09:21:29.747628+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.752376+0000', 'last_change': '2023-12-12T09:21:29.752376+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.752376+0000', 'last_undegraded': '2023-12-12T09:21:29.752376+0000', 'last_fullsized': '2023-12-12T09:21:29.752376+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.738106+0000', 'last_change': '2023-12-12T09:21:29.738106+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.738106+0000', 'last_undegraded': '2023-12-12T09:21:29.738106+0000', 'last_fullsized': '2023-12-12T09:21:29.738106+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.737984+0000', 'last_change': '2023-12-12T09:21:29.737984+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.737984+0000', 'last_undegraded': '2023-12-12T09:21:29.737984+0000', 'last_fullsized': '2023-12-12T09:21:29.737984+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:21:36.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.761597+0000', 'last_change': '2023-12-12T09:21:29.761597+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.761597+0000', 'last_undegraded': '2023-12-12T09:21:29.761597+0000', 'last_fullsized': '2023-12-12T09:21:29.761597+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.742169+0000', 'last_change': '2023-12-12T09:21:29.742169+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.742169+0000', 'last_undegraded': '2023-12-12T09:21:29.742169+0000', 'last_fullsized': '2023-12-12T09:21:29.742169+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.756044+0000', 'last_change': '2023-12-12T09:21:29.756044+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.756044+0000', 'last_undegraded': '2023-12-12T09:21:29.756044+0000', 'last_fullsized': '2023-12-12T09:21:29.756044+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.744341+0000', 'last_change': '2023-12-12T09:21:29.744341+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.744341+0000', 'last_undegraded': '2023-12-12T09:21:29.744341+0000', 'last_fullsized': '2023-12-12T09:21:29.744341+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.748510+0000', 'last_change': '2023-12-12T09:21:29.748510+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.748510+0000', 'last_undegraded': '2023-12-12T09:21:29.748510+0000', 'last_fullsized': '2023-12-12T09:21:29.748510+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-12-12T09:21:36.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.753362+0000', 'last_change': '2023-12-12T09:21:29.753362+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.753362+0000', 'last_undegraded': '2023-12-12T09:21:29.753362+0000', 'last_fullsized': '2023-12-12T09:21:29.753362+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.753891+0000', 'last_change': '2023-12-12T09:21:29.753891+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.753891+0000', 'last_undegraded': '2023-12-12T09:21:29.753891+0000', 'last_fullsized': '2023-12-12T09:21:29.753891+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.749833+0000', 'last_change': '2023-12-12T09:21:29.749833+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.749833+0000', 'last_undegraded': '2023-12-12T09:21:29.749833+0000', 'last_fullsized': '2023-12-12T09:21:29.749833+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.741323+0000', 'last_change': '2023-12-12T09:21:29.741323+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.741323+0000', 'last_undegraded': '2023-12-12T09:21:29.741323+0000', 'last_fullsized': '2023-12-12T09:21:29.741323+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.752364+0000', 'last_change': '2023-12-12T09:21:29.752364+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.752364+0000', 'last_undegraded': '2023-12-12T09:21:29.752364+0000', 'last_fullsized': '2023-12-12T09:21:29.752364+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-12-12T09:21:36.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.747442+0000', 'last_change': '2023-12-12T09:21:29.747442+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.747442+0000', 'last_undegraded': '2023-12-12T09:21:29.747442+0000', 'last_fullsized': '2023-12-12T09:21:29.747442+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.759796+0000', 'last_change': '2023-12-12T09:21:29.759796+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.759796+0000', 'last_undegraded': '2023-12-12T09:21:29.759796+0000', 'last_fullsized': '2023-12-12T09:21:29.759796+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.748560+0000', 'last_change': '2023-12-12T09:21:29.748560+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.748560+0000', 'last_undegraded': '2023-12-12T09:21:29.748560+0000', 'last_fullsized': '2023-12-12T09:21:29.748560+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.746033+0000', 'last_change': '2023-12-12T09:21:29.746033+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.746033+0000', 'last_undegraded': '2023-12-12T09:21:29.746033+0000', 'last_fullsized': '2023-12-12T09:21:29.746033+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.753393+0000', 'last_change': '2023-12-12T09:21:29.753393+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.753393+0000', 'last_undegraded': '2023-12-12T09:21:29.753393+0000', 'last_fullsized': '2023-12-12T09:21:29.753393+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.745130+0000', 'last_change': '2023-12-12T09:21:29.745130+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.745130+0000', 'last_undegraded': '2023-12-12T09:21:29.745130+0000', 'last_fullsized': '2023-12-12T09:21:29.745130+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-12-12T09:21:36.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.756200+0000', 'last_change': '2023-12-12T09:21:29.756200+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.756200+0000', 'last_undegraded': '2023-12-12T09:21:29.756200+0000', 'last_fullsized': '2023-12-12T09:21:29.756200+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.749552+0000', 'last_change': '2023-12-12T09:21:29.749552+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.749552+0000', 'last_undegraded': '2023-12-12T09:21:29.749552+0000', 'last_fullsized': '2023-12-12T09:21:29.749552+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.750335+0000', 'last_change': '2023-12-12T09:21:29.750335+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.750335+0000', 'last_undegraded': '2023-12-12T09:21:29.750335+0000', 'last_fullsized': '2023-12-12T09:21:29.750335+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.753153+0000', 'last_change': '2023-12-12T09:21:29.753153+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.753153+0000', 'last_undegraded': '2023-12-12T09:21:29.753153+0000', 'last_fullsized': '2023-12-12T09:21:29.753153+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.749319+0000', 'last_change': '2023-12-12T09:21:29.749319+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.749319+0000', 'last_undegraded': '2023-12-12T09:21:29.749319+0000', 'last_fullsized': '2023-12-12T09:21:29.749319+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.745981+0000', 'last_change': '2023-12-12T09:21:29.745981+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.745981+0000', 'last_undegraded': '2023-12-12T09:21:29.745981+0000', 'last_fullsized': '2023-12-12T09:21:29.745981+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-12-12T09:21:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.754999+0000', 'last_change': '2023-12-12T09:21:29.754999+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.754999+0000', 'last_undegraded': '2023-12-12T09:21:29.754999+0000', 'last_fullsized': '2023-12-12T09:21:29.754999+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.744828+0000', 'last_change': '2023-12-12T09:21:29.744828+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.744828+0000', 'last_undegraded': '2023-12-12T09:21:29.744828+0000', 'last_fullsized': '2023-12-12T09:21:29.744828+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.754111+0000', 'last_change': '2023-12-12T09:21:29.754111+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.754111+0000', 'last_undegraded': '2023-12-12T09:21:29.754111+0000', 'last_fullsized': '2023-12-12T09:21:29.754111+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.749019+0000', 'last_change': '2023-12-12T09:21:29.749019+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.749019+0000', 'last_undegraded': '2023-12-12T09:21:29.749019+0000', 'last_fullsized': '2023-12-12T09:21:29.749019+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.743492+0000', 'last_change': '2023-12-12T09:21:29.743492+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.743492+0000', 'last_undegraded': '2023-12-12T09:21:29.743492+0000', 'last_fullsized': '2023-12-12T09:21:29.743492+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.759355+0000', 'last_change': '2023-12-12T09:21:29.759355+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.759355+0000', 'last_undegraded': '2023-12-12T09:21:29.759355+0000', 'last_fullsized': '2023-12-12T09:21:29.759355+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.752797+0000', 'last_change': '2023-12-12T09:21:29.752797+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.752797+0000', 'last_undegraded': '2023-12-12T09:21:29.752797+0000', 'last_fullsized': '2023-12-12T09:21:29.752797+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.746955+0000', 'last_change': '2023-12-12T09:21:29.746955+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.746955+0000', 'last_undegraded': '2023-12-12T09:21:29.746955+0000', 'last_fullsized': '2023-12-12T09:21:29.746955+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.745070+0000', 'last_change': '2023-12-12T09:21:29.745070+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.745070+0000', 'last_undegraded': '2023-12-12T09:21:29.745070+0000', 'last_fullsized': '2023-12-12T09:21:29.745070+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.744936+0000', 'last_change': '2023-12-12T09:21:29.744936+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.744936+0000', 'last_undegraded': '2023-12-12T09:21:29.744936+0000', 'last_fullsized': '2023-12-12T09:21:29.744936+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.759489+0000', 'last_change': '2023-12-12T09:21:29.759489+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.759489+0000', 'last_undegraded': '2023-12-12T09:21:29.759489+0000', 'last_fullsized': '2023-12-12T09:21:29.759489+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-12-12T09:21:36.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:21:29.753889+0000', 'last_change': '2023-12-12T09:21:29.753889+0000', 'last_active': '2023-12-12T09:21:29.722620+0000', 'last_peered': '2023-12-12T09:21:29.722620+0000', 'last_clean': '2023-12-12T09:21:29.722620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:21:29.753889+0000', 'last_undegraded': '2023-12-12T09:21:29.753889+0000', 'last_fullsized': '2023-12-12T09:21:29.753889+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'last_clean_scrub_stamp': '2023-12-12T09:21:29.722620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:21:36.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-12T09:21:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.410+0000 7ff98f1ec640 1 Processor -- start 2023-12-12T09:21:36.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.410+0000 7ff98f1ec640 1 -- start start 2023-12-12T09:21:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.411+0000 7ff98f1ec640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9880b48c0 0x7ff988071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.411+0000 7ff98f1ec640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98815bbf0 con 0x7ff988070230 2023-12-12T09:21:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.411+0000 7ff98f1ec640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff988144af0 con 0x7ff988144710 2023-12-12T09:21:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.411+0000 7ff98f1ec640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff988070bf0 con 0x7ff9880b48c0 2023-12-12T09:21:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.412+0000 7ff98d789640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9880b48c0 0x7ff988071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.412+0000 7ff98d789640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff9880b48c0 0x7ff988071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54762/0 (socket says 172.21.15.84:54762) 2023-12-12T09:21:36.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.412+0000 7ff98d789640 1 -- 172.21.15.84:0/1390638282 learned_addr learned my addr 172.21.15.84:0/1390638282 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:36.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.412+0000 7ff98d789640 1 -- 172.21.15.84:0/1390638282 >> v1:172.21.15.99:6789/0 conn(0x7ff988144710 legacy=0x7ff98815b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:36.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.412+0000 7ff98d789640 1 -- 172.21.15.84:0/1390638282 >> v1:172.21.15.84:6789/0 conn(0x7ff988070230 legacy=0x7ff9880b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:36.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.412+0000 7ff98d789640 1 -- 172.21.15.84:0/1390638282 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988070ed0 con 0x7ff9880b48c0 2023-12-12T09:21:36.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.413+0000 7ff98d789640 1 --2- 172.21.15.84:0/1390638282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9880b48c0 0x7ff988071c90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff980009e50 tx=0x7ff98002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71214965bc3025c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:36.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff9877fe640 1 -- 172.21.15.84:0/1390638282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98002ca80 con 0x7ff9880b48c0 2023-12-12T09:21:36.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff9877fe640 1 -- 172.21.15.84:0/1390638282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98002cbe0 con 0x7ff9880b48c0 2023-12-12T09:21:36.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff9877fe640 1 -- 172.21.15.84:0/1390638282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800343f0 con 0x7ff9880b48c0 2023-12-12T09:21:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff98f1ec640 1 -- 172.21.15.84:0/1390638282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9880b48c0 msgr2=0x7ff988071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff98f1ec640 1 --2- 172.21.15.84:0/1390638282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9880b48c0 0x7ff988071c90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff980009e50 tx=0x7ff98002bee0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff98f1ec640 1 -- 172.21.15.84:0/1390638282 shutdown_connections 2023-12-12T09:21:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff98f1ec640 1 --2- 172.21.15.84:0/1390638282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9880b48c0 0x7ff988071c90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff98f1ec640 1 -- 172.21.15.84:0/1390638282 >> 172.21.15.84:0/1390638282 conn(0x7ff98806c560 msgr2=0x7ff98806c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.414+0000 7ff98f1ec640 1 -- 172.21.15.84:0/1390638282 shutdown_connections 2023-12-12T09:21:36.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.415+0000 7ff98f1ec640 1 -- 172.21.15.84:0/1390638282 wait complete. 2023-12-12T09:21:36.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.417+0000 7ff98f1ec640 1 Processor -- start 2023-12-12T09:21:36.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.417+0000 7ff98f1ec640 1 -- start start 2023-12-12T09:21:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.418+0000 7ff98f1ec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff988070230 0x7ff98813c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.418+0000 7ff98f1ec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9880b48c0 0x7ff9880b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.418+0000 7ff98f1ec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff988144710 0x7ff9880afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.418+0000 7ff98f1ec640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880b3fc0 con 0x7ff988070230 2023-12-12T09:21:36.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.418+0000 7ff98f1ec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880b3440 con 0x7ff988144710 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.418+0000 7ff98f1ec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880b3720 con 0x7ff9880b48c0 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.418+0000 7ff98cf88640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff988070230 0x7ff98813c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98cf88640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff988070230 0x7ff98813c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54764/0 (socket says 172.21.15.84:54764) 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98cf88640 1 -- 172.21.15.84:0/3470648908 learned_addr learned my addr 172.21.15.84:0/3470648908 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff987fff640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9880b48c0 0x7ff9880b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98d789640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff988144710 0x7ff9880afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98cf88640 1 -- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9880b48c0 msgr2=0x7ff9880b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98cf88640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9880b48c0 0x7ff9880b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98cf88640 1 -- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff988144710 msgr2=0x7ff9880afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98cf88640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff988144710 0x7ff9880afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98cf88640 1 -- 172.21.15.84:0/3470648908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980009b30 con 0x7ff988070230 2023-12-12T09:21:36.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98d789640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff988144710 0x7ff9880afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:21:36.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.419+0000 7ff98cf88640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff988070230 0x7ff98813c590 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00b3f0 tx=0x7ff97c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:36.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.420+0000 7ff9857fa640 1 -- 172.21.15.84:0/3470648908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c011830 con 0x7ff988070230 2023-12-12T09:21:36.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.420+0000 7ff9857fa640 1 -- 172.21.15.84:0/3470648908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c011990 con 0x7ff988070230 2023-12-12T09:21:36.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.420+0000 7ff9857fa640 1 -- 172.21.15.84:0/3470648908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c011d40 con 0x7ff988070230 2023-12-12T09:21:36.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.420+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9880b3a00 con 0x7ff988070230 2023-12-12T09:21:36.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.420+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98813cad0 con 0x7ff988070230 2023-12-12T09:21:36.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.421+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9880743d0 con 0x7ff988070230 2023-12-12T09:21:36.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.422+0000 7ff9857fa640 1 -- 172.21.15.84:0/3470648908 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff97c01a400 con 0x7ff988070230 2023-12-12T09:21:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.423+0000 7ff9857fa640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff96c06ae40 0x7ff96c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.423+0000 7ff9857fa640 1 -- 172.21.15.84:0/3470648908 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff97c089500 con 0x7ff988070230 2023-12-12T09:21:36.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.423+0000 7ff987fff640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff96c06ae40 0x7ff96c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.424+0000 7ff987fff640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff96c06ae40 0x7ff96c06d300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9881f6570 tx=0x7ff974009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.427+0000 7ff9857fa640 1 -- 172.21.15.84:0/3470648908 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff97c054500 con 0x7ff988070230 2023-12-12T09:21:36.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.693+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff9880673c0 con 0x7ff988070230 2023-12-12T09:21:36.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.694+0000 7ff9857fa640 1 -- 172.21.15.84:0/3470648908 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1034 (secure 0 0 0) 0x7ff97c057b20 con 0x7ff988070230 2023-12-12T09:21:36.694 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:36.694 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":134,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1702372774,"num_in_osds":8,"osd_in_since":1702372765,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":226045952,"bytes_avail":772868067328,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5556}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-12-12T09:20:47.096211+0000","services":{}},"progress_events":{}} 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.696+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff96c06ae40 msgr2=0x7ff96c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.696+0000 7ff98f1ec640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff96c06ae40 0x7ff96c06d300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9881f6570 tx=0x7ff974009040 comp rx=0 tx=0).stop 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.696+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff988070230 msgr2=0x7ff98813c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.696+0000 7ff98f1ec640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff988070230 0x7ff98813c590 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00b3f0 tx=0x7ff97c00b8b0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.697+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 shutdown_connections 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.697+0000 7ff98f1ec640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff988144710 0x7ff9880afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.697+0000 7ff98f1ec640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9880b48c0 0x7ff9880b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.697+0000 7ff98f1ec640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff96c06ae40 0x7ff96c06d300 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.697+0000 7ff98f1ec640 1 --2- 172.21.15.84:0/3470648908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff988070230 0x7ff98813c590 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.697+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 >> 172.21.15.84:0/3470648908 conn(0x7ff98806c560 msgr2=0x7ff98815c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:36.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.697+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 shutdown_connections 2023-12-12T09:21:36.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.697+0000 7ff98f1ec640 1 -- 172.21.15.84:0/3470648908 wait complete. 2023-12-12T09:21:36.716 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-12T09:21:36.717 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:21:36.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.919+0000 7f4ba6a9b640 1 Processor -- start 2023-12-12T09:21:36.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.919+0000 7f4ba6a9b640 1 -- start start 2023-12-12T09:21:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.920+0000 7f4ba6a9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce330 0x7f4ba013d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.920+0000 7f4ba6a9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4ba00ce790 0x7f4ba013d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.920+0000 7f4ba6a9b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba0140270 con 0x7f4ba0071bb0 2023-12-12T09:21:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.920+0000 7f4ba6a9b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba00cd850 con 0x7f4ba00ce790 2023-12-12T09:21:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.920+0000 7f4ba6a9b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00cdb30 con 0x7f4ba00ce330 2023-12-12T09:21:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.921+0000 7f4ba5038640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4ba00ce790 0x7f4ba013d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.921+0000 7f4ba4837640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4ba0071bb0 0x7f4ba0071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48634/0 (socket says 172.21.15.84:48634) 2023-12-12T09:21:36.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.921+0000 7f4ba4837640 1 -- 172.21.15.84:0/1700692501 learned_addr learned my addr 172.21.15.84:0/1700692501 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:36.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.921+0000 7f4ba5038640 1 -- 172.21.15.84:0/1700692501 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce330 msgr2=0x7f4ba013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:36.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.921+0000 7f4ba5038640 1 --2- 172.21.15.84:0/1700692501 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce330 0x7f4ba013d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.921+0000 7f4ba5038640 1 -- 172.21.15.84:0/1700692501 >> v1:172.21.15.84:6789/0 conn(0x7f4ba0071bb0 legacy=0x7f4ba0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.921+0000 7f4ba5038640 1 -- 172.21.15.84:0/1700692501 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00cde10 con 0x7f4ba00ce790 2023-12-12T09:21:36.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.921+0000 7f4b977fe640 1 -- 172.21.15.84:0/1700692501 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010373856 0 0) 0x7f4ba0140270 con 0x7f4ba0071bb0 2023-12-12T09:21:36.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.922+0000 7f4ba5038640 1 --2- 172.21.15.84:0/1700692501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce790 0x7f4ba013d910 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4b980097a0 tx=0x7f4b9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1909c2a03b6abf3b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:36.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.922+0000 7f4b977fe640 1 -- 172.21.15.84:0/1700692501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98031830 con 0x7f4ba00ce790 2023-12-12T09:21:36.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4b977fe640 1 -- 172.21.15.84:0/1700692501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98031990 con 0x7f4ba00ce790 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4b977fe640 1 -- 172.21.15.84:0/1700692501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98031d20 con 0x7f4ba00ce790 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/1700692501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce790 msgr2=0x7f4ba013d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/1700692501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce790 0x7f4ba013d910 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4b980097a0 tx=0x7f4b9802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/1700692501 shutdown_connections 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/1700692501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce790 0x7f4ba013d910 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/1700692501 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce330 0x7f4ba013d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/1700692501 >> 172.21.15.84:0/1700692501 conn(0x7f4ba006c3d0 msgr2=0x7f4ba006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/1700692501 shutdown_connections 2023-12-12T09:21:36.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.923+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/1700692501 wait complete. 2023-12-12T09:21:36.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.925+0000 7f4ba6a9b640 1 Processor -- start 2023-12-12T09:21:36.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.925+0000 7f4ba6a9b640 1 -- start start 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.926+0000 7f4ba6a9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0071bb0 0x7f4ba01f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.926+0000 7f4ba6a9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce330 0x7f4ba00b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.926+0000 7f4ba6a9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce790 0x7f4ba0138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.926+0000 7f4ba6a9b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0153290 con 0x7f4ba00ce330 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.926+0000 7f4ba6a9b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba01f4c50 con 0x7f4ba0071bb0 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.926+0000 7f4ba6a9b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba01f4f30 con 0x7f4ba00ce790 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.926+0000 7f4b97fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce330 0x7f4ba00b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b97fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce330 0x7f4ba00b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54788/0 (socket says 172.21.15.84:54788) 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b97fff640 1 -- 172.21.15.84:0/2947064761 learned_addr learned my addr 172.21.15.84:0/2947064761 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4ba4837640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0071bb0 0x7f4ba01f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4ba5038640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce790 0x7f4ba0138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b97fff640 1 -- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce790 msgr2=0x7f4ba0138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b97fff640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce790 0x7f4ba0138b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b97fff640 1 -- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0071bb0 msgr2=0x7f4ba01f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b97fff640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0071bb0 0x7f4ba01f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b97fff640 1 -- 172.21.15.84:0/2947064761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98009400 con 0x7f4ba00ce330 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4ba5038640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce790 0x7f4ba0138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b97fff640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce330 0x7f4ba00b00c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00b4a0 tx=0x7f4b9c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.927+0000 7f4b957fa640 1 -- 172.21.15.84:0/2947064761 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c010610 con 0x7f4ba00ce330 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.928+0000 7f4b957fa640 1 -- 172.21.15.84:0/2947064761 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c010770 con 0x7f4ba00ce330 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.928+0000 7f4b957fa640 1 -- 172.21.15.84:0/2947064761 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c010b20 con 0x7f4ba00ce330 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.928+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba01f5210 con 0x7f4ba00ce330 2023-12-12T09:21:36.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.928+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba01f57d0 con 0x7f4ba00ce330 2023-12-12T09:21:36.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.929+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba00673c0 con 0x7f4ba00ce330 2023-12-12T09:21:36.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.930+0000 7f4b957fa640 1 -- 172.21.15.84:0/2947064761 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b9c010c80 con 0x7f4ba00ce330 2023-12-12T09:21:36.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.931+0000 7f4b957fa640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b8c06ae40 0x7f4b8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:36.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.931+0000 7f4b957fa640 1 -- 172.21.15.84:0/2947064761 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4b9c0893f0 con 0x7f4ba00ce330 2023-12-12T09:21:36.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.931+0000 7f4ba4837640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b8c06ae40 0x7f4b8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:36.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.932+0000 7f4ba4837640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b8c06ae40 0x7f4b8c06d300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b900012e0 tx=0x7f4b90007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:36.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:36.935+0000 7f4b957fa640 1 -- 172.21.15.84:0/2947064761 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b9c0542c0 con 0x7f4ba00ce330 2023-12-12T09:21:37.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.123+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ba013f510 con 0x7f4b8c06ae40 2023-12-12T09:21:37.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.145+0000 7f4b957fa640 1 -- 172.21.15.84:0/2947064761 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286856 (secure 0 0 0) 0x7f4b90005c70 con 0x7f4b8c06ae40 2023-12-12T09:21:37.149 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:37.151 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:21:37.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b8c06ae40 msgr2=0x7f4b8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b8c06ae40 0x7f4b8c06d300 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b900012e0 tx=0x7f4b90007ef0 comp rx=0 tx=0).stop 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce330 msgr2=0x7f4ba00b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce330 0x7f4ba00b00c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00b4a0 tx=0x7f4b9c00b960 comp rx=0 tx=0).stop 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 shutdown_connections 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ba00ce790 0x7f4ba0138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4b8c06ae40 0x7f4b8c06d300 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ba00ce330 0x7f4ba00b00c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 --2- 172.21.15.84:0/2947064761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0071bb0 0x7f4ba01f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 >> 172.21.15.84:0/2947064761 conn(0x7f4ba006c3d0 msgr2=0x7f4ba013deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 shutdown_connections 2023-12-12T09:21:37.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:37.152+0000 7f4ba6a9b640 1 -- 172.21.15.84:0/2947064761 wait complete. 2023-12-12T09:21:37.172 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-12-12T09:21:37.112599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221124,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753596,"statfs":{"total":773094113280,"available":772867682304,"internally_reserved":0,"allocated":5021696,"data_stored":2821452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.381381"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796548+0000","last_change":"2023-12-12T09:21:30.800930+0000","last_active":"2023-12-12T09:21:31.796548+0000","last_peered":"2023-12-12T09:21:31.796548+0000","last_clean":"2023-12-12T09:21:31.796548+0000","last_became_active":"2023-12-12T09:21:30.800640+0000","last_became_peered":"2023-12-12T09:21:30.800640+0000","last_unstale":"2023-12-12T09:21:31.796548+0000","last_undegraded":"2023-12-12T09:21:31.796548+0000","last_fullsized":"2023-12-12T09:21:31.796548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:27.476172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796132+0000","last_change":"2023-12-12T09:21:30.807237+0000","last_active":"2023-12-12T09:21:31.796132+0000","last_peered":"2023-12-12T09:21:31.796132+0000","last_clean":"2023-12-12T09:21:31.796132+0000","last_became_active":"2023-12-12T09:21:30.806945+0000","last_became_peered":"2023-12-12T09:21:30.806945+0000","last_unstale":"2023-12-12T09:21:31.796132+0000","last_undegraded":"2023-12-12T09:21:31.796132+0000","last_fullsized":"2023-12-12T09:21:31.796132+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:19:40.895801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.023123+0000","last_change":"2023-12-12T09:21:30.802742+0000","last_active":"2023-12-12T09:21:32.023123+0000","last_peered":"2023-12-12T09:21:32.023123+0000","last_clean":"2023-12-12T09:21:32.023123+0000","last_became_active":"2023-12-12T09:21:30.801597+0000","last_became_peered":"2023-12-12T09:21:30.801597+0000","last_unstale":"2023-12-12T09:21:32.023123+0000","last_undegraded":"2023-12-12T09:21:32.023123+0000","last_fullsized":"2023-12-12T09:21:32.023123+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:50:57.392678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.022362+0000","last_change":"2023-12-12T09:21:30.799058+0000","last_active":"2023-12-12T09:21:32.022362+0000","last_peered":"2023-12-12T09:21:32.022362+0000","last_clean":"2023-12-12T09:21:32.022362+0000","last_became_active":"2023-12-12T09:21:30.798646+0000","last_became_peered":"2023-12-12T09:21:30.798646+0000","last_unstale":"2023-12-12T09:21:32.022362+0000","last_undegraded":"2023-12-12T09:21:32.022362+0000","last_fullsized":"2023-12-12T09:21:32.022362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:44.724124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020348+0000","last_change":"2023-12-12T09:21:30.795732+0000","last_active":"2023-12-12T09:21:32.020348+0000","last_peered":"2023-12-12T09:21:32.020348+0000","last_clean":"2023-12-12T09:21:32.020348+0000","last_became_active":"2023-12-12T09:21:30.795436+0000","last_became_peered":"2023-12-12T09:21:30.795436+0000","last_unstale":"2023-12-12T09:21:32.020348+0000","last_undegraded":"2023-12-12T09:21:32.020348+0000","last_fullsized":"2023-12-12T09:21:32.020348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:15.157523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020494+0000","last_change":"2023-12-12T09:21:30.799163+0000","last_active":"2023-12-12T09:21:32.020494+0000","last_peered":"2023-12-12T09:21:32.020494+0000","last_clean":"2023-12-12T09:21:32.020494+0000","last_became_active":"2023-12-12T09:21:30.796554+0000","last_became_peered":"2023-12-12T09:21:30.796554+0000","last_unstale":"2023-12-12T09:21:32.020494+0000","last_undegraded":"2023-12-12T09:21:32.020494+0000","last_fullsized":"2023-12-12T09:21:32.020494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:03.332191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799061+0000","last_change":"2023-12-12T09:21:30.796498+0000","last_active":"2023-12-12T09:21:31.799061+0000","last_peered":"2023-12-12T09:21:31.799061+0000","last_clean":"2023-12-12T09:21:31.799061+0000","last_became_active":"2023-12-12T09:21:30.795797+0000","last_became_peered":"2023-12-12T09:21:30.795797+0000","last_unstale":"2023-12-12T09:21:31.799061+0000","last_undegraded":"2023-12-12T09:21:31.799061+0000","last_fullsized":"2023-12-12T09:21:31.799061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:06:52.602829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.795870+0000","last_change":"2023-12-12T09:21:30.784650+0000","last_active":"2023-12-12T09:21:31.795870+0000","last_peered":"2023-12-12T09:21:31.795870+0000","last_clean":"2023-12-12T09:21:31.795870+0000","last_became_active":"2023-12-12T09:21:30.783980+0000","last_became_peered":"2023-12-12T09:21:30.783980+0000","last_unstale":"2023-12-12T09:21:31.795870+0000","last_undegraded":"2023-12-12T09:21:31.795870+0000","last_fullsized":"2023-12-12T09:21:31.795870+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:04.169649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.024010+0000","last_change":"2023-12-12T09:21:30.803440+0000","last_active":"2023-12-12T09:21:32.024010+0000","last_peered":"2023-12-12T09:21:32.024010+0000","last_clean":"2023-12-12T09:21:32.024010+0000","last_became_active":"2023-12-12T09:21:30.803178+0000","last_became_peered":"2023-12-12T09:21:30.803178+0000","last_unstale":"2023-12-12T09:21:32.024010+0000","last_undegraded":"2023-12-12T09:21:32.024010+0000","last_fullsized":"2023-12-12T09:21:32.024010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:38.101765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800989+0000","last_change":"2023-12-12T09:21:30.806040+0000","last_active":"2023-12-12T09:21:31.800989+0000","last_peered":"2023-12-12T09:21:31.800989+0000","last_clean":"2023-12-12T09:21:31.800989+0000","last_became_active":"2023-12-12T09:21:30.805765+0000","last_became_peered":"2023-12-12T09:21:30.805765+0000","last_unstale":"2023-12-12T09:21:31.800989+0000","last_undegraded":"2023-12-12T09:21:31.800989+0000","last_fullsized":"2023-12-12T09:21:31.800989+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:49:10.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800328+0000","last_change":"2023-12-12T09:21:30.794833+0000","last_active":"2023-12-12T09:21:31.800328+0000","last_peered":"2023-12-12T09:21:31.800328+0000","last_clean":"2023-12-12T09:21:31.800328+0000","last_became_active":"2023-12-12T09:21:30.794315+0000","last_became_peered":"2023-12-12T09:21:30.794315+0000","last_unstale":"2023-12-12T09:21:31.800328+0000","last_undegraded":"2023-12-12T09:21:31.800328+0000","last_fullsized":"2023-12-12T09:21:31.800328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:06:40.973147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.022594+0000","last_change":"2023-12-12T09:21:30.800264+0000","last_active":"2023-12-12T09:21:32.022594+0000","last_peered":"2023-12-12T09:21:32.022594+0000","last_clean":"2023-12-12T09:21:32.022594+0000","last_became_active":"2023-12-12T09:21:30.799970+0000","last_became_peered":"2023-12-12T09:21:30.799970+0000","last_unstale":"2023-12-12T09:21:32.022594+0000","last_undegraded":"2023-12-12T09:21:32.022594+0000","last_fullsized":"2023-12-12T09:21:32.022594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:14.214933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799863+0000","last_change":"2023-12-12T09:21:30.807731+0000","last_active":"2023-12-12T09:21:31.799863+0000","last_peered":"2023-12-12T09:21:31.799863+0000","last_clean":"2023-12-12T09:21:31.799863+0000","last_became_active":"2023-12-12T09:21:30.806312+0000","last_became_peered":"2023-12-12T09:21:30.806312+0000","last_unstale":"2023-12-12T09:21:31.799863+0000","last_undegraded":"2023-12-12T09:21:31.799863+0000","last_fullsized":"2023-12-12T09:21:31.799863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:36:46.387119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.797551+0000","last_change":"2023-12-12T09:21:30.802698+0000","last_active":"2023-12-12T09:21:31.797551+0000","last_peered":"2023-12-12T09:21:31.797551+0000","last_clean":"2023-12-12T09:21:31.797551+0000","last_became_active":"2023-12-12T09:21:30.802422+0000","last_became_peered":"2023-12-12T09:21:30.802422+0000","last_unstale":"2023-12-12T09:21:31.797551+0000","last_undegraded":"2023-12-12T09:21:31.797551+0000","last_fullsized":"2023-12-12T09:21:31.797551+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:55.922461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799398+0000","last_change":"2023-12-12T09:21:30.801101+0000","last_active":"2023-12-12T09:21:31.799398+0000","last_peered":"2023-12-12T09:21:31.799398+0000","last_clean":"2023-12-12T09:21:31.799398+0000","last_became_active":"2023-12-12T09:21:30.800750+0000","last_became_peered":"2023-12-12T09:21:30.800750+0000","last_unstale":"2023-12-12T09:21:31.799398+0000","last_undegraded":"2023-12-12T09:21:31.799398+0000","last_fullsized":"2023-12-12T09:21:31.799398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:15:06.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.019991+0000","last_change":"2023-12-12T09:21:30.801963+0000","last_active":"2023-12-12T09:21:32.019991+0000","last_peered":"2023-12-12T09:21:32.019991+0000","last_clean":"2023-12-12T09:21:32.019991+0000","last_became_active":"2023-12-12T09:21:30.801696+0000","last_became_peered":"2023-12-12T09:21:30.801696+0000","last_unstale":"2023-12-12T09:21:32.019991+0000","last_undegraded":"2023-12-12T09:21:32.019991+0000","last_fullsized":"2023-12-12T09:21:32.019991+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:16:01.921093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.022640+0000","last_change":"2023-12-12T09:21:30.807713+0000","last_active":"2023-12-12T09:21:32.022640+0000","last_peered":"2023-12-12T09:21:32.022640+0000","last_clean":"2023-12-12T09:21:32.022640+0000","last_became_active":"2023-12-12T09:21:30.805906+0000","last_became_peered":"2023-12-12T09:21:30.805906+0000","last_unstale":"2023-12-12T09:21:32.022640+0000","last_undegraded":"2023-12-12T09:21:32.022640+0000","last_fullsized":"2023-12-12T09:21:32.022640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:04:42.474886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021237+0000","last_change":"2023-12-12T09:21:30.800242+0000","last_active":"2023-12-12T09:21:32.021237+0000","last_peered":"2023-12-12T09:21:32.021237+0000","last_clean":"2023-12-12T09:21:32.021237+0000","last_became_active":"2023-12-12T09:21:30.799689+0000","last_became_peered":"2023-12-12T09:21:30.799689+0000","last_unstale":"2023-12-12T09:21:32.021237+0000","last_undegraded":"2023-12-12T09:21:32.021237+0000","last_fullsized":"2023-12-12T09:21:32.021237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:20.670375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.023206+0000","last_change":"2023-12-12T09:21:30.815970+0000","last_active":"2023-12-12T09:21:32.023206+0000","last_peered":"2023-12-12T09:21:32.023206+0000","last_clean":"2023-12-12T09:21:32.023206+0000","last_became_active":"2023-12-12T09:21:30.814903+0000","last_became_peered":"2023-12-12T09:21:30.814903+0000","last_unstale":"2023-12-12T09:21:32.023206+0000","last_undegraded":"2023-12-12T09:21:32.023206+0000","last_fullsized":"2023-12-12T09:21:32.023206+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:33.565640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020892+0000","last_change":"2023-12-12T09:21:30.802821+0000","last_active":"2023-12-12T09:21:32.020892+0000","last_peered":"2023-12-12T09:21:32.020892+0000","last_clean":"2023-12-12T09:21:32.020892+0000","last_became_active":"2023-12-12T09:21:30.802551+0000","last_became_peered":"2023-12-12T09:21:30.802551+0000","last_unstale":"2023-12-12T09:21:32.020892+0000","last_undegraded":"2023-12-12T09:21:32.020892+0000","last_fullsized":"2023-12-12T09:21:32.020892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:11:12.489157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800014+0000","last_change":"2023-12-12T09:21:30.805916+0000","last_active":"2023-12-12T09:21:31.800014+0000","last_peered":"2023-12-12T09:21:31.800014+0000","last_clean":"2023-12-12T09:21:31.800014+0000","last_became_active":"2023-12-12T09:21:30.802075+0000","last_became_peered":"2023-12-12T09:21:30.802075+0000","last_unstale":"2023-12-12T09:21:31.800014+0000","last_undegraded":"2023-12-12T09:21:31.800014+0000","last_fullsized":"2023-12-12T09:21:31.800014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:15:45.073501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799254+0000","last_change":"2023-12-12T09:21:30.804890+0000","last_active":"2023-12-12T09:21:31.799254+0000","last_peered":"2023-12-12T09:21:31.799254+0000","last_clean":"2023-12-12T09:21:31.799254+0000","last_became_active":"2023-12-12T09:21:30.804622+0000","last_became_peered":"2023-12-12T09:21:30.804622+0000","last_unstale":"2023-12-12T09:21:31.799254+0000","last_undegraded":"2023-12-12T09:21:31.799254+0000","last_fullsized":"2023-12-12T09:21:31.799254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:06:52.602829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020612+0000","last_change":"2023-12-12T09:21:30.818591+0000","last_active":"2023-12-12T09:21:32.020612+0000","last_peered":"2023-12-12T09:21:32.020612+0000","last_clean":"2023-12-12T09:21:32.020612+0000","last_became_active":"2023-12-12T09:21:30.816866+0000","last_became_peered":"2023-12-12T09:21:30.816866+0000","last_unstale":"2023-12-12T09:21:32.020612+0000","last_undegraded":"2023-12-12T09:21:32.020612+0000","last_fullsized":"2023-12-12T09:21:32.020612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:14.214933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020127+0000","last_change":"2023-12-12T09:21:30.806981+0000","last_active":"2023-12-12T09:21:32.020127+0000","last_peered":"2023-12-12T09:21:32.020127+0000","last_clean":"2023-12-12T09:21:32.020127+0000","last_became_active":"2023-12-12T09:21:30.806666+0000","last_became_peered":"2023-12-12T09:21:30.806666+0000","last_unstale":"2023-12-12T09:21:32.020127+0000","last_undegraded":"2023-12-12T09:21:32.020127+0000","last_fullsized":"2023-12-12T09:21:32.020127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:51:24.308647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021225+0000","last_change":"2023-12-12T09:21:30.803962+0000","last_active":"2023-12-12T09:21:32.021225+0000","last_peered":"2023-12-12T09:21:32.021225+0000","last_clean":"2023-12-12T09:21:32.021225+0000","last_became_active":"2023-12-12T09:21:30.803308+0000","last_became_peered":"2023-12-12T09:21:30.803308+0000","last_unstale":"2023-12-12T09:21:32.021225+0000","last_undegraded":"2023-12-12T09:21:32.021225+0000","last_fullsized":"2023-12-12T09:21:32.021225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:40.033419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021411+0000","last_change":"2023-12-12T09:21:30.800148+0000","last_active":"2023-12-12T09:21:32.021411+0000","last_peered":"2023-12-12T09:21:32.021411+0000","last_clean":"2023-12-12T09:21:32.021411+0000","last_became_active":"2023-12-12T09:21:30.799270+0000","last_became_peered":"2023-12-12T09:21:30.799270+0000","last_unstale":"2023-12-12T09:21:32.021411+0000","last_undegraded":"2023-12-12T09:21:32.021411+0000","last_fullsized":"2023-12-12T09:21:32.021411+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:55.922461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021244+0000","last_change":"2023-12-12T09:21:30.812096+0000","last_active":"2023-12-12T09:21:32.021244+0000","last_peered":"2023-12-12T09:21:32.021244+0000","last_clean":"2023-12-12T09:21:32.021244+0000","last_became_active":"2023-12-12T09:21:30.811814+0000","last_became_peered":"2023-12-12T09:21:30.811814+0000","last_unstale":"2023-12-12T09:21:32.021244+0000","last_undegraded":"2023-12-12T09:21:32.021244+0000","last_fullsized":"2023-12-12T09:21:32.021244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:25:28.836792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800550+0000","last_change":"2023-12-12T09:21:30.795498+0000","last_active":"2023-12-12T09:21:31.800550+0000","last_peered":"2023-12-12T09:21:31.800550+0000","last_clean":"2023-12-12T09:21:31.800550+0000","last_became_active":"2023-12-12T09:21:30.795202+0000","last_became_peered":"2023-12-12T09:21:30.795202+0000","last_unstale":"2023-12-12T09:21:31.800550+0000","last_undegraded":"2023-12-12T09:21:31.800550+0000","last_fullsized":"2023-12-12T09:21:31.800550+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:31:16.255769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020304+0000","last_change":"2023-12-12T09:21:30.805829+0000","last_active":"2023-12-12T09:21:32.020304+0000","last_peered":"2023-12-12T09:21:32.020304+0000","last_clean":"2023-12-12T09:21:32.020304+0000","last_became_active":"2023-12-12T09:21:30.803723+0000","last_became_peered":"2023-12-12T09:21:30.803723+0000","last_unstale":"2023-12-12T09:21:32.020304+0000","last_undegraded":"2023-12-12T09:21:32.020304+0000","last_fullsized":"2023-12-12T09:21:32.020304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:24.640139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.019971+0000","last_change":"2023-12-12T09:21:30.802686+0000","last_active":"2023-12-12T09:21:32.019971+0000","last_peered":"2023-12-12T09:21:32.019971+0000","last_clean":"2023-12-12T09:21:32.019971+0000","last_became_active":"2023-12-12T09:21:30.802400+0000","last_became_peered":"2023-12-12T09:21:30.802400+0000","last_unstale":"2023-12-12T09:21:32.019971+0000","last_undegraded":"2023-12-12T09:21:32.019971+0000","last_fullsized":"2023-12-12T09:21:32.019971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:33.565640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020646+0000","last_change":"2023-12-12T09:21:30.818600+0000","last_active":"2023-12-12T09:21:32.020646+0000","last_peered":"2023-12-12T09:21:32.020646+0000","last_clean":"2023-12-12T09:21:32.020646+0000","last_became_active":"2023-12-12T09:21:30.817249+0000","last_became_peered":"2023-12-12T09:21:30.817249+0000","last_unstale":"2023-12-12T09:21:32.020646+0000","last_undegraded":"2023-12-12T09:21:32.020646+0000","last_fullsized":"2023-12-12T09:21:32.020646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:27.906245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.019975+0000","last_change":"2023-12-12T09:21:30.807756+0000","last_active":"2023-12-12T09:21:32.019975+0000","last_peered":"2023-12-12T09:21:32.019975+0000","last_clean":"2023-12-12T09:21:32.019975+0000","last_became_active":"2023-12-12T09:21:30.807385+0000","last_became_peered":"2023-12-12T09:21:30.807385+0000","last_unstale":"2023-12-12T09:21:32.019975+0000","last_undegraded":"2023-12-12T09:21:32.019975+0000","last_fullsized":"2023-12-12T09:21:32.019975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:28:38.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021732+0000","last_change":"2023-12-12T09:21:30.816865+0000","last_active":"2023-12-12T09:21:32.021732+0000","last_peered":"2023-12-12T09:21:32.021732+0000","last_clean":"2023-12-12T09:21:32.021732+0000","last_became_active":"2023-12-12T09:21:30.815052+0000","last_became_peered":"2023-12-12T09:21:30.815052+0000","last_unstale":"2023-12-12T09:21:32.021732+0000","last_undegraded":"2023-12-12T09:21:32.021732+0000","last_fullsized":"2023-12-12T09:21:32.021732+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:55.922461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.814658+0000","last_change":"2023-12-12T09:21:29.759176+0000","last_active":"2023-12-12T09:21:30.814658+0000","last_peered":"2023-12-12T09:21:30.814658+0000","last_clean":"2023-12-12T09:21:30.814658+0000","last_became_active":"2023-12-12T09:21:29.758919+0000","last_became_peered":"2023-12-12T09:21:29.758919+0000","last_unstale":"2023-12-12T09:21:30.814658+0000","last_undegraded":"2023-12-12T09:21:30.814658+0000","last_fullsized":"2023-12-12T09:21:30.814658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021337+0000","last_change":"2023-12-12T09:21:30.810317+0000","last_active":"2023-12-12T09:21:32.021337+0000","last_peered":"2023-12-12T09:21:32.021337+0000","last_clean":"2023-12-12T09:21:32.021337+0000","last_became_active":"2023-12-12T09:21:30.808017+0000","last_became_peered":"2023-12-12T09:21:30.808017+0000","last_unstale":"2023-12-12T09:21:32.021337+0000","last_undegraded":"2023-12-12T09:21:32.021337+0000","last_fullsized":"2023-12-12T09:21:32.021337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:50:57.392678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.809868+0000","last_change":"2023-12-12T09:21:29.768735+0000","last_active":"2023-12-12T09:21:30.809868+0000","last_peered":"2023-12-12T09:21:30.809868+0000","last_clean":"2023-12-12T09:21:30.809868+0000","last_became_active":"2023-12-12T09:21:29.768270+0000","last_became_peered":"2023-12-12T09:21:29.768270+0000","last_unstale":"2023-12-12T09:21:30.809868+0000","last_undegraded":"2023-12-12T09:21:30.809868+0000","last_fullsized":"2023-12-12T09:21:30.809868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:46.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799585+0000","last_change":"2023-12-12T09:21:30.803306+0000","last_active":"2023-12-12T09:21:31.799585+0000","last_peered":"2023-12-12T09:21:31.799585+0000","last_clean":"2023-12-12T09:21:31.799585+0000","last_became_active":"2023-12-12T09:21:30.803061+0000","last_became_peered":"2023-12-12T09:21:30.803061+0000","last_unstale":"2023-12-12T09:21:31.799585+0000","last_undegraded":"2023-12-12T09:21:31.799585+0000","last_fullsized":"2023-12-12T09:21:31.799585+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:15:06.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.816109+0000","last_change":"2023-12-12T09:21:29.761602+0000","last_active":"2023-12-12T09:21:30.816109+0000","last_peered":"2023-12-12T09:21:30.816109+0000","last_clean":"2023-12-12T09:21:30.816109+0000","last_became_active":"2023-12-12T09:21:29.761302+0000","last_became_peered":"2023-12-12T09:21:29.761302+0000","last_unstale":"2023-12-12T09:21:30.816109+0000","last_undegraded":"2023-12-12T09:21:30.816109+0000","last_fullsized":"2023-12-12T09:21:30.816109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:46.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796357+0000","last_change":"2023-12-12T09:21:30.802702+0000","last_active":"2023-12-12T09:21:31.796357+0000","last_peered":"2023-12-12T09:21:31.796357+0000","last_clean":"2023-12-12T09:21:31.796357+0000","last_became_active":"2023-12-12T09:21:30.802390+0000","last_became_peered":"2023-12-12T09:21:30.802390+0000","last_unstale":"2023-12-12T09:21:31.796357+0000","last_undegraded":"2023-12-12T09:21:31.796357+0000","last_fullsized":"2023-12-12T09:21:31.796357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:40:52.539020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.813327+0000","last_change":"2023-12-12T09:21:29.757460+0000","last_active":"2023-12-12T09:21:30.813327+0000","last_peered":"2023-12-12T09:21:30.813327+0000","last_clean":"2023-12-12T09:21:30.813327+0000","last_became_active":"2023-12-12T09:21:29.757144+0000","last_became_peered":"2023-12-12T09:21:29.757144+0000","last_unstale":"2023-12-12T09:21:30.813327+0000","last_undegraded":"2023-12-12T09:21:30.813327+0000","last_fullsized":"2023-12-12T09:21:30.813327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:02.326740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020131+0000","last_change":"2023-12-12T09:21:30.801863+0000","last_active":"2023-12-12T09:21:32.020131+0000","last_peered":"2023-12-12T09:21:32.020131+0000","last_clean":"2023-12-12T09:21:32.020131+0000","last_became_active":"2023-12-12T09:21:30.801019+0000","last_became_peered":"2023-12-12T09:21:30.801019+0000","last_unstale":"2023-12-12T09:21:32.020131+0000","last_undegraded":"2023-12-12T09:21:32.020131+0000","last_fullsized":"2023-12-12T09:21:32.020131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:16:01.921093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.820166+0000","last_change":"2023-12-12T09:21:29.764003+0000","last_active":"2023-12-12T09:21:30.820166+0000","last_peered":"2023-12-12T09:21:30.820166+0000","last_clean":"2023-12-12T09:21:30.820166+0000","last_became_active":"2023-12-12T09:21:29.763739+0000","last_became_peered":"2023-12-12T09:21:29.763739+0000","last_unstale":"2023-12-12T09:21:30.820166+0000","last_undegraded":"2023-12-12T09:21:30.820166+0000","last_fullsized":"2023-12-12T09:21:30.820166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:13.209482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799635+0000","last_change":"2023-12-12T09:21:30.798523+0000","last_active":"2023-12-12T09:21:31.799635+0000","last_peered":"2023-12-12T09:21:31.799635+0000","last_clean":"2023-12-12T09:21:31.799635+0000","last_became_active":"2023-12-12T09:21:30.797655+0000","last_became_peered":"2023-12-12T09:21:30.797655+0000","last_unstale":"2023-12-12T09:21:31.799635+0000","last_undegraded":"2023-12-12T09:21:31.799635+0000","last_fullsized":"2023-12-12T09:21:31.799635+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:42:56.417244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.820023+0000","last_change":"2023-12-12T09:21:29.772599+0000","last_active":"2023-12-12T09:21:30.820023+0000","last_peered":"2023-12-12T09:21:30.820023+0000","last_clean":"2023-12-12T09:21:30.820023+0000","last_became_active":"2023-12-12T09:21:29.772099+0000","last_became_peered":"2023-12-12T09:21:29.772099+0000","last_unstale":"2023-12-12T09:21:30.820023+0000","last_undegraded":"2023-12-12T09:21:30.820023+0000","last_fullsized":"2023-12-12T09:21:30.820023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.798184+0000","last_change":"2023-12-12T09:21:30.795925+0000","last_active":"2023-12-12T09:21:31.798184+0000","last_peered":"2023-12-12T09:21:31.798184+0000","last_clean":"2023-12-12T09:21:31.798184+0000","last_became_active":"2023-12-12T09:21:30.795614+0000","last_became_peered":"2023-12-12T09:21:30.795614+0000","last_unstale":"2023-12-12T09:21:31.798184+0000","last_undegraded":"2023-12-12T09:21:31.798184+0000","last_fullsized":"2023-12-12T09:21:31.798184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:41:06.511178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.789417+0000","last_change":"2023-12-12T09:21:29.767795+0000","last_active":"2023-12-12T09:21:30.789417+0000","last_peered":"2023-12-12T09:21:30.789417+0000","last_clean":"2023-12-12T09:21:30.789417+0000","last_became_active":"2023-12-12T09:21:29.767472+0000","last_became_peered":"2023-12-12T09:21:29.767472+0000","last_unstale":"2023-12-12T09:21:30.789417+0000","last_undegraded":"2023-12-12T09:21:30.789417+0000","last_fullsized":"2023-12-12T09:21:30.789417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:59:11.847628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796068+0000","last_change":"2023-12-12T09:21:30.804858+0000","last_active":"2023-12-12T09:21:31.796068+0000","last_peered":"2023-12-12T09:21:31.796068+0000","last_clean":"2023-12-12T09:21:31.796068+0000","last_became_active":"2023-12-12T09:21:30.804302+0000","last_became_peered":"2023-12-12T09:21:30.804302+0000","last_unstale":"2023-12-12T09:21:31.796068+0000","last_undegraded":"2023-12-12T09:21:31.796068+0000","last_fullsized":"2023-12-12T09:21:31.796068+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:23:48.151377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.773527+0000","last_change":"2023-12-12T09:21:29.760059+0000","last_active":"2023-12-12T09:21:30.773527+0000","last_peered":"2023-12-12T09:21:30.773527+0000","last_clean":"2023-12-12T09:21:30.773527+0000","last_became_active":"2023-12-12T09:21:29.759181+0000","last_became_peered":"2023-12-12T09:21:29.759181+0000","last_unstale":"2023-12-12T09:21:30.773527+0000","last_undegraded":"2023-12-12T09:21:30.773527+0000","last_fullsized":"2023-12-12T09:21:30.773527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:28:37.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.022807+0000","last_change":"2023-12-12T09:21:30.796056+0000","last_active":"2023-12-12T09:21:32.022807+0000","last_peered":"2023-12-12T09:21:32.022807+0000","last_clean":"2023-12-12T09:21:32.022807+0000","last_became_active":"2023-12-12T09:21:30.795289+0000","last_became_peered":"2023-12-12T09:21:30.795289+0000","last_unstale":"2023-12-12T09:21:32.022807+0000","last_undegraded":"2023-12-12T09:21:32.022807+0000","last_fullsized":"2023-12-12T09:21:32.022807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:59.089587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.768592+0000","last_change":"2023-12-12T09:21:29.765362+0000","last_active":"2023-12-12T09:21:30.768592+0000","last_peered":"2023-12-12T09:21:30.768592+0000","last_clean":"2023-12-12T09:21:30.768592+0000","last_became_active":"2023-12-12T09:21:29.765103+0000","last_became_peered":"2023-12-12T09:21:29.765103+0000","last_unstale":"2023-12-12T09:21:30.768592+0000","last_undegraded":"2023-12-12T09:21:30.768592+0000","last_fullsized":"2023-12-12T09:21:30.768592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:13:30.511314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021835+0000","last_change":"2023-12-12T09:21:30.807364+0000","last_active":"2023-12-12T09:21:32.021835+0000","last_peered":"2023-12-12T09:21:32.021835+0000","last_clean":"2023-12-12T09:21:32.021835+0000","last_became_active":"2023-12-12T09:21:30.807098+0000","last_became_peered":"2023-12-12T09:21:30.807098+0000","last_unstale":"2023-12-12T09:21:32.021835+0000","last_undegraded":"2023-12-12T09:21:32.021835+0000","last_fullsized":"2023-12-12T09:21:32.021835+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:38.101765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.782351+0000","last_change":"2023-12-12T09:21:29.768355+0000","last_active":"2023-12-12T09:21:30.782351+0000","last_peered":"2023-12-12T09:21:30.782351+0000","last_clean":"2023-12-12T09:21:30.782351+0000","last_became_active":"2023-12-12T09:21:29.768018+0000","last_became_peered":"2023-12-12T09:21:29.768018+0000","last_unstale":"2023-12-12T09:21:30.782351+0000","last_undegraded":"2023-12-12T09:21:30.782351+0000","last_fullsized":"2023-12-12T09:21:30.782351+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:41:05.505726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.023903+0000","last_change":"2023-12-12T09:21:30.798599+0000","last_active":"2023-12-12T09:21:32.023903+0000","last_peered":"2023-12-12T09:21:32.023903+0000","last_clean":"2023-12-12T09:21:32.023903+0000","last_became_active":"2023-12-12T09:21:30.798313+0000","last_became_peered":"2023-12-12T09:21:30.798313+0000","last_unstale":"2023-12-12T09:21:32.023903+0000","last_undegraded":"2023-12-12T09:21:32.023903+0000","last_fullsized":"2023-12-12T09:21:32.023903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:55.922461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.820401+0000","last_change":"2023-12-12T09:21:29.768295+0000","last_active":"2023-12-12T09:21:30.820401+0000","last_peered":"2023-12-12T09:21:30.820401+0000","last_clean":"2023-12-12T09:21:30.820401+0000","last_became_active":"2023-12-12T09:21:29.767583+0000","last_became_peered":"2023-12-12T09:21:29.767583+0000","last_unstale":"2023-12-12T09:21:30.820401+0000","last_undegraded":"2023-12-12T09:21:30.820401+0000","last_fullsized":"2023-12-12T09:21:30.820401+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:02.326740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.798764+0000","last_change":"2023-12-12T09:21:30.802074+0000","last_active":"2023-12-12T09:21:31.798764+0000","last_peered":"2023-12-12T09:21:31.798764+0000","last_clean":"2023-12-12T09:21:31.798764+0000","last_became_active":"2023-12-12T09:21:30.801410+0000","last_became_peered":"2023-12-12T09:21:30.801410+0000","last_unstale":"2023-12-12T09:21:31.798764+0000","last_undegraded":"2023-12-12T09:21:31.798764+0000","last_fullsized":"2023-12-12T09:21:31.798764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:04:42.474886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.823328+0000","last_change":"2023-12-12T09:21:29.766850+0000","last_active":"2023-12-12T09:21:30.823328+0000","last_peered":"2023-12-12T09:21:30.823328+0000","last_clean":"2023-12-12T09:21:30.823328+0000","last_became_active":"2023-12-12T09:21:29.766432+0000","last_became_peered":"2023-12-12T09:21:29.766432+0000","last_unstale":"2023-12-12T09:21:30.823328+0000","last_undegraded":"2023-12-12T09:21:30.823328+0000","last_fullsized":"2023-12-12T09:21:30.823328+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:59.389631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020485+0000","last_change":"2023-12-12T09:21:30.789001+0000","last_active":"2023-12-12T09:21:32.020485+0000","last_peered":"2023-12-12T09:21:32.020485+0000","last_clean":"2023-12-12T09:21:32.020485+0000","last_became_active":"2023-12-12T09:21:30.788615+0000","last_became_peered":"2023-12-12T09:21:30.788615+0000","last_unstale":"2023-12-12T09:21:32.020485+0000","last_undegraded":"2023-12-12T09:21:32.020485+0000","last_fullsized":"2023-12-12T09:21:32.020485+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:28:38.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.815302+0000","last_change":"2023-12-12T09:21:29.762250+0000","last_active":"2023-12-12T09:21:30.815302+0000","last_peered":"2023-12-12T09:21:30.815302+0000","last_clean":"2023-12-12T09:21:30.815302+0000","last_became_active":"2023-12-12T09:21:29.761642+0000","last_became_peered":"2023-12-12T09:21:29.761642+0000","last_unstale":"2023-12-12T09:21:30.815302+0000","last_undegraded":"2023-12-12T09:21:30.815302+0000","last_fullsized":"2023-12-12T09:21:30.815302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:42.662327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796045+0000","last_change":"2023-12-12T09:21:30.796156+0000","last_active":"2023-12-12T09:21:31.796045+0000","last_peered":"2023-12-12T09:21:31.796045+0000","last_clean":"2023-12-12T09:21:31.796045+0000","last_became_active":"2023-12-12T09:21:30.795875+0000","last_became_peered":"2023-12-12T09:21:30.795875+0000","last_unstale":"2023-12-12T09:21:31.796045+0000","last_undegraded":"2023-12-12T09:21:31.796045+0000","last_fullsized":"2023-12-12T09:21:31.796045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:30:03.665219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.789158+0000","last_change":"2023-12-12T09:21:29.763371+0000","last_active":"2023-12-12T09:21:30.789158+0000","last_peered":"2023-12-12T09:21:30.789158+0000","last_clean":"2023-12-12T09:21:30.789158+0000","last_became_active":"2023-12-12T09:21:29.763082+0000","last_became_peered":"2023-12-12T09:21:29.763082+0000","last_unstale":"2023-12-12T09:21:30.789158+0000","last_undegraded":"2023-12-12T09:21:30.789158+0000","last_fullsized":"2023-12-12T09:21:30.789158+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:35:40.682360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020774+0000","last_change":"2023-12-12T09:21:30.814615+0000","last_active":"2023-12-12T09:21:32.020774+0000","last_peered":"2023-12-12T09:21:32.020774+0000","last_clean":"2023-12-12T09:21:32.020774+0000","last_became_active":"2023-12-12T09:21:30.814299+0000","last_became_peered":"2023-12-12T09:21:30.814299+0000","last_unstale":"2023-12-12T09:21:32.020774+0000","last_undegraded":"2023-12-12T09:21:32.020774+0000","last_fullsized":"2023-12-12T09:21:32.020774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:03.332191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.799135+0000","last_change":"2023-12-12T09:21:29.753760+0000","last_active":"2023-12-12T09:21:30.799135+0000","last_peered":"2023-12-12T09:21:30.799135+0000","last_clean":"2023-12-12T09:21:30.799135+0000","last_became_active":"2023-12-12T09:21:29.753342+0000","last_became_peered":"2023-12-12T09:21:29.753342+0000","last_unstale":"2023-12-12T09:21:30.799135+0000","last_undegraded":"2023-12-12T09:21:30.799135+0000","last_fullsized":"2023-12-12T09:21:30.799135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796274+0000","last_change":"2023-12-12T09:21:30.797994+0000","last_active":"2023-12-12T09:21:31.796274+0000","last_peered":"2023-12-12T09:21:31.796274+0000","last_clean":"2023-12-12T09:21:31.796274+0000","last_became_active":"2023-12-12T09:21:30.797710+0000","last_became_peered":"2023-12-12T09:21:30.797710+0000","last_unstale":"2023-12-12T09:21:31.796274+0000","last_undegraded":"2023-12-12T09:21:31.796274+0000","last_fullsized":"2023-12-12T09:21:31.796274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:15.641549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.825985+0000","last_change":"2023-12-12T09:21:29.772645+0000","last_active":"2023-12-12T09:21:30.825985+0000","last_peered":"2023-12-12T09:21:30.825985+0000","last_clean":"2023-12-12T09:21:30.825985+0000","last_became_active":"2023-12-12T09:21:29.772381+0000","last_became_peered":"2023-12-12T09:21:29.772381+0000","last_unstale":"2023-12-12T09:21:30.825985+0000","last_undegraded":"2023-12-12T09:21:30.825985+0000","last_fullsized":"2023-12-12T09:21:30.825985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796227+0000","last_change":"2023-12-12T09:21:30.803729+0000","last_active":"2023-12-12T09:21:31.796227+0000","last_peered":"2023-12-12T09:21:31.796227+0000","last_clean":"2023-12-12T09:21:31.796227+0000","last_became_active":"2023-12-12T09:21:30.802986+0000","last_became_peered":"2023-12-12T09:21:30.802986+0000","last_unstale":"2023-12-12T09:21:31.796227+0000","last_undegraded":"2023-12-12T09:21:31.796227+0000","last_fullsized":"2023-12-12T09:21:31.796227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:48.670581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.815334+0000","last_change":"2023-12-12T09:21:29.768150+0000","last_active":"2023-12-12T09:21:30.815334+0000","last_peered":"2023-12-12T09:21:30.815334+0000","last_clean":"2023-12-12T09:21:30.815334+0000","last_became_active":"2023-12-12T09:21:29.767829+0000","last_became_peered":"2023-12-12T09:21:29.767829+0000","last_unstale":"2023-12-12T09:21:30.815334+0000","last_undegraded":"2023-12-12T09:21:30.815334+0000","last_fullsized":"2023-12-12T09:21:30.815334+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:54.917010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800528+0000","last_change":"2023-12-12T09:21:30.804720+0000","last_active":"2023-12-12T09:21:31.800528+0000","last_peered":"2023-12-12T09:21:31.800528+0000","last_clean":"2023-12-12T09:21:31.800528+0000","last_became_active":"2023-12-12T09:21:30.803118+0000","last_became_peered":"2023-12-12T09:21:30.803118+0000","last_unstale":"2023-12-12T09:21:31.800528+0000","last_undegraded":"2023-12-12T09:21:31.800528+0000","last_fullsized":"2023-12-12T09:21:31.800528+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:46:30.508385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.815913+0000","last_change":"2023-12-12T09:21:29.761367+0000","last_active":"2023-12-12T09:21:30.815913+0000","last_peered":"2023-12-12T09:21:30.815913+0000","last_clean":"2023-12-12T09:21:30.815913+0000","last_became_active":"2023-12-12T09:21:29.761014+0000","last_became_peered":"2023-12-12T09:21:29.761014+0000","last_unstale":"2023-12-12T09:21:30.815913+0000","last_undegraded":"2023-12-12T09:21:30.815913+0000","last_fullsized":"2023-12-12T09:21:30.815913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:13.209482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799561+0000","last_change":"2023-12-12T09:21:30.801314+0000","last_active":"2023-12-12T09:21:31.799561+0000","last_peered":"2023-12-12T09:21:31.799561+0000","last_clean":"2023-12-12T09:21:31.799561+0000","last_became_active":"2023-12-12T09:21:30.799223+0000","last_became_peered":"2023-12-12T09:21:30.799223+0000","last_unstale":"2023-12-12T09:21:31.799561+0000","last_undegraded":"2023-12-12T09:21:31.799561+0000","last_fullsized":"2023-12-12T09:21:31.799561+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:04.358938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.821081+0000","last_change":"2023-12-12T09:21:29.770091+0000","last_active":"2023-12-12T09:21:30.821081+0000","last_peered":"2023-12-12T09:21:30.821081+0000","last_clean":"2023-12-12T09:21:30.821081+0000","last_became_active":"2023-12-12T09:21:29.769239+0000","last_became_peered":"2023-12-12T09:21:29.769239+0000","last_unstale":"2023-12-12T09:21:30.821081+0000","last_undegraded":"2023-12-12T09:21:30.821081+0000","last_fullsized":"2023-12-12T09:21:30.821081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:33.554189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.023357+0000","last_change":"2023-12-12T09:21:30.807074+0000","last_active":"2023-12-12T09:21:32.023357+0000","last_peered":"2023-12-12T09:21:32.023357+0000","last_clean":"2023-12-12T09:21:32.023357+0000","last_became_active":"2023-12-12T09:21:30.806899+0000","last_became_peered":"2023-12-12T09:21:30.806899+0000","last_unstale":"2023-12-12T09:21:32.023357+0000","last_undegraded":"2023-12-12T09:21:32.023357+0000","last_fullsized":"2023-12-12T09:21:32.023357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:24.640139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.790964+0000","last_change":"2023-12-12T09:21:29.760344+0000","last_active":"2023-12-12T09:21:30.790964+0000","last_peered":"2023-12-12T09:21:30.790964+0000","last_clean":"2023-12-12T09:21:30.790964+0000","last_became_active":"2023-12-12T09:21:29.760057+0000","last_became_peered":"2023-12-12T09:21:29.760057+0000","last_unstale":"2023-12-12T09:21:30.790964+0000","last_undegraded":"2023-12-12T09:21:30.790964+0000","last_fullsized":"2023-12-12T09:21:30.790964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:16:00.915642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020334+0000","last_change":"2023-12-12T09:21:30.810071+0000","last_active":"2023-12-12T09:21:32.020334+0000","last_peered":"2023-12-12T09:21:32.020334+0000","last_clean":"2023-12-12T09:21:32.020334+0000","last_became_active":"2023-12-12T09:21:30.807984+0000","last_became_peered":"2023-12-12T09:21:30.807984+0000","last_unstale":"2023-12-12T09:21:32.020334+0000","last_undegraded":"2023-12-12T09:21:32.020334+0000","last_fullsized":"2023-12-12T09:21:32.020334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:28:38.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.820166+0000","last_change":"2023-12-12T09:21:29.756282+0000","last_active":"2023-12-12T09:21:30.820166+0000","last_peered":"2023-12-12T09:21:30.820166+0000","last_clean":"2023-12-12T09:21:30.820166+0000","last_became_active":"2023-12-12T09:21:29.755942+0000","last_became_peered":"2023-12-12T09:21:29.755942+0000","last_unstale":"2023-12-12T09:21:30.820166+0000","last_undegraded":"2023-12-12T09:21:30.820166+0000","last_fullsized":"2023-12-12T09:21:30.820166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:57:32.531602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021886+0000","last_change":"2023-12-12T09:21:30.801113+0000","last_active":"2023-12-12T09:21:32.021886+0000","last_peered":"2023-12-12T09:21:32.021886+0000","last_clean":"2023-12-12T09:21:32.021886+0000","last_became_active":"2023-12-12T09:21:30.800217+0000","last_became_peered":"2023-12-12T09:21:30.800217+0000","last_unstale":"2023-12-12T09:21:32.021886+0000","last_undegraded":"2023-12-12T09:21:32.021886+0000","last_fullsized":"2023-12-12T09:21:32.021886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:03.332191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.804834+0000","last_change":"2023-12-12T09:21:29.752853+0000","last_active":"2023-12-12T09:21:30.804834+0000","last_peered":"2023-12-12T09:21:30.804834+0000","last_clean":"2023-12-12T09:21:30.804834+0000","last_became_active":"2023-12-12T09:21:29.752575+0000","last_became_peered":"2023-12-12T09:21:29.752575+0000","last_unstale":"2023-12-12T09:21:30.804834+0000","last_undegraded":"2023-12-12T09:21:30.804834+0000","last_fullsized":"2023-12-12T09:21:30.804834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:10.745369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799142+0000","last_change":"2023-12-12T09:21:30.805203+0000","last_active":"2023-12-12T09:21:31.799142+0000","last_peered":"2023-12-12T09:21:31.799142+0000","last_clean":"2023-12-12T09:21:31.799142+0000","last_became_active":"2023-12-12T09:21:30.803653+0000","last_became_peered":"2023-12-12T09:21:30.803653+0000","last_unstale":"2023-12-12T09:21:31.799142+0000","last_undegraded":"2023-12-12T09:21:31.799142+0000","last_fullsized":"2023-12-12T09:21:31.799142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:04.358938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.792755+0000","last_change":"2023-12-12T09:21:29.772886+0000","last_active":"2023-12-12T09:21:30.792755+0000","last_peered":"2023-12-12T09:21:30.792755+0000","last_clean":"2023-12-12T09:21:30.792755+0000","last_became_active":"2023-12-12T09:21:29.772078+0000","last_became_peered":"2023-12-12T09:21:29.772078+0000","last_unstale":"2023-12-12T09:21:30.792755+0000","last_undegraded":"2023-12-12T09:21:30.792755+0000","last_fullsized":"2023-12-12T09:21:30.792755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:39.027967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796458+0000","last_change":"2023-12-12T09:21:30.804647+0000","last_active":"2023-12-12T09:21:31.796458+0000","last_peered":"2023-12-12T09:21:31.796458+0000","last_clean":"2023-12-12T09:21:31.796458+0000","last_became_active":"2023-12-12T09:21:30.803941+0000","last_became_peered":"2023-12-12T09:21:30.803941+0000","last_unstale":"2023-12-12T09:21:31.796458+0000","last_undegraded":"2023-12-12T09:21:31.796458+0000","last_fullsized":"2023-12-12T09:21:31.796458+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:59:09.599989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.800821+0000","last_change":"2023-12-12T09:21:29.746023+0000","last_active":"2023-12-12T09:21:30.800821+0000","last_peered":"2023-12-12T09:21:30.800821+0000","last_clean":"2023-12-12T09:21:30.800821+0000","last_became_active":"2023-12-12T09:21:29.745607+0000","last_became_peered":"2023-12-12T09:21:29.745607+0000","last_unstale":"2023-12-12T09:21:30.800821+0000","last_undegraded":"2023-12-12T09:21:30.800821+0000","last_fullsized":"2023-12-12T09:21:30.800821+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:52.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020945+0000","last_change":"2023-12-12T09:21:30.808827+0000","last_active":"2023-12-12T09:21:32.020945+0000","last_peered":"2023-12-12T09:21:32.020945+0000","last_clean":"2023-12-12T09:21:32.020945+0000","last_became_active":"2023-12-12T09:21:30.802896+0000","last_became_peered":"2023-12-12T09:21:30.802896+0000","last_unstale":"2023-12-12T09:21:32.020945+0000","last_undegraded":"2023-12-12T09:21:32.020945+0000","last_fullsized":"2023-12-12T09:21:32.020945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:14.214933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.817880+0000","last_change":"2023-12-12T09:21:29.767517+0000","last_active":"2023-12-12T09:21:30.817880+0000","last_peered":"2023-12-12T09:21:30.817880+0000","last_clean":"2023-12-12T09:21:30.817880+0000","last_became_active":"2023-12-12T09:21:29.767194+0000","last_became_peered":"2023-12-12T09:21:29.767194+0000","last_unstale":"2023-12-12T09:21:30.817880+0000","last_undegraded":"2023-12-12T09:21:30.817880+0000","last_fullsized":"2023-12-12T09:21:30.817880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:37.096313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021903+0000","last_change":"2023-12-12T09:21:30.818520+0000","last_active":"2023-12-12T09:21:32.021903+0000","last_peered":"2023-12-12T09:21:32.021903+0000","last_clean":"2023-12-12T09:21:32.021903+0000","last_became_active":"2023-12-12T09:21:30.818194+0000","last_became_peered":"2023-12-12T09:21:30.818194+0000","last_unstale":"2023-12-12T09:21:32.021903+0000","last_undegraded":"2023-12-12T09:21:32.021903+0000","last_fullsized":"2023-12-12T09:21:32.021903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:41:06.511178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.805250+0000","last_change":"2023-12-12T09:21:29.760226+0000","last_active":"2023-12-12T09:21:30.805250+0000","last_peered":"2023-12-12T09:21:30.805250+0000","last_clean":"2023-12-12T09:21:30.805250+0000","last_became_active":"2023-12-12T09:21:29.759388+0000","last_became_peered":"2023-12-12T09:21:29.759388+0000","last_unstale":"2023-12-12T09:21:30.805250+0000","last_undegraded":"2023-12-12T09:21:30.805250+0000","last_fullsized":"2023-12-12T09:21:30.805250+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:22:07.722696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796247+0000","last_change":"2023-12-12T09:21:30.783440+0000","last_active":"2023-12-12T09:21:31.796247+0000","last_peered":"2023-12-12T09:21:31.796247+0000","last_clean":"2023-12-12T09:21:31.796247+0000","last_became_active":"2023-12-12T09:21:30.782670+0000","last_became_peered":"2023-12-12T09:21:30.782670+0000","last_unstale":"2023-12-12T09:21:31.796247+0000","last_undegraded":"2023-12-12T09:21:31.796247+0000","last_fullsized":"2023-12-12T09:21:31.796247+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:06:26.988444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.779722+0000","last_change":"2023-12-12T09:21:29.765291+0000","last_active":"2023-12-12T09:21:30.779722+0000","last_peered":"2023-12-12T09:21:30.779722+0000","last_clean":"2023-12-12T09:21:30.779722+0000","last_became_active":"2023-12-12T09:21:29.764996+0000","last_became_peered":"2023-12-12T09:21:29.764996+0000","last_unstale":"2023-12-12T09:21:30.779722+0000","last_undegraded":"2023-12-12T09:21:30.779722+0000","last_fullsized":"2023-12-12T09:21:30.779722+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:35:40.682360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020881+0000","last_change":"2023-12-12T09:21:30.795364+0000","last_active":"2023-12-12T09:21:32.020881+0000","last_peered":"2023-12-12T09:21:32.020881+0000","last_clean":"2023-12-12T09:21:32.020881+0000","last_became_active":"2023-12-12T09:21:30.794975+0000","last_became_peered":"2023-12-12T09:21:30.794975+0000","last_unstale":"2023-12-12T09:21:32.020881+0000","last_undegraded":"2023-12-12T09:21:32.020881+0000","last_fullsized":"2023-12-12T09:21:32.020881+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:27.906245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.783942+0000","last_change":"2023-12-12T09:21:29.759411+0000","last_active":"2023-12-12T09:21:30.783942+0000","last_peered":"2023-12-12T09:21:30.783942+0000","last_clean":"2023-12-12T09:21:30.783942+0000","last_became_active":"2023-12-12T09:21:29.759110+0000","last_became_peered":"2023-12-12T09:21:29.759110+0000","last_unstale":"2023-12-12T09:21:30.783942+0000","last_undegraded":"2023-12-12T09:21:30.783942+0000","last_fullsized":"2023-12-12T09:21:30.783942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:55:42.118287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020078+0000","last_change":"2023-12-12T09:21:30.808929+0000","last_active":"2023-12-12T09:21:32.020078+0000","last_peered":"2023-12-12T09:21:32.020078+0000","last_clean":"2023-12-12T09:21:32.020078+0000","last_became_active":"2023-12-12T09:21:30.808584+0000","last_became_peered":"2023-12-12T09:21:30.808584+0000","last_unstale":"2023-12-12T09:21:32.020078+0000","last_undegraded":"2023-12-12T09:21:32.020078+0000","last_fullsized":"2023-12-12T09:21:32.020078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:27.906245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.797802+0000","last_change":"2023-12-12T09:21:29.764220+0000","last_active":"2023-12-12T09:21:30.797802+0000","last_peered":"2023-12-12T09:21:30.797802+0000","last_clean":"2023-12-12T09:21:30.797802+0000","last_became_active":"2023-12-12T09:21:29.763979+0000","last_became_peered":"2023-12-12T09:21:29.763979+0000","last_unstale":"2023-12-12T09:21:30.797802+0000","last_undegraded":"2023-12-12T09:21:30.797802+0000","last_fullsized":"2023-12-12T09:21:30.797802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.797840+0000","last_change":"2023-12-12T09:21:30.789488+0000","last_active":"2023-12-12T09:21:31.797840+0000","last_peered":"2023-12-12T09:21:31.797840+0000","last_clean":"2023-12-12T09:21:31.797840+0000","last_became_active":"2023-12-12T09:21:30.788911+0000","last_became_peered":"2023-12-12T09:21:30.788911+0000","last_unstale":"2023-12-12T09:21:31.797840+0000","last_undegraded":"2023-12-12T09:21:31.797840+0000","last_fullsized":"2023-12-12T09:21:31.797840+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:38.101765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.774160+0000","last_change":"2023-12-12T09:21:29.759573+0000","last_active":"2023-12-12T09:21:30.774160+0000","last_peered":"2023-12-12T09:21:30.774160+0000","last_clean":"2023-12-12T09:21:30.774160+0000","last_became_active":"2023-12-12T09:21:29.757748+0000","last_became_peered":"2023-12-12T09:21:29.757748+0000","last_unstale":"2023-12-12T09:21:30.774160+0000","last_undegraded":"2023-12-12T09:21:30.774160+0000","last_fullsized":"2023-12-12T09:21:30.774160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:26.900793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021689+0000","last_change":"2023-12-12T09:21:30.812979+0000","last_active":"2023-12-12T09:21:32.021689+0000","last_peered":"2023-12-12T09:21:32.021689+0000","last_clean":"2023-12-12T09:21:32.021689+0000","last_became_active":"2023-12-12T09:21:30.808337+0000","last_became_peered":"2023-12-12T09:21:30.808337+0000","last_unstale":"2023-12-12T09:21:32.021689+0000","last_undegraded":"2023-12-12T09:21:32.021689+0000","last_fullsized":"2023-12-12T09:21:32.021689+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:50:57.392678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.765556+0000","last_change":"2023-12-12T09:21:29.760420+0000","last_active":"2023-12-12T09:21:30.765556+0000","last_peered":"2023-12-12T09:21:30.765556+0000","last_clean":"2023-12-12T09:21:30.765556+0000","last_became_active":"2023-12-12T09:21:29.760160+0000","last_became_peered":"2023-12-12T09:21:29.760160+0000","last_unstale":"2023-12-12T09:21:30.765556+0000","last_undegraded":"2023-12-12T09:21:30.765556+0000","last_fullsized":"2023-12-12T09:21:30.765556+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:58:17.563159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800299+0000","last_change":"2023-12-12T09:21:30.797506+0000","last_active":"2023-12-12T09:21:31.800299+0000","last_peered":"2023-12-12T09:21:31.800299+0000","last_clean":"2023-12-12T09:21:31.800299+0000","last_became_active":"2023-12-12T09:21:30.796680+0000","last_became_peered":"2023-12-12T09:21:30.796680+0000","last_unstale":"2023-12-12T09:21:31.800299+0000","last_undegraded":"2023-12-12T09:21:31.800299+0000","last_fullsized":"2023-12-12T09:21:31.800299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:01.254285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.796187+0000","last_change":"2023-12-12T09:21:29.773445+0000","last_active":"2023-12-12T09:21:30.796187+0000","last_peered":"2023-12-12T09:21:30.796187+0000","last_clean":"2023-12-12T09:21:30.796187+0000","last_became_active":"2023-12-12T09:21:29.773170+0000","last_became_peered":"2023-12-12T09:21:29.773170+0000","last_unstale":"2023-12-12T09:21:30.796187+0000","last_undegraded":"2023-12-12T09:21:30.796187+0000","last_fullsized":"2023-12-12T09:21:30.796187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:35:40.682360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.790132+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:21:30.790132+0000","last_peered":"2023-12-12T09:21:30.790132+0000","last_clean":"2023-12-12T09:21:30.790132+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:21:30.790132+0000","last_undegraded":"2023-12-12T09:21:30.790132+0000","last_fullsized":"2023-12-12T09:21:30.790132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1081344,"data_stored":796537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.028}]},{"osd":1,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.143},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.554}]},{"osd":2,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.747}]},{"osd":3,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.2930000000000001,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.645}]},{"osd":5,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.242}]},{"osd":6,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.5980000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":205069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.878}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.425},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.98899999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.202},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.5860000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1020000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.718},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.5529999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.294},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.776}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.492},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.514}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":204599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.83999999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.91100000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.319},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.0660000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.012},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.73}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.115},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.379}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.47},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.4390000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.242},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.6479999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":205091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.22},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.98999999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.155},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.91000000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.4650000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.425}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.272},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.0720000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.575},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.556}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.524},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.649}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":206133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.44},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.58799999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.622},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.026}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.85299999999999998}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.88800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":204557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.0289999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.2929999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.3200000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.256},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.4850000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.21,"5min":2.21,"15min":2.21},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.409}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.571},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.194}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.343}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":204577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.70699999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.613},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.2330000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.891},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.4710000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.411}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.5389999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":2.2229999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.7150000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":2.0830000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1069056,"data_stored":794889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84799999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.153}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.032},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.7410000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.2230000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.98299999999999998}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.341}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:21:40.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:21:40.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.399+0000 7fe1f2809640 1 Processor -- start 2023-12-12T09:21:40.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.399+0000 7fe1f2809640 1 -- start start 2023-12-12T09:21:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.401+0000 7fe1f2809640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe1ec160940 0x7fe1ec0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.401+0000 7fe1f2809640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1ec0d37c0 0x7fe1ec0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.401+0000 7fe1f2809640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ec0d3fd0 con 0x7fe1ec0d1f40 2023-12-12T09:21:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.401+0000 7fe1f2809640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec0cdc80 con 0x7fe1ec0d37c0 2023-12-12T09:21:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.401+0000 7fe1f2809640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ec0d3cf0 con 0x7fe1ec160940 2023-12-12T09:21:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.401+0000 7fe1f0da6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1ec0d37c0 0x7fe1ec0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.401+0000 7fe1f0da6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1ec0d37c0 0x7fe1ec0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54796/0 (socket says 172.21.15.84:54796) 2023-12-12T09:21:40.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.401+0000 7fe1f0da6640 1 -- 172.21.15.84:0/2410542691 learned_addr learned my addr 172.21.15.84:0/2410542691 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.402+0000 7fe1ebfff640 1 --2- 172.21.15.84:0/2410542691 >> v2:172.21.15.99:3300/0 conn(0x7fe1ec160940 0x7fe1ec0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.402+0000 7fe1f0da6640 1 -- 172.21.15.84:0/2410542691 >> v2:172.21.15.99:3300/0 conn(0x7fe1ec160940 msgr2=0x7fe1ec0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.402+0000 7fe1f0da6640 1 --2- 172.21.15.84:0/2410542691 >> v2:172.21.15.99:3300/0 conn(0x7fe1ec160940 0x7fe1ec0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.402+0000 7fe1f0da6640 1 -- 172.21.15.84:0/2410542691 >> v1:172.21.15.99:6789/0 conn(0x7fe1ec0d1f40 legacy=0x7fe1ec0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.402+0000 7fe1f0da6640 1 -- 172.21.15.84:0/2410542691 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0cdf20 con 0x7fe1ec0d37c0 2023-12-12T09:21:40.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.403+0000 7fe1f0da6640 1 --2- 172.21.15.84:0/2410542691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec0d37c0 0x7fe1ec0cea00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec08d860 tx=0x7fe1e402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8dc75b4c002707 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:40.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.403+0000 7fe1eb7fe640 1 -- 172.21.15.84:0/2410542691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e402ca80 con 0x7fe1ec0d37c0 2023-12-12T09:21:40.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.403+0000 7fe1eb7fe640 1 -- 172.21.15.84:0/2410542691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e402cbe0 con 0x7fe1ec0d37c0 2023-12-12T09:21:40.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.403+0000 7fe1eb7fe640 1 -- 172.21.15.84:0/2410542691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40343f0 con 0x7fe1ec0d37c0 2023-12-12T09:21:40.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.404+0000 7fe1f2809640 1 -- 172.21.15.84:0/2410542691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec0d37c0 msgr2=0x7fe1ec0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.404+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2410542691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec0d37c0 0x7fe1ec0cea00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec08d860 tx=0x7fe1e402bee0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.404+0000 7fe1f2809640 1 -- 172.21.15.84:0/2410542691 shutdown_connections 2023-12-12T09:21:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.404+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2410542691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec0d37c0 0x7fe1ec0cea00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.404+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2410542691 >> v2:172.21.15.99:3300/0 conn(0x7fe1ec160940 0x7fe1ec0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.404+0000 7fe1f2809640 1 -- 172.21.15.84:0/2410542691 >> 172.21.15.84:0/2410542691 conn(0x7fe1ec09c3e0 msgr2=0x7fe1ec0d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.404+0000 7fe1f2809640 1 -- 172.21.15.84:0/2410542691 shutdown_connections 2023-12-12T09:21:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.404+0000 7fe1f2809640 1 -- 172.21.15.84:0/2410542691 wait complete. 2023-12-12T09:21:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.406+0000 7fe1f2809640 1 Processor -- start 2023-12-12T09:21:40.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.406+0000 7fe1f2809640 1 -- start start 2023-12-12T09:21:40.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f2809640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1ec0d1f40 0x7fe1ec159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f2809640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1ec0d37c0 0x7fe1ec15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f2809640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec160940 0x7fe1ec0cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f2809640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0b6060 con 0x7fe1ec160940 2023-12-12T09:21:40.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f2809640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0cbb00 con 0x7fe1ec0d37c0 2023-12-12T09:21:40.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f2809640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0cbde0 con 0x7fe1ec0d1f40 2023-12-12T09:21:40.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f0da6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec160940 0x7fe1ec0cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f0da6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec160940 0x7fe1ec0cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54802/0 (socket says 172.21.15.84:54802) 2023-12-12T09:21:40.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.407+0000 7fe1f0da6640 1 -- 172.21.15.84:0/2548476360 learned_addr learned my addr 172.21.15.84:0/2548476360 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:40.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1f0da6640 1 -- 172.21.15.84:0/2548476360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1ec0d1f40 msgr2=0x7fe1ec159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:40.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1ebfff640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1ec0d1f40 0x7fe1ec159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1e3fff640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1ec0d37c0 0x7fe1ec15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1f0da6640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1ec0d1f40 0x7fe1ec159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1f0da6640 1 -- 172.21.15.84:0/2548476360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1ec0d37c0 msgr2=0x7fe1ec15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1f0da6640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1ec0d37c0 0x7fe1ec15b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1f0da6640 1 -- 172.21.15.84:0/2548476360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4009b30 con 0x7fe1ec160940 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1f0da6640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec160940 0x7fe1ec0cb1d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4036040 tx=0x7fe1e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1e97fa640 1 -- 172.21.15.84:0/2548476360 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4009510 con 0x7fe1ec160940 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1e97fa640 1 -- 172.21.15.84:0/2548476360 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e403e450 con 0x7fe1ec160940 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec0cc0c0 con 0x7fe1ec160940 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1e97fa640 1 -- 172.21.15.84:0/2548476360 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e403e7e0 con 0x7fe1ec160940 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.408+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec15bc30 con 0x7fe1ec160940 2023-12-12T09:21:40.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.409+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec072b80 con 0x7fe1ec160940 2023-12-12T09:21:40.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.410+0000 7fe1e97fa640 1 -- 172.21.15.84:0/2548476360 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1e402cd50 con 0x7fe1ec160940 2023-12-12T09:21:40.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.411+0000 7fe1e97fa640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1cc06ae40 0x7fe1cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.411+0000 7fe1e97fa640 1 -- 172.21.15.84:0/2548476360 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe1e40ac2f0 con 0x7fe1ec160940 2023-12-12T09:21:40.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.412+0000 7fe1ebfff640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1cc06ae40 0x7fe1cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.412+0000 7fe1ebfff640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1cc06ae40 0x7fe1cc06d300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc006fd0 tx=0x7fe1dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:40.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.416+0000 7fe1e97fa640 1 -- 172.21.15.84:0/2548476360 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1e40772e0 con 0x7fe1ec160940 2023-12-12T09:21:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.600+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1ec0ce4e0 con 0x7fe1cc06ae40 2023-12-12T09:21:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.623+0000 7fe1e97fa640 1 -- 172.21.15.84:0/2548476360 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286856 (secure 0 0 0) 0x7fe1dc00e4b0 con 0x7fe1cc06ae40 2023-12-12T09:21:40.627 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:40.629 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:21:40.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1cc06ae40 msgr2=0x7fe1cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:40.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1cc06ae40 0x7fe1cc06d300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc006fd0 tx=0x7fe1dc008040 comp rx=0 tx=0).stop 2023-12-12T09:21:40.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec160940 msgr2=0x7fe1ec0cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:40.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec160940 0x7fe1ec0cb1d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4036040 tx=0x7fe1e4004a40 comp rx=0 tx=0).stop 2023-12-12T09:21:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 shutdown_connections 2023-12-12T09:21:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe1cc06ae40 0x7fe1cc06d300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1ec160940 0x7fe1ec0cb1d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1ec0d37c0 0x7fe1ec15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 --2- 172.21.15.84:0/2548476360 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1ec0d1f40 0x7fe1ec159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 >> 172.21.15.84:0/2548476360 conn(0x7fe1ec09c3e0 msgr2=0x7fe1ec0b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 shutdown_connections 2023-12-12T09:21:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.629+0000 7fe1f2809640 1 -- 172.21.15.84:0/2548476360 wait complete. 2023-12-12T09:21:40.648 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-12-12T09:21:39.113577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221124,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753596,"statfs":{"total":773094113280,"available":772867682304,"internally_reserved":0,"allocated":5021696,"data_stored":2821452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.351612"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796548+0000","last_change":"2023-12-12T09:21:30.800930+0000","last_active":"2023-12-12T09:21:31.796548+0000","last_peered":"2023-12-12T09:21:31.796548+0000","last_clean":"2023-12-12T09:21:31.796548+0000","last_became_active":"2023-12-12T09:21:30.800640+0000","last_became_peered":"2023-12-12T09:21:30.800640+0000","last_unstale":"2023-12-12T09:21:31.796548+0000","last_undegraded":"2023-12-12T09:21:31.796548+0000","last_fullsized":"2023-12-12T09:21:31.796548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:16:27.476172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796132+0000","last_change":"2023-12-12T09:21:30.807237+0000","last_active":"2023-12-12T09:21:31.796132+0000","last_peered":"2023-12-12T09:21:31.796132+0000","last_clean":"2023-12-12T09:21:31.796132+0000","last_became_active":"2023-12-12T09:21:30.806945+0000","last_became_peered":"2023-12-12T09:21:30.806945+0000","last_unstale":"2023-12-12T09:21:31.796132+0000","last_undegraded":"2023-12-12T09:21:31.796132+0000","last_fullsized":"2023-12-12T09:21:31.796132+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:19:40.895801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.023123+0000","last_change":"2023-12-12T09:21:30.802742+0000","last_active":"2023-12-12T09:21:32.023123+0000","last_peered":"2023-12-12T09:21:32.023123+0000","last_clean":"2023-12-12T09:21:32.023123+0000","last_became_active":"2023-12-12T09:21:30.801597+0000","last_became_peered":"2023-12-12T09:21:30.801597+0000","last_unstale":"2023-12-12T09:21:32.023123+0000","last_undegraded":"2023-12-12T09:21:32.023123+0000","last_fullsized":"2023-12-12T09:21:32.023123+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:50:57.392678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.022362+0000","last_change":"2023-12-12T09:21:30.799058+0000","last_active":"2023-12-12T09:21:32.022362+0000","last_peered":"2023-12-12T09:21:32.022362+0000","last_clean":"2023-12-12T09:21:32.022362+0000","last_became_active":"2023-12-12T09:21:30.798646+0000","last_became_peered":"2023-12-12T09:21:30.798646+0000","last_unstale":"2023-12-12T09:21:32.022362+0000","last_undegraded":"2023-12-12T09:21:32.022362+0000","last_fullsized":"2023-12-12T09:21:32.022362+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:44.724124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020348+0000","last_change":"2023-12-12T09:21:30.795732+0000","last_active":"2023-12-12T09:21:32.020348+0000","last_peered":"2023-12-12T09:21:32.020348+0000","last_clean":"2023-12-12T09:21:32.020348+0000","last_became_active":"2023-12-12T09:21:30.795436+0000","last_became_peered":"2023-12-12T09:21:30.795436+0000","last_unstale":"2023-12-12T09:21:32.020348+0000","last_undegraded":"2023-12-12T09:21:32.020348+0000","last_fullsized":"2023-12-12T09:21:32.020348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:15.157523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020494+0000","last_change":"2023-12-12T09:21:30.799163+0000","last_active":"2023-12-12T09:21:32.020494+0000","last_peered":"2023-12-12T09:21:32.020494+0000","last_clean":"2023-12-12T09:21:32.020494+0000","last_became_active":"2023-12-12T09:21:30.796554+0000","last_became_peered":"2023-12-12T09:21:30.796554+0000","last_unstale":"2023-12-12T09:21:32.020494+0000","last_undegraded":"2023-12-12T09:21:32.020494+0000","last_fullsized":"2023-12-12T09:21:32.020494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:03.332191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799061+0000","last_change":"2023-12-12T09:21:30.796498+0000","last_active":"2023-12-12T09:21:31.799061+0000","last_peered":"2023-12-12T09:21:31.799061+0000","last_clean":"2023-12-12T09:21:31.799061+0000","last_became_active":"2023-12-12T09:21:30.795797+0000","last_became_peered":"2023-12-12T09:21:30.795797+0000","last_unstale":"2023-12-12T09:21:31.799061+0000","last_undegraded":"2023-12-12T09:21:31.799061+0000","last_fullsized":"2023-12-12T09:21:31.799061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:06:52.602829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.795870+0000","last_change":"2023-12-12T09:21:30.784650+0000","last_active":"2023-12-12T09:21:31.795870+0000","last_peered":"2023-12-12T09:21:31.795870+0000","last_clean":"2023-12-12T09:21:31.795870+0000","last_became_active":"2023-12-12T09:21:30.783980+0000","last_became_peered":"2023-12-12T09:21:30.783980+0000","last_unstale":"2023-12-12T09:21:31.795870+0000","last_undegraded":"2023-12-12T09:21:31.795870+0000","last_fullsized":"2023-12-12T09:21:31.795870+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:01:04.169649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.024010+0000","last_change":"2023-12-12T09:21:30.803440+0000","last_active":"2023-12-12T09:21:32.024010+0000","last_peered":"2023-12-12T09:21:32.024010+0000","last_clean":"2023-12-12T09:21:32.024010+0000","last_became_active":"2023-12-12T09:21:30.803178+0000","last_became_peered":"2023-12-12T09:21:30.803178+0000","last_unstale":"2023-12-12T09:21:32.024010+0000","last_undegraded":"2023-12-12T09:21:32.024010+0000","last_fullsized":"2023-12-12T09:21:32.024010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:38.101765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800989+0000","last_change":"2023-12-12T09:21:30.806040+0000","last_active":"2023-12-12T09:21:31.800989+0000","last_peered":"2023-12-12T09:21:31.800989+0000","last_clean":"2023-12-12T09:21:31.800989+0000","last_became_active":"2023-12-12T09:21:30.805765+0000","last_became_peered":"2023-12-12T09:21:30.805765+0000","last_unstale":"2023-12-12T09:21:31.800989+0000","last_undegraded":"2023-12-12T09:21:31.800989+0000","last_fullsized":"2023-12-12T09:21:31.800989+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:49:10.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800328+0000","last_change":"2023-12-12T09:21:30.794833+0000","last_active":"2023-12-12T09:21:31.800328+0000","last_peered":"2023-12-12T09:21:31.800328+0000","last_clean":"2023-12-12T09:21:31.800328+0000","last_became_active":"2023-12-12T09:21:30.794315+0000","last_became_peered":"2023-12-12T09:21:30.794315+0000","last_unstale":"2023-12-12T09:21:31.800328+0000","last_undegraded":"2023-12-12T09:21:31.800328+0000","last_fullsized":"2023-12-12T09:21:31.800328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:06:40.973147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.022594+0000","last_change":"2023-12-12T09:21:30.800264+0000","last_active":"2023-12-12T09:21:32.022594+0000","last_peered":"2023-12-12T09:21:32.022594+0000","last_clean":"2023-12-12T09:21:32.022594+0000","last_became_active":"2023-12-12T09:21:30.799970+0000","last_became_peered":"2023-12-12T09:21:30.799970+0000","last_unstale":"2023-12-12T09:21:32.022594+0000","last_undegraded":"2023-12-12T09:21:32.022594+0000","last_fullsized":"2023-12-12T09:21:32.022594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:14.214933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799863+0000","last_change":"2023-12-12T09:21:30.807731+0000","last_active":"2023-12-12T09:21:31.799863+0000","last_peered":"2023-12-12T09:21:31.799863+0000","last_clean":"2023-12-12T09:21:31.799863+0000","last_became_active":"2023-12-12T09:21:30.806312+0000","last_became_peered":"2023-12-12T09:21:30.806312+0000","last_unstale":"2023-12-12T09:21:31.799863+0000","last_undegraded":"2023-12-12T09:21:31.799863+0000","last_fullsized":"2023-12-12T09:21:31.799863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:36:46.387119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.797551+0000","last_change":"2023-12-12T09:21:30.802698+0000","last_active":"2023-12-12T09:21:31.797551+0000","last_peered":"2023-12-12T09:21:31.797551+0000","last_clean":"2023-12-12T09:21:31.797551+0000","last_became_active":"2023-12-12T09:21:30.802422+0000","last_became_peered":"2023-12-12T09:21:30.802422+0000","last_unstale":"2023-12-12T09:21:31.797551+0000","last_undegraded":"2023-12-12T09:21:31.797551+0000","last_fullsized":"2023-12-12T09:21:31.797551+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:55.922461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799398+0000","last_change":"2023-12-12T09:21:30.801101+0000","last_active":"2023-12-12T09:21:31.799398+0000","last_peered":"2023-12-12T09:21:31.799398+0000","last_clean":"2023-12-12T09:21:31.799398+0000","last_became_active":"2023-12-12T09:21:30.800750+0000","last_became_peered":"2023-12-12T09:21:30.800750+0000","last_unstale":"2023-12-12T09:21:31.799398+0000","last_undegraded":"2023-12-12T09:21:31.799398+0000","last_fullsized":"2023-12-12T09:21:31.799398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:15:06.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.019991+0000","last_change":"2023-12-12T09:21:30.801963+0000","last_active":"2023-12-12T09:21:32.019991+0000","last_peered":"2023-12-12T09:21:32.019991+0000","last_clean":"2023-12-12T09:21:32.019991+0000","last_became_active":"2023-12-12T09:21:30.801696+0000","last_became_peered":"2023-12-12T09:21:30.801696+0000","last_unstale":"2023-12-12T09:21:32.019991+0000","last_undegraded":"2023-12-12T09:21:32.019991+0000","last_fullsized":"2023-12-12T09:21:32.019991+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:16:01.921093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.022640+0000","last_change":"2023-12-12T09:21:30.807713+0000","last_active":"2023-12-12T09:21:32.022640+0000","last_peered":"2023-12-12T09:21:32.022640+0000","last_clean":"2023-12-12T09:21:32.022640+0000","last_became_active":"2023-12-12T09:21:30.805906+0000","last_became_peered":"2023-12-12T09:21:30.805906+0000","last_unstale":"2023-12-12T09:21:32.022640+0000","last_undegraded":"2023-12-12T09:21:32.022640+0000","last_fullsized":"2023-12-12T09:21:32.022640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:04:42.474886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021237+0000","last_change":"2023-12-12T09:21:30.800242+0000","last_active":"2023-12-12T09:21:32.021237+0000","last_peered":"2023-12-12T09:21:32.021237+0000","last_clean":"2023-12-12T09:21:32.021237+0000","last_became_active":"2023-12-12T09:21:30.799689+0000","last_became_peered":"2023-12-12T09:21:30.799689+0000","last_unstale":"2023-12-12T09:21:32.021237+0000","last_undegraded":"2023-12-12T09:21:32.021237+0000","last_fullsized":"2023-12-12T09:21:32.021237+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:20.670375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.023206+0000","last_change":"2023-12-12T09:21:30.815970+0000","last_active":"2023-12-12T09:21:32.023206+0000","last_peered":"2023-12-12T09:21:32.023206+0000","last_clean":"2023-12-12T09:21:32.023206+0000","last_became_active":"2023-12-12T09:21:30.814903+0000","last_became_peered":"2023-12-12T09:21:30.814903+0000","last_unstale":"2023-12-12T09:21:32.023206+0000","last_undegraded":"2023-12-12T09:21:32.023206+0000","last_fullsized":"2023-12-12T09:21:32.023206+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:33.565640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020892+0000","last_change":"2023-12-12T09:21:30.802821+0000","last_active":"2023-12-12T09:21:32.020892+0000","last_peered":"2023-12-12T09:21:32.020892+0000","last_clean":"2023-12-12T09:21:32.020892+0000","last_became_active":"2023-12-12T09:21:30.802551+0000","last_became_peered":"2023-12-12T09:21:30.802551+0000","last_unstale":"2023-12-12T09:21:32.020892+0000","last_undegraded":"2023-12-12T09:21:32.020892+0000","last_fullsized":"2023-12-12T09:21:32.020892+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:11:12.489157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800014+0000","last_change":"2023-12-12T09:21:30.805916+0000","last_active":"2023-12-12T09:21:31.800014+0000","last_peered":"2023-12-12T09:21:31.800014+0000","last_clean":"2023-12-12T09:21:31.800014+0000","last_became_active":"2023-12-12T09:21:30.802075+0000","last_became_peered":"2023-12-12T09:21:30.802075+0000","last_unstale":"2023-12-12T09:21:31.800014+0000","last_undegraded":"2023-12-12T09:21:31.800014+0000","last_fullsized":"2023-12-12T09:21:31.800014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:15:45.073501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799254+0000","last_change":"2023-12-12T09:21:30.804890+0000","last_active":"2023-12-12T09:21:31.799254+0000","last_peered":"2023-12-12T09:21:31.799254+0000","last_clean":"2023-12-12T09:21:31.799254+0000","last_became_active":"2023-12-12T09:21:30.804622+0000","last_became_peered":"2023-12-12T09:21:30.804622+0000","last_unstale":"2023-12-12T09:21:31.799254+0000","last_undegraded":"2023-12-12T09:21:31.799254+0000","last_fullsized":"2023-12-12T09:21:31.799254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:06:52.602829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020612+0000","last_change":"2023-12-12T09:21:30.818591+0000","last_active":"2023-12-12T09:21:32.020612+0000","last_peered":"2023-12-12T09:21:32.020612+0000","last_clean":"2023-12-12T09:21:32.020612+0000","last_became_active":"2023-12-12T09:21:30.816866+0000","last_became_peered":"2023-12-12T09:21:30.816866+0000","last_unstale":"2023-12-12T09:21:32.020612+0000","last_undegraded":"2023-12-12T09:21:32.020612+0000","last_fullsized":"2023-12-12T09:21:32.020612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:14.214933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020127+0000","last_change":"2023-12-12T09:21:30.806981+0000","last_active":"2023-12-12T09:21:32.020127+0000","last_peered":"2023-12-12T09:21:32.020127+0000","last_clean":"2023-12-12T09:21:32.020127+0000","last_became_active":"2023-12-12T09:21:30.806666+0000","last_became_peered":"2023-12-12T09:21:30.806666+0000","last_unstale":"2023-12-12T09:21:32.020127+0000","last_undegraded":"2023-12-12T09:21:32.020127+0000","last_fullsized":"2023-12-12T09:21:32.020127+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:51:24.308647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021225+0000","last_change":"2023-12-12T09:21:30.803962+0000","last_active":"2023-12-12T09:21:32.021225+0000","last_peered":"2023-12-12T09:21:32.021225+0000","last_clean":"2023-12-12T09:21:32.021225+0000","last_became_active":"2023-12-12T09:21:30.803308+0000","last_became_peered":"2023-12-12T09:21:30.803308+0000","last_unstale":"2023-12-12T09:21:32.021225+0000","last_undegraded":"2023-12-12T09:21:32.021225+0000","last_fullsized":"2023-12-12T09:21:32.021225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:40.033419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021411+0000","last_change":"2023-12-12T09:21:30.800148+0000","last_active":"2023-12-12T09:21:32.021411+0000","last_peered":"2023-12-12T09:21:32.021411+0000","last_clean":"2023-12-12T09:21:32.021411+0000","last_became_active":"2023-12-12T09:21:30.799270+0000","last_became_peered":"2023-12-12T09:21:30.799270+0000","last_unstale":"2023-12-12T09:21:32.021411+0000","last_undegraded":"2023-12-12T09:21:32.021411+0000","last_fullsized":"2023-12-12T09:21:32.021411+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:55.922461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021244+0000","last_change":"2023-12-12T09:21:30.812096+0000","last_active":"2023-12-12T09:21:32.021244+0000","last_peered":"2023-12-12T09:21:32.021244+0000","last_clean":"2023-12-12T09:21:32.021244+0000","last_became_active":"2023-12-12T09:21:30.811814+0000","last_became_peered":"2023-12-12T09:21:30.811814+0000","last_unstale":"2023-12-12T09:21:32.021244+0000","last_undegraded":"2023-12-12T09:21:32.021244+0000","last_fullsized":"2023-12-12T09:21:32.021244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:25:28.836792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800550+0000","last_change":"2023-12-12T09:21:30.795498+0000","last_active":"2023-12-12T09:21:31.800550+0000","last_peered":"2023-12-12T09:21:31.800550+0000","last_clean":"2023-12-12T09:21:31.800550+0000","last_became_active":"2023-12-12T09:21:30.795202+0000","last_became_peered":"2023-12-12T09:21:30.795202+0000","last_unstale":"2023-12-12T09:21:31.800550+0000","last_undegraded":"2023-12-12T09:21:31.800550+0000","last_fullsized":"2023-12-12T09:21:31.800550+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:31:16.255769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020304+0000","last_change":"2023-12-12T09:21:30.805829+0000","last_active":"2023-12-12T09:21:32.020304+0000","last_peered":"2023-12-12T09:21:32.020304+0000","last_clean":"2023-12-12T09:21:32.020304+0000","last_became_active":"2023-12-12T09:21:30.803723+0000","last_became_peered":"2023-12-12T09:21:30.803723+0000","last_unstale":"2023-12-12T09:21:32.020304+0000","last_undegraded":"2023-12-12T09:21:32.020304+0000","last_fullsized":"2023-12-12T09:21:32.020304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:24.640139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.019971+0000","last_change":"2023-12-12T09:21:30.802686+0000","last_active":"2023-12-12T09:21:32.019971+0000","last_peered":"2023-12-12T09:21:32.019971+0000","last_clean":"2023-12-12T09:21:32.019971+0000","last_became_active":"2023-12-12T09:21:30.802400+0000","last_became_peered":"2023-12-12T09:21:30.802400+0000","last_unstale":"2023-12-12T09:21:32.019971+0000","last_undegraded":"2023-12-12T09:21:32.019971+0000","last_fullsized":"2023-12-12T09:21:32.019971+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:33.565640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020646+0000","last_change":"2023-12-12T09:21:30.818600+0000","last_active":"2023-12-12T09:21:32.020646+0000","last_peered":"2023-12-12T09:21:32.020646+0000","last_clean":"2023-12-12T09:21:32.020646+0000","last_became_active":"2023-12-12T09:21:30.817249+0000","last_became_peered":"2023-12-12T09:21:30.817249+0000","last_unstale":"2023-12-12T09:21:32.020646+0000","last_undegraded":"2023-12-12T09:21:32.020646+0000","last_fullsized":"2023-12-12T09:21:32.020646+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:27.906245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.019975+0000","last_change":"2023-12-12T09:21:30.807756+0000","last_active":"2023-12-12T09:21:32.019975+0000","last_peered":"2023-12-12T09:21:32.019975+0000","last_clean":"2023-12-12T09:21:32.019975+0000","last_became_active":"2023-12-12T09:21:30.807385+0000","last_became_peered":"2023-12-12T09:21:30.807385+0000","last_unstale":"2023-12-12T09:21:32.019975+0000","last_undegraded":"2023-12-12T09:21:32.019975+0000","last_fullsized":"2023-12-12T09:21:32.019975+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:28:38.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021732+0000","last_change":"2023-12-12T09:21:30.816865+0000","last_active":"2023-12-12T09:21:32.021732+0000","last_peered":"2023-12-12T09:21:32.021732+0000","last_clean":"2023-12-12T09:21:32.021732+0000","last_became_active":"2023-12-12T09:21:30.815052+0000","last_became_peered":"2023-12-12T09:21:30.815052+0000","last_unstale":"2023-12-12T09:21:32.021732+0000","last_undegraded":"2023-12-12T09:21:32.021732+0000","last_fullsized":"2023-12-12T09:21:32.021732+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:55.922461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.814658+0000","last_change":"2023-12-12T09:21:29.759176+0000","last_active":"2023-12-12T09:21:30.814658+0000","last_peered":"2023-12-12T09:21:30.814658+0000","last_clean":"2023-12-12T09:21:30.814658+0000","last_became_active":"2023-12-12T09:21:29.758919+0000","last_became_peered":"2023-12-12T09:21:29.758919+0000","last_unstale":"2023-12-12T09:21:30.814658+0000","last_undegraded":"2023-12-12T09:21:30.814658+0000","last_fullsized":"2023-12-12T09:21:30.814658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021337+0000","last_change":"2023-12-12T09:21:30.810317+0000","last_active":"2023-12-12T09:21:32.021337+0000","last_peered":"2023-12-12T09:21:32.021337+0000","last_clean":"2023-12-12T09:21:32.021337+0000","last_became_active":"2023-12-12T09:21:30.808017+0000","last_became_peered":"2023-12-12T09:21:30.808017+0000","last_unstale":"2023-12-12T09:21:32.021337+0000","last_undegraded":"2023-12-12T09:21:32.021337+0000","last_fullsized":"2023-12-12T09:21:32.021337+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:50:57.392678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.809868+0000","last_change":"2023-12-12T09:21:29.768735+0000","last_active":"2023-12-12T09:21:30.809868+0000","last_peered":"2023-12-12T09:21:30.809868+0000","last_clean":"2023-12-12T09:21:30.809868+0000","last_became_active":"2023-12-12T09:21:29.768270+0000","last_became_peered":"2023-12-12T09:21:29.768270+0000","last_unstale":"2023-12-12T09:21:30.809868+0000","last_undegraded":"2023-12-12T09:21:30.809868+0000","last_fullsized":"2023-12-12T09:21:30.809868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:46.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799585+0000","last_change":"2023-12-12T09:21:30.803306+0000","last_active":"2023-12-12T09:21:31.799585+0000","last_peered":"2023-12-12T09:21:31.799585+0000","last_clean":"2023-12-12T09:21:31.799585+0000","last_became_active":"2023-12-12T09:21:30.803061+0000","last_became_peered":"2023-12-12T09:21:30.803061+0000","last_unstale":"2023-12-12T09:21:31.799585+0000","last_undegraded":"2023-12-12T09:21:31.799585+0000","last_fullsized":"2023-12-12T09:21:31.799585+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:15:06.067973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.816109+0000","last_change":"2023-12-12T09:21:29.761602+0000","last_active":"2023-12-12T09:21:30.816109+0000","last_peered":"2023-12-12T09:21:30.816109+0000","last_clean":"2023-12-12T09:21:30.816109+0000","last_became_active":"2023-12-12T09:21:29.761302+0000","last_became_peered":"2023-12-12T09:21:29.761302+0000","last_unstale":"2023-12-12T09:21:30.816109+0000","last_undegraded":"2023-12-12T09:21:30.816109+0000","last_fullsized":"2023-12-12T09:21:30.816109+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:46.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796357+0000","last_change":"2023-12-12T09:21:30.802702+0000","last_active":"2023-12-12T09:21:31.796357+0000","last_peered":"2023-12-12T09:21:31.796357+0000","last_clean":"2023-12-12T09:21:31.796357+0000","last_became_active":"2023-12-12T09:21:30.802390+0000","last_became_peered":"2023-12-12T09:21:30.802390+0000","last_unstale":"2023-12-12T09:21:31.796357+0000","last_undegraded":"2023-12-12T09:21:31.796357+0000","last_fullsized":"2023-12-12T09:21:31.796357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:40:52.539020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.813327+0000","last_change":"2023-12-12T09:21:29.757460+0000","last_active":"2023-12-12T09:21:30.813327+0000","last_peered":"2023-12-12T09:21:30.813327+0000","last_clean":"2023-12-12T09:21:30.813327+0000","last_became_active":"2023-12-12T09:21:29.757144+0000","last_became_peered":"2023-12-12T09:21:29.757144+0000","last_unstale":"2023-12-12T09:21:30.813327+0000","last_undegraded":"2023-12-12T09:21:30.813327+0000","last_fullsized":"2023-12-12T09:21:30.813327+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:02.326740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020131+0000","last_change":"2023-12-12T09:21:30.801863+0000","last_active":"2023-12-12T09:21:32.020131+0000","last_peered":"2023-12-12T09:21:32.020131+0000","last_clean":"2023-12-12T09:21:32.020131+0000","last_became_active":"2023-12-12T09:21:30.801019+0000","last_became_peered":"2023-12-12T09:21:30.801019+0000","last_unstale":"2023-12-12T09:21:32.020131+0000","last_undegraded":"2023-12-12T09:21:32.020131+0000","last_fullsized":"2023-12-12T09:21:32.020131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:16:01.921093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.820166+0000","last_change":"2023-12-12T09:21:29.764003+0000","last_active":"2023-12-12T09:21:30.820166+0000","last_peered":"2023-12-12T09:21:30.820166+0000","last_clean":"2023-12-12T09:21:30.820166+0000","last_became_active":"2023-12-12T09:21:29.763739+0000","last_became_peered":"2023-12-12T09:21:29.763739+0000","last_unstale":"2023-12-12T09:21:30.820166+0000","last_undegraded":"2023-12-12T09:21:30.820166+0000","last_fullsized":"2023-12-12T09:21:30.820166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:13.209482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799635+0000","last_change":"2023-12-12T09:21:30.798523+0000","last_active":"2023-12-12T09:21:31.799635+0000","last_peered":"2023-12-12T09:21:31.799635+0000","last_clean":"2023-12-12T09:21:31.799635+0000","last_became_active":"2023-12-12T09:21:30.797655+0000","last_became_peered":"2023-12-12T09:21:30.797655+0000","last_unstale":"2023-12-12T09:21:31.799635+0000","last_undegraded":"2023-12-12T09:21:31.799635+0000","last_fullsized":"2023-12-12T09:21:31.799635+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:42:56.417244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.820023+0000","last_change":"2023-12-12T09:21:29.772599+0000","last_active":"2023-12-12T09:21:30.820023+0000","last_peered":"2023-12-12T09:21:30.820023+0000","last_clean":"2023-12-12T09:21:30.820023+0000","last_became_active":"2023-12-12T09:21:29.772099+0000","last_became_peered":"2023-12-12T09:21:29.772099+0000","last_unstale":"2023-12-12T09:21:30.820023+0000","last_undegraded":"2023-12-12T09:21:30.820023+0000","last_fullsized":"2023-12-12T09:21:30.820023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:11:32.560189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.798184+0000","last_change":"2023-12-12T09:21:30.795925+0000","last_active":"2023-12-12T09:21:31.798184+0000","last_peered":"2023-12-12T09:21:31.798184+0000","last_clean":"2023-12-12T09:21:31.798184+0000","last_became_active":"2023-12-12T09:21:30.795614+0000","last_became_peered":"2023-12-12T09:21:30.795614+0000","last_unstale":"2023-12-12T09:21:31.798184+0000","last_undegraded":"2023-12-12T09:21:31.798184+0000","last_fullsized":"2023-12-12T09:21:31.798184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:41:06.511178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.789417+0000","last_change":"2023-12-12T09:21:29.767795+0000","last_active":"2023-12-12T09:21:30.789417+0000","last_peered":"2023-12-12T09:21:30.789417+0000","last_clean":"2023-12-12T09:21:30.789417+0000","last_became_active":"2023-12-12T09:21:29.767472+0000","last_became_peered":"2023-12-12T09:21:29.767472+0000","last_unstale":"2023-12-12T09:21:30.789417+0000","last_undegraded":"2023-12-12T09:21:30.789417+0000","last_fullsized":"2023-12-12T09:21:30.789417+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:59:11.847628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796068+0000","last_change":"2023-12-12T09:21:30.804858+0000","last_active":"2023-12-12T09:21:31.796068+0000","last_peered":"2023-12-12T09:21:31.796068+0000","last_clean":"2023-12-12T09:21:31.796068+0000","last_became_active":"2023-12-12T09:21:30.804302+0000","last_became_peered":"2023-12-12T09:21:30.804302+0000","last_unstale":"2023-12-12T09:21:31.796068+0000","last_undegraded":"2023-12-12T09:21:31.796068+0000","last_fullsized":"2023-12-12T09:21:31.796068+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:23:48.151377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.773527+0000","last_change":"2023-12-12T09:21:29.760059+0000","last_active":"2023-12-12T09:21:30.773527+0000","last_peered":"2023-12-12T09:21:30.773527+0000","last_clean":"2023-12-12T09:21:30.773527+0000","last_became_active":"2023-12-12T09:21:29.759181+0000","last_became_peered":"2023-12-12T09:21:29.759181+0000","last_unstale":"2023-12-12T09:21:30.773527+0000","last_undegraded":"2023-12-12T09:21:30.773527+0000","last_fullsized":"2023-12-12T09:21:30.773527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:28:37.810532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.022807+0000","last_change":"2023-12-12T09:21:30.796056+0000","last_active":"2023-12-12T09:21:32.022807+0000","last_peered":"2023-12-12T09:21:32.022807+0000","last_clean":"2023-12-12T09:21:32.022807+0000","last_became_active":"2023-12-12T09:21:30.795289+0000","last_became_peered":"2023-12-12T09:21:30.795289+0000","last_unstale":"2023-12-12T09:21:32.022807+0000","last_undegraded":"2023-12-12T09:21:32.022807+0000","last_fullsized":"2023-12-12T09:21:32.022807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:59.089587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.768592+0000","last_change":"2023-12-12T09:21:29.765362+0000","last_active":"2023-12-12T09:21:30.768592+0000","last_peered":"2023-12-12T09:21:30.768592+0000","last_clean":"2023-12-12T09:21:30.768592+0000","last_became_active":"2023-12-12T09:21:29.765103+0000","last_became_peered":"2023-12-12T09:21:29.765103+0000","last_unstale":"2023-12-12T09:21:30.768592+0000","last_undegraded":"2023-12-12T09:21:30.768592+0000","last_fullsized":"2023-12-12T09:21:30.768592+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:13:30.511314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021835+0000","last_change":"2023-12-12T09:21:30.807364+0000","last_active":"2023-12-12T09:21:32.021835+0000","last_peered":"2023-12-12T09:21:32.021835+0000","last_clean":"2023-12-12T09:21:32.021835+0000","last_became_active":"2023-12-12T09:21:30.807098+0000","last_became_peered":"2023-12-12T09:21:30.807098+0000","last_unstale":"2023-12-12T09:21:32.021835+0000","last_undegraded":"2023-12-12T09:21:32.021835+0000","last_fullsized":"2023-12-12T09:21:32.021835+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:38.101765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.782351+0000","last_change":"2023-12-12T09:21:29.768355+0000","last_active":"2023-12-12T09:21:30.782351+0000","last_peered":"2023-12-12T09:21:30.782351+0000","last_clean":"2023-12-12T09:21:30.782351+0000","last_became_active":"2023-12-12T09:21:29.768018+0000","last_became_peered":"2023-12-12T09:21:29.768018+0000","last_unstale":"2023-12-12T09:21:30.782351+0000","last_undegraded":"2023-12-12T09:21:30.782351+0000","last_fullsized":"2023-12-12T09:21:30.782351+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:41:05.505726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.023903+0000","last_change":"2023-12-12T09:21:30.798599+0000","last_active":"2023-12-12T09:21:32.023903+0000","last_peered":"2023-12-12T09:21:32.023903+0000","last_clean":"2023-12-12T09:21:32.023903+0000","last_became_active":"2023-12-12T09:21:30.798313+0000","last_became_peered":"2023-12-12T09:21:30.798313+0000","last_unstale":"2023-12-12T09:21:32.023903+0000","last_undegraded":"2023-12-12T09:21:32.023903+0000","last_fullsized":"2023-12-12T09:21:32.023903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:55.922461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.820401+0000","last_change":"2023-12-12T09:21:29.768295+0000","last_active":"2023-12-12T09:21:30.820401+0000","last_peered":"2023-12-12T09:21:30.820401+0000","last_clean":"2023-12-12T09:21:30.820401+0000","last_became_active":"2023-12-12T09:21:29.767583+0000","last_became_peered":"2023-12-12T09:21:29.767583+0000","last_unstale":"2023-12-12T09:21:30.820401+0000","last_undegraded":"2023-12-12T09:21:30.820401+0000","last_fullsized":"2023-12-12T09:21:30.820401+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:02.326740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.798764+0000","last_change":"2023-12-12T09:21:30.802074+0000","last_active":"2023-12-12T09:21:31.798764+0000","last_peered":"2023-12-12T09:21:31.798764+0000","last_clean":"2023-12-12T09:21:31.798764+0000","last_became_active":"2023-12-12T09:21:30.801410+0000","last_became_peered":"2023-12-12T09:21:30.801410+0000","last_unstale":"2023-12-12T09:21:31.798764+0000","last_undegraded":"2023-12-12T09:21:31.798764+0000","last_fullsized":"2023-12-12T09:21:31.798764+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:04:42.474886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.823328+0000","last_change":"2023-12-12T09:21:29.766850+0000","last_active":"2023-12-12T09:21:30.823328+0000","last_peered":"2023-12-12T09:21:30.823328+0000","last_clean":"2023-12-12T09:21:30.823328+0000","last_became_active":"2023-12-12T09:21:29.766432+0000","last_became_peered":"2023-12-12T09:21:29.766432+0000","last_unstale":"2023-12-12T09:21:30.823328+0000","last_undegraded":"2023-12-12T09:21:30.823328+0000","last_fullsized":"2023-12-12T09:21:30.823328+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:59.389631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020485+0000","last_change":"2023-12-12T09:21:30.789001+0000","last_active":"2023-12-12T09:21:32.020485+0000","last_peered":"2023-12-12T09:21:32.020485+0000","last_clean":"2023-12-12T09:21:32.020485+0000","last_became_active":"2023-12-12T09:21:30.788615+0000","last_became_peered":"2023-12-12T09:21:30.788615+0000","last_unstale":"2023-12-12T09:21:32.020485+0000","last_undegraded":"2023-12-12T09:21:32.020485+0000","last_fullsized":"2023-12-12T09:21:32.020485+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:28:38.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.815302+0000","last_change":"2023-12-12T09:21:29.762250+0000","last_active":"2023-12-12T09:21:30.815302+0000","last_peered":"2023-12-12T09:21:30.815302+0000","last_clean":"2023-12-12T09:21:30.815302+0000","last_became_active":"2023-12-12T09:21:29.761642+0000","last_became_peered":"2023-12-12T09:21:29.761642+0000","last_unstale":"2023-12-12T09:21:30.815302+0000","last_undegraded":"2023-12-12T09:21:30.815302+0000","last_fullsized":"2023-12-12T09:21:30.815302+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:42.662327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796045+0000","last_change":"2023-12-12T09:21:30.796156+0000","last_active":"2023-12-12T09:21:31.796045+0000","last_peered":"2023-12-12T09:21:31.796045+0000","last_clean":"2023-12-12T09:21:31.796045+0000","last_became_active":"2023-12-12T09:21:30.795875+0000","last_became_peered":"2023-12-12T09:21:30.795875+0000","last_unstale":"2023-12-12T09:21:31.796045+0000","last_undegraded":"2023-12-12T09:21:31.796045+0000","last_fullsized":"2023-12-12T09:21:31.796045+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:30:03.665219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.789158+0000","last_change":"2023-12-12T09:21:29.763371+0000","last_active":"2023-12-12T09:21:30.789158+0000","last_peered":"2023-12-12T09:21:30.789158+0000","last_clean":"2023-12-12T09:21:30.789158+0000","last_became_active":"2023-12-12T09:21:29.763082+0000","last_became_peered":"2023-12-12T09:21:29.763082+0000","last_unstale":"2023-12-12T09:21:30.789158+0000","last_undegraded":"2023-12-12T09:21:30.789158+0000","last_fullsized":"2023-12-12T09:21:30.789158+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:35:40.682360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020774+0000","last_change":"2023-12-12T09:21:30.814615+0000","last_active":"2023-12-12T09:21:32.020774+0000","last_peered":"2023-12-12T09:21:32.020774+0000","last_clean":"2023-12-12T09:21:32.020774+0000","last_became_active":"2023-12-12T09:21:30.814299+0000","last_became_peered":"2023-12-12T09:21:30.814299+0000","last_unstale":"2023-12-12T09:21:32.020774+0000","last_undegraded":"2023-12-12T09:21:32.020774+0000","last_fullsized":"2023-12-12T09:21:32.020774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:03.332191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.799135+0000","last_change":"2023-12-12T09:21:29.753760+0000","last_active":"2023-12-12T09:21:30.799135+0000","last_peered":"2023-12-12T09:21:30.799135+0000","last_clean":"2023-12-12T09:21:30.799135+0000","last_became_active":"2023-12-12T09:21:29.753342+0000","last_became_peered":"2023-12-12T09:21:29.753342+0000","last_unstale":"2023-12-12T09:21:30.799135+0000","last_undegraded":"2023-12-12T09:21:30.799135+0000","last_fullsized":"2023-12-12T09:21:30.799135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:03:58.084135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796274+0000","last_change":"2023-12-12T09:21:30.797994+0000","last_active":"2023-12-12T09:21:31.796274+0000","last_peered":"2023-12-12T09:21:31.796274+0000","last_clean":"2023-12-12T09:21:31.796274+0000","last_became_active":"2023-12-12T09:21:30.797710+0000","last_became_peered":"2023-12-12T09:21:30.797710+0000","last_unstale":"2023-12-12T09:21:31.796274+0000","last_undegraded":"2023-12-12T09:21:31.796274+0000","last_fullsized":"2023-12-12T09:21:31.796274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:15.641549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.825985+0000","last_change":"2023-12-12T09:21:29.772645+0000","last_active":"2023-12-12T09:21:30.825985+0000","last_peered":"2023-12-12T09:21:30.825985+0000","last_clean":"2023-12-12T09:21:30.825985+0000","last_became_active":"2023-12-12T09:21:29.772381+0000","last_became_peered":"2023-12-12T09:21:29.772381+0000","last_unstale":"2023-12-12T09:21:30.825985+0000","last_undegraded":"2023-12-12T09:21:30.825985+0000","last_fullsized":"2023-12-12T09:21:30.825985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:52:14.152071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796227+0000","last_change":"2023-12-12T09:21:30.803729+0000","last_active":"2023-12-12T09:21:31.796227+0000","last_peered":"2023-12-12T09:21:31.796227+0000","last_clean":"2023-12-12T09:21:31.796227+0000","last_became_active":"2023-12-12T09:21:30.802986+0000","last_became_peered":"2023-12-12T09:21:30.802986+0000","last_unstale":"2023-12-12T09:21:31.796227+0000","last_undegraded":"2023-12-12T09:21:31.796227+0000","last_fullsized":"2023-12-12T09:21:31.796227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:53:48.670581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.815334+0000","last_change":"2023-12-12T09:21:29.768150+0000","last_active":"2023-12-12T09:21:30.815334+0000","last_peered":"2023-12-12T09:21:30.815334+0000","last_clean":"2023-12-12T09:21:30.815334+0000","last_became_active":"2023-12-12T09:21:29.767829+0000","last_became_peered":"2023-12-12T09:21:29.767829+0000","last_unstale":"2023-12-12T09:21:30.815334+0000","last_undegraded":"2023-12-12T09:21:30.815334+0000","last_fullsized":"2023-12-12T09:21:30.815334+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:52:54.917010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800528+0000","last_change":"2023-12-12T09:21:30.804720+0000","last_active":"2023-12-12T09:21:31.800528+0000","last_peered":"2023-12-12T09:21:31.800528+0000","last_clean":"2023-12-12T09:21:31.800528+0000","last_became_active":"2023-12-12T09:21:30.803118+0000","last_became_peered":"2023-12-12T09:21:30.803118+0000","last_unstale":"2023-12-12T09:21:31.800528+0000","last_undegraded":"2023-12-12T09:21:31.800528+0000","last_fullsized":"2023-12-12T09:21:31.800528+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:46:30.508385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.815913+0000","last_change":"2023-12-12T09:21:29.761367+0000","last_active":"2023-12-12T09:21:30.815913+0000","last_peered":"2023-12-12T09:21:30.815913+0000","last_clean":"2023-12-12T09:21:30.815913+0000","last_became_active":"2023-12-12T09:21:29.761014+0000","last_became_peered":"2023-12-12T09:21:29.761014+0000","last_unstale":"2023-12-12T09:21:30.815913+0000","last_undegraded":"2023-12-12T09:21:30.815913+0000","last_fullsized":"2023-12-12T09:21:30.815913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:13.209482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799561+0000","last_change":"2023-12-12T09:21:30.801314+0000","last_active":"2023-12-12T09:21:31.799561+0000","last_peered":"2023-12-12T09:21:31.799561+0000","last_clean":"2023-12-12T09:21:31.799561+0000","last_became_active":"2023-12-12T09:21:30.799223+0000","last_became_peered":"2023-12-12T09:21:30.799223+0000","last_unstale":"2023-12-12T09:21:31.799561+0000","last_undegraded":"2023-12-12T09:21:31.799561+0000","last_fullsized":"2023-12-12T09:21:31.799561+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:04.358938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.821081+0000","last_change":"2023-12-12T09:21:29.770091+0000","last_active":"2023-12-12T09:21:30.821081+0000","last_peered":"2023-12-12T09:21:30.821081+0000","last_clean":"2023-12-12T09:21:30.821081+0000","last_became_active":"2023-12-12T09:21:29.769239+0000","last_became_peered":"2023-12-12T09:21:29.769239+0000","last_unstale":"2023-12-12T09:21:30.821081+0000","last_undegraded":"2023-12-12T09:21:30.821081+0000","last_fullsized":"2023-12-12T09:21:30.821081+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:33.554189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.023357+0000","last_change":"2023-12-12T09:21:30.807074+0000","last_active":"2023-12-12T09:21:32.023357+0000","last_peered":"2023-12-12T09:21:32.023357+0000","last_clean":"2023-12-12T09:21:32.023357+0000","last_became_active":"2023-12-12T09:21:30.806899+0000","last_became_peered":"2023-12-12T09:21:30.806899+0000","last_unstale":"2023-12-12T09:21:32.023357+0000","last_undegraded":"2023-12-12T09:21:32.023357+0000","last_fullsized":"2023-12-12T09:21:32.023357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:52:24.640139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.790964+0000","last_change":"2023-12-12T09:21:29.760344+0000","last_active":"2023-12-12T09:21:30.790964+0000","last_peered":"2023-12-12T09:21:30.790964+0000","last_clean":"2023-12-12T09:21:30.790964+0000","last_became_active":"2023-12-12T09:21:29.760057+0000","last_became_peered":"2023-12-12T09:21:29.760057+0000","last_unstale":"2023-12-12T09:21:30.790964+0000","last_undegraded":"2023-12-12T09:21:30.790964+0000","last_fullsized":"2023-12-12T09:21:30.790964+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:16:00.915642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020334+0000","last_change":"2023-12-12T09:21:30.810071+0000","last_active":"2023-12-12T09:21:32.020334+0000","last_peered":"2023-12-12T09:21:32.020334+0000","last_clean":"2023-12-12T09:21:32.020334+0000","last_became_active":"2023-12-12T09:21:30.807984+0000","last_became_peered":"2023-12-12T09:21:30.807984+0000","last_unstale":"2023-12-12T09:21:32.020334+0000","last_undegraded":"2023-12-12T09:21:32.020334+0000","last_fullsized":"2023-12-12T09:21:32.020334+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:28:38.815984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.820166+0000","last_change":"2023-12-12T09:21:29.756282+0000","last_active":"2023-12-12T09:21:30.820166+0000","last_peered":"2023-12-12T09:21:30.820166+0000","last_clean":"2023-12-12T09:21:30.820166+0000","last_became_active":"2023-12-12T09:21:29.755942+0000","last_became_peered":"2023-12-12T09:21:29.755942+0000","last_unstale":"2023-12-12T09:21:30.820166+0000","last_undegraded":"2023-12-12T09:21:30.820166+0000","last_fullsized":"2023-12-12T09:21:30.820166+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:57:32.531602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021886+0000","last_change":"2023-12-12T09:21:30.801113+0000","last_active":"2023-12-12T09:21:32.021886+0000","last_peered":"2023-12-12T09:21:32.021886+0000","last_clean":"2023-12-12T09:21:32.021886+0000","last_became_active":"2023-12-12T09:21:30.800217+0000","last_became_peered":"2023-12-12T09:21:30.800217+0000","last_unstale":"2023-12-12T09:21:32.021886+0000","last_undegraded":"2023-12-12T09:21:32.021886+0000","last_fullsized":"2023-12-12T09:21:32.021886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:09:03.332191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.804834+0000","last_change":"2023-12-12T09:21:29.752853+0000","last_active":"2023-12-12T09:21:30.804834+0000","last_peered":"2023-12-12T09:21:30.804834+0000","last_clean":"2023-12-12T09:21:30.804834+0000","last_became_active":"2023-12-12T09:21:29.752575+0000","last_became_peered":"2023-12-12T09:21:29.752575+0000","last_unstale":"2023-12-12T09:21:30.804834+0000","last_undegraded":"2023-12-12T09:21:30.804834+0000","last_fullsized":"2023-12-12T09:21:30.804834+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:35:10.745369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.799142+0000","last_change":"2023-12-12T09:21:30.805203+0000","last_active":"2023-12-12T09:21:31.799142+0000","last_peered":"2023-12-12T09:21:31.799142+0000","last_clean":"2023-12-12T09:21:31.799142+0000","last_became_active":"2023-12-12T09:21:30.803653+0000","last_became_peered":"2023-12-12T09:21:30.803653+0000","last_unstale":"2023-12-12T09:21:31.799142+0000","last_undegraded":"2023-12-12T09:21:31.799142+0000","last_fullsized":"2023-12-12T09:21:31.799142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:23:04.358938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.792755+0000","last_change":"2023-12-12T09:21:29.772886+0000","last_active":"2023-12-12T09:21:30.792755+0000","last_peered":"2023-12-12T09:21:30.792755+0000","last_clean":"2023-12-12T09:21:30.792755+0000","last_became_active":"2023-12-12T09:21:29.772078+0000","last_became_peered":"2023-12-12T09:21:29.772078+0000","last_unstale":"2023-12-12T09:21:30.792755+0000","last_undegraded":"2023-12-12T09:21:30.792755+0000","last_fullsized":"2023-12-12T09:21:30.792755+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:39.027967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796458+0000","last_change":"2023-12-12T09:21:30.804647+0000","last_active":"2023-12-12T09:21:31.796458+0000","last_peered":"2023-12-12T09:21:31.796458+0000","last_clean":"2023-12-12T09:21:31.796458+0000","last_became_active":"2023-12-12T09:21:30.803941+0000","last_became_peered":"2023-12-12T09:21:30.803941+0000","last_unstale":"2023-12-12T09:21:31.796458+0000","last_undegraded":"2023-12-12T09:21:31.796458+0000","last_fullsized":"2023-12-12T09:21:31.796458+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:59:09.599989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.800821+0000","last_change":"2023-12-12T09:21:29.746023+0000","last_active":"2023-12-12T09:21:30.800821+0000","last_peered":"2023-12-12T09:21:30.800821+0000","last_clean":"2023-12-12T09:21:30.800821+0000","last_became_active":"2023-12-12T09:21:29.745607+0000","last_became_peered":"2023-12-12T09:21:29.745607+0000","last_unstale":"2023-12-12T09:21:30.800821+0000","last_undegraded":"2023-12-12T09:21:30.800821+0000","last_fullsized":"2023-12-12T09:21:30.800821+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:31:52.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020945+0000","last_change":"2023-12-12T09:21:30.808827+0000","last_active":"2023-12-12T09:21:32.020945+0000","last_peered":"2023-12-12T09:21:32.020945+0000","last_clean":"2023-12-12T09:21:32.020945+0000","last_became_active":"2023-12-12T09:21:30.802896+0000","last_became_peered":"2023-12-12T09:21:30.802896+0000","last_unstale":"2023-12-12T09:21:32.020945+0000","last_undegraded":"2023-12-12T09:21:32.020945+0000","last_fullsized":"2023-12-12T09:21:32.020945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:14.214933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.817880+0000","last_change":"2023-12-12T09:21:29.767517+0000","last_active":"2023-12-12T09:21:30.817880+0000","last_peered":"2023-12-12T09:21:30.817880+0000","last_clean":"2023-12-12T09:21:30.817880+0000","last_became_active":"2023-12-12T09:21:29.767194+0000","last_became_peered":"2023-12-12T09:21:29.767194+0000","last_unstale":"2023-12-12T09:21:30.817880+0000","last_undegraded":"2023-12-12T09:21:30.817880+0000","last_fullsized":"2023-12-12T09:21:30.817880+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:37.096313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021903+0000","last_change":"2023-12-12T09:21:30.818520+0000","last_active":"2023-12-12T09:21:32.021903+0000","last_peered":"2023-12-12T09:21:32.021903+0000","last_clean":"2023-12-12T09:21:32.021903+0000","last_became_active":"2023-12-12T09:21:30.818194+0000","last_became_peered":"2023-12-12T09:21:30.818194+0000","last_unstale":"2023-12-12T09:21:32.021903+0000","last_undegraded":"2023-12-12T09:21:32.021903+0000","last_fullsized":"2023-12-12T09:21:32.021903+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:41:06.511178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.805250+0000","last_change":"2023-12-12T09:21:29.760226+0000","last_active":"2023-12-12T09:21:30.805250+0000","last_peered":"2023-12-12T09:21:30.805250+0000","last_clean":"2023-12-12T09:21:30.805250+0000","last_became_active":"2023-12-12T09:21:29.759388+0000","last_became_peered":"2023-12-12T09:21:29.759388+0000","last_unstale":"2023-12-12T09:21:30.805250+0000","last_undegraded":"2023-12-12T09:21:30.805250+0000","last_fullsized":"2023-12-12T09:21:30.805250+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:22:07.722696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.796247+0000","last_change":"2023-12-12T09:21:30.783440+0000","last_active":"2023-12-12T09:21:31.796247+0000","last_peered":"2023-12-12T09:21:31.796247+0000","last_clean":"2023-12-12T09:21:31.796247+0000","last_became_active":"2023-12-12T09:21:30.782670+0000","last_became_peered":"2023-12-12T09:21:30.782670+0000","last_unstale":"2023-12-12T09:21:31.796247+0000","last_undegraded":"2023-12-12T09:21:31.796247+0000","last_fullsized":"2023-12-12T09:21:31.796247+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:06:26.988444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.779722+0000","last_change":"2023-12-12T09:21:29.765291+0000","last_active":"2023-12-12T09:21:30.779722+0000","last_peered":"2023-12-12T09:21:30.779722+0000","last_clean":"2023-12-12T09:21:30.779722+0000","last_became_active":"2023-12-12T09:21:29.764996+0000","last_became_peered":"2023-12-12T09:21:29.764996+0000","last_unstale":"2023-12-12T09:21:30.779722+0000","last_undegraded":"2023-12-12T09:21:30.779722+0000","last_fullsized":"2023-12-12T09:21:30.779722+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:35:40.682360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020881+0000","last_change":"2023-12-12T09:21:30.795364+0000","last_active":"2023-12-12T09:21:32.020881+0000","last_peered":"2023-12-12T09:21:32.020881+0000","last_clean":"2023-12-12T09:21:32.020881+0000","last_became_active":"2023-12-12T09:21:30.794975+0000","last_became_peered":"2023-12-12T09:21:30.794975+0000","last_unstale":"2023-12-12T09:21:32.020881+0000","last_undegraded":"2023-12-12T09:21:32.020881+0000","last_fullsized":"2023-12-12T09:21:32.020881+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:27.906245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.783942+0000","last_change":"2023-12-12T09:21:29.759411+0000","last_active":"2023-12-12T09:21:30.783942+0000","last_peered":"2023-12-12T09:21:30.783942+0000","last_clean":"2023-12-12T09:21:30.783942+0000","last_became_active":"2023-12-12T09:21:29.759110+0000","last_became_peered":"2023-12-12T09:21:29.759110+0000","last_unstale":"2023-12-12T09:21:30.783942+0000","last_undegraded":"2023-12-12T09:21:30.783942+0000","last_fullsized":"2023-12-12T09:21:30.783942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:55:42.118287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.020078+0000","last_change":"2023-12-12T09:21:30.808929+0000","last_active":"2023-12-12T09:21:32.020078+0000","last_peered":"2023-12-12T09:21:32.020078+0000","last_clean":"2023-12-12T09:21:32.020078+0000","last_became_active":"2023-12-12T09:21:30.808584+0000","last_became_peered":"2023-12-12T09:21:30.808584+0000","last_unstale":"2023-12-12T09:21:32.020078+0000","last_undegraded":"2023-12-12T09:21:32.020078+0000","last_fullsized":"2023-12-12T09:21:32.020078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:27.906245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.797802+0000","last_change":"2023-12-12T09:21:29.764220+0000","last_active":"2023-12-12T09:21:30.797802+0000","last_peered":"2023-12-12T09:21:30.797802+0000","last_clean":"2023-12-12T09:21:30.797802+0000","last_became_active":"2023-12-12T09:21:29.763979+0000","last_became_peered":"2023-12-12T09:21:29.763979+0000","last_unstale":"2023-12-12T09:21:30.797802+0000","last_undegraded":"2023-12-12T09:21:30.797802+0000","last_fullsized":"2023-12-12T09:21:30.797802+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:28:43.718673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.797840+0000","last_change":"2023-12-12T09:21:30.789488+0000","last_active":"2023-12-12T09:21:31.797840+0000","last_peered":"2023-12-12T09:21:31.797840+0000","last_clean":"2023-12-12T09:21:31.797840+0000","last_became_active":"2023-12-12T09:21:30.788911+0000","last_became_peered":"2023-12-12T09:21:30.788911+0000","last_unstale":"2023-12-12T09:21:31.797840+0000","last_undegraded":"2023-12-12T09:21:31.797840+0000","last_fullsized":"2023-12-12T09:21:31.797840+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:31:38.101765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.774160+0000","last_change":"2023-12-12T09:21:29.759573+0000","last_active":"2023-12-12T09:21:30.774160+0000","last_peered":"2023-12-12T09:21:30.774160+0000","last_clean":"2023-12-12T09:21:30.774160+0000","last_became_active":"2023-12-12T09:21:29.757748+0000","last_became_peered":"2023-12-12T09:21:29.757748+0000","last_unstale":"2023-12-12T09:21:30.774160+0000","last_undegraded":"2023-12-12T09:21:30.774160+0000","last_fullsized":"2023-12-12T09:21:30.774160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:37:26.900793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:32.021689+0000","last_change":"2023-12-12T09:21:30.812979+0000","last_active":"2023-12-12T09:21:32.021689+0000","last_peered":"2023-12-12T09:21:32.021689+0000","last_clean":"2023-12-12T09:21:32.021689+0000","last_became_active":"2023-12-12T09:21:30.808337+0000","last_became_peered":"2023-12-12T09:21:30.808337+0000","last_unstale":"2023-12-12T09:21:32.021689+0000","last_undegraded":"2023-12-12T09:21:32.021689+0000","last_fullsized":"2023-12-12T09:21:32.021689+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:50:57.392678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.765556+0000","last_change":"2023-12-12T09:21:29.760420+0000","last_active":"2023-12-12T09:21:30.765556+0000","last_peered":"2023-12-12T09:21:30.765556+0000","last_clean":"2023-12-12T09:21:30.765556+0000","last_became_active":"2023-12-12T09:21:29.760160+0000","last_became_peered":"2023-12-12T09:21:29.760160+0000","last_unstale":"2023-12-12T09:21:30.765556+0000","last_undegraded":"2023-12-12T09:21:30.765556+0000","last_fullsized":"2023-12-12T09:21:30.765556+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:58:17.563159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-12T09:21:31.800299+0000","last_change":"2023-12-12T09:21:30.797506+0000","last_active":"2023-12-12T09:21:31.800299+0000","last_peered":"2023-12-12T09:21:31.800299+0000","last_clean":"2023-12-12T09:21:31.800299+0000","last_became_active":"2023-12-12T09:21:30.796680+0000","last_became_peered":"2023-12-12T09:21:30.796680+0000","last_unstale":"2023-12-12T09:21:31.800299+0000","last_undegraded":"2023-12-12T09:21:31.800299+0000","last_fullsized":"2023-12-12T09:21:31.800299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:29.722620+0000","last_clean_scrub_stamp":"2023-12-12T09:21:29.722620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:24:01.254285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.796187+0000","last_change":"2023-12-12T09:21:29.773445+0000","last_active":"2023-12-12T09:21:30.796187+0000","last_peered":"2023-12-12T09:21:30.796187+0000","last_clean":"2023-12-12T09:21:30.796187+0000","last_became_active":"2023-12-12T09:21:29.773170+0000","last_became_peered":"2023-12-12T09:21:29.773170+0000","last_unstale":"2023-12-12T09:21:30.796187+0000","last_undegraded":"2023-12-12T09:21:30.796187+0000","last_fullsized":"2023-12-12T09:21:30.796187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:21:28.717168+0000","last_clean_scrub_stamp":"2023-12-12T09:21:28.717168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:35:40.682360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-12T09:21:30.790132+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:21:30.790132+0000","last_peered":"2023-12-12T09:21:30.790132+0000","last_clean":"2023-12-12T09:21:30.790132+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:21:30.790132+0000","last_undegraded":"2023-12-12T09:21:30.790132+0000","last_fullsized":"2023-12-12T09:21:30.790132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1081344,"data_stored":796537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":4.4340000000000002,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.028}]},{"osd":1,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.143},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.554}]},{"osd":2,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.747}]},{"osd":3,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.1080000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.2930000000000001,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.645}]},{"osd":5,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.242}]},{"osd":6,"last update":"Tue Dec 12 09:20:34 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.5980000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":205069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.878}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.425},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.98899999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.202},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":1.5860000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1020000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.718},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":1.5529999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.294},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.776}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.492},{"interface":"front","average":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.514}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":204599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.83999999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.91100000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.319},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.0660000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.012},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.73}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5219999999999998,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.115},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.8420000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.379}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.47},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.5649999999999999,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.4390000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.7490000000000001,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.242},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":1.6479999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":205091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.22},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.1469999999999998,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.98999999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.155},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.91000000000000003}]},{"osd":2,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.4650000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.425}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.272},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":3.343,"5min":3.343,"15min":3.343},"last":1.0720000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.575},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.2240000000000002,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.556}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":3.085,"5min":3.085,"15min":3.085},"last":1.524},{"interface":"front","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.1899999999999999,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.649}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":206133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.44},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.58799999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.622},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.026}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.85299999999999998}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.88800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":204557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.0289999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.4430000000000001,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":1.2929999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.03,"15min":1.03},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.3200000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.256},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":3.0950000000000002,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.4850000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.21,"5min":2.21,"15min":2.21},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.999,"5min":0.999,"15min":0.999},"max":{"1min":2.6720000000000002,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.409}]},{"osd":6,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.571},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.194}]},{"osd":7,"last update":"Tue Dec 12 09:20:36 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.0310000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.343}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":204577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.70699999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.613},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.2330000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.891},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.4710000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.411}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.5389999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.867,"5min":2.867,"15min":2.867},"last":2.2229999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.7150000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":2.0830000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1069056,"data_stored":794889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.84799999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.464,"5min":2.464,"15min":2.464},"last":1.153}]},{"osd":4,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.032},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.7410000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.2230000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":0.98299999999999998}]},{"osd":7,"last update":"Tue Dec 12 09:20:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.399,"15min":1.399},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.341}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:21:40.653 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:21:40.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-12T09:21:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.913+0000 7f8333ada640 1 Processor -- start 2023-12-12T09:21:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.914+0000 7f8333ada640 1 -- start start 2023-12-12T09:21:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.915+0000 7f8333ada640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f832c15fa40 0x7f832c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.915+0000 7f8333ada640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f832c160e30 0x7f832c0cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.915+0000 7f8333ada640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0ce300 con 0x7f832c0cfab0 2023-12-12T09:21:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.915+0000 7f8333ada640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c0d0b30 con 0x7f832c15fa40 2023-12-12T09:21:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.915+0000 7f8333ada640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c0cdcf0 con 0x7f832c160e30 2023-12-12T09:21:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.915+0000 7f8331876640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f832c15fa40 0x7f832c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.915+0000 7f8331876640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f832c15fa40 0x7f832c0b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54814/0 (socket says 172.21.15.84:54814) 2023-12-12T09:21:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.915+0000 7f8331876640 1 -- 172.21.15.84:0/595854569 learned_addr learned my addr 172.21.15.84:0/595854569 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.916+0000 7f8332077640 1 --2- 172.21.15.84:0/595854569 >> v2:172.21.15.99:3300/0 conn(0x7f832c160e30 0x7f832c0cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.916+0000 7f8331876640 1 -- 172.21.15.84:0/595854569 >> v2:172.21.15.99:3300/0 conn(0x7f832c160e30 msgr2=0x7f832c0cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.916+0000 7f8331876640 1 --2- 172.21.15.84:0/595854569 >> v2:172.21.15.99:3300/0 conn(0x7f832c160e30 0x7f832c0cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.916+0000 7f8331876640 1 -- 172.21.15.84:0/595854569 >> v1:172.21.15.99:6789/0 conn(0x7f832c0cfab0 legacy=0x7f832c0d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.916+0000 7f8331876640 1 -- 172.21.15.84:0/595854569 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0d0570 con 0x7f832c15fa40 2023-12-12T09:21:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.916+0000 7f8332077640 1 --2- 172.21.15.84:0/595854569 >> v2:172.21.15.99:3300/0 conn(0x7f832c160e30 0x7f832c0cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.917+0000 7f8331876640 1 --2- 172.21.15.84:0/595854569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c0b2ab0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f832c0b91d0 tx=0x7f831c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa9f3cf6ce56e8c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.917+0000 7f8330874640 1 -- 172.21.15.84:0/595854569 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c02ca80 con 0x7f832c15fa40 2023-12-12T09:21:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.917+0000 7f8330874640 1 -- 172.21.15.84:0/595854569 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c02cbe0 con 0x7f832c15fa40 2023-12-12T09:21:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.917+0000 7f8330874640 1 -- 172.21.15.84:0/595854569 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c0343f0 con 0x7f832c15fa40 2023-12-12T09:21:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.918+0000 7f8333ada640 1 -- 172.21.15.84:0/595854569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 msgr2=0x7f832c0b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.918+0000 7f8333ada640 1 --2- 172.21.15.84:0/595854569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c0b2ab0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f832c0b91d0 tx=0x7f831c02bee0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.918+0000 7f8333ada640 1 -- 172.21.15.84:0/595854569 shutdown_connections 2023-12-12T09:21:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.918+0000 7f8333ada640 1 --2- 172.21.15.84:0/595854569 >> v2:172.21.15.99:3300/0 conn(0x7f832c160e30 0x7f832c0cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.918+0000 7f8333ada640 1 --2- 172.21.15.84:0/595854569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c0b2ab0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.918+0000 7f8333ada640 1 -- 172.21.15.84:0/595854569 >> 172.21.15.84:0/595854569 conn(0x7f832c09c480 msgr2=0x7f832c0d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.918+0000 7f8333ada640 1 -- 172.21.15.84:0/595854569 shutdown_connections 2023-12-12T09:21:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.918+0000 7f8333ada640 1 -- 172.21.15.84:0/595854569 wait complete. 2023-12-12T09:21:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.920+0000 7f8333ada640 1 Processor -- start 2023-12-12T09:21:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.920+0000 7f8333ada640 1 -- start start 2023-12-12T09:21:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8333ada640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f832c0cfab0 0x7f832c1f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8333ada640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c1e6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8333ada640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832c160e30 0x7f832c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8333ada640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0b2f30 con 0x7f832c15fa40 2023-12-12T09:21:40.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8333ada640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c1e7290 con 0x7f832c0cfab0 2023-12-12T09:21:40.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8333ada640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c1e7570 con 0x7f832c160e30 2023-12-12T09:21:40.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8331075640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c1e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8331075640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c1e6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54824/0 (socket says 172.21.15.84:54824) 2023-12-12T09:21:40.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.921+0000 7f8331075640 1 -- 172.21.15.84:0/3940680472 learned_addr learned my addr 172.21.15.84:0/3940680472 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8331876640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f832c0cfab0 0x7f832c1f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8331075640 1 -- 172.21.15.84:0/3940680472 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832c160e30 msgr2=0x7f832c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8331075640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832c160e30 0x7f832c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8331075640 1 -- 172.21.15.84:0/3940680472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f832c0cfab0 msgr2=0x7f832c1f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8331075640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f832c0cfab0 0x7f832c1f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8331075640 1 -- 172.21.15.84:0/3940680472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c009b30 con 0x7f832c15fa40 2023-12-12T09:21:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8331876640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f832c0cfab0 0x7f832c1f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8331075640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c1e6960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f832000b3f0 tx=0x7f832000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f832a7fc640 1 -- 172.21.15.84:0/3940680472 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320011830 con 0x7f832c15fa40 2023-12-12T09:21:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f832a7fc640 1 -- 172.21.15.84:0/3940680472 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8320011990 con 0x7f832c15fa40 2023-12-12T09:21:40.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c1e7850 con 0x7f832c15fa40 2023-12-12T09:21:40.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f832a7fc640 1 -- 172.21.15.84:0/3940680472 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320011d40 con 0x7f832c15fa40 2023-12-12T09:21:40.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.922+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c1f2a90 con 0x7f832c15fa40 2023-12-12T09:21:40.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.924+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c072b80 con 0x7f832c15fa40 2023-12-12T09:21:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.925+0000 7f832a7fc640 1 -- 172.21.15.84:0/3940680472 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f832001a400 con 0x7f832c15fa40 2023-12-12T09:21:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.926+0000 7f832a7fc640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f831806ae40 0x7f831806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.926+0000 7f832a7fc640 1 -- 172.21.15.84:0/3940680472 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8320089500 con 0x7f832c15fa40 2023-12-12T09:21:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.927+0000 7f8331876640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f831806ae40 0x7f831806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:40.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.927+0000 7f8331876640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f831806ae40 0x7f831806d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f831c035000 tx=0x7f831c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:40.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:40.932+0000 7f832a7fc640 1 -- 172.21.15.84:0/3940680472 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8320054500 con 0x7f832c15fa40 2023-12-12T09:21:41.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.189+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f832c0b3070 con 0x7f832c15fa40 2023-12-12T09:21:41.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.194+0000 7f832a7fc640 1 -- 172.21.15.84:0/3940680472 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f832c0b3070 con 0x7f832c15fa40 2023-12-12T09:21:41.195 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:21:41.195 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:21:41.195 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-12-12T09:21:41.195 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-12-12T09:21:41.195 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-12T09:21:41.195 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-12-12T09:21:41.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f831806ae40 msgr2=0x7f831806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:41.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f831806ae40 0x7f831806d300 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f831c035000 tx=0x7f831c030000 comp rx=0 tx=0).stop 2023-12-12T09:21:41.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 msgr2=0x7f832c1e6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:41.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c1e6960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f832000b3f0 tx=0x7f832000b8b0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 shutdown_connections 2023-12-12T09:21:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f832c160e30 0x7f832c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f831806ae40 0x7f831806d300 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f832c15fa40 0x7f832c1e6960 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 --2- 172.21.15.84:0/3940680472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f832c0cfab0 0x7f832c1f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 >> 172.21.15.84:0/3940680472 conn(0x7f832c09c480 msgr2=0x7f832c0d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 shutdown_connections 2023-12-12T09:21:41.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.197+0000 7f8333ada640 1 -- 172.21.15.84:0/3940680472 wait complete. 2023-12-12T09:21:41.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:21:41.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.414+0000 7f704f72c640 1 Processor -- start 2023-12-12T09:21:41.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.414+0000 7f704f72c640 1 -- start start 2023-12-12T09:21:41.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.416+0000 7f704f72c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f704813ff90 0x7f7048142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:41.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.416+0000 7f704f72c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70480b4ba0 0x7f7048142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:41.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.416+0000 7f704f72c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f704815d9a0 0x7f704815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:41.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.416+0000 7f704f72c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704815e6d0 con 0x7f704815d9a0 2023-12-12T09:21:41.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.416+0000 7f704f72c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70480b3b60 con 0x7f704813ff90 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.416+0000 7f704f72c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70480b3de0 con 0x7f70480b4ba0 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.416+0000 7f704dcc9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f704815d9a0 0x7f704815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704dcc9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f704815d9a0 0x7f704815de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54830/0 (socket says 172.21.15.84:54830) 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704dcc9640 1 -- 172.21.15.84:0/3213832395 learned_addr learned my addr 172.21.15.84:0/3213832395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704ccc7640 1 --2- 172.21.15.84:0/3213832395 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70480b4ba0 0x7f7048142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704d4c8640 1 --2- 172.21.15.84:0/3213832395 >> v2:172.21.15.99:3300/0 conn(0x7f704813ff90 0x7f7048142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704dcc9640 1 -- 172.21.15.84:0/3213832395 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70480b4ba0 msgr2=0x7f7048142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704dcc9640 1 --2- 172.21.15.84:0/3213832395 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70480b4ba0 0x7f7048142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704dcc9640 1 -- 172.21.15.84:0/3213832395 >> v2:172.21.15.99:3300/0 conn(0x7f704813ff90 msgr2=0x7f7048142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704dcc9640 1 --2- 172.21.15.84:0/3213832395 >> v2:172.21.15.99:3300/0 conn(0x7f704813ff90 0x7f7048142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.417+0000 7f704dcc9640 1 -- 172.21.15.84:0/3213832395 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70480b40c0 con 0x7f704815d9a0 2023-12-12T09:21:41.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.418+0000 7f704dcc9640 1 --2- 172.21.15.84:0/3213832395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704815d9a0 0x7f704815de50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f70480748b0 tx=0x7f704002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd4ffd2de7ec27f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.418+0000 7f703ffff640 1 -- 172.21.15.84:0/3213832395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704002ca70 con 0x7f704815d9a0 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.418+0000 7f703ffff640 1 -- 172.21.15.84:0/3213832395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704002cbd0 con 0x7f704815d9a0 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.418+0000 7f703ffff640 1 -- 172.21.15.84:0/3213832395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70400343f0 con 0x7f704815d9a0 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 -- 172.21.15.84:0/3213832395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704815d9a0 msgr2=0x7f704815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 --2- 172.21.15.84:0/3213832395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704815d9a0 0x7f704815de50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f70480748b0 tx=0x7f704002bed0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 -- 172.21.15.84:0/3213832395 shutdown_connections 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 --2- 172.21.15.84:0/3213832395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704815d9a0 0x7f704815de50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 --2- 172.21.15.84:0/3213832395 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f70480b4ba0 0x7f7048142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 --2- 172.21.15.84:0/3213832395 >> v2:172.21.15.99:3300/0 conn(0x7f704813ff90 0x7f7048142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 -- 172.21.15.84:0/3213832395 >> 172.21.15.84:0/3213832395 conn(0x7f704806c3d0 msgr2=0x7f704806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 -- 172.21.15.84:0/3213832395 shutdown_connections 2023-12-12T09:21:41.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.419+0000 7f704f72c640 1 -- 172.21.15.84:0/3213832395 wait complete. 2023-12-12T09:21:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.421+0000 7f704f72c640 1 Processor -- start 2023-12-12T09:21:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.421+0000 7f704f72c640 1 -- start start 2023-12-12T09:21:41.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704f72c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70480b4ba0 0x7f7048154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:41.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704f72c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704813ff90 0x7f70481558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:41.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704f72c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f704815d9a0 0x7f7048155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:41.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704f72c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70480b0780 con 0x7f704813ff90 2023-12-12T09:21:41.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704f72c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70480afc00 con 0x7f70480b4ba0 2023-12-12T09:21:41.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704f72c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70480afee0 con 0x7f704815d9a0 2023-12-12T09:21:41.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704ccc7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704813ff90 0x7f70481558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:41.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704ccc7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704813ff90 0x7f70481558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54836/0 (socket says 172.21.15.84:54836) 2023-12-12T09:21:41.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.422+0000 7f704ccc7640 1 -- 172.21.15.84:0/2132777144 learned_addr learned my addr 172.21.15.84:0/2132777144 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:41.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704d4c8640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70480b4ba0 0x7f7048154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:41.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704ccc7640 1 -- 172.21.15.84:0/2132777144 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f704815d9a0 msgr2=0x7f7048155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:41.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704ccc7640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f704815d9a0 0x7f7048155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704ccc7640 1 -- 172.21.15.84:0/2132777144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70480b4ba0 msgr2=0x7f7048154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:41.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704ccc7640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70480b4ba0 0x7f7048154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704ccc7640 1 -- 172.21.15.84:0/2132777144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040009b30 con 0x7f704813ff90 2023-12-12T09:21:41.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704ccc7640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704813ff90 0x7f70481558d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f703800d5f0 tx=0x7f703800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:41.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f703dffb640 1 -- 172.21.15.84:0/2132777144 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038018070 con 0x7f704813ff90 2023-12-12T09:21:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f703dffb640 1 -- 172.21.15.84:0/2132777144 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7038004240 con 0x7f704813ff90 2023-12-12T09:21:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70480b01c0 con 0x7f704813ff90 2023-12-12T09:21:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f703dffb640 1 -- 172.21.15.84:0/2132777144 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380043f0 con 0x7f704813ff90 2023-12-12T09:21:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.423+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7048154ed0 con 0x7f704813ff90 2023-12-12T09:21:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.424+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70480673c0 con 0x7f704813ff90 2023-12-12T09:21:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.425+0000 7f703dffb640 1 -- 172.21.15.84:0/2132777144 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7038003610 con 0x7f704813ff90 2023-12-12T09:21:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.426+0000 7f703dffb640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f702c06ae40 0x7f702c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:41.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.426+0000 7f703dffb640 1 -- 172.21.15.84:0/2132777144 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7038089550 con 0x7f704813ff90 2023-12-12T09:21:41.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.426+0000 7f704d4c8640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f702c06ae40 0x7f702c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:41.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.427+0000 7f704d4c8640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f702c06ae40 0x7f702c06d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7044006fd0 tx=0x7f7044008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:41.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.431+0000 7f703dffb640 1 -- 172.21.15.84:0/2132777144 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70380544b0 con 0x7f704813ff90 2023-12-12T09:21:41.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.657+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7048070210 con 0x7f704813ff90 2023-12-12T09:21:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.659+0000 7f703dffb640 1 -- 172.21.15.84:0/2132777144 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f7038057ad0 con 0x7f704813ff90 2023-12-12T09:21:41.659 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:41.659 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6834/3349912921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3349912921},{"type":"v1","addr":"172.21.15.99:6834","nonce":3349912921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3102874305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6833","nonce":3102874305},{"type":"v1","addr":"172.21.15.99:6835","nonce":3102874305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2816609542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2816609542},{"type":"v1","addr":"172.21.15.84:6837","nonce":2816609542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:21:30.192583+0000","modified":"2023-12-12T09:21:33.287292+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6836/1717242900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1717242900},{"type":"v1","addr":"172.21.15.84:6836","nonce":1717242900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:21:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 17 2023-12-12T09:21:41.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f702c06ae40 msgr2=0x7f702c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:41.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f702c06ae40 0x7f702c06d300 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7044006fd0 tx=0x7f7044008040 comp rx=0 tx=0).stop 2023-12-12T09:21:41.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704813ff90 msgr2=0x7f70481558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:41.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704813ff90 0x7f70481558d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f703800d5f0 tx=0x7f703800dab0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 shutdown_connections 2023-12-12T09:21:41.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f704815d9a0 0x7f7048155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f702c06ae40 0x7f702c06d300 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f704813ff90 0x7f70481558d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 --2- 172.21.15.84:0/2132777144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70480b4ba0 0x7f7048154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:41.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 >> 172.21.15.84:0/2132777144 conn(0x7f704806c3d0 msgr2=0x7f7048142b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:41.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.661+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 shutdown_connections 2023-12-12T09:21:41.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:41.662+0000 7f704f72c640 1 -- 172.21.15.84:0/2132777144 wait complete. 2023-12-12T09:21:42.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T09:21:30.192583+0000', 'modified': '2023-12-12T09:21:33.287292+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5556}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5556': {'gid': 5556, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.84:6836/1717242900', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 1717242900}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 1717242900}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T09:21:42.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T09:21:42.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-12T09:21:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.310+0000 7f9ed8fa9640 1 Processor -- start 2023-12-12T09:21:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.310+0000 7f9ed8fa9640 1 -- start start 2023-12-12T09:21:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed8fa9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9ed4143d20 0x7f9ed40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed8fa9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9ed40ce550 0x7f9ed40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed8fa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ed41447f0 0x7f9ed415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed8fa9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40cea30 con 0x7f9ed4143d20 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed8fa9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed40702b0 con 0x7f9ed40ce550 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed8fa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4070590 con 0x7f9ed41447f0 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9ed4143d20 0x7f9ed40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9ed4143d20 0x7f9ed40b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54838/0 (socket says 172.21.15.84:54838) 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.312+0000 7f9ed259c640 1 -- 172.21.15.84:0/4201318146 learned_addr learned my addr 172.21.15.84:0/4201318146 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.313+0000 7f9ed259c640 1 -- 172.21.15.84:0/4201318146 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ed41447f0 msgr2=0x7f9ed415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.313+0000 7f9ed259c640 1 --2- 172.21.15.84:0/4201318146 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ed41447f0 0x7f9ed415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.313+0000 7f9ed259c640 1 -- 172.21.15.84:0/4201318146 >> v2:172.21.15.99:3300/0 conn(0x7f9ed40ce550 msgr2=0x7f9ed40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.313+0000 7f9ed259c640 1 --2- 172.21.15.84:0/4201318146 >> v2:172.21.15.99:3300/0 conn(0x7f9ed40ce550 0x7f9ed40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.313+0000 7f9ed259c640 1 -- 172.21.15.84:0/4201318146 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4070870 con 0x7f9ed4143d20 2023-12-12T09:21:42.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.314+0000 7f9ed259c640 1 --2- 172.21.15.84:0/4201318146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4143d20 0x7f9ed40b40d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9ed406be30 tx=0x7f9ec402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210f14cb460088e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.314+0000 7f9ed1d9b640 1 -- 172.21.15.84:0/4201318146 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec402ca80 con 0x7f9ed4143d20 2023-12-12T09:21:42.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.314+0000 7f9ed1d9b640 1 -- 172.21.15.84:0/4201318146 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec402cbe0 con 0x7f9ed4143d20 2023-12-12T09:21:42.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.314+0000 7f9ed1d9b640 1 -- 172.21.15.84:0/4201318146 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40343f0 con 0x7f9ed4143d20 2023-12-12T09:21:42.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/4201318146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4143d20 msgr2=0x7f9ed40b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/4201318146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4143d20 0x7f9ed40b40d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9ed406be30 tx=0x7f9ec402bee0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/4201318146 shutdown_connections 2023-12-12T09:21:42.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/4201318146 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ed41447f0 0x7f9ed415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/4201318146 >> v2:172.21.15.99:3300/0 conn(0x7f9ed40ce550 0x7f9ed40b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/4201318146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed4143d20 0x7f9ed40b40d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/4201318146 >> 172.21.15.84:0/4201318146 conn(0x7f9ed406c3d0 msgr2=0x7f9ed406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/4201318146 shutdown_connections 2023-12-12T09:21:42.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.315+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/4201318146 wait complete. 2023-12-12T09:21:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.317+0000 7f9ed8fa9640 1 Processor -- start 2023-12-12T09:21:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.317+0000 7f9ed8fa9640 1 -- start start 2023-12-12T09:21:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed8fa9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed40ce550 0x7f9ed41376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed8fa9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ed4143d20 0x7f9ed40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed8fa9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed41447f0 0x7f9ed40b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed8fa9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41411a0 con 0x7f9ed40ce550 2023-12-12T09:21:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed8fa9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4142000 con 0x7f9ed41447f0 2023-12-12T09:21:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed8fa9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4135030 con 0x7f9ed4143d20 2023-12-12T09:21:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed40ce550 0x7f9ed41376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed40ce550 0x7f9ed41376b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54842/0 (socket says 172.21.15.84:54842) 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed259c640 1 -- 172.21.15.84:0/1590919837 learned_addr learned my addr 172.21.15.84:0/1590919837 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed259c640 1 -- 172.21.15.84:0/1590919837 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ed4143d20 msgr2=0x7f9ed40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed259c640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ed4143d20 0x7f9ed40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed259c640 1 -- 172.21.15.84:0/1590919837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed41447f0 msgr2=0x7f9ed40b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed259c640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed41447f0 0x7f9ed40b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.318+0000 7f9ed259c640 1 -- 172.21.15.84:0/1590919837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009b30 con 0x7f9ed40ce550 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.319+0000 7f9ed259c640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed40ce550 0x7f9ed41376b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4036040 tx=0x7f9ec4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.319+0000 7f9ecb7fe640 1 -- 172.21.15.84:0/1590919837 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec403e450 con 0x7f9ed40ce550 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.319+0000 7f9ecb7fe640 1 -- 172.21.15.84:0/1590919837 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec403e5d0 con 0x7f9ed40ce550 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.319+0000 7f9ecb7fe640 1 -- 172.21.15.84:0/1590919837 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec403e980 con 0x7f9ed40ce550 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.319+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/1590919837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed41413f0 con 0x7f9ed40ce550 2023-12-12T09:21:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.319+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/1590919837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed41419b0 con 0x7f9ed40ce550 2023-12-12T09:21:42.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.322+0000 7f9ecb7fe640 1 -- 172.21.15.84:0/1590919837 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ec402cd50 con 0x7f9ed40ce550 2023-12-12T09:21:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.323+0000 7f9ecb7fe640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9eb406ae70 0x7f9eb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.323+0000 7f9ecb7fe640 1 -- 172.21.15.84:0/1590919837 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9ec40ac130 con 0x7f9ed40ce550 2023-12-12T09:21:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.323+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9eb406ae70 0x7f9eb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.324+0000 7f9edbc1a740 1 Processor -- start 2023-12-12T09:21:42.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.324+0000 7f9edbc1a740 1 -- start start 2023-12-12T09:21:42.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.324+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9eb406ae70 0x7f9eb406d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40b0a60 tx=0x7f9ebc006c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe5e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe2e2c0 0x55a1afe5b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1afda0f40 con 0x55a1afe31b90 2023-12-12T09:21:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1afd9e630 con 0x55a1afe2e2c0 2023-12-12T09:21:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1afd99f20 con 0x55a1afe5e010 2023-12-12T09:21:42.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9ed2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9ed2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54858/0 (socket says 172.21.15.84:54858) 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9ed2d9d640 1 -- 172.21.15.84:0/2488215499 learned_addr learned my addr 172.21.15.84:0/2488215499 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9ed2d9d640 1 -- 172.21.15.84:0/2488215499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 msgr2=0x55a1afe5e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9ed2d9d640 1 --2- 172.21.15.84:0/2488215499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe5e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9ed2d9d640 1 -- 172.21.15.84:0/2488215499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe2e2c0 msgr2=0x55a1afe5b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9ed2d9d640 1 --2- 172.21.15.84:0/2488215499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe2e2c0 0x55a1afe5b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.325+0000 7f9ed2d9d640 1 -- 172.21.15.84:0/2488215499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1afd5c910 con 0x55a1afe31b90 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.326+0000 7f9ed2d9d640 1 --2- 172.21.15.84:0/2488215499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5b7c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0096c0 tx=0x7f9ecc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45014f131dd8e1df server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.326+0000 7f9eb3fff640 1 -- 172.21.15.84:0/2488215499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00b8c0 con 0x55a1afe31b90 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.326+0000 7f9eb3fff640 1 -- 172.21.15.84:0/2488215499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00ba20 con 0x55a1afe31b90 2023-12-12T09:21:42.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.326+0000 7f9eb3fff640 1 -- 172.21.15.84:0/2488215499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00bdb0 con 0x55a1afe31b90 2023-12-12T09:21:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 -- 172.21.15.84:0/2488215499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 msgr2=0x55a1afe5b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/2488215499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5b7c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0096c0 tx=0x7f9ecc009b80 comp rx=0 tx=0).stop 2023-12-12T09:21:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 -- 172.21.15.84:0/2488215499 shutdown_connections 2023-12-12T09:21:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/2488215499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5b7c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/2488215499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe2e2c0 0x55a1afe5b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/2488215499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe5e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 -- 172.21.15.84:0/2488215499 >> 172.21.15.84:0/2488215499 conn(0x55a1afe30530 msgr2=0x55a1afe78e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 -- 172.21.15.84:0/2488215499 shutdown_connections 2023-12-12T09:21:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.327+0000 7f9edbc1a740 1 -- 172.21.15.84:0/2488215499 wait complete. 2023-12-12T09:21:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.328+0000 7f9edbc1a740 1 -- start start 2023-12-12T09:21:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.328+0000 7f9edbc1a740 1 Processor -- start 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe603f0 0x55a1afe56be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1afd362f0 con 0x55a1afe31b90 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1afd53c70 con 0x55a1afe603f0 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1afafcf20 con 0x55a1afe5e010 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9edbc1a740 10 client.0 _ll_register_callbacks cb 0x55a1afd583b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9ed259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9ed259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54860/0 (socket says 172.21.15.84:54860) 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.329+0000 7f9ed259c640 1 -- 172.21.15.84:0/3175034272 learned_addr learned my addr 172.21.15.84:0/3175034272 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9ed259c640 1 -- 172.21.15.84:0/3175034272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 msgr2=0x55a1afe566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9ed259c640 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9ed2d9d640 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe603f0 0x55a1afe56be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9ed259c640 1 -- 172.21.15.84:0/3175034272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe603f0 msgr2=0x55a1afe56be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9ed259c640 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe603f0 0x55a1afe56be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9ed259c640 1 -- 172.21.15.84:0/3175034272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc0092f0 con 0x55a1afe31b90 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9ed259c640 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5feb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4077260 tx=0x7f9ec407a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dcd63147724d79 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9eb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9eb17fa640 1 -- 172.21.15.84:0/3175034272 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec407a450 con 0x55a1afe31b90 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9eb17fa640 1 -- 172.21.15.84:0/3175034272 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9ec407ad60 con 0x55a1afe31b90 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3175034272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1afd92db0 con 0x55a1afe31b90 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9eb17fa640 1 -- 172.21.15.84:0/3175034272 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ec407eeb0 con 0x55a1afe31b90 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9edbc1a740 10 client.5748 fetch_fsmap learned FSMap version 17 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.330+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3175034272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a1afd985a0 con 0x55a1afe31b90 2023-12-12T09:21:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9eb17fa640 1 -- 172.21.15.84:0/3175034272 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a1afd92db0 con 0x55a1afe31b90 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9eb17fa640 1 -- 172.21.15.84:0/3175034272 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9ec403c070 con 0x55a1afe31b90 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9edbc1a740 10 client.5748 fetch_fsmap finished waiting for FSMap version 17 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9edbc1a740 10 client.5748 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9edbc1a740 20 client.5748 populate_metadata read hostname 'smithi084' 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] conn(0x55a1afe8d7e0 0x55a1afe57d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9edbc1a740 4 client.5748 mds_command: new command op to 5556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3175034272 --> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1afd92ad0 con 0x55a1afe8d7e0 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.331+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] conn(0x55a1afe8d7e0 0x55a1afe57d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.332+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] conn(0x55a1afe8d7e0 0x55a1afe57d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60ed95139824dff server_cookie=6f122b0f674b1b28 in_seq=0 out_seq=0 2023-12-12T09:21:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.332+0000 7f9eb17fa640 10 client.5748 ms_handle_connect on v2:172.21.15.84:6834/1717242900 2023-12-12T09:21:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.332+0000 7f9eb17fa640 1 -- 172.21.15.84:0/3175034272 <== mds.0 v2:172.21.15.84:6834/1717242900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a1afd92ad0 con 0x55a1afe8d7e0 2023-12-12T09:21:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.332+0000 7f9eb17fa640 10 client.5748 handle_command_reply: tid=0 2023-12-12T09:21:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 client.5748 shutdown 2023-12-12T09:21:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3175034272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 msgr2=0x55a1afe5feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5feb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4077260 tx=0x7f9ec407a6c0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3175034272 shutdown_connections 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] conn(0x55a1afe8d7e0 0x55a1afe57d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe603f0 0x55a1afe56be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3175034272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe31b90 0x55a1afe5feb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9eb17fa640 0 client.5748 ms_handle_reset on v2:172.21.15.84:6834/1717242900 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3175034272 >> 172.21.15.84:0/3175034272 conn(0x55a1afe2e2c0 msgr2=0x55a1afe61cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3175034272 shutdown_connections 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3175034272 wait complete. 2023-12-12T09:21:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.333+0000 7f9edbc1a740 20 client.5748 trim_cache size 0 max 16384 2023-12-12T09:21:42.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.350+0000 7f9edbc1a740 1 Processor -- start 2023-12-12T09:21:42.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.350+0000 7f9edbc1a740 1 -- start start 2023-12-12T09:21:42.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe32280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe5f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe56460 0x55a1afe5fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1afe496b0 con 0x55a1afe603f0 2023-12-12T09:21:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1afe7b9e0 con 0x55a1afe56460 2023-12-12T09:21:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1afe7c330 con 0x55a1afe5e010 2023-12-12T09:21:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9ec9d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe5f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9ec9d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe5f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54862/0 (socket says 172.21.15.84:54862) 2023-12-12T09:21:42.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.351+0000 7f9ec9d9b640 1 -- 172.21.15.84:0/3834537168 learned_addr learned my addr 172.21.15.84:0/3834537168 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:42.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec9d9b640 1 -- 172.21.15.84:0/3834537168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 msgr2=0x55a1afe32280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/3834537168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe32280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec9d9b640 1 -- 172.21.15.84:0/3834537168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe56460 msgr2=0x55a1afe5fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/3834537168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe56460 0x55a1afe5fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec9d9b640 1 -- 172.21.15.84:0/3834537168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1afd35b80 con 0x55a1afe603f0 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/3834537168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe5f500 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40af3d0 tx=0x7f9ebc0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8a993558776950 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec8d99640 1 -- 172.21.15.84:0/3834537168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc01a040 con 0x55a1afe603f0 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec8d99640 1 -- 172.21.15.84:0/3834537168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc020620 con 0x55a1afe603f0 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.352+0000 7f9ec8d99640 1 -- 172.21.15.84:0/3834537168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc015450 con 0x55a1afe603f0 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3834537168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 msgr2=0x55a1afe5f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3834537168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe5f500 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40af3d0 tx=0x7f9ebc0047d0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3834537168 shutdown_connections 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3834537168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe56460 0x55a1afe5fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3834537168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe5f500 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/3834537168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe5e010 0x55a1afe32280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3834537168 >> 172.21.15.84:0/3834537168 conn(0x55a1afe2e2c0 msgr2=0x55a1afe29a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:42.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3834537168 shutdown_connections 2023-12-12T09:21:42.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.353+0000 7f9edbc1a740 1 -- 172.21.15.84:0/3834537168 wait complete. 2023-12-12T09:21:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.354+0000 7f9edbc1a740 1 -- start start 2023-12-12T09:21:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.354+0000 7f9edbc1a740 1 Processor -- start 2023-12-12T09:21:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe56460 0x55a1afeed520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe5e010 0x55a1afe53d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9edbc1a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe54290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1afe30360 con 0x55a1afe603f0 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1afe547d0 con 0x55a1afe5e010 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9edbc1a740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1afe61040 con 0x55a1afe56460 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9edbc1a740 10 client.0 _ll_register_callbacks cb 0x55a1afe5e850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9ed2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe54290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9ed2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe54290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54864/0 (socket says 172.21.15.84:54864) 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9ed2d9d640 1 -- 172.21.15.84:0/490069496 learned_addr learned my addr 172.21.15.84:0/490069496 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9ed2d9d640 1 -- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe56460 msgr2=0x55a1afeed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.355+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe5e010 0x55a1afe53d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9ed259c640 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe56460 0x55a1afeed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9ed2d9d640 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe56460 0x55a1afeed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9ed2d9d640 1 -- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe5e010 msgr2=0x55a1afe53d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9ed2d9d640 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe5e010 0x55a1afe53d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9ed2d9d640 1 -- 172.21.15.84:0/490069496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc015040 con 0x55a1afe603f0 2023-12-12T09:21:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9ec9d9b640 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe5e010 0x55a1afe53d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9ed2d9d640 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe54290 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009690 tx=0x7f9ecc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b394c0d087ad332a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9eb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-12-12T09:21:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9eb17fa640 1 -- 172.21.15.84:0/490069496 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc026650 con 0x55a1afe603f0 2023-12-12T09:21:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9eb17fa640 1 -- 172.21.15.84:0/490069496 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9ecc00be60 con 0x55a1afe603f0 2023-12-12T09:21:42.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.356+0000 7f9edbc1a740 1 -- 172.21.15.84:0/490069496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ecc00ba20 con 0x55a1afe603f0 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9eb17fa640 1 -- 172.21.15.84:0/490069496 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ecc0267b0 con 0x55a1afe603f0 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9edbc1a740 10 client.5754 fetch_fsmap learned FSMap version 17 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9edbc1a740 1 -- 172.21.15.84:0/490069496 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a1afd5b170 con 0x55a1afe603f0 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9eb17fa640 1 -- 172.21.15.84:0/490069496 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00ba20 con 0x55a1afe603f0 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9eb17fa640 1 -- 172.21.15.84:0/490069496 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9ecc026910 con 0x55a1afe603f0 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9edbc1a740 10 client.5754 fetch_fsmap finished waiting for FSMap version 17 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9edbc1a740 10 client.5754 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9edbc1a740 20 client.5754 populate_metadata read hostname 'smithi084' 2023-12-12T09:21:42.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] conn(0x55a1afe32280 0x55a1afe8b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9edbc1a740 4 client.5754 mds_command: new command op to 5556 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9edbc1a740 1 -- 172.21.15.84:0/490069496 --> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a1afa9a6c0 con 0x55a1afe32280 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.357+0000 7f9ed259c640 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] conn(0x55a1afe32280 0x55a1afe8b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9eb17fa640 10 client.5754 ms_handle_connect on v2:172.21.15.84:6834/1717242900 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9ed259c640 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] conn(0x55a1afe32280 0x55a1afe8b560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4f7641827c02bd server_cookie=b9219c80b6d00b61 in_seq=0 out_seq=0 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9eb17fa640 1 -- 172.21.15.84:0/490069496 <== mds.0 v2:172.21.15.84:6834/1717242900 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a1afa9a6c0 con 0x55a1afe32280 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9eb17fa640 10 client.5754 handle_command_reply: tid=0 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 client.5754 shutdown 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 -- 172.21.15.84:0/490069496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 msgr2=0x55a1afe54290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe54290 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009690 tx=0x7f9ecc004730 comp rx=0 tx=0).stop 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 -- 172.21.15.84:0/490069496 shutdown_connections 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.84:6834/1717242900,v1:172.21.15.84:6836/1717242900] conn(0x55a1afe32280 0x55a1afe8b560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a1afe603f0 0x55a1afe54290 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a1afe5e010 0x55a1afe53d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 --2- 172.21.15.84:0/490069496 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55a1afe56460 0x55a1afeed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9eb17fa640 0 client.5754 ms_handle_reset on v2:172.21.15.84:6834/1717242900 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.358+0000 7f9edbc1a740 1 -- 172.21.15.84:0/490069496 >> 172.21.15.84:0/490069496 conn(0x55a1afe2e2c0 msgr2=0x55a1afe48030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9edbc1a740 1 -- 172.21.15.84:0/490069496 shutdown_connections 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9edbc1a740 1 -- 172.21.15.84:0/490069496 wait complete. 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9edbc1a740 20 client.5754 trim_cache size 0 max 16384 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "6cf288f4-52d2-4b85-a338-100a1ef88319", 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5556, 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-12-12T09:21:42.362 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-12-12T09:21:42.363 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-12-12T09:21:42.363 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.572128214999999, 2023-12-12T09:21:42.363 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 17, 2023-12-12T09:21:42.363 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 41, 2023-12-12T09:21:42.363 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 41, 2023-12-12T09:21:42.363 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 20.611365360000001 2023-12-12T09:21:42.363 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9eb406ae70 msgr2=0x7f9eb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9eb406ae70 0x7f9eb406d330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40b0a60 tx=0x7f9ebc006c90 comp rx=0 tx=0).stop 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed40ce550 msgr2=0x7f9ed41376b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed40ce550 0x7f9ed41376b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4036040 tx=0x7f9ec4004a40 comp rx=0 tx=0).stop 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/1590919837 shutdown_connections 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed41447f0 0x7f9ed40b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9ed4143d20 0x7f9ed40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9eb406ae70 0x7f9eb406d330 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 --2- 172.21.15.84:0/1590919837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ed40ce550 0x7f9ed41376b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/1590919837 >> 172.21.15.84:0/1590919837 conn(0x7f9ed406c3d0 msgr2=0x7f9ed413e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.359+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/1590919837 shutdown_connections 2023-12-12T09:21:42.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.360+0000 7f9ed8fa9640 1 -- 172.21.15.84:0/1590919837 wait complete. 2023-12-12T09:21:42.376 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:21:42.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.587+0000 7f5e2e763640 1 Processor -- start 2023-12-12T09:21:42.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.588+0000 7f5e2e763640 1 -- start start 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.589+0000 7f5e2e763640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5e2806de80 0x7f5e2815f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.589+0000 7f5e2e763640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e280705b0 0x7f5e280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.589+0000 7f5e2e763640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e28144b20 con 0x7f5e28144740 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.589+0000 7f5e2e763640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2806e310 con 0x7f5e280705b0 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.589+0000 7f5e2e763640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2806d670 con 0x7f5e2806de80 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2df62640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e280705b0 0x7f5e280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2d761640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5e28144740 0x7f5e2815e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48644/0 (socket says 172.21.15.84:48644) 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2df62640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5e280705b0 0x7f5e280709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54872/0 (socket says 172.21.15.84:54872) 2023-12-12T09:21:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2d761640 1 -- 172.21.15.84:0/1152339658 learned_addr learned my addr 172.21.15.84:0/1152339658 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2cf60640 1 --2- 172.21.15.84:0/1152339658 >> v2:172.21.15.99:3300/0 conn(0x7f5e2806de80 0x7f5e2815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2df62640 1 -- 172.21.15.84:0/1152339658 >> v2:172.21.15.99:3300/0 conn(0x7f5e2806de80 msgr2=0x7f5e2815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2df62640 1 --2- 172.21.15.84:0/1152339658 >> v2:172.21.15.99:3300/0 conn(0x7f5e2806de80 0x7f5e2815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2df62640 1 -- 172.21.15.84:0/1152339658 >> v1:172.21.15.84:6789/0 conn(0x7f5e28144740 legacy=0x7f5e2815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2df62640 1 -- 172.21.15.84:0/1152339658 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2806cdd0 con 0x7f5e280705b0 2023-12-12T09:21:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e2cf60640 1 --2- 172.21.15.84:0/1152339658 >> v2:172.21.15.99:3300/0 conn(0x7f5e2806de80 0x7f5e2815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.590+0000 7f5e1ffff640 1 -- 172.21.15.84:0/1152339658 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025525799 0 0) 0x7f5e28144b20 con 0x7f5e28144740 2023-12-12T09:21:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.591+0000 7f5e2df62640 1 --2- 172.21.15.84:0/1152339658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e280705b0 0x7f5e280709e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5e28071c90 tx=0x7f5e2002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9effd370df28604d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.591+0000 7f5e1ffff640 1 -- 172.21.15.84:0/1152339658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2002cc80 con 0x7f5e280705b0 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.591+0000 7f5e1ffff640 1 -- 172.21.15.84:0/1152339658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2002cde0 con 0x7f5e280705b0 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.591+0000 7f5e1ffff640 1 -- 172.21.15.84:0/1152339658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20034660 con 0x7f5e280705b0 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.592+0000 7f5e2e763640 1 -- 172.21.15.84:0/1152339658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e280705b0 msgr2=0x7f5e280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.592+0000 7f5e2e763640 1 --2- 172.21.15.84:0/1152339658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e280705b0 0x7f5e280709e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5e28071c90 tx=0x7f5e2002bed0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.592+0000 7f5e2e763640 1 -- 172.21.15.84:0/1152339658 shutdown_connections 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.592+0000 7f5e2e763640 1 --2- 172.21.15.84:0/1152339658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e280705b0 0x7f5e280709e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.592+0000 7f5e2e763640 1 --2- 172.21.15.84:0/1152339658 >> v2:172.21.15.99:3300/0 conn(0x7f5e2806de80 0x7f5e2815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.592+0000 7f5e2e763640 1 -- 172.21.15.84:0/1152339658 >> 172.21.15.84:0/1152339658 conn(0x7f5e280b07f0 msgr2=0x7f5e280b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.592+0000 7f5e2e763640 1 -- 172.21.15.84:0/1152339658 shutdown_connections 2023-12-12T09:21:42.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.592+0000 7f5e2e763640 1 -- 172.21.15.84:0/1152339658 wait complete. 2023-12-12T09:21:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.594+0000 7f5e2e763640 1 Processor -- start 2023-12-12T09:21:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.594+0000 7f5e2e763640 1 -- start start 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2e763640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e2806de80 0x7f5e28137f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2e763640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e280705b0 0x7f5e2812d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2e763640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e28144740 0x7f5e281570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2e763640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2815bc30 con 0x7f5e2806de80 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2e763640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2812d7f0 con 0x7f5e280705b0 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2e763640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e281f0a30 con 0x7f5e28144740 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2d761640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e2806de80 0x7f5e28137f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2d761640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e2806de80 0x7f5e28137f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54884/0 (socket says 172.21.15.84:54884) 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.595+0000 7f5e2d761640 1 -- 172.21.15.84:0/4257880022 learned_addr learned my addr 172.21.15.84:0/4257880022 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2d761640 1 -- 172.21.15.84:0/4257880022 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e28144740 msgr2=0x7f5e281570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2d761640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e28144740 0x7f5e281570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2d761640 1 -- 172.21.15.84:0/4257880022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e280705b0 msgr2=0x7f5e2812d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2cf60640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e280705b0 0x7f5e2812d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2d761640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e280705b0 0x7f5e2812d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2d761640 1 -- 172.21.15.84:0/4257880022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20009a70 con 0x7f5e2806de80 2023-12-12T09:21:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2d761640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e2806de80 0x7f5e28137f50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c460 tx=0x7f5e2400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e1dffb640 1 -- 172.21.15.84:0/4257880022 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240074e0 con 0x7f5e2806de80 2023-12-12T09:21:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e1dffb640 1 -- 172.21.15.84:0/4257880022 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24007660 con 0x7f5e2806de80 2023-12-12T09:21:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e1dffb640 1 -- 172.21.15.84:0/4257880022 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24004a20 con 0x7f5e2806de80 2023-12-12T09:21:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2813ae70 con 0x7f5e2806de80 2023-12-12T09:21:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.596+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2815b570 con 0x7f5e2806de80 2023-12-12T09:21:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.598+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2806dca0 con 0x7f5e2806de80 2023-12-12T09:21:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.599+0000 7f5e1dffb640 1 -- 172.21.15.84:0/4257880022 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e24004b80 con 0x7f5e2806de80 2023-12-12T09:21:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.599+0000 7f5e1dffb640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e0c06ae40 0x7f5e0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.600+0000 7f5e1dffb640 1 -- 172.21.15.84:0/4257880022 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e240889f0 con 0x7f5e2806de80 2023-12-12T09:21:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.600+0000 7f5e2cf60640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e0c06ae40 0x7f5e0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:42.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.601+0000 7f5e2cf60640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e0c06ae40 0x7f5e0c06d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5e28137c60 tx=0x7f5e18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:42.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.605+0000 7f5e1dffb640 1 -- 172.21.15.84:0/4257880022 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e240538c0 con 0x7f5e2806de80 2023-12-12T09:21:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.831+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5e280673c0 con 0x7f5e2806de80 2023-12-12T09:21:42.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.831+0000 7f5e1dffb640 1 -- 172.21.15.84:0/4257880022 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5e24018070 con 0x7f5e2806de80 2023-12-12T09:21:42.832 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:21:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e0c06ae40 msgr2=0x7f5e0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e0c06ae40 0x7f5e0c06d300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5e28137c60 tx=0x7f5e18008040 comp rx=0 tx=0).stop 2023-12-12T09:21:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e2806de80 msgr2=0x7f5e28137f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:42.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e2806de80 0x7f5e28137f50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c460 tx=0x7f5e2400c920 comp rx=0 tx=0).stop 2023-12-12T09:21:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 shutdown_connections 2023-12-12T09:21:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5e28144740 0x7f5e281570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e280705b0 0x7f5e2812d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5e0c06ae40 0x7f5e0c06d300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 --2- 172.21.15.84:0/4257880022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e2806de80 0x7f5e28137f50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 >> 172.21.15.84:0/4257880022 conn(0x7f5e280b07f0 msgr2=0x7f5e28159540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 shutdown_connections 2023-12-12T09:21:42.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:42.834+0000 7f5e2e763640 1 -- 172.21.15.84:0/4257880022 wait complete. 2023-12-12T09:21:42.852 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:21:42.852 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:21:42.853 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:21:42.853 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:21:42.853 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:21:42.853 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:21:42.853 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:21:42.853 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:21:42.853 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:21:42.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:42.853 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:21:42.903 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42101sec preferred_lft 42101sec 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c8b:52ff:fef6:cd60/64 scope link 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:21:42.904 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:21:42.905 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c2:ab:b4:6c:14:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:21:42.905 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c0ab:b4ff:fe6c:1499/64 scope link 2023-12-12T09:21:42.905 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:21:42.905 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:21:42.905 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:21:42.905 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3c57:6bff:fed3:b000/64 scope link 2023-12-12T09:21:42.905 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:21:42.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:42.906 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:21:42.994 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:21:42.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:42.999 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:21:43.053 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:21:43.053 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:21:43.054 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:21:43.054 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:21:43.054 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:21:43.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:43.055 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:21:43.055 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:21:43.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:21:43.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:21:43.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:21:43.055 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:21:43.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:43.240 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:21:43.291 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:21:43.291 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T09:21:43.293 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:21:43.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:43.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-12-12T09:21:43.387 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T09:21:43.387 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:21:43.387 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:21:43.443 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:21:43.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:21:43.443 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:21:43.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:21:43.579 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:21:43.634 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:21:43.634 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:21:43.634 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:21:43.634 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:21:43.634 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:21:43.634 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:21:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:21:43.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:21:43.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:43.637 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:21:43.685 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:21:43.685 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T09:21:43.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:21:43.765 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:21:43.805 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:21:43.805 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:21:43.805 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:21:43.806 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:21:43.807 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:21:43.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:21:43.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:21:43.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:21:43.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:43.809 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:21:43.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-12-12T09:21:43.875+0000 7f6a55444480 -1 init, newargv = 0x563e46a81bb0 newargc=15 2023-12-12T09:21:43.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[104786]: starting ceph client 2023-12-12T09:21:43.885 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[104786]: starting fuse 2023-12-12T09:21:43.896 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:21:43.896 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-12T09:21:43.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:21:43.896 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:21:43.896 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:21:43.896 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:21:43.896 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:21:43.897 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:21:43.898 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:21:43.898 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:21:43.898 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:21:43.898 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:21:43.898 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:21:43.898 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-12-12T09:21:43.898 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:21:44.095 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.104786.asok 2023-12-12T09:21:44.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:21:44.113 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.104786.asok 2023-12-12T09:21:44.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:44.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.104786.asok status 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "104786", 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:21:44.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5769, 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 5769 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1606903766 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:44.353 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1606903766 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.5769 192.168.0.1:0/1606903766", 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/1606903766", 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 17, 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 41, 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:21:44.354 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:21:44.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:44.366 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:21:44.367 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T09:21:44.423 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:21:44.423 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T09:21:44.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:44.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:21:44.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-12-12T09:21:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.729+0000 7fd588c75640 1 Processor -- start 2023-12-12T09:21:44.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.729+0000 7fd588c75640 1 -- start start 2023-12-12T09:21:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.731+0000 7fd588c75640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd5840cbd20 0x7fd58416c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.731+0000 7fd588c75640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5840b32d0 con 0x7fd584162840 2023-12-12T09:21:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.731+0000 7fd588c75640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5840b35b0 con 0x7fd58415f270 2023-12-12T09:21:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.731+0000 7fd588c75640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd584162cc0 con 0x7fd5840cbd20 2023-12-12T09:21:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.731+0000 7fd57bfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd584162840 0x7fd5840cb610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48650/0 (socket says 172.21.15.84:48650) 2023-12-12T09:21:44.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.731+0000 7fd57bfff640 1 -- 172.21.15.84:0/1559562249 learned_addr learned my addr 172.21.15.84:0/1559562249 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.731+0000 7fd582d9d640 1 --2- 172.21.15.84:0/1559562249 >> v2:172.21.15.99:3300/0 conn(0x7fd5840cbd20 0x7fd58416c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.731+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439402123 0 0) 0x7fd5840b32d0 con 0x7fd584162840 2023-12-12T09:21:44.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd570003520 con 0x7fd584162840 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314680030 0 0) 0x7fd570003520 con 0x7fd584162840 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 >> v2:172.21.15.99:3300/0 conn(0x7fd5840cbd20 msgr2=0x7fd58416c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 --2- 172.21.15.84:0/1559562249 >> v2:172.21.15.99:3300/0 conn(0x7fd5840cbd20 0x7fd58416c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 >> v1:172.21.15.99:6789/0 conn(0x7fd58415f270 legacy=0x7fd5840b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840b3890 con 0x7fd584162840 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fd56c001670 con 0x7fd584162840 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 >> v1:172.21.15.84:6789/0 conn(0x7fd584162840 legacy=0x7fd5840cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd570003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5700047c0 0x7fd570004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5700051d0 0x7fd57000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd584162cc0 con 0x7fd570003a50 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57000c100 con 0x7fd5700051d0 2023-12-12T09:21:44.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57000c2c0 con 0x7fd5700047c0 2023-12-12T09:21:44.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.732+0000 7fd58259c640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd570003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:44.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.733+0000 7fd58259c640 1 -- 172.21.15.84:0/1559562249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5700047c0 msgr2=0x7fd570004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:44.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.733+0000 7fd58259c640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5700047c0 0x7fd570004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:44.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.733+0000 7fd58259c640 1 -- 172.21.15.84:0/1559562249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5700051d0 msgr2=0x7fd57000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:44.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.733+0000 7fd58259c640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5700051d0 0x7fd57000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:44.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.733+0000 7fd58259c640 1 -- 172.21.15.84:0/1559562249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570003520 con 0x7fd570003a50 2023-12-12T09:21:44.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.733+0000 7fd582d9d640 1 -- 172.21.15.84:0/1559562249 reap_dead start 2023-12-12T09:21:44.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.734+0000 7fd58259c640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd570003e70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd574001720 tx=0x7fd5700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b177dae621abbbb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:44.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.734+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740052d0 con 0x7fd570003a50 2023-12-12T09:21:44.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.734+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57402e050 con 0x7fd570003a50 2023-12-12T09:21:44.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.734+0000 7fd581d9b640 1 -- 172.21.15.84:0/1559562249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574003830 con 0x7fd570003a50 2023-12-12T09:21:44.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.735+0000 7fd588c75640 1 -- 172.21.15.84:0/1559562249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 msgr2=0x7fd570003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:44.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.735+0000 7fd588c75640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd570003e70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd574001720 tx=0x7fd5700057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:44.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.735+0000 7fd588c75640 1 -- 172.21.15.84:0/1559562249 shutdown_connections 2023-12-12T09:21:44.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.735+0000 7fd588c75640 1 --2- 172.21.15.84:0/1559562249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd570003e70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:44.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.735+0000 7fd588c75640 1 -- 172.21.15.84:0/1559562249 >> 172.21.15.84:0/1559562249 conn(0x7fd5840b0970 msgr2=0x7fd5840b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:44.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.735+0000 7fd588c75640 1 -- 172.21.15.84:0/1559562249 shutdown_connections 2023-12-12T09:21:44.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.735+0000 7fd588c75640 1 -- 172.21.15.84:0/1559562249 wait complete. 2023-12-12T09:21:44.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.737+0000 7fd588c75640 1 Processor -- start 2023-12-12T09:21:44.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.737+0000 7fd588c75640 1 -- start start 2023-12-12T09:21:44.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd588c75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd584147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:44.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd588c75640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584147ac0 0x7fd584160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:44.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd588c75640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584160e90 0x7fd5841fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:44.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd588c75640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd584161310 con 0x7fd570003a50 2023-12-12T09:21:44.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd588c75640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5841fb450 con 0x7fd584160e90 2023-12-12T09:21:44.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd588c75640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58415d3b0 con 0x7fd584147ac0 2023-12-12T09:21:44.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd58259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd584147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:44.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd58259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd584147580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54892/0 (socket says 172.21.15.84:54892) 2023-12-12T09:21:44.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.738+0000 7fd58259c640 1 -- 172.21.15.84:0/4044249260 learned_addr learned my addr 172.21.15.84:0/4044249260 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd582d9d640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584160e90 0x7fd5841fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd58259c640 1 -- 172.21.15.84:0/4044249260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584147ac0 msgr2=0x7fd584160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd58259c640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584147ac0 0x7fd584160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd58259c640 1 -- 172.21.15.84:0/4044249260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584160e90 msgr2=0x7fd5841fa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd58259c640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584160e90 0x7fd5841fa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd58259c640 1 -- 172.21.15.84:0/4044249260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58415d690 con 0x7fd570003a50 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd582d9d640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584160e90 0x7fd5841fa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd58259c640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd584147580 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd57402bbe0 tx=0x7fd574001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:44.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd57affd640 1 -- 172.21.15.84:0/4044249260 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5740076c0 con 0x7fd570003a50 2023-12-12T09:21:44.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58415d970 con 0x7fd570003a50 2023-12-12T09:21:44.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd57affd640 1 -- 172.21.15.84:0/4044249260 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd574007a30 con 0x7fd570003a50 2023-12-12T09:21:44.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.739+0000 7fd57affd640 1 -- 172.21.15.84:0/4044249260 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd574006be0 con 0x7fd570003a50 2023-12-12T09:21:44.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.740+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58415de90 con 0x7fd570003a50 2023-12-12T09:21:44.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.741+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd584067f60 con 0x7fd570003a50 2023-12-12T09:21:44.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.742+0000 7fd57affd640 1 -- 172.21.15.84:0/4044249260 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd574006d40 con 0x7fd570003a50 2023-12-12T09:21:44.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.742+0000 7fd57affd640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd56406ae40 0x7fd56406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:44.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.743+0000 7fd57affd640 1 -- 172.21.15.84:0/4044249260 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd5740ab5b0 con 0x7fd570003a50 2023-12-12T09:21:44.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.743+0000 7fd57bfff640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd56406ae40 0x7fd56406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:44.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.743+0000 7fd57bfff640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd56406ae40 0x7fd56406d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0018e0 tx=0x7fd56c0014b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:44.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.747+0000 7fd57affd640 1 -- 172.21.15.84:0/4044249260 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5740765a0 con 0x7fd570003a50 2023-12-12T09:21:44.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:44.936+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7fd58415db00 con 0x7fd570003a50 2023-12-12T09:21:45.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.203+0000 7fd57affd640 1 -- 172.21.15.84:0/4044249260 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v42) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd574079bc0 con 0x7fd570003a50 2023-12-12T09:21:45.203 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'data_new' created 2023-12-12T09:21:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.206+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd56406ae40 msgr2=0x7fd56406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.206+0000 7fd588c75640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd56406ae40 0x7fd56406d300 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0018e0 tx=0x7fd56c0014b0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 msgr2=0x7fd584147580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd584147580 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd57402bbe0 tx=0x7fd574001120 comp rx=0 tx=0).stop 2023-12-12T09:21:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 shutdown_connections 2023-12-12T09:21:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd584160e90 0x7fd5841fa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd584147ac0 0x7fd584160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd56406ae40 0x7fd56406d300 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 --2- 172.21.15.84:0/4044249260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd570003a50 0x7fd584147580 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 >> 172.21.15.84:0/4044249260 conn(0x7fd5840b0970 msgr2=0x7fd58415e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 shutdown_connections 2023-12-12T09:21:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.207+0000 7fd588c75640 1 -- 172.21.15.84:0/4044249260 wait complete. 2023-12-12T09:21:45.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2023-12-12T09:21:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.425+0000 7fa578a89640 1 Processor -- start 2023-12-12T09:21:45.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.426+0000 7fa578a89640 1 -- start start 2023-12-12T09:21:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.427+0000 7fa578a89640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa57406d430 0x7fa57406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.427+0000 7fa578a89640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa5740b1dc0 0x7fa5740b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.427+0000 7fa578a89640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa574071c00 con 0x7fa574143860 2023-12-12T09:21:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.427+0000 7fa578a89640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57406ddb0 con 0x7fa5740b1dc0 2023-12-12T09:21:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.427+0000 7fa578a89640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa574143c40 con 0x7fa57406d430 2023-12-12T09:21:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.428+0000 7fa572d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa5740b1dc0 0x7fa5740b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.428+0000 7fa572d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa5740b1dc0 0x7fa5740b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54906/0 (socket says 172.21.15.84:54906) 2023-12-12T09:21:45.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.428+0000 7fa572d9d640 1 -- 172.21.15.84:0/794084071 learned_addr learned my addr 172.21.15.84:0/794084071 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:45.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.428+0000 7fa56bfff640 1 --2- 172.21.15.84:0/794084071 >> v2:172.21.15.99:3300/0 conn(0x7fa57406d430 0x7fa57406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:45.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.428+0000 7fa572d9d640 1 -- 172.21.15.84:0/794084071 >> v2:172.21.15.99:3300/0 conn(0x7fa57406d430 msgr2=0x7fa57406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:45.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.428+0000 7fa572d9d640 1 --2- 172.21.15.84:0/794084071 >> v2:172.21.15.99:3300/0 conn(0x7fa57406d430 0x7fa57406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.428+0000 7fa572d9d640 1 -- 172.21.15.84:0/794084071 >> v1:172.21.15.99:6789/0 conn(0x7fa574143860 legacy=0x7fa5740b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:45.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.428+0000 7fa572d9d640 1 -- 172.21.15.84:0/794084071 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740b4780 con 0x7fa5740b1dc0 2023-12-12T09:21:45.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.430+0000 7fa572d9d640 1 --2- 172.21.15.84:0/794084071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa5740b2210 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa5740cb710 tx=0x7fa56c02dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763cdbfc522b8e04 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:45.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.430+0000 7fa571d9b640 1 -- 172.21.15.84:0/794084071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c02eb70 con 0x7fa5740b1dc0 2023-12-12T09:21:45.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.430+0000 7fa571d9b640 1 -- 172.21.15.84:0/794084071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c02ecd0 con 0x7fa5740b1dc0 2023-12-12T09:21:45.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.430+0000 7fa571d9b640 1 -- 172.21.15.84:0/794084071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c036610 con 0x7fa5740b1dc0 2023-12-12T09:21:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.430+0000 7fa578a89640 1 -- 172.21.15.84:0/794084071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 msgr2=0x7fa5740b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.430+0000 7fa578a89640 1 --2- 172.21.15.84:0/794084071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa5740b2210 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa5740cb710 tx=0x7fa56c02dfd0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.431+0000 7fa578a89640 1 -- 172.21.15.84:0/794084071 shutdown_connections 2023-12-12T09:21:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.431+0000 7fa578a89640 1 --2- 172.21.15.84:0/794084071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa5740b2210 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.431+0000 7fa578a89640 1 --2- 172.21.15.84:0/794084071 >> v2:172.21.15.99:3300/0 conn(0x7fa57406d430 0x7fa57406d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.431+0000 7fa578a89640 1 -- 172.21.15.84:0/794084071 >> 172.21.15.84:0/794084071 conn(0x7fa5740b0ac0 msgr2=0x7fa5740b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.431+0000 7fa578a89640 1 -- 172.21.15.84:0/794084071 shutdown_connections 2023-12-12T09:21:45.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.431+0000 7fa578a89640 1 -- 172.21.15.84:0/794084071 wait complete. 2023-12-12T09:21:45.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.432+0000 7fa578a89640 1 Processor -- start 2023-12-12T09:21:45.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.433+0000 7fa578a89640 1 -- start start 2023-12-12T09:21:45.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.433+0000 7fa578a89640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa57406d430 0x7fa574142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa578a89640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa574139850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa578a89640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa574143860 0x7fa57415a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa578a89640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574139d90 con 0x7fa5740b1dc0 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa578a89640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa574142280 con 0x7fa574143860 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa578a89640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57415cde0 con 0x7fa57406d430 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa574139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa574139850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54916/0 (socket says 172.21.15.84:54916) 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa56bfff640 1 -- 172.21.15.84:0/3354999369 learned_addr learned my addr 172.21.15.84:0/3354999369 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa56bfff640 1 -- 172.21.15.84:0/3354999369 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa57406d430 msgr2=0x7fa574142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa56bfff640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa57406d430 0x7fa574142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa56bfff640 1 -- 172.21.15.84:0/3354999369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa574143860 msgr2=0x7fa57415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa56bfff640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa574143860 0x7fa57415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.434+0000 7fa56bfff640 1 -- 172.21.15.84:0/3354999369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c009b30 con 0x7fa5740b1dc0 2023-12-12T09:21:45.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.435+0000 7fa56bfff640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa574139850 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d5f0 tx=0x7fa55c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.435+0000 7fa56affd640 1 -- 172.21.15.84:0/3354999369 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0125f0 con 0x7fa5740b1dc0 2023-12-12T09:21:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.435+0000 7fa56affd640 1 -- 172.21.15.84:0/3354999369 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c012750 con 0x7fa5740b1dc0 2023-12-12T09:21:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.435+0000 7fa56affd640 1 -- 172.21.15.84:0/3354999369 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c012b00 con 0x7fa5740b1dc0 2023-12-12T09:21:45.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.435+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa574141c30 con 0x7fa5740b1dc0 2023-12-12T09:21:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.435+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57415d0c0 con 0x7fa5740b1dc0 2023-12-12T09:21:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.436+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5740673c0 con 0x7fa5740b1dc0 2023-12-12T09:21:45.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.437+0000 7fa56affd640 1 -- 172.21.15.84:0/3354999369 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa55c012c60 con 0x7fa5740b1dc0 2023-12-12T09:21:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.438+0000 7fa56affd640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa55406ae70 0x7fa55406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.438+0000 7fa56affd640 1 -- 172.21.15.84:0/3354999369 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6392+0+0 (secure 0 0 0) 0x7fa55c089da0 con 0x7fa5740b1dc0 2023-12-12T09:21:45.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.438+0000 7fa57259c640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa55406ae70 0x7fa55406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:45.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.439+0000 7fa57259c640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa55406ae70 0x7fa55406d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa564003cc0 tx=0x7fa5640079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:45.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.443+0000 7fa56affd640 1 -- 172.21.15.84:0/3354999369 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa55c054b00 con 0x7fa5740b1dc0 2023-12-12T09:21:45.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:45.671+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7fa574072380 con 0x7fa5740b1dc0 2023-12-12T09:21:46.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.227+0000 7fa56affd640 1 -- 172.21.15.84:0/3354999369 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 7 to fsmap v18) v1 ==== 131+0+0 (secure 0 0 0) 0x7fa55c058120 con 0x7fa5740b1dc0 2023-12-12T09:21:46.233 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 7 to fsmap 2023-12-12T09:21:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.238+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa55406ae70 msgr2=0x7fa55406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.238+0000 7fa578a89640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa55406ae70 0x7fa55406d330 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa564003cc0 tx=0x7fa5640079b0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.238+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 msgr2=0x7fa574139850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.238+0000 7fa578a89640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa574139850 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d5f0 tx=0x7fa55c00dab0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.239+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 shutdown_connections 2023-12-12T09:21:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.239+0000 7fa578a89640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa574143860 0x7fa57415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.239+0000 7fa578a89640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa55406ae70 0x7fa55406d330 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.239+0000 7fa578a89640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5740b1dc0 0x7fa574139850 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.239+0000 7fa578a89640 1 --2- 172.21.15.84:0/3354999369 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa57406d430 0x7fa574142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.239+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 >> 172.21.15.84:0/3354999369 conn(0x7fa5740b0ac0 msgr2=0x7fa5740b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:46.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.241+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 shutdown_connections 2023-12-12T09:21:46.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.241+0000 7fa578a89640 1 -- 172.21.15.84:0/3354999369 wait complete. 2023-12-12T09:21:46.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:21:46.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.447+0000 7f8159209640 1 Processor -- start 2023-12-12T09:21:46.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.447+0000 7f8159209640 1 -- start start 2023-12-12T09:21:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.448+0000 7f8159209640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8154144740 0x7f815406de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f8159209640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f815415e950 0x7f815415edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f8159209640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8154144b20 con 0x7f815415f2f0 2023-12-12T09:21:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f8159209640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815415f760 con 0x7f8154144740 2023-12-12T09:21:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f8159209640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815406d670 con 0x7f815415e950 2023-12-12T09:21:46.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f8158a08640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f815415f2f0 0x7f81540cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41540/0 (socket says 172.21.15.84:41540) 2023-12-12T09:21:46.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f8158a08640 1 -- 172.21.15.84:0/1341975567 learned_addr learned my addr 172.21.15.84:0/1341975567 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:46.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f8153fff640 1 --2- 172.21.15.84:0/1341975567 >> v2:172.21.15.99:3300/0 conn(0x7f8154144740 0x7f815406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f81537fe640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f815415e950 0x7f815415edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.449+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424096359 0 0) 0x7f8154144b20 con 0x7f815415f2f0 2023-12-12T09:21:46.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8140003520 con 0x7f815415f2f0 2023-12-12T09:21:46.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2807080214 0 0) 0x7f8140003520 con 0x7f815415f2f0 2023-12-12T09:21:46.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f815415e950 msgr2=0x7f815415edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:46.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f815415e950 0x7f815415edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 >> v2:172.21.15.99:3300/0 conn(0x7f8154144740 msgr2=0x7f815406de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:46.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 --2- 172.21.15.84:0/1341975567 >> v2:172.21.15.99:3300/0 conn(0x7f8154144740 0x7f815406de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815406cdd0 con 0x7f815415f2f0 2023-12-12T09:21:46.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f814c001670 con 0x7f815415f2f0 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 >> v1:172.21.15.84:6789/0 conn(0x7f815415f2f0 legacy=0x7f81540cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f815415e950 0x7f8140003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140003ff0 0x7f81400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8140004d00 0x7f8140005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815415f760 con 0x7f8140004d00 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815406d670 con 0x7f8140003ff0 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814000bae0 con 0x7f815415e950 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8153fff640 1 --2- 172.21.15.84:0/1341975567 >> v2:172.21.15.99:3300/0 conn(0x7f8154144740 0x7f815406de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:21:46.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.450+0000 7f8158a08640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8140004d00 0x7f8140005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.451+0000 7f81537fe640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140003ff0 0x7f81400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.451+0000 7f8158a08640 1 -- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f815415e950 msgr2=0x7f8140003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.451+0000 7f8158a08640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f815415e950 0x7f8140003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.451+0000 7f8158a08640 1 -- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140003ff0 msgr2=0x7f81400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.451+0000 7f8158a08640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140003ff0 0x7f81400047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.451+0000 7f8158a08640 1 -- 172.21.15.84:0/1341975567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140003520 con 0x7f8140004d00 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.452+0000 7f8158a08640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8140004d00 0x7f8140005180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f814c00c110 tx=0x7f81400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a894d994e6a61c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.452+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c005ad0 con 0x7f8140004d00 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.452+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c005c50 con 0x7f8140004d00 2023-12-12T09:21:46.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.452+0000 7f8152ffd640 1 -- 172.21.15.84:0/1341975567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c02c830 con 0x7f8140004d00 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.452+0000 7f8159209640 1 -- 172.21.15.84:0/1341975567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8140004d00 msgr2=0x7f8140005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.452+0000 7f8159209640 1 --2- 172.21.15.84:0/1341975567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8140004d00 0x7f8140005180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f814c00c110 tx=0x7f81400057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.452+0000 7f8158a08640 1 -- 172.21.15.84:0/1341975567 reap_dead start 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.453+0000 7f8159209640 1 -- 172.21.15.84:0/1341975567 shutdown_connections 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.453+0000 7f8159209640 1 -- 172.21.15.84:0/1341975567 >> 172.21.15.84:0/1341975567 conn(0x7f81540b07f0 msgr2=0x7f81540b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.453+0000 7f8159209640 1 -- 172.21.15.84:0/1341975567 shutdown_connections 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.453+0000 7f8159209640 1 -- 172.21.15.84:0/1341975567 wait complete. 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.454+0000 7f8159209640 1 Processor -- start 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.455+0000 7f8159209640 1 -- start start 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.455+0000 7f8159209640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140004d00 0x7f8154157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8159209640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f81541f2870 0x7f8154154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8159209640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81540c88e0 0x7f81541595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8159209640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81540c9d90 con 0x7f81540c88e0 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8159209640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81541f2cf0 con 0x7f8140004d00 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8159209640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81540c9110 con 0x7f81541f2870 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8158a08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81540c88e0 0x7f81541595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8158a08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81540c88e0 0x7f81541595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46688/0 (socket says 172.21.15.84:46688) 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8158a08640 1 -- 172.21.15.84:0/3250669290 learned_addr learned my addr 172.21.15.84:0/3250669290 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f81537fe640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f81541f2870 0x7f8154154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8153fff640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140004d00 0x7f8154157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8158a08640 1 -- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f81541f2870 msgr2=0x7f8154154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8158a08640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f81541f2870 0x7f8154154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8158a08640 1 -- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140004d00 msgr2=0x7f8154157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8158a08640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140004d00 0x7f8154157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8158a08640 1 -- 172.21.15.84:0/3250669290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540c93f0 con 0x7f81540c88e0 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f81537fe640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f81541f2870 0x7f8154154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:46.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.456+0000 7f8153fff640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140004d00 0x7f8154157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.457+0000 7f8158a08640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81540c88e0 0x7f81541595e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f814c02c4a0 tx=0x7f814c0019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.457+0000 7f8150ff9640 1 -- 172.21.15.84:0/3250669290 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c03c040 con 0x7f81540c88e0 2023-12-12T09:21:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.457+0000 7f8150ff9640 1 -- 172.21.15.84:0/3250669290 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c02cc40 con 0x7f81540c88e0 2023-12-12T09:21:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.457+0000 7f8150ff9640 1 -- 172.21.15.84:0/3250669290 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c001b80 con 0x7f81540c88e0 2023-12-12T09:21:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.457+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81540c96d0 con 0x7f81540c88e0 2023-12-12T09:21:46.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.457+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8154154850 con 0x7f81540c88e0 2023-12-12T09:21:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.458+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81540673c0 con 0x7f81540c88e0 2023-12-12T09:21:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.459+0000 7f8150ff9640 1 -- 172.21.15.84:0/3250669290 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f814c032070 con 0x7f81540c88e0 2023-12-12T09:21:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.460+0000 7f8150ff9640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f813406ae40 0x7f813406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.460+0000 7f8150ff9640 1 -- 172.21.15.84:0/3250669290 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f814c0aa5b0 con 0x7f81540c88e0 2023-12-12T09:21:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.461+0000 7f8153fff640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f813406ae40 0x7f813406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.461+0000 7f8153fff640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f813406ae40 0x7f813406d300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f81440094c0 tx=0x7f814400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:46.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.465+0000 7f8150ff9640 1 -- 172.21.15.84:0/3250669290 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f814c0752f0 con 0x7f81540c88e0 2023-12-12T09:21:46.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.690+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8154071f60 con 0x7f81540c88e0 2023-12-12T09:21:46.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.691+0000 7f8150ff9640 1 -- 172.21.15.84:0/3250669290 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f814c078910 con 0x7f81540c88e0 2023-12-12T09:21:46.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:46.692 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6834/3349912921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3349912921},{"type":"v1","addr":"172.21.15.99:6834","nonce":3349912921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3102874305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6833","nonce":3102874305},{"type":"v1","addr":"172.21.15.99:6835","nonce":3102874305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2816609542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2816609542},{"type":"v1","addr":"172.21.15.84:6837","nonce":2816609542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:21:30.192583+0000","modified":"2023-12-12T09:21:45.673958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6836/1717242900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1717242900},{"type":"v1","addr":"172.21.15.84:6836","nonce":1717242900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:21:46.692 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-12-12T09:21:46.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f813406ae40 msgr2=0x7f813406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f813406ae40 0x7f813406d300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f81440094c0 tx=0x7f814400b040 comp rx=0 tx=0).stop 2023-12-12T09:21:46.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81540c88e0 msgr2=0x7f81541595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81540c88e0 0x7f81541595e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f814c02c4a0 tx=0x7f814c0019a0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 shutdown_connections 2023-12-12T09:21:46.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f813406ae40 0x7f813406d300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81540c88e0 0x7f81541595e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f81541f2870 0x7f8154154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.693+0000 7f8159209640 1 --2- 172.21.15.84:0/3250669290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8140004d00 0x7f8154157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.694+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 >> 172.21.15.84:0/3250669290 conn(0x7f81540b07f0 msgr2=0x7f815406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:46.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.694+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 shutdown_connections 2023-12-12T09:21:46.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.694+0000 7f8159209640 1 -- 172.21.15.84:0/3250669290 wait complete. 2023-12-12T09:21:46.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:46.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.913+0000 7fbb37c31640 1 Processor -- start 2023-12-12T09:21:46.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.913+0000 7fbb37c31640 1 -- start start 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.915+0000 7fbb37c31640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 0x7fbb300b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.915+0000 7fbb37c31640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbb300ce550 0x7fbb300b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.915+0000 7fbb37c31640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb301447f0 0x7fbb3015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.915+0000 7fbb37c31640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb300cea30 con 0x7fbb301447f0 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.915+0000 7fbb37c31640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb300702b0 con 0x7fbb300ce550 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.915+0000 7fbb37c31640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30070590 con 0x7fbb30143d20 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb361ce640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb301447f0 0x7fbb3015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb361ce640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb301447f0 0x7fbb3015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46704/0 (socket says 172.21.15.84:46704) 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb361ce640 1 -- 172.21.15.84:0/1415895867 learned_addr learned my addr 172.21.15.84:0/1415895867 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:46.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb359cd640 1 --2- 172.21.15.84:0/1415895867 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 0x7fbb300b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb351cc640 1 --2- 172.21.15.84:0/1415895867 >> v2:172.21.15.99:3300/0 conn(0x7fbb300ce550 0x7fbb300b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb361ce640 1 -- 172.21.15.84:0/1415895867 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 msgr2=0x7fbb300b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb361ce640 1 --2- 172.21.15.84:0/1415895867 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 0x7fbb300b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb361ce640 1 -- 172.21.15.84:0/1415895867 >> v2:172.21.15.99:3300/0 conn(0x7fbb300ce550 msgr2=0x7fbb300b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb361ce640 1 --2- 172.21.15.84:0/1415895867 >> v2:172.21.15.99:3300/0 conn(0x7fbb300ce550 0x7fbb300b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.916+0000 7fbb361ce640 1 -- 172.21.15.84:0/1415895867 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30070870 con 0x7fbb301447f0 2023-12-12T09:21:46.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.917+0000 7fbb361ce640 1 --2- 172.21.15.84:0/1415895867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb301447f0 0x7fbb3015eaf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbb3006bd40 tx=0x7fbb2802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f08c008d31502 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb349cb640 1 -- 172.21.15.84:0/1415895867 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2802ca70 con 0x7fbb301447f0 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb349cb640 1 -- 172.21.15.84:0/1415895867 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2802cbd0 con 0x7fbb301447f0 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb349cb640 1 -- 172.21.15.84:0/1415895867 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb280343f0 con 0x7fbb301447f0 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 -- 172.21.15.84:0/1415895867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb301447f0 msgr2=0x7fbb3015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 --2- 172.21.15.84:0/1415895867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb301447f0 0x7fbb3015eaf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbb3006bd40 tx=0x7fbb2802bed0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 -- 172.21.15.84:0/1415895867 shutdown_connections 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 --2- 172.21.15.84:0/1415895867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb301447f0 0x7fbb3015eaf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 --2- 172.21.15.84:0/1415895867 >> v2:172.21.15.99:3300/0 conn(0x7fbb300ce550 0x7fbb300b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 --2- 172.21.15.84:0/1415895867 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 0x7fbb300b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 -- 172.21.15.84:0/1415895867 >> 172.21.15.84:0/1415895867 conn(0x7fbb3006c3d0 msgr2=0x7fbb3006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:46.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 -- 172.21.15.84:0/1415895867 shutdown_connections 2023-12-12T09:21:46.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.918+0000 7fbb37c31640 1 -- 172.21.15.84:0/1415895867 wait complete. 2023-12-12T09:21:46.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.920+0000 7fbb37c31640 1 Processor -- start 2023-12-12T09:21:46.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.920+0000 7fbb37c31640 1 -- start start 2023-12-12T09:21:46.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.921+0000 7fbb37c31640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb300ce550 0x7fbb301f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.921+0000 7fbb37c31640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 0x7fbb301f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.921+0000 7fbb37c31640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb301447f0 0x7fbb3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.921+0000 7fbb37c31640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb301f3310 con 0x7fbb300ce550 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.921+0000 7fbb37c31640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb301f6230 con 0x7fbb301447f0 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.921+0000 7fbb37c31640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3015e2c0 con 0x7fbb30143d20 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.921+0000 7fbb359cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb300ce550 0x7fbb301f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.921+0000 7fbb359cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb300ce550 0x7fbb301f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46714/0 (socket says 172.21.15.84:46714) 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb359cd640 1 -- 172.21.15.84:0/986476048 learned_addr learned my addr 172.21.15.84:0/986476048 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb351cc640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 0x7fbb301f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb359cd640 1 -- 172.21.15.84:0/986476048 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 msgr2=0x7fbb301f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb361ce640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb301447f0 0x7fbb3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb359cd640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 0x7fbb301f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb359cd640 1 -- 172.21.15.84:0/986476048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb301447f0 msgr2=0x7fbb3006d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:46.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb359cd640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb301447f0 0x7fbb3006d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb359cd640 1 -- 172.21.15.84:0/986476048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28009b30 con 0x7fbb300ce550 2023-12-12T09:21:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb359cd640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb300ce550 0x7fbb301f2dd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00d800 tx=0x7fbb2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb267fc640 1 -- 172.21.15.84:0/986476048 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00b6c0 con 0x7fbb300ce550 2023-12-12T09:21:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb267fc640 1 -- 172.21.15.84:0/986476048 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c00b820 con 0x7fbb300ce550 2023-12-12T09:21:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.922+0000 7fbb267fc640 1 -- 172.21.15.84:0/986476048 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c00bbb0 con 0x7fbb300ce550 2023-12-12T09:21:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.923+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb30133130 con 0x7fbb300ce550 2023-12-12T09:21:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.923+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb301336f0 con 0x7fbb300ce550 2023-12-12T09:21:46.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.924+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb300673c0 con 0x7fbb300ce550 2023-12-12T09:21:46.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.925+0000 7fbb267fc640 1 -- 172.21.15.84:0/986476048 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb2c00bd10 con 0x7fbb300ce550 2023-12-12T09:21:46.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.926+0000 7fbb267fc640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb1406ae90 0x7fbb1406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:46.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.926+0000 7fbb267fc640 1 -- 172.21.15.84:0/986476048 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fbb2c089d90 con 0x7fbb300ce550 2023-12-12T09:21:46.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.926+0000 7fbb351cc640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb1406ae90 0x7fbb1406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:46.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.926+0000 7fbb351cc640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb1406ae90 0x7fbb1406d350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb30136660 tx=0x7fbb20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:46.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:46.930+0000 7fbb267fc640 1 -- 172.21.15.84:0/986476048 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb2c054be0 con 0x7fbb300ce550 2023-12-12T09:21:47.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.127+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb3006e3b0 con 0x7fbb300ce550 2023-12-12T09:21:47.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.130+0000 7fbb267fc640 1 -- 172.21.15.84:0/986476048 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18482 (secure 0 0 0) 0x7fbb2c058200 con 0x7fbb300ce550 2023-12-12T09:21:47.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:47.131 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":43,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:45.673359+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb1406ae90 msgr2=0x7fbb1406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb1406ae90 0x7fbb1406d350 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb30136660 tx=0x7fbb20008040 comp rx=0 tx=0).stop 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb300ce550 msgr2=0x7fbb301f2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb300ce550 0x7fbb301f2dd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00d800 tx=0x7fbb2c00dcc0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 shutdown_connections 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb301447f0 0x7fbb3006d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb30143d20 0x7fbb301f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb1406ae90 0x7fbb1406d350 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 --2- 172.21.15.84:0/986476048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb300ce550 0x7fbb301f2dd0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.133+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 >> 172.21.15.84:0/986476048 conn(0x7fbb3006c3d0 msgr2=0x7fbb3013e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.134+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 shutdown_connections 2023-12-12T09:21:47.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.134+0000 7fbb37c31640 1 -- 172.21.15.84:0/986476048 wait complete. 2023-12-12T09:21:47.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:47.152 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2023-12-12T09:21:47.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:47.213 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2023-12-12T09:21:47.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-12-12T09:21:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.467+0000 7f0bc6168640 1 Processor -- start 2023-12-12T09:21:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.468+0000 7f0bc6168640 1 -- start start 2023-12-12T09:21:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.469+0000 7f0bc6168640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc0158c60 0x7f0bc0071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.469+0000 7f0bc6168640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc015c080 con 0x7f0bc009cc60 2023-12-12T09:21:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.469+0000 7f0bc6168640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc0071460 con 0x7f0bc00abd50 2023-12-12T09:21:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.469+0000 7f0bc6168640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0072480 con 0x7f0bc0158c60 2023-12-12T09:21:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.470+0000 7f0bb7fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0bc009cc60 0x7f0bc00ad950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41550/0 (socket says 172.21.15.84:41550) 2023-12-12T09:21:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.470+0000 7f0bb7fff640 1 -- 172.21.15.84:0/3258192931 learned_addr learned my addr 172.21.15.84:0/3258192931 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.470+0000 7f0bbf7fe640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc0158c60 0x7f0bc0071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.470+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639211069 0 0) 0x7f0bc015c080 con 0x7f0bc009cc60 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.470+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bac003520 con 0x7f0bc009cc60 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.470+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2310961699 0 0) 0x7f0bac003520 con 0x7f0bc009cc60 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.470+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc0158c60 msgr2=0x7f0bc0071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.470+0000 7f0bbeffd640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc0158c60 0x7f0bc0071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 >> v1:172.21.15.99:6789/0 conn(0x7f0bc00abd50 legacy=0x7f0bc006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc0071740 con 0x7f0bc009cc60 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f0ba8001670 con 0x7f0bc009cc60 2023-12-12T09:21:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 >> v1:172.21.15.84:6789/0 conn(0x7f0bc009cc60 legacy=0x7f0bc00ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc0158c60 0x7f0bac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac004d00 0x7f0bac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0072480 con 0x7f0bac0039a0 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac00ba30 con 0x7f0bac004d00 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac00bbf0 con 0x7f0bc0158c60 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbf7fe640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bb7fff640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc0158c60 0x7f0bac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbf7fe640 1 -- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc0158c60 msgr2=0x7f0bac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbf7fe640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc0158c60 0x7f0bac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbffff640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac004d00 0x7f0bac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.471+0000 7f0bbf7fe640 1 -- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac004d00 msgr2=0x7f0bac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.472+0000 7f0bbf7fe640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bac004d00 0x7f0bac005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.472+0000 7f0bbf7fe640 1 -- 172.21.15.84:0/3258192931 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac003520 con 0x7f0bac0039a0 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.473+0000 7f0bbf7fe640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bac003dc0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009a90 tx=0x7f0bac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16d04f4330fa16d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.473+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb002c680 con 0x7f0bac0039a0 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.473+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb002c7e0 con 0x7f0bac0039a0 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.473+0000 7f0bbeffd640 1 -- 172.21.15.84:0/3258192931 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb002cb70 con 0x7f0bac0039a0 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.474+0000 7f0bc6168640 1 -- 172.21.15.84:0/3258192931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 msgr2=0x7f0bac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.474+0000 7f0bc6168640 1 --2- 172.21.15.84:0/3258192931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bac003dc0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009a90 tx=0x7f0bac0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.474+0000 7f0bbffff640 1 -- 172.21.15.84:0/3258192931 reap_dead start 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.474+0000 7f0bc6168640 1 -- 172.21.15.84:0/3258192931 shutdown_connections 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.474+0000 7f0bc6168640 1 -- 172.21.15.84:0/3258192931 >> 172.21.15.84:0/3258192931 conn(0x7f0bc00b0a00 msgr2=0x7f0bc00b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.474+0000 7f0bc6168640 1 -- 172.21.15.84:0/3258192931 shutdown_connections 2023-12-12T09:21:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.474+0000 7f0bc6168640 1 -- 172.21.15.84:0/3258192931 wait complete. 2023-12-12T09:21:47.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.475+0000 7f0bc6168640 1 Processor -- start 2023-12-12T09:21:47.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.476+0000 7f0bc6168640 1 -- start start 2023-12-12T09:21:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.476+0000 7f0bc6168640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bc01f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.476+0000 7f0bc6168640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bc015c4e0 0x7f0bc014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.476+0000 7f0bc6168640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc00af1a0 0x7f0bc014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.476+0000 7f0bc6168640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc015e0b0 con 0x7f0bac0039a0 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.476+0000 7f0bc6168640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01f57c0 con 0x7f0bc015c4e0 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.476+0000 7f0bc6168640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc009af60 con 0x7f0bc00af1a0 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bc01f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bc01f5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46726/0 (socket says 172.21.15.84:46726) 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbf7fe640 1 -- 172.21.15.84:0/2914118331 learned_addr learned my addr 172.21.15.84:0/2914118331 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbffff640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc00af1a0 0x7f0bc014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbf7fe640 1 -- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc00af1a0 msgr2=0x7f0bc014b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bb7fff640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bc015c4e0 0x7f0bc014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbf7fe640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc00af1a0 0x7f0bc014b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbf7fe640 1 -- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bc015c4e0 msgr2=0x7f0bc014d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbf7fe640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bc015c4e0 0x7f0bc014d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbf7fe640 1 -- 172.21.15.84:0/2914118331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc015ca10 con 0x7f0bac0039a0 2023-12-12T09:21:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.477+0000 7f0bbffff640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc00af1a0 0x7f0bc014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.478+0000 7f0bbf7fe640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bc01f5280 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0bb002c220 tx=0x7f0bb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.478+0000 7f0bbcff9640 1 -- 172.21.15.84:0/2914118331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0003810 con 0x7f0bac0039a0 2023-12-12T09:21:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.478+0000 7f0bbcff9640 1 -- 172.21.15.84:0/2914118331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0003970 con 0x7f0bac0039a0 2023-12-12T09:21:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.478+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc015ccf0 con 0x7f0bac0039a0 2023-12-12T09:21:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.478+0000 7f0bbcff9640 1 -- 172.21.15.84:0/2914118331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0003ce0 con 0x7f0bac0039a0 2023-12-12T09:21:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.478+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc015d2b0 con 0x7f0bac0039a0 2023-12-12T09:21:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.479+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc0067f60 con 0x7f0bac0039a0 2023-12-12T09:21:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.480+0000 7f0bbcff9640 1 -- 172.21.15.84:0/2914118331 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bb0034440 con 0x7f0bac0039a0 2023-12-12T09:21:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.481+0000 7f0bbcff9640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ba006ae40 0x7f0ba006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.481+0000 7f0bbcff9640 1 -- 172.21.15.84:0/2914118331 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f0bb00ab7c0 con 0x7f0bac0039a0 2023-12-12T09:21:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.481+0000 7f0bb7fff640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ba006ae40 0x7f0ba006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:47.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.482+0000 7f0bb7fff640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ba006ae40 0x7f0ba006d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8001200 tx=0x7f0ba8001110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:47.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.486+0000 7f0bbcff9640 1 -- 172.21.15.84:0/2914118331 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0bb0076640 con 0x7f0bac0039a0 2023-12-12T09:21:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.727+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f0bc00673c0 con 0x7f0bac0039a0 2023-12-12T09:21:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.731+0000 7f0bbcff9640 1 -- 172.21.15.84:0/2914118331 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v14) v1 ==== 210+0+167 (secure 0 0 0) 0x7f0bb00044e0 con 0x7f0bac0039a0 2023-12-12T09:21:47.731 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:21:47.731 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:21:47.732 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow rw" 2023-12-12T09:21:47.732 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-12-12T09:21:47.732 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2023-12-12T09:21:47.732 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-12-12T09:21:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.733+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ba006ae40 msgr2=0x7f0ba006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.733+0000 7f0bc6168640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ba006ae40 0x7f0ba006d300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8001200 tx=0x7f0ba8001110 comp rx=0 tx=0).stop 2023-12-12T09:21:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 msgr2=0x7f0bc01f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bc01f5280 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0bb002c220 tx=0x7f0bb0004730 comp rx=0 tx=0).stop 2023-12-12T09:21:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 shutdown_connections 2023-12-12T09:21:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0bc00af1a0 0x7f0bc014b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0bc015c4e0 0x7f0bc014d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0ba006ae40 0x7f0ba006d300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 --2- 172.21.15.84:0/2914118331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bac0039a0 0x7f0bc01f5280 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 >> 172.21.15.84:0/2914118331 conn(0x7f0bc00b0a00 msgr2=0x7f0bc0156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 shutdown_connections 2023-12-12T09:21:47.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:47.734+0000 7f0bc6168640 1 -- 172.21.15.84:0/2914118331 wait complete. 2023-12-12T09:21:47.752 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:21:47.752 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:21:47.802 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:48.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.005+0000 7f2c1e290640 1 Processor -- start 2023-12-12T09:21:48.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.006+0000 7f2c1e290640 1 -- start start 2023-12-12T09:21:48.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.007+0000 7f2c1e290640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2c180b2c00 0x7f2c18165240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.007+0000 7f2c1e290640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c18153ff0 con 0x7f2c180b30b0 2023-12-12T09:21:48.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.007+0000 7f2c1e290640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c180b3ca0 con 0x7f2c1815a2c0 2023-12-12T09:21:48.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.007+0000 7f2c1e290640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c18070920 con 0x7f2c180b2c00 2023-12-12T09:21:48.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.007+0000 7f2c17fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2c180b30b0 0x7f2c18070210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41562/0 (socket says 172.21.15.84:41562) 2023-12-12T09:21:48.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.007+0000 7f2c17fff640 1 -- 172.21.15.84:0/70417953 learned_addr learned my addr 172.21.15.84:0/70417953 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076490686 0 0) 0x7f2c18153ff0 con 0x7f2c180b30b0 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c04003520 con 0x7f2c180b30b0 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c1c82d640 1 --2- 172.21.15.84:0/70417953 >> v2:172.21.15.99:3300/0 conn(0x7f2c180b2c00 0x7f2c18165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3683587248 0 0) 0x7f2c04003520 con 0x7f2c180b30b0 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 >> v2:172.21.15.99:3300/0 conn(0x7f2c180b2c00 msgr2=0x7f2c18165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 --2- 172.21.15.84:0/70417953 >> v2:172.21.15.99:3300/0 conn(0x7f2c180b2c00 0x7f2c18165240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 >> v1:172.21.15.99:6789/0 conn(0x7f2c1815a2c0 legacy=0x7f2c180b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180b3ef0 con 0x7f2c180b30b0 2023-12-12T09:21:48.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2c08001670 con 0x7f2c180b30b0 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 >> v1:172.21.15.84:6789/0 conn(0x7f2c180b30b0 legacy=0x7f2c18070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04003970 0x7f2c04003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.008+0000 7f2c177fe640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c040047c0 0x7f2c04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c177fe640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c04005180 0x7f2c0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18070920 con 0x7f2c04005180 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0400c0b0 con 0x7f2c04003970 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0400c270 con 0x7f2c040047c0 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c1c82d640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c04005180 0x7f2c0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c0ffff640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c040047c0 0x7f2c04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c17fff640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04003970 0x7f2c04003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c1c82d640 1 -- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c040047c0 msgr2=0x7f2c04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c1c82d640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c040047c0 0x7f2c04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c1c82d640 1 -- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04003970 msgr2=0x7f2c04003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c1c82d640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04003970 0x7f2c04003d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c1c82d640 1 -- 172.21.15.84:0/70417953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04003520 con 0x7f2c04005180 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.009+0000 7f2c0ffff640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c040047c0 0x7f2c04004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.010+0000 7f2c1c82d640 1 -- 172.21.15.84:0/70417953 reap_dead start 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.010+0000 7f2c1c82d640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c04005180 0x7f2c0400b980 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2c1815e190 tx=0x7f2c040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a597cdb68f6106 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1002ee90 con 0x7f2c04005180 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c10036440 con 0x7f2c04005180 2023-12-12T09:21:48.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c177fe640 1 -- 172.21.15.84:0/70417953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100367d0 con 0x7f2c04005180 2023-12-12T09:21:48.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c1e290640 1 -- 172.21.15.84:0/70417953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c04005180 msgr2=0x7f2c0400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c1e290640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c04005180 0x7f2c0400b980 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2c1815e190 tx=0x7f2c040057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c1e290640 1 -- 172.21.15.84:0/70417953 shutdown_connections 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c1e290640 1 --2- 172.21.15.84:0/70417953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c04005180 0x7f2c0400b980 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c1e290640 1 -- 172.21.15.84:0/70417953 >> 172.21.15.84:0/70417953 conn(0x7f2c1806c3d0 msgr2=0x7f2c1806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c1e290640 1 -- 172.21.15.84:0/70417953 shutdown_connections 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.011+0000 7f2c1e290640 1 -- 172.21.15.84:0/70417953 wait complete. 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.013+0000 7f2c1e290640 1 Processor -- start 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.013+0000 7f2c1e290640 1 -- start start 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.014+0000 7f2c1e290640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04005180 0x7f2c181e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.014+0000 7f2c1e290640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c18156930 0x7f2c181e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.014+0000 7f2c1e290640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c18156db0 0x7f2c181e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.014+0000 7f2c1e290640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181e51a0 con 0x7f2c18156930 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.014+0000 7f2c1e290640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18148460 con 0x7f2c04005180 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.014+0000 7f2c1e290640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181e4b70 con 0x7f2c18156db0 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c18156930 0x7f2c181e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c18156930 0x7f2c181e35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46750/0 (socket says 172.21.15.84:46750) 2023-12-12T09:21:48.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 -- 172.21.15.84:0/1044547218 learned_addr learned my addr 172.21.15.84:0/1044547218 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:48.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c17fff640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04005180 0x7f2c181e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 -- 172.21.15.84:0/1044547218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c18156db0 msgr2=0x7f2c181e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c18156db0 0x7f2c181e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 -- 172.21.15.84:0/1044547218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04005180 msgr2=0x7f2c181e1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04005180 0x7f2c181e1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 -- 172.21.15.84:0/1044547218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c181e44d0 con 0x7f2c18156930 2023-12-12T09:21:48.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.015+0000 7f2c0ffff640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c18156930 0x7f2c181e35c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000d5c0 tx=0x7f2c0000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.016+0000 7f2c157fa640 1 -- 172.21.15.84:0/1044547218 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00007220 con 0x7f2c18156930 2023-12-12T09:21:48.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.016+0000 7f2c157fa640 1 -- 172.21.15.84:0/1044547218 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c000073a0 con 0x7f2c18156930 2023-12-12T09:21:48.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.016+0000 7f2c157fa640 1 -- 172.21.15.84:0/1044547218 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c000067d0 con 0x7f2c18156930 2023-12-12T09:21:48.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.016+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c181e47b0 con 0x7f2c18156930 2023-12-12T09:21:48.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.016+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c181e2010 con 0x7f2c18156930 2023-12-12T09:21:48.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.017+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c181e52e0 con 0x7f2c18156930 2023-12-12T09:21:48.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.018+0000 7f2c157fa640 1 -- 172.21.15.84:0/1044547218 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c00006930 con 0x7f2c18156930 2023-12-12T09:21:48.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.019+0000 7f2c157fa640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf806ae70 0x7f2bf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.019+0000 7f2c157fa640 1 -- 172.21.15.84:0/1044547218 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f2c00089610 con 0x7f2c18156930 2023-12-12T09:21:48.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.019+0000 7f2c17fff640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf806ae70 0x7f2bf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.020+0000 7f2c17fff640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf806ae70 0x7f2bf806d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2c18071110 tx=0x7f2c08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.024+0000 7f2c157fa640 1 -- 172.21.15.84:0/1044547218 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c181e52e0 con 0x7f2c18156930 2023-12-12T09:21:48.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.214+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c181e52e0 con 0x7f2c18156930 2023-12-12T09:21:48.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.217+0000 7f2c157fa640 1 -- 172.21.15.84:0/1044547218 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f2c181e52e0 con 0x7f2c18156930 2023-12-12T09:21:48.218 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:48.218 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.220+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf806ae70 msgr2=0x7f2bf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.220+0000 7f2c1e290640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf806ae70 0x7f2bf806d330 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2c18071110 tx=0x7f2c08009040 comp rx=0 tx=0).stop 2023-12-12T09:21:48.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.220+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c18156930 msgr2=0x7f2c181e35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.220+0000 7f2c1e290640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c18156930 0x7f2c181e35c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000d5c0 tx=0x7f2c0000da80 comp rx=0 tx=0).stop 2023-12-12T09:21:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.221+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 shutdown_connections 2023-12-12T09:21:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.221+0000 7f2c1e290640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c18156db0 0x7f2c181e3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.221+0000 7f2c1e290640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf806ae70 0x7f2bf806d330 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.221+0000 7f2c1e290640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c18156930 0x7f2c181e35c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.221+0000 7f2c1e290640 1 --2- 172.21.15.84:0/1044547218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c04005180 0x7f2c181e1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.221+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 >> 172.21.15.84:0/1044547218 conn(0x7f2c1806c3d0 msgr2=0x7f2c180b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.221+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 shutdown_connections 2023-12-12T09:21:48.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.221+0000 7f2c1e290640 1 -- 172.21.15.84:0/1044547218 wait complete. 2023-12-12T09:21:48.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:21:28.519227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:21:29.210161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-12T09:21:44.988386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:21:48.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:21:48.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.442+0000 7f792fdbe640 1 Processor -- start 2023-12-12T09:21:48.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.443+0000 7f792fdbe640 1 -- start start 2023-12-12T09:21:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.444+0000 7f792fdbe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79280cfd80 0x7f792815d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.444+0000 7f792fdbe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f79280d0160 0x7f792815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.444+0000 7f792fdbe640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79280b0460 con 0x7f79280b08f0 2023-12-12T09:21:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.444+0000 7f792fdbe640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79280afe80 con 0x7f79280d0160 2023-12-12T09:21:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.444+0000 7f792fdbe640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280d1e20 con 0x7f79280cfd80 2023-12-12T09:21:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.444+0000 7f792e35b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f79280b08f0 0x7f79280b0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41576/0 (socket says 172.21.15.84:41576) 2023-12-12T09:21:48.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792e35b640 1 -- 172.21.15.84:0/3597333211 learned_addr learned my addr 172.21.15.84:0/3597333211 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792db5a640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79280cfd80 0x7f792815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792d359640 1 --2- 172.21.15.84:0/3597333211 >> v2:172.21.15.99:3300/0 conn(0x7f79280d0160 0x7f792815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539340237 0 0) 0x7f79280b0460 con 0x7f79280b08f0 2023-12-12T09:21:48.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7914003520 con 0x7f79280b08f0 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1913407961 0 0) 0x7f7914003520 con 0x7f79280b08f0 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79280cfd80 msgr2=0x7f792815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79280cfd80 0x7f792815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 >> v2:172.21.15.99:3300/0 conn(0x7f79280d0160 msgr2=0x7f792815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 --2- 172.21.15.84:0/3597333211 >> v2:172.21.15.99:3300/0 conn(0x7f79280d0160 0x7f792815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79280b00f0 con 0x7f79280b08f0 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f79200019f0 con 0x7f79280b08f0 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 >> v1:172.21.15.84:6789/0 conn(0x7f79280b08f0 legacy=0x7f79280b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.445+0000 7f792cb58640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7914003970 0x7f7914003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792cb58640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79280cfd80 0x7f79140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792cb58640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7914004d00 0x7f7914005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280afe80 con 0x7f7914004d00 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280d1e20 con 0x7f7914003970 2023-12-12T09:21:48.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791400b980 con 0x7f79280cfd80 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792e35b640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7914004d00 0x7f7914005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792d359640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79280cfd80 0x7f79140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792db5a640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7914003970 0x7f7914003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792e35b640 1 -- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79280cfd80 msgr2=0x7f79140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792e35b640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f79280cfd80 0x7f79140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792e35b640 1 -- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7914003970 msgr2=0x7f7914003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792e35b640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7914003970 0x7f7914003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.446+0000 7f792e35b640 1 -- 172.21.15.84:0/3597333211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7914003520 con 0x7f7914004d00 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.447+0000 7f792e35b640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7914004d00 0x7f7914005180 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f792000a860 tx=0x7f79140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a16a3ac604d543f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920034630 con 0x7f7914004d00 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792002f070 con 0x7f7914004d00 2023-12-12T09:21:48.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792cb58640 1 -- 172.21.15.84:0/3597333211 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79200349f0 con 0x7f7914004d00 2023-12-12T09:21:48.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792fdbe640 1 -- 172.21.15.84:0/3597333211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7914004d00 msgr2=0x7f7914005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792fdbe640 1 --2- 172.21.15.84:0/3597333211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7914004d00 0x7f7914005180 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f792000a860 tx=0x7f79140057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792e35b640 1 -- 172.21.15.84:0/3597333211 reap_dead start 2023-12-12T09:21:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792fdbe640 1 -- 172.21.15.84:0/3597333211 shutdown_connections 2023-12-12T09:21:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792fdbe640 1 -- 172.21.15.84:0/3597333211 >> 172.21.15.84:0/3597333211 conn(0x7f792809c480 msgr2=0x7f79280d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792fdbe640 1 -- 172.21.15.84:0/3597333211 shutdown_connections 2023-12-12T09:21:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.448+0000 7f792fdbe640 1 -- 172.21.15.84:0/3597333211 wait complete. 2023-12-12T09:21:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.450+0000 7f792fdbe640 1 Processor -- start 2023-12-12T09:21:48.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.450+0000 7f792fdbe640 1 -- start start 2023-12-12T09:21:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.451+0000 7f792fdbe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7914004d00 0x7f792815add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.451+0000 7f792fdbe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79280cca70 0x7f79280a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.451+0000 7f792fdbe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79280ccef0 0x7f79280a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.451+0000 7f792fdbe640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c7690 con 0x7f79280cca70 2023-12-12T09:21:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.451+0000 7f792fdbe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280ca350 con 0x7f79280ccef0 2023-12-12T09:21:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.451+0000 7f792fdbe640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c78e0 con 0x7f7914004d00 2023-12-12T09:21:48.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79280cca70 0x7f79280a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79280cca70 0x7f79280a02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46774/0 (socket says 172.21.15.84:46774) 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 -- 172.21.15.84:0/3746175894 learned_addr learned my addr 172.21.15.84:0/3746175894 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792db5a640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7914004d00 0x7f792815add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 -- 172.21.15.84:0/3746175894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7914004d00 msgr2=0x7f792815add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7914004d00 0x7f792815add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 -- 172.21.15.84:0/3746175894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79280ccef0 msgr2=0x7f79280a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792e35b640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79280ccef0 0x7f79280a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79280ccef0 0x7f79280a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 -- 172.21.15.84:0/3746175894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79280c7bc0 con 0x7f79280cca70 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f792d359640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79280cca70 0x7f79280a02a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7918011700 tx=0x7f7918011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.452+0000 7f791e7fc640 1 -- 172.21.15.84:0/3746175894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800f9c0 con 0x7f79280cca70 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.453+0000 7f791e7fc640 1 -- 172.21.15.84:0/3746175894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791800fb20 con 0x7f79280cca70 2023-12-12T09:21:48.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.453+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79280c7ea0 con 0x7f79280cca70 2023-12-12T09:21:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.453+0000 7f791e7fc640 1 -- 172.21.15.84:0/3746175894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800fe90 con 0x7f79280cca70 2023-12-12T09:21:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.453+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792815bdd0 con 0x7f79280cca70 2023-12-12T09:21:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.454+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7928072b80 con 0x7f79280cca70 2023-12-12T09:21:48.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.455+0000 7f791e7fc640 1 -- 172.21.15.84:0/3746175894 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7918015460 con 0x7f79280cca70 2023-12-12T09:21:48.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.456+0000 7f791e7fc640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f790c06ae70 0x7f790c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.456+0000 7f791e7fc640 1 -- 172.21.15.84:0/3746175894 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f791808a1e0 con 0x7f79280cca70 2023-12-12T09:21:48.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.456+0000 7f792db5a640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f790c06ae70 0x7f790c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.457+0000 7f792db5a640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f790c06ae70 0x7f790c06d330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f79280b7010 tx=0x7f7924008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.460+0000 7f791e7fc640 1 -- 172.21.15.84:0/3746175894 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7918054fb0 con 0x7f79280cca70 2023-12-12T09:21:48.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.647+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79280673c0 con 0x7f79280cca70 2023-12-12T09:21:48.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.648+0000 7f791e7fc640 1 -- 172.21.15.84:0/3746175894 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79180585d0 con 0x7f79280cca70 2023-12-12T09:21:48.648 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.650+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f790c06ae70 msgr2=0x7f790c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.650+0000 7f792fdbe640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f790c06ae70 0x7f790c06d330 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f79280b7010 tx=0x7f7924008040 comp rx=0 tx=0).stop 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.650+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79280cca70 msgr2=0x7f79280a02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.650+0000 7f792fdbe640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79280cca70 0x7f79280a02a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7918011700 tx=0x7f7918011bc0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.651+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 shutdown_connections 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.651+0000 7f792fdbe640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79280ccef0 0x7f79280a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.651+0000 7f792fdbe640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f790c06ae70 0x7f790c06d330 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.651+0000 7f792fdbe640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79280cca70 0x7f79280a02a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.651+0000 7f792fdbe640 1 --2- 172.21.15.84:0/3746175894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7914004d00 0x7f792815add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.651+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 >> 172.21.15.84:0/3746175894 conn(0x7f792809c480 msgr2=0x7f79280b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.651+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 shutdown_connections 2023-12-12T09:21:48.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.651+0000 7f792fdbe640 1 -- 172.21.15.84:0/3746175894 wait complete. 2023-12-12T09:21:48.669 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:21:48.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.875+0000 7f03d2de3640 1 Processor -- start 2023-12-12T09:21:48.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.875+0000 7f03d2de3640 1 -- start start 2023-12-12T09:21:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.877+0000 7f03d2de3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03cc155690 0x7f03cc06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.877+0000 7f03d2de3640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f03cc0cde40 0x7f03cc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.877+0000 7f03d2de3640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc155a70 con 0x7f03cc15b4f0 2023-12-12T09:21:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.877+0000 7f03d2de3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0ce830 con 0x7f03cc155690 2023-12-12T09:21:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.877+0000 7f03d2de3640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc15c120 con 0x7f03cc0cde40 2023-12-12T09:21:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.877+0000 7f03d0b7f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03cc155690 0x7f03cc06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.877+0000 7f03d0b7f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f03cc155690 0x7f03cc06ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46778/0 (socket says 172.21.15.84:46778) 2023-12-12T09:21:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.877+0000 7f03d0b7f640 1 -- 172.21.15.84:0/3818157136 learned_addr learned my addr 172.21.15.84:0/3818157136 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:48.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.878+0000 7f03cbfff640 1 --2- 172.21.15.84:0/3818157136 >> v2:172.21.15.99:3300/0 conn(0x7f03cc0cde40 0x7f03cc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.878+0000 7f03d0b7f640 1 -- 172.21.15.84:0/3818157136 >> v2:172.21.15.99:3300/0 conn(0x7f03cc0cde40 msgr2=0x7f03cc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.878+0000 7f03d0b7f640 1 --2- 172.21.15.84:0/3818157136 >> v2:172.21.15.99:3300/0 conn(0x7f03cc0cde40 0x7f03cc0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.878+0000 7f03d0b7f640 1 -- 172.21.15.84:0/3818157136 >> v1:172.21.15.99:6789/0 conn(0x7f03cc15b4f0 legacy=0x7f03cc15b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.878+0000 7f03d0b7f640 1 -- 172.21.15.84:0/3818157136 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc15c400 con 0x7f03cc155690 2023-12-12T09:21:48.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.879+0000 7f03d0b7f640 1 --2- 172.21.15.84:0/3818157136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc155690 0x7f03cc06ce60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0cfcb0 tx=0x7f03c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d349da2ddfe9c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.879+0000 7f03cb7fe640 1 -- 172.21.15.84:0/3818157136 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0031870 con 0x7f03cc155690 2023-12-12T09:21:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.879+0000 7f03cb7fe640 1 -- 172.21.15.84:0/3818157136 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c00319d0 con 0x7f03cc155690 2023-12-12T09:21:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.879+0000 7f03cb7fe640 1 -- 172.21.15.84:0/3818157136 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0031d60 con 0x7f03cc155690 2023-12-12T09:21:48.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.880+0000 7f03d2de3640 1 -- 172.21.15.84:0/3818157136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc155690 msgr2=0x7f03cc06ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.880+0000 7f03d2de3640 1 --2- 172.21.15.84:0/3818157136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc155690 0x7f03cc06ce60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f03cc0cfcb0 tx=0x7f03c002b910 comp rx=0 tx=0).stop 2023-12-12T09:21:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.880+0000 7f03d2de3640 1 -- 172.21.15.84:0/3818157136 shutdown_connections 2023-12-12T09:21:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.880+0000 7f03d2de3640 1 --2- 172.21.15.84:0/3818157136 >> v2:172.21.15.99:3300/0 conn(0x7f03cc0cde40 0x7f03cc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.880+0000 7f03d2de3640 1 --2- 172.21.15.84:0/3818157136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc155690 0x7f03cc06ce60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.880+0000 7f03d2de3640 1 -- 172.21.15.84:0/3818157136 >> 172.21.15.84:0/3818157136 conn(0x7f03cc0b0900 msgr2=0x7f03cc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.880+0000 7f03d2de3640 1 -- 172.21.15.84:0/3818157136 shutdown_connections 2023-12-12T09:21:48.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.880+0000 7f03d2de3640 1 -- 172.21.15.84:0/3818157136 wait complete. 2023-12-12T09:21:48.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.883+0000 7f03d2de3640 1 Processor -- start 2023-12-12T09:21:48.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.883+0000 7f03d2de3640 1 -- start start 2023-12-12T09:21:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d2de3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03cc0cde40 0x7f03cc1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d2de3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f03cc155690 0x7f03cc141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d2de3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc15b4f0 0x7f03cc0af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d2de3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc157c70 con 0x7f03cc15b4f0 2023-12-12T09:21:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d2de3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc158f00 con 0x7f03cc0cde40 2023-12-12T09:21:48.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d2de3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc157ee0 con 0x7f03cc155690 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d1380640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc15b4f0 0x7f03cc0af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d1380640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc15b4f0 0x7f03cc0af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46786/0 (socket says 172.21.15.84:46786) 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.884+0000 7f03d1380640 1 -- 172.21.15.84:0/1967361339 learned_addr learned my addr 172.21.15.84:0/1967361339 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03d0b7f640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03cc0cde40 0x7f03cc1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03cbfff640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f03cc155690 0x7f03cc141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03d1380640 1 -- 172.21.15.84:0/1967361339 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f03cc155690 msgr2=0x7f03cc141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03d1380640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f03cc155690 0x7f03cc141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03d1380640 1 -- 172.21.15.84:0/1967361339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03cc0cde40 msgr2=0x7f03cc1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03d1380640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03cc0cde40 0x7f03cc1589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03d1380640 1 -- 172.21.15.84:0/1967361339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00094d0 con 0x7f03cc15b4f0 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03d1380640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc15b4f0 0x7f03cc0af990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f03c400b970 tx=0x7f03c400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03c97fa640 1 -- 172.21.15.84:0/1967361339 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400cb40 con 0x7f03cc15b4f0 2023-12-12T09:21:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03c97fa640 1 -- 172.21.15.84:0/1967361339 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c400cca0 con 0x7f03cc15b4f0 2023-12-12T09:21:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03c97fa640 1 -- 172.21.15.84:0/1967361339 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4014680 con 0x7f03cc15b4f0 2023-12-12T09:21:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.885+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc1581c0 con 0x7f03cc15b4f0 2023-12-12T09:21:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.886+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc141960 con 0x7f03cc15b4f0 2023-12-12T09:21:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.887+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc0673c0 con 0x7f03cc15b4f0 2023-12-12T09:21:48.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.887+0000 7f03c97fa640 1 -- 172.21.15.84:0/1967361339 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03c401d3b0 con 0x7f03cc15b4f0 2023-12-12T09:21:48.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.888+0000 7f03c97fa640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03b006ae40 0x7f03b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:48.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.888+0000 7f03c97fa640 1 -- 172.21.15.84:0/1967361339 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f03c40897b0 con 0x7f03cc15b4f0 2023-12-12T09:21:48.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.889+0000 7f03d0b7f640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03b006ae40 0x7f03b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:48.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.889+0000 7f03d0b7f640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03b006ae40 0x7f03b006d300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f03c0036000 tx=0x7f03c003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:48.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:48.893+0000 7f03c97fa640 1 -- 172.21.15.84:0/1967361339 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03c40544f0 con 0x7f03cc15b4f0 2023-12-12T09:21:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.087+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03cc151d50 con 0x7f03cc15b4f0 2023-12-12T09:21:49.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.088+0000 7f03c97fa640 1 -- 172.21.15.84:0/1967361339 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03c4057b10 con 0x7f03cc15b4f0 2023-12-12T09:21:49.088 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:49.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03b006ae40 msgr2=0x7f03b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03b006ae40 0x7f03b006d300 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f03c0036000 tx=0x7f03c003c040 comp rx=0 tx=0).stop 2023-12-12T09:21:49.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc15b4f0 msgr2=0x7f03cc0af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc15b4f0 0x7f03cc0af990 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f03c400b970 tx=0x7f03c400be30 comp rx=0 tx=0).stop 2023-12-12T09:21:49.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 shutdown_connections 2023-12-12T09:21:49.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f03b006ae40 0x7f03b006d300 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03cc15b4f0 0x7f03cc0af990 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f03cc155690 0x7f03cc141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 --2- 172.21.15.84:0/1967361339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f03cc0cde40 0x7f03cc1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 >> 172.21.15.84:0/1967361339 conn(0x7f03cc0b0900 msgr2=0x7f03cc154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:49.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 shutdown_connections 2023-12-12T09:21:49.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.091+0000 7f03d2de3640 1 -- 172.21.15.84:0/1967361339 wait complete. 2023-12-12T09:21:49.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:21:49.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.325+0000 7f947f32c640 1 Processor -- start 2023-12-12T09:21:49.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.325+0000 7f947f32c640 1 -- start start 2023-12-12T09:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.326+0000 7f947f32c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f947815d460 0x7f94780b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.326+0000 7f947f32c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94780cbb10 con 0x7f94780cfbc0 2023-12-12T09:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.326+0000 7f947f32c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94780d00c0 con 0x7f947809a130 2023-12-12T09:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.326+0000 7f947f32c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94780d03a0 con 0x7f947815d460 2023-12-12T09:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.327+0000 7f947c8c7640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f94780cfbc0 0x7f9478099a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41578/0 (socket says 172.21.15.84:41578) 2023-12-12T09:21:49.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.327+0000 7f947c8c7640 1 -- 172.21.15.84:0/1932069726 learned_addr learned my addr 172.21.15.84:0/1932069726 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.327+0000 7f947d0c8640 1 --2- 172.21.15.84:0/1932069726 >> v2:172.21.15.99:3300/0 conn(0x7f947815d460 0x7f94780b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.327+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145709000 0 0) 0x7f94780cbb10 con 0x7f94780cfbc0 2023-12-12T09:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.327+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9464003520 con 0x7f94780cfbc0 2023-12-12T09:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.327+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333743294 0 0) 0x7f9464003520 con 0x7f94780cfbc0 2023-12-12T09:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 >> v2:172.21.15.99:3300/0 conn(0x7f947815d460 msgr2=0x7f94780b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:49.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 --2- 172.21.15.84:0/1932069726 >> v2:172.21.15.99:3300/0 conn(0x7f947815d460 0x7f94780b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 >> v1:172.21.15.99:6789/0 conn(0x7f947809a130 legacy=0x7f94780cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94780cb4c0 con 0x7f94780cfbc0 2023-12-12T09:21:49.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f9468001670 con 0x7f94780cfbc0 2023-12-12T09:21:49.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 >> v1:172.21.15.84:6789/0 conn(0x7f94780cfbc0 legacy=0x7f9478099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9464003970 0x7f9464003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94640047c0 0x7f9464004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9464005180 0x7f946400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94780d03a0 con 0x7f94640047c0 2023-12-12T09:21:49.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946400c030 con 0x7f9464005180 2023-12-12T09:21:49.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946400c1f0 con 0x7f9464003970 2023-12-12T09:21:49.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947c8c7640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94640047c0 0x7f9464004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947d0c8640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9464003970 0x7f9464003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947d8c9640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9464005180 0x7f946400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947c8c7640 1 -- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9464003970 msgr2=0x7f9464003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:49.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947c8c7640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9464003970 0x7f9464003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947c8c7640 1 -- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9464005180 msgr2=0x7f946400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:49.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947c8c7640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9464005180 0x7f946400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947c8c7640 1 -- 172.21.15.84:0/1932069726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464003520 con 0x7f94640047c0 2023-12-12T09:21:49.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947d8c9640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9464005180 0x7f946400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:49.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.328+0000 7f947d8c9640 1 -- 172.21.15.84:0/1932069726 reap_dead start 2023-12-12T09:21:49.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.329+0000 7f947c8c7640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94640047c0 0x7f9464004c40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f946800c240 tx=0x7f94640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6134fb86362eaba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:49.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9468005ad0 con 0x7f94640047c0 2023-12-12T09:21:49.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9468005c30 con 0x7f94640047c0 2023-12-12T09:21:49.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f946ffff640 1 -- 172.21.15.84:0/1932069726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946802caf0 con 0x7f94640047c0 2023-12-12T09:21:49.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f947f32c640 1 -- 172.21.15.84:0/1932069726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94640047c0 msgr2=0x7f9464004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f947f32c640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94640047c0 0x7f9464004c40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f946800c240 tx=0x7f94640057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f947f32c640 1 -- 172.21.15.84:0/1932069726 shutdown_connections 2023-12-12T09:21:49.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f947f32c640 1 --2- 172.21.15.84:0/1932069726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94640047c0 0x7f9464004c40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f947f32c640 1 -- 172.21.15.84:0/1932069726 >> 172.21.15.84:0/1932069726 conn(0x7f94780b2960 msgr2=0x7f94780b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:49.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.330+0000 7f947f32c640 1 -- 172.21.15.84:0/1932069726 shutdown_connections 2023-12-12T09:21:49.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.331+0000 7f947f32c640 1 -- 172.21.15.84:0/1932069726 wait complete. 2023-12-12T09:21:49.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.332+0000 7f947f32c640 1 Processor -- start 2023-12-12T09:21:49.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.332+0000 7f947f32c640 1 -- start start 2023-12-12T09:21:49.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.333+0000 7f947f32c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640047c0 0x7f947815c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.333+0000 7f947f32c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94780ca7c0 0x7f94780c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947f32c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94780c9150 0x7f94780aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947f32c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94780cac20 con 0x7f94780c9150 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947f32c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94780cae30 con 0x7f94640047c0 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947f32c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94780cb110 con 0x7f94780ca7c0 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d8c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94780c9150 0x7f94780aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d8c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94780c9150 0x7f94780aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46808/0 (socket says 172.21.15.84:46808) 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d8c9640 1 -- 172.21.15.84:0/657750456 learned_addr learned my addr 172.21.15.84:0/657750456 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d0c8640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640047c0 0x7f947815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947c8c7640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94780ca7c0 0x7f94780c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d8c9640 1 -- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94780ca7c0 msgr2=0x7f94780c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d8c9640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94780ca7c0 0x7f94780c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d8c9640 1 -- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640047c0 msgr2=0x7f947815c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d8c9640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640047c0 0x7f947815c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947d8c9640 1 -- 172.21.15.84:0/657750456 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947815ecc0 con 0x7f94780c9150 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.334+0000 7f947c8c7640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94780ca7c0 0x7f94780c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.335+0000 7f947d8c9640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94780c9150 0x7f94780aebb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9478071980 tx=0x7f947000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.335+0000 7f946dffb640 1 -- 172.21.15.84:0/657750456 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470003d80 con 0x7f94780c9150 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.335+0000 7f946dffb640 1 -- 172.21.15.84:0/657750456 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9470005070 con 0x7f94780c9150 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.335+0000 7f946dffb640 1 -- 172.21.15.84:0/657750456 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9470005420 con 0x7f94780c9150 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.335+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947815efa0 con 0x7f94780c9150 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.335+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94780af0f0 con 0x7f94780c9150 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.336+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947815f4c0 con 0x7f94780c9150 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.337+0000 7f946dffb640 1 -- 172.21.15.84:0/657750456 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9470005580 con 0x7f94780c9150 2023-12-12T09:21:49.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.338+0000 7f946dffb640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f945c06ae70 0x7f945c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.339+0000 7f946dffb640 1 -- 172.21.15.84:0/657750456 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f94700892a0 con 0x7f94780c9150 2023-12-12T09:21:49.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.339+0000 7f947d0c8640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f945c06ae70 0x7f945c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.339+0000 7f947d0c8640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f945c06ae70 0x7f945c06d330 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9474009a90 tx=0x7f9474008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:49.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.343+0000 7f946dffb640 1 -- 172.21.15.84:0/657750456 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f947815f4c0 con 0x7f94780c9150 2023-12-12T09:21:49.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.534+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f947815f4c0 con 0x7f94780c9150 2023-12-12T09:21:49.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.535+0000 7f946dffb640 1 -- 172.21.15.84:0/657750456 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f947815f4c0 con 0x7f94780c9150 2023-12-12T09:21:49.535 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:21:49.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.537+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f945c06ae70 msgr2=0x7f945c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.537+0000 7f947f32c640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f945c06ae70 0x7f945c06d330 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9474009a90 tx=0x7f9474008040 comp rx=0 tx=0).stop 2023-12-12T09:21:49.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.537+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94780c9150 msgr2=0x7f94780aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.537+0000 7f947f32c640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94780c9150 0x7f94780aebb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9478071980 tx=0x7f947000d9d0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.537+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 shutdown_connections 2023-12-12T09:21:49.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.537+0000 7f947f32c640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f945c06ae70 0x7f945c06d330 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.537+0000 7f947f32c640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94780c9150 0x7f94780aebb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.538+0000 7f947f32c640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94780ca7c0 0x7f94780c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.538+0000 7f947f32c640 1 --2- 172.21.15.84:0/657750456 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640047c0 0x7f947815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.538+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 >> 172.21.15.84:0/657750456 conn(0x7f94780b2960 msgr2=0x7f94780b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:49.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.538+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 shutdown_connections 2023-12-12T09:21:49.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.538+0000 7f947f32c640 1 -- 172.21.15.84:0/657750456 wait complete. 2023-12-12T09:21:49.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-12T09:21:49.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.765+0000 7f8ea66e0640 1 Processor -- start 2023-12-12T09:21:49.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.765+0000 7f8ea66e0640 1 -- start start 2023-12-12T09:21:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8ea66e0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8ea00b40d0 0x7f8ea006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8ea66e0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ea015be60 0x7f8ea013e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8ea66e0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00ceb80 con 0x7f8ea00ce6f0 2023-12-12T09:21:49.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8ea66e0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea00ce260 con 0x7f8ea015be60 2023-12-12T09:21:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8ea66e0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea00cd930 con 0x7f8ea00b40d0 2023-12-12T09:21:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8ea4c7d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8ea015be60 0x7f8ea013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8e9f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8ea00ce6f0 0x7f8ea00b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41586/0 (socket says 172.21.15.84:41586) 2023-12-12T09:21:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8e9f7fe640 1 -- 172.21.15.84:0/1995771835 learned_addr learned my addr 172.21.15.84:0/1995771835 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8ea4c7d640 1 --2- 172.21.15.84:0/1995771835 >> v2:172.21.15.84:3300/0 conn(0x7f8ea015be60 0x7f8ea013e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46816/0 (socket says 172.21.15.84:46816) 2023-12-12T09:21:49.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.767+0000 7f8e9ffff640 1 --2- 172.21.15.84:0/1995771835 >> v2:172.21.15.99:3300/0 conn(0x7f8ea00b40d0 0x7f8ea006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.768+0000 7f8ea4c7d640 1 -- 172.21.15.84:0/1995771835 >> v2:172.21.15.99:3300/0 conn(0x7f8ea00b40d0 msgr2=0x7f8ea006dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.768+0000 7f8ea4c7d640 1 --2- 172.21.15.84:0/1995771835 >> v2:172.21.15.99:3300/0 conn(0x7f8ea00b40d0 0x7f8ea006dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.768+0000 7f8ea4c7d640 1 -- 172.21.15.84:0/1995771835 >> v1:172.21.15.84:6789/0 conn(0x7f8ea00ce6f0 legacy=0x7f8ea00b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.768+0000 7f8ea4c7d640 1 -- 172.21.15.84:0/1995771835 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea00cdc10 con 0x7f8ea015be60 2023-12-12T09:21:49.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.768+0000 7f8e9effd640 1 -- 172.21.15.84:0/1995771835 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560693702 0 0) 0x7f8ea00ceb80 con 0x7f8ea00ce6f0 2023-12-12T09:21:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.769+0000 7f8ea4c7d640 1 --2- 172.21.15.84:0/1995771835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea013e750 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00b4d90 tx=0x7f8e9802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64eb0e127427389c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.769+0000 7f8e9effd640 1 -- 172.21.15.84:0/1995771835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9802cc80 con 0x7f8ea015be60 2023-12-12T09:21:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.769+0000 7f8e9effd640 1 -- 172.21.15.84:0/1995771835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9802cde0 con 0x7f8ea015be60 2023-12-12T09:21:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.769+0000 7f8e9effd640 1 -- 172.21.15.84:0/1995771835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98034660 con 0x7f8ea015be60 2023-12-12T09:21:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.770+0000 7f8ea66e0640 1 -- 172.21.15.84:0/1995771835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 msgr2=0x7f8ea013e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.770+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/1995771835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea013e750 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00b4d90 tx=0x7f8e9802bed0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.770+0000 7f8ea66e0640 1 -- 172.21.15.84:0/1995771835 shutdown_connections 2023-12-12T09:21:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.770+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/1995771835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea013e750 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.770+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/1995771835 >> v2:172.21.15.99:3300/0 conn(0x7f8ea00b40d0 0x7f8ea006dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.770+0000 7f8ea66e0640 1 -- 172.21.15.84:0/1995771835 >> 172.21.15.84:0/1995771835 conn(0x7f8ea00b0ac0 msgr2=0x7f8ea00b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.770+0000 7f8ea66e0640 1 -- 172.21.15.84:0/1995771835 shutdown_connections 2023-12-12T09:21:49.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.770+0000 7f8ea66e0640 1 -- 172.21.15.84:0/1995771835 wait complete. 2023-12-12T09:21:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.772+0000 7f8ea66e0640 1 Processor -- start 2023-12-12T09:21:49.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.772+0000 7f8ea66e0640 1 -- start start 2023-12-12T09:21:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea66e0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ea00b40d0 0x7f8ea01f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea66e0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea00ce6f0 0x7f8ea00afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea66e0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea00affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea66e0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01f2df0 con 0x7f8ea015be60 2023-12-12T09:21:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea66e0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea013e650 con 0x7f8ea00ce6f0 2023-12-12T09:21:49.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea66e0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01f39b0 con 0x7f8ea00b40d0 2023-12-12T09:21:49.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea4c7d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea00affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea4c7d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea00affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46822/0 (socket says 172.21.15.84:46822) 2023-12-12T09:21:49.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea4c7d640 1 -- 172.21.15.84:0/3091654704 learned_addr learned my addr 172.21.15.84:0/3091654704 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:49.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea4c7d640 1 -- 172.21.15.84:0/3091654704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ea00b40d0 msgr2=0x7f8ea01f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea4c7d640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ea00b40d0 0x7f8ea01f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea4c7d640 1 -- 172.21.15.84:0/3091654704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea00ce6f0 msgr2=0x7f8ea00afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.773+0000 7f8ea4c7d640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea00ce6f0 0x7f8ea00afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.774+0000 7f8ea4c7d640 1 -- 172.21.15.84:0/3091654704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98009a70 con 0x7f8ea015be60 2023-12-12T09:21:49.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.774+0000 7f8ea4c7d640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea00affc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8e9802c4e0 tx=0x7f8e98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:49.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.774+0000 7f8e9cff9640 1 -- 172.21.15.84:0/3091654704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98040650 con 0x7f8ea015be60 2023-12-12T09:21:49.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.774+0000 7f8e9cff9640 1 -- 172.21.15.84:0/3091654704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e980407b0 con 0x7f8ea015be60 2023-12-12T09:21:49.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.774+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea00b2b40 con 0x7f8ea015be60 2023-12-12T09:21:49.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.774+0000 7f8e9cff9640 1 -- 172.21.15.84:0/3091654704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98040b60 con 0x7f8ea015be60 2023-12-12T09:21:49.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.774+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea00b3100 con 0x7f8ea015be60 2023-12-12T09:21:49.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.775+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea015e640 con 0x7f8ea015be60 2023-12-12T09:21:49.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.776+0000 7f8e9cff9640 1 -- 172.21.15.84:0/3091654704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e98040cc0 con 0x7f8ea015be60 2023-12-12T09:21:49.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.778+0000 7f8e9cff9640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8e8c06ae70 0x7f8e8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:49.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.778+0000 7f8e9cff9640 1 -- 172.21.15.84:0/3091654704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f8e980ac700 con 0x7f8ea015be60 2023-12-12T09:21:49.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.778+0000 7f8e9ffff640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8e8c06ae70 0x7f8e8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:49.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.779+0000 7f8e9ffff640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8e8c06ae70 0x7f8e8c06d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8e90006fd0 tx=0x7f8e90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:49.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.782+0000 7f8e9cff9640 1 -- 172.21.15.84:0/3091654704 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e98077440 con 0x7f8ea015be60 2023-12-12T09:21:49.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.972+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f8ea013e800 con 0x7f8ea015be60 2023-12-12T09:21:49.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.972+0000 7f8e9cff9640 1 -- 172.21.15.84:0/3091654704 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v44) v1 ==== 97+0+11 (secure 0 0 0) 0x7f8ea013e800 con 0x7f8ea015be60 2023-12-12T09:21:49.973 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:49.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8e8c06ae70 msgr2=0x7f8e8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8e8c06ae70 0x7f8e8c06d330 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8e90006fd0 tx=0x7f8e90008040 comp rx=0 tx=0).stop 2023-12-12T09:21:49.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 msgr2=0x7f8ea00affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:49.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea00affc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8e9802c4e0 tx=0x7f8e98004a40 comp rx=0 tx=0).stop 2023-12-12T09:21:49.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 shutdown_connections 2023-12-12T09:21:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8e8c06ae70 0x7f8e8c06d330 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ea015be60 0x7f8ea00affc0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ea00ce6f0 0x7f8ea00afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 --2- 172.21.15.84:0/3091654704 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8ea00b40d0 0x7f8ea01f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 >> 172.21.15.84:0/3091654704 conn(0x7f8ea00b0ac0 msgr2=0x7f8ea015d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 shutdown_connections 2023-12-12T09:21:49.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:49.975+0000 7f8ea66e0640 1 -- 172.21.15.84:0/3091654704 wait complete. 2023-12-12T09:21:49.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:21:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.207+0000 7f4784f7c640 1 Processor -- start 2023-12-12T09:21:50.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.208+0000 7f4784f7c640 1 -- start start 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.209+0000 7f4784f7c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f47800ce330 0x7f478013d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.209+0000 7f4784f7c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47800ce7c0 0x7f478013d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.209+0000 7f4784f7c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4780140270 con 0x7f4780071bb0 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.209+0000 7f4784f7c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47800cd850 con 0x7f47800ce7c0 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.209+0000 7f4784f7c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47800cdb30 con 0x7f47800ce330 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.210+0000 7f477ed9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47800ce7c0 0x7f478013d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.210+0000 7f477ed9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f47800ce7c0 0x7f478013d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46824/0 (socket says 172.21.15.84:46824) 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.210+0000 7f477ed9d640 1 -- 172.21.15.84:0/785311434 learned_addr learned my addr 172.21.15.84:0/785311434 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:50.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.210+0000 7f477dd9b640 1 --2- 172.21.15.84:0/785311434 >> v2:172.21.15.99:3300/0 conn(0x7f47800ce330 0x7f478013d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.210+0000 7f477ed9d640 1 -- 172.21.15.84:0/785311434 >> v2:172.21.15.99:3300/0 conn(0x7f47800ce330 msgr2=0x7f478013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:50.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.210+0000 7f477ed9d640 1 --2- 172.21.15.84:0/785311434 >> v2:172.21.15.99:3300/0 conn(0x7f47800ce330 0x7f478013d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.210+0000 7f477ed9d640 1 -- 172.21.15.84:0/785311434 >> v1:172.21.15.99:6789/0 conn(0x7f4780071bb0 legacy=0x7f4780071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:50.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.210+0000 7f477ed9d640 1 -- 172.21.15.84:0/785311434 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47800cde10 con 0x7f47800ce7c0 2023-12-12T09:21:50.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.211+0000 7f477ed9d640 1 --2- 172.21.15.84:0/785311434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47800ce7c0 0x7f478013d910 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4778009870 tx=0x7f477802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b3f2d91b4d0be4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:50.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.211+0000 7f477d59a640 1 -- 172.21.15.84:0/785311434 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778031870 con 0x7f47800ce7c0 2023-12-12T09:21:50.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f477d59a640 1 -- 172.21.15.84:0/785311434 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47780319d0 con 0x7f47800ce7c0 2023-12-12T09:21:50.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f477d59a640 1 -- 172.21.15.84:0/785311434 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4778031d60 con 0x7f47800ce7c0 2023-12-12T09:21:50.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f4784f7c640 1 -- 172.21.15.84:0/785311434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47800ce7c0 msgr2=0x7f478013d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f4784f7c640 1 --2- 172.21.15.84:0/785311434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47800ce7c0 0x7f478013d910 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4778009870 tx=0x7f477802b910 comp rx=0 tx=0).stop 2023-12-12T09:21:50.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f4784f7c640 1 -- 172.21.15.84:0/785311434 shutdown_connections 2023-12-12T09:21:50.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f4784f7c640 1 --2- 172.21.15.84:0/785311434 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47800ce7c0 0x7f478013d910 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f4784f7c640 1 --2- 172.21.15.84:0/785311434 >> v2:172.21.15.99:3300/0 conn(0x7f47800ce330 0x7f478013d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f4784f7c640 1 -- 172.21.15.84:0/785311434 >> 172.21.15.84:0/785311434 conn(0x7f478006c3d0 msgr2=0x7f478006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:50.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f4784f7c640 1 -- 172.21.15.84:0/785311434 shutdown_connections 2023-12-12T09:21:50.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.212+0000 7f4784f7c640 1 -- 172.21.15.84:0/785311434 wait complete. 2023-12-12T09:21:50.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.214+0000 7f4784f7c640 1 Processor -- start 2023-12-12T09:21:50.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.214+0000 7f4784f7c640 1 -- start start 2023-12-12T09:21:50.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.215+0000 7f4784f7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4780071bb0 0x7f4780147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.215+0000 7f4784f7c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47800ce330 0x7f478012d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.215+0000 7f4784f7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47800ce7c0 0x7f478012de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.215+0000 7f4784f7c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4780155a10 con 0x7f4780071bb0 2023-12-12T09:21:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.215+0000 7f4784f7c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4780148310 con 0x7f47800ce7c0 2023-12-12T09:21:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.215+0000 7f4784f7c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478012e580 con 0x7f47800ce330 2023-12-12T09:21:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.215+0000 7f477e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4780071bb0 0x7f4780147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f477e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4780071bb0 0x7f4780147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46840/0 (socket says 172.21.15.84:46840) 2023-12-12T09:21:50.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f477e59c640 1 -- 172.21.15.84:0/2766268999 learned_addr learned my addr 172.21.15.84:0/2766268999 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f477e59c640 1 -- 172.21.15.84:0/2766268999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47800ce330 msgr2=0x7f478012d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f477e59c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47800ce330 0x7f478012d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f477e59c640 1 -- 172.21.15.84:0/2766268999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47800ce7c0 msgr2=0x7f478012de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f477e59c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47800ce7c0 0x7f478012de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f477e59c640 1 -- 172.21.15.84:0/2766268999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47780094d0 con 0x7f4780071bb0 2023-12-12T09:21:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f477e59c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4780071bb0 0x7f4780147dd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f477000c7a0 tx=0x7f477000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f4776ffd640 1 -- 172.21.15.84:0/2766268999 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770003d80 con 0x7f4780071bb0 2023-12-12T09:21:50.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f4776ffd640 1 -- 172.21.15.84:0/2766268999 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4770005070 con 0x7f4780071bb0 2023-12-12T09:21:50.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f4776ffd640 1 -- 172.21.15.84:0/2766268999 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770005460 con 0x7f4780071bb0 2023-12-12T09:21:50.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.216+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f478012e860 con 0x7f4780071bb0 2023-12-12T09:21:50.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.217+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f478012ee20 con 0x7f4780071bb0 2023-12-12T09:21:50.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.218+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47800673c0 con 0x7f4780071bb0 2023-12-12T09:21:50.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.219+0000 7f4776ffd640 1 -- 172.21.15.84:0/2766268999 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47700055c0 con 0x7f4780071bb0 2023-12-12T09:21:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.220+0000 7f4776ffd640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476006ae40 0x7f476006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.220+0000 7f4776ffd640 1 -- 172.21.15.84:0/2766268999 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f4770088d80 con 0x7f4780071bb0 2023-12-12T09:21:50.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.220+0000 7f477dd9b640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476006ae40 0x7f476006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.221+0000 7f477dd9b640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476006ae40 0x7f476006d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f478006e080 tx=0x7f4768008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:50.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.225+0000 7f4776ffd640 1 -- 172.21.15.84:0/2766268999 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4770053b60 con 0x7f4780071bb0 2023-12-12T09:21:50.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.429+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47800ae710 con 0x7f4780071bb0 2023-12-12T09:21:50.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.430+0000 7f4776ffd640 1 -- 172.21.15.84:0/2766268999 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4770057180 con 0x7f4780071bb0 2023-12-12T09:21:50.430 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.432+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476006ae40 msgr2=0x7f476006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.432+0000 7f4784f7c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476006ae40 0x7f476006d300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f478006e080 tx=0x7f4768008040 comp rx=0 tx=0).stop 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.432+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4780071bb0 msgr2=0x7f4780147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.432+0000 7f4784f7c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4780071bb0 0x7f4780147dd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f477000c7a0 tx=0x7f477000cc60 comp rx=0 tx=0).stop 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.433+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 shutdown_connections 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.433+0000 7f4784f7c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f47800ce7c0 0x7f478012de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.433+0000 7f4784f7c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f47800ce330 0x7f478012d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.433+0000 7f4784f7c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f476006ae40 0x7f476006d300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.433+0000 7f4784f7c640 1 --2- 172.21.15.84:0/2766268999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4780071bb0 0x7f4780147dd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.433+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 >> 172.21.15.84:0/2766268999 conn(0x7f478006c3d0 msgr2=0x7f478013c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:50.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.433+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 shutdown_connections 2023-12-12T09:21:50.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.433+0000 7f4784f7c640 1 -- 172.21.15.84:0/2766268999 wait complete. 2023-12-12T09:21:50.450 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:21:50.450 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:21:50.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:21:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.756+0000 7f7fe30bb640 1 Processor -- start 2023-12-12T09:21:50.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.756+0000 7f7fe30bb640 1 -- start start 2023-12-12T09:21:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fe30bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc143d20 0x7f7fdc0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fe30bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fdc0ce550 0x7f7fdc0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fe30bb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7fdc1447f0 0x7f7fdc15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fe30bb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc0cea30 con 0x7f7fdc0ce550 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fe30bb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc0702b0 con 0x7f7fdc1447f0 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fe30bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc070590 con 0x7f7fdc143d20 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fdbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fdc0ce550 0x7f7fdc0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fdbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fdc0ce550 0x7f7fdc0b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46844/0 (socket says 172.21.15.84:46844) 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fdbfff640 1 -- 172.21.15.84:0/187086697 learned_addr learned my addr 172.21.15.84:0/187086697 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fe0e57640 1 --2- 172.21.15.84:0/187086697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc143d20 0x7f7fdc0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fe1658640 1 --2- 172.21.15.84:0/187086697 >> v2:172.21.15.99:3300/0 conn(0x7f7fdc1447f0 0x7f7fdc15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fdbfff640 1 -- 172.21.15.84:0/187086697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc143d20 msgr2=0x7f7fdc0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fdbfff640 1 --2- 172.21.15.84:0/187086697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc143d20 0x7f7fdc0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fdbfff640 1 -- 172.21.15.84:0/187086697 >> v2:172.21.15.99:3300/0 conn(0x7f7fdc1447f0 msgr2=0x7f7fdc15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fdbfff640 1 --2- 172.21.15.84:0/187086697 >> v2:172.21.15.99:3300/0 conn(0x7f7fdc1447f0 0x7f7fdc15eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.758+0000 7f7fdbfff640 1 -- 172.21.15.84:0/187086697 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc070870 con 0x7f7fdc0ce550 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.759+0000 7f7fdbfff640 1 --2- 172.21.15.84:0/187086697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0ce550 0x7f7fdc0b4610 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0b1e50 tx=0x7f7fc802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a117d0ff40d79924 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.760+0000 7f7fdb7fe640 1 -- 172.21.15.84:0/187086697 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8031870 con 0x7f7fdc0ce550 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.760+0000 7f7fdb7fe640 1 -- 172.21.15.84:0/187086697 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc80319d0 con 0x7f7fdc0ce550 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.760+0000 7f7fdb7fe640 1 -- 172.21.15.84:0/187086697 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8031d60 con 0x7f7fdc0ce550 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.760+0000 7f7fe30bb640 1 -- 172.21.15.84:0/187086697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0ce550 msgr2=0x7f7fdc0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.760+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/187086697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0ce550 0x7f7fdc0b4610 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0b1e50 tx=0x7f7fc802b910 comp rx=0 tx=0).stop 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.761+0000 7f7fe30bb640 1 -- 172.21.15.84:0/187086697 shutdown_connections 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.761+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/187086697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc0ce550 0x7f7fdc0b4610 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.761+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/187086697 >> v2:172.21.15.99:3300/0 conn(0x7f7fdc1447f0 0x7f7fdc15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.761+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/187086697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc143d20 0x7f7fdc0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.761+0000 7f7fe30bb640 1 -- 172.21.15.84:0/187086697 >> 172.21.15.84:0/187086697 conn(0x7f7fdc06c3d0 msgr2=0x7f7fdc06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.761+0000 7f7fe30bb640 1 -- 172.21.15.84:0/187086697 shutdown_connections 2023-12-12T09:21:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.761+0000 7f7fe30bb640 1 -- 172.21.15.84:0/187086697 wait complete. 2023-12-12T09:21:50.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.762+0000 7f7fe30bb640 1 Processor -- start 2023-12-12T09:21:50.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.763+0000 7f7fe30bb640 1 -- start start 2023-12-12T09:21:50.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe30bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc0ce550 0x7f7fdc0b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe30bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc143d20 0x7f7fdc15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe30bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc1447f0 0x7f7fdc15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe30bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc15d000 con 0x7f7fdc1447f0 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe30bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc15c3f0 con 0x7f7fdc143d20 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe30bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc15c6d0 con 0x7f7fdc0ce550 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe1658640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc1447f0 0x7f7fdc15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe1658640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc1447f0 0x7f7fdc15a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46860/0 (socket says 172.21.15.84:46860) 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe1658640 1 -- 172.21.15.84:0/1499531121 learned_addr learned my addr 172.21.15.84:0/1499531121 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe0e57640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc0ce550 0x7f7fdc0b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fdbfff640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc143d20 0x7f7fdc15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe1658640 1 -- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc0ce550 msgr2=0x7f7fdc0b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe1658640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc0ce550 0x7f7fdc0b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe1658640 1 -- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc143d20 msgr2=0x7f7fdc15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe1658640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc143d20 0x7f7fdc15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fe1658640 1 -- 172.21.15.84:0/1499531121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc80094d0 con 0x7f7fdc1447f0 2023-12-12T09:21:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.764+0000 7f7fdbfff640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc143d20 0x7f7fdc15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.765+0000 7f7fe1658640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc1447f0 0x7f7fdc15a830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400cd40 tx=0x7f7fd400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:50.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.765+0000 7f7fd97fa640 1 -- 172.21.15.84:0/1499531121 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4003b90 con 0x7f7fdc1447f0 2023-12-12T09:21:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.765+0000 7f7fd97fa640 1 -- 172.21.15.84:0/1499531121 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd4003cf0 con 0x7f7fdc1447f0 2023-12-12T09:21:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.765+0000 7f7fd97fa640 1 -- 172.21.15.84:0/1499531121 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4004240 con 0x7f7fdc1447f0 2023-12-12T09:21:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.765+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc15c9b0 con 0x7f7fdc1447f0 2023-12-12T09:21:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.765+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc0b38e0 con 0x7f7fdc1447f0 2023-12-12T09:21:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.766+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc0b3ad0 con 0x7f7fdc1447f0 2023-12-12T09:21:50.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.767+0000 7f7fd97fa640 1 -- 172.21.15.84:0/1499531121 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fd40043a0 con 0x7f7fdc1447f0 2023-12-12T09:21:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.768+0000 7f7fd97fa640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7fc006ae40 0x7f7fc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.768+0000 7f7fd97fa640 1 -- 172.21.15.84:0/1499531121 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f7fd4012070 con 0x7f7fdc1447f0 2023-12-12T09:21:50.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.768+0000 7f7fe0e57640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7fc006ae40 0x7f7fc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:50.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.769+0000 7f7fe0e57640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7fc006ae40 0x7f7fc006d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000a970 tx=0x7f7fd0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:50.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.772+0000 7f7fd97fa640 1 -- 172.21.15.84:0/1499531121 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fd4055000 con 0x7f7fdc1447f0 2023-12-12T09:21:50.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.961+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fdc0673c0 con 0x7f7fdc1447f0 2023-12-12T09:21:50.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.964+0000 7f7fd97fa640 1 -- 172.21.15.84:0/1499531121 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f7fd4058620 con 0x7f7fdc1447f0 2023-12-12T09:21:50.964 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:21:50.964 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:21:50.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7fc006ae40 msgr2=0x7f7fc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7fc006ae40 0x7f7fc006d300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000a970 tx=0x7f7fd0008040 comp rx=0 tx=0).stop 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc1447f0 msgr2=0x7f7fdc15a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc1447f0 0x7f7fdc15a830 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400cd40 tx=0x7f7fd400a660 comp rx=0 tx=0).stop 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 shutdown_connections 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7fc006ae40 0x7f7fc006d300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fdc1447f0 0x7f7fdc15a830 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc143d20 0x7f7fdc15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 --2- 172.21.15.84:0/1499531121 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7fdc0ce550 0x7f7fdc0b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 >> 172.21.15.84:0/1499531121 conn(0x7f7fdc06c3d0 msgr2=0x7f7fdc0afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 shutdown_connections 2023-12-12T09:21:50.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:50.967+0000 7f7fe30bb640 1 -- 172.21.15.84:0/1499531121 wait complete. 2023-12-12T09:21:50.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:21:28.519227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:21:29.210161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-12T09:21:44.988386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:21:50.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:21:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.202+0000 7f28def01640 1 Processor -- start 2023-12-12T09:21:51.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.202+0000 7f28def01640 1 -- start start 2023-12-12T09:21:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.204+0000 7f28def01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.204+0000 7f28def01640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f28d80b4170 0x7f28d806d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.204+0000 7f28def01640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d8071c00 con 0x7f28d806d970 2023-12-12T09:21:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.204+0000 7f28def01640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d806de00 con 0x7f28d80b4170 2023-12-12T09:21:51.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.204+0000 7f28def01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8143c40 con 0x7f28d8143860 2023-12-12T09:21:51.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.204+0000 7f28dcc9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.204+0000 7f28d7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f28d80b4170 0x7f28d806d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.205+0000 7f28d7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f28d80b4170 0x7f28d806d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:55398/0 (socket says 172.21.15.84:55398) 2023-12-12T09:21:51.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.205+0000 7f28dcc9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:45292/0 (socket says 172.21.15.84:45292) 2023-12-12T09:21:51.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.205+0000 7f28d7fff640 1 -- 172.21.15.84:0/3342857373 learned_addr learned my addr 172.21.15.84:0/3342857373 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:51.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.205+0000 7f28d7fff640 1 -- 172.21.15.84:0/3342857373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 msgr2=0x7f28d80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.205+0000 7f28d7fff640 1 --2- 172.21.15.84:0/3342857373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d80b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.205+0000 7f28d7fff640 1 -- 172.21.15.84:0/3342857373 >> v1:172.21.15.99:6789/0 conn(0x7f28d806d970 legacy=0x7f28d815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.205+0000 7f28d7fff640 1 -- 172.21.15.84:0/3342857373 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80b4780 con 0x7f28d80b4170 2023-12-12T09:21:51.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.205+0000 7f28dcc9d640 1 --2- 172.21.15.84:0/3342857373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:21:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.207+0000 7f28d7fff640 1 --2- 172.21.15.84:0/3342857373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d80b4170 0x7f28d806d430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009870 tx=0x7f28c402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a1439264355104 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.207+0000 7f28d77fe640 1 -- 172.21.15.84:0/3342857373 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40317c0 con 0x7f28d80b4170 2023-12-12T09:21:51.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.207+0000 7f28d77fe640 1 -- 172.21.15.84:0/3342857373 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4031920 con 0x7f28d80b4170 2023-12-12T09:21:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.207+0000 7f28d77fe640 1 -- 172.21.15.84:0/3342857373 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4031cb0 con 0x7f28d80b4170 2023-12-12T09:21:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.208+0000 7f28def01640 1 -- 172.21.15.84:0/3342857373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d80b4170 msgr2=0x7f28d806d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.208+0000 7f28def01640 1 --2- 172.21.15.84:0/3342857373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d80b4170 0x7f28d806d430 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009870 tx=0x7f28c402b860 comp rx=0 tx=0).stop 2023-12-12T09:21:51.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.208+0000 7f28def01640 1 -- 172.21.15.84:0/3342857373 shutdown_connections 2023-12-12T09:21:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.208+0000 7f28def01640 1 --2- 172.21.15.84:0/3342857373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d80b4170 0x7f28d806d430 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.208+0000 7f28def01640 1 --2- 172.21.15.84:0/3342857373 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.208+0000 7f28def01640 1 -- 172.21.15.84:0/3342857373 >> 172.21.15.84:0/3342857373 conn(0x7f28d80b0ac0 msgr2=0x7f28d80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.208+0000 7f28def01640 1 -- 172.21.15.84:0/3342857373 shutdown_connections 2023-12-12T09:21:51.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.208+0000 7f28def01640 1 -- 172.21.15.84:0/3342857373 wait complete. 2023-12-12T09:21:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.210+0000 7f28def01640 1 Processor -- start 2023-12-12T09:21:51.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.210+0000 7f28def01640 1 -- start start 2023-12-12T09:21:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.211+0000 7f28def01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d806d970 0x7f28d8141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.211+0000 7f28def01640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d80b4170 0x7f28d80ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.211+0000 7f28def01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d813be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.211+0000 7f28def01640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80ae760 con 0x7f28d80b4170 2023-12-12T09:21:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.211+0000 7f28def01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d81417f0 con 0x7f28d806d970 2023-12-12T09:21:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.211+0000 7f28def01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8141ad0 con 0x7f28d8143860 2023-12-12T09:21:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.211+0000 7f28d7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d80b4170 0x7f28d80ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28d7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d80b4170 0x7f28d80ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46874/0 (socket says 172.21.15.84:46874) 2023-12-12T09:21:51.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28d7fff640 1 -- 172.21.15.84:0/3960121855 learned_addr learned my addr 172.21.15.84:0/3960121855 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:51.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28dcc9d640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d806d970 0x7f28d8141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28dd49e640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d813be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28d7fff640 1 -- 172.21.15.84:0/3960121855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 msgr2=0x7f28d813be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28d7fff640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d813be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28d7fff640 1 -- 172.21.15.84:0/3960121855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d806d970 msgr2=0x7f28d8141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28d7fff640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d806d970 0x7f28d8141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28d7fff640 1 -- 172.21.15.84:0/3960121855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc00b6a0 con 0x7f28d80b4170 2023-12-12T09:21:51.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.212+0000 7f28d7fff640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d80b4170 0x7f28d80ae220 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f28c4000c00 tx=0x7f28c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:51.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.213+0000 7f28d57fa640 1 -- 172.21.15.84:0/3960121855 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4032860 con 0x7f28d80b4170 2023-12-12T09:21:51.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.213+0000 7f28d57fa640 1 -- 172.21.15.84:0/3960121855 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c40329e0 con 0x7f28d80b4170 2023-12-12T09:21:51.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.213+0000 7f28d57fa640 1 -- 172.21.15.84:0/3960121855 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4032d90 con 0x7f28d80b4170 2023-12-12T09:21:51.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.213+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c40094d0 con 0x7f28d80b4170 2023-12-12T09:21:51.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.213+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d8142090 con 0x7f28d80b4170 2023-12-12T09:21:51.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.214+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d80673c0 con 0x7f28d80b4170 2023-12-12T09:21:51.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.215+0000 7f28d57fa640 1 -- 172.21.15.84:0/3960121855 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28c404d3f0 con 0x7f28d80b4170 2023-12-12T09:21:51.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.216+0000 7f28d57fa640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f28bc06ae40 0x7f28bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.216+0000 7f28d57fa640 1 -- 172.21.15.84:0/3960121855 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f28c40ab6a0 con 0x7f28d80b4170 2023-12-12T09:21:51.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.216+0000 7f28dcc9d640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f28bc06ae40 0x7f28bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.217+0000 7f28dcc9d640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f28bc06ae40 0x7f28bc06d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00bf00 tx=0x7f28cc00b3a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:51.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.220+0000 7f28d57fa640 1 -- 172.21.15.84:0/3960121855 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28c4076470 con 0x7f28d80b4170 2023-12-12T09:21:51.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.413+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28d8140d80 con 0x7f28d80b4170 2023-12-12T09:21:51.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.414+0000 7f28d57fa640 1 -- 172.21.15.84:0/3960121855 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28c4079a90 con 0x7f28d80b4170 2023-12-12T09:21:51.414 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f28bc06ae40 msgr2=0x7f28bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f28bc06ae40 0x7f28bc06d300 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00bf00 tx=0x7f28cc00b3a0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d80b4170 msgr2=0x7f28d80ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d80b4170 0x7f28d80ae220 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f28c4000c00 tx=0x7f28c40046c0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 shutdown_connections 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28d8143860 0x7f28d813be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f28bc06ae40 0x7f28bc06d300 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28d80b4170 0x7f28d80ae220 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 --2- 172.21.15.84:0/3960121855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d806d970 0x7f28d8141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.416+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 >> 172.21.15.84:0/3960121855 conn(0x7f28d80b0ac0 msgr2=0x7f28d815cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.417+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 shutdown_connections 2023-12-12T09:21:51.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.417+0000 7f28def01640 1 -- 172.21.15.84:0/3960121855 wait complete. 2023-12-12T09:21:51.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:21:51.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.646+0000 7f89a7f4c640 1 Processor -- start 2023-12-12T09:21:51.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.646+0000 7f89a7f4c640 1 -- start start 2023-12-12T09:21:51.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.648+0000 7f89a7f4c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f89a015bc00 0x7f89a00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.648+0000 7f89a7f4c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a0155a70 con 0x7f89a0155690 2023-12-12T09:21:51.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.648+0000 7f89a7f4c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a015c120 con 0x7f89a00cde40 2023-12-12T09:21:51.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.648+0000 7f89a7f4c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a00ce830 con 0x7f89a015bc00 2023-12-12T09:21:51.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.648+0000 7f89a5ce8640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f89a0155690 0x7f89a006ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41600/0 (socket says 172.21.15.84:41600) 2023-12-12T09:21:51.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.648+0000 7f89a5ce8640 1 -- 172.21.15.84:0/3362393683 learned_addr learned my addr 172.21.15.84:0/3362393683 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a64e9640 1 --2- 172.21.15.84:0/3362393683 >> v2:172.21.15.99:3300/0 conn(0x7f89a015bc00 0x7f89a00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723522379 0 0) 0x7f89a0155a70 con 0x7f89a0155690 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f898c003520 con 0x7f89a0155690 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733872749 0 0) 0x7f898c003520 con 0x7f89a0155690 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 >> v2:172.21.15.99:3300/0 conn(0x7f89a015bc00 msgr2=0x7f89a00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 --2- 172.21.15.84:0/3362393683 >> v2:172.21.15.99:3300/0 conn(0x7f89a015bc00 0x7f89a00ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 >> v1:172.21.15.99:6789/0 conn(0x7f89a00cde40 legacy=0x7f89a015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a015c400 con 0x7f89a0155690 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f899c001670 con 0x7f89a0155690 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 >> v1:172.21.15.84:6789/0 conn(0x7f89a0155690 legacy=0x7f89a006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.649+0000 7f89a4ce6640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0039c0 0x7f898c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a4ce6640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a4ce6640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f898c005180 0x7f898c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00ce830 con 0x7f898c0047c0 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c00c080 con 0x7f898c005180 2023-12-12T09:21:51.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c00c240 con 0x7f898c0039c0 2023-12-12T09:21:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a54e7640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a5ce8640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0039c0 0x7f898c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a54e7640 1 -- 172.21.15.84:0/3362393683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0039c0 msgr2=0x7f898c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a54e7640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0039c0 0x7f898c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a54e7640 1 -- 172.21.15.84:0/3362393683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f898c005180 msgr2=0x7f898c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a54e7640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f898c005180 0x7f898c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a54e7640 1 -- 172.21.15.84:0/3362393683 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c003520 con 0x7f898c0047c0 2023-12-12T09:21:51.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.650+0000 7f89a64e9640 1 -- 172.21.15.84:0/3362393683 reap_dead start 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.651+0000 7f89a54e7640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8994001750 tx=0x7f898c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bcac117c981434 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940052d0 con 0x7f898c0047c0 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899402e050 con 0x7f898c0047c0 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a4ce6640 1 -- 172.21.15.84:0/3362393683 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994003830 con 0x7f898c0047c0 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3362393683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898c0047c0 msgr2=0x7f898c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a7f4c640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8994001750 tx=0x7f898c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3362393683 shutdown_connections 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a7f4c640 1 --2- 172.21.15.84:0/3362393683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898c0047c0 0x7f898c004c40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3362393683 >> 172.21.15.84:0/3362393683 conn(0x7f89a00b0900 msgr2=0x7f89a00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:51.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3362393683 shutdown_connections 2023-12-12T09:21:51.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.652+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3362393683 wait complete. 2023-12-12T09:21:51.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.654+0000 7f89a7f4c640 1 Processor -- start 2023-12-12T09:21:51.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.654+0000 7f89a7f4c640 1 -- start start 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a7f4c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0047c0 0x7f89a014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a7f4c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a01502b0 0x7f89a014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a7f4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89a014d720 0x7f89a014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a7f4c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a009b900 con 0x7f89a01502b0 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a7f4c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a009bbe0 con 0x7f89a014d720 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a7f4c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a009bec0 con 0x7f898c0047c0 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a54e7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a01502b0 0x7f89a014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a54e7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a01502b0 0x7f89a014d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46898/0 (socket says 172.21.15.84:46898) 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.655+0000 7f89a54e7640 1 -- 172.21.15.84:0/3985041576 learned_addr learned my addr 172.21.15.84:0/3985041576 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a5ce8640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0047c0 0x7f89a014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a64e9640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89a014d720 0x7f89a014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a54e7640 1 -- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0047c0 msgr2=0x7f89a014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a54e7640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0047c0 0x7f89a014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a54e7640 1 -- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89a014d720 msgr2=0x7f89a014dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a54e7640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89a014d720 0x7f89a014dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a54e7640 1 -- 172.21.15.84:0/3985041576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a009c1a0 con 0x7f89a01502b0 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a5ce8640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0047c0 0x7f89a014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89a54e7640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a01502b0 0x7f89a014d1e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8994000c00 tx=0x7f8994001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.656+0000 7f89927fc640 1 -- 172.21.15.84:0/3985041576 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89940076c0 con 0x7f89a01502b0 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.657+0000 7f89927fc640 1 -- 172.21.15.84:0/3985041576 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994007a30 con 0x7f89a01502b0 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.657+0000 7f89927fc640 1 -- 172.21.15.84:0/3985041576 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994006be0 con 0x7f89a01502b0 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.657+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a00aed50 con 0x7f89a01502b0 2023-12-12T09:21:51.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.657+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a0143b50 con 0x7f89a01502b0 2023-12-12T09:21:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.658+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a00673c0 con 0x7f89a01502b0 2023-12-12T09:21:51.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.659+0000 7f89927fc640 1 -- 172.21.15.84:0/3985041576 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8994006d40 con 0x7f89a01502b0 2023-12-12T09:21:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.661+0000 7f89927fc640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f898406ae40 0x7f898406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.661+0000 7f89927fc640 1 -- 172.21.15.84:0/3985041576 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f89940ab4b0 con 0x7f89a01502b0 2023-12-12T09:21:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.661+0000 7f89a5ce8640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f898406ae40 0x7f898406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:51.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.662+0000 7f89a5ce8640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f898406ae40 0x7f898406d300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89a00cde10 tx=0x7f899c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:51.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.665+0000 7f89927fc640 1 -- 172.21.15.84:0/3985041576 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8994076320 con 0x7f89a01502b0 2023-12-12T09:21:51.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.855+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89a015b0a0 con 0x7f89a01502b0 2023-12-12T09:21:51.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.856+0000 7f89927fc640 1 -- 172.21.15.84:0/3985041576 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8994079940 con 0x7f89a01502b0 2023-12-12T09:21:51.856 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.858+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f898406ae40 msgr2=0x7f898406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.858+0000 7f89a7f4c640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f898406ae40 0x7f898406d300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89a00cde10 tx=0x7f899c009040 comp rx=0 tx=0).stop 2023-12-12T09:21:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.858+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a01502b0 msgr2=0x7f89a014d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.858+0000 7f89a7f4c640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a01502b0 0x7f89a014d1e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8994000c00 tx=0x7f8994001120 comp rx=0 tx=0).stop 2023-12-12T09:21:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.859+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 shutdown_connections 2023-12-12T09:21:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.859+0000 7f89a7f4c640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89a014d720 0x7f89a014dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.859+0000 7f89a7f4c640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f898406ae40 0x7f898406d300 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.859+0000 7f89a7f4c640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89a01502b0 0x7f89a014d1e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.859+0000 7f89a7f4c640 1 --2- 172.21.15.84:0/3985041576 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f898c0047c0 0x7f89a014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.859+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 >> 172.21.15.84:0/3985041576 conn(0x7f89a00b0900 msgr2=0x7f89a015dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.859+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 shutdown_connections 2023-12-12T09:21:51.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:51.859+0000 7f89a7f4c640 1 -- 172.21.15.84:0/3985041576 wait complete. 2023-12-12T09:21:51.877 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:21:52.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.095+0000 7fe520e9b640 1 Processor -- start 2023-12-12T09:21:52.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.095+0000 7fe520e9b640 1 -- start start 2023-12-12T09:21:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.097+0000 7fe520e9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c0b40d0 0x7fe51c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.097+0000 7fe520e9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe51c0ce6f0 0x7fe51c0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.097+0000 7fe520e9b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51c0ceb80 con 0x7fe51c15be60 2023-12-12T09:21:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.097+0000 7fe520e9b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51c0ce260 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.097+0000 7fe520e9b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c0b49f0 con 0x7fe51c0b40d0 2023-12-12T09:21:52.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.097+0000 7fe51a59c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c0b40d0 0x7fe51c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.098+0000 7fe519d9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe51c0ce6f0 0x7fe51c0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.098+0000 7fe51a59c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c0b40d0 0x7fe51c06dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:45320/0 (socket says 172.21.15.84:45320) 2023-12-12T09:21:52.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.098+0000 7fe51a59c640 1 -- 172.21.15.84:0/975404327 learned_addr learned my addr 172.21.15.84:0/975404327 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:52.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.098+0000 7fe51a59c640 1 -- 172.21.15.84:0/975404327 >> v2:172.21.15.99:3300/0 conn(0x7fe51c0ce6f0 msgr2=0x7fe51c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:52.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.098+0000 7fe51a59c640 1 --2- 172.21.15.84:0/975404327 >> v2:172.21.15.99:3300/0 conn(0x7fe51c0ce6f0 0x7fe51c0b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.098+0000 7fe51a59c640 1 -- 172.21.15.84:0/975404327 >> v1:172.21.15.99:6789/0 conn(0x7fe51c15be60 legacy=0x7fe51c13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.098+0000 7fe51a59c640 1 -- 172.21.15.84:0/975404327 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c0cd930 con 0x7fe51c0b40d0 2023-12-12T09:21:52.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.100+0000 7fe51a59c640 1 --2- 172.21.15.84:0/975404327 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c0b40d0 0x7fe51c06dff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009870 tx=0x7fe50c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e2944f8163ae2fd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.101+0000 7fe51959a640 1 -- 172.21.15.84:0/975404327 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c030840 con 0x7fe51c0b40d0 2023-12-12T09:21:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.101+0000 7fe51959a640 1 -- 172.21.15.84:0/975404327 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c0309a0 con 0x7fe51c0b40d0 2023-12-12T09:21:52.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.101+0000 7fe51959a640 1 -- 172.21.15.84:0/975404327 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c030d30 con 0x7fe51c0b40d0 2023-12-12T09:21:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.102+0000 7fe520e9b640 1 -- 172.21.15.84:0/975404327 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c0b40d0 msgr2=0x7fe51c06dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.102+0000 7fe520e9b640 1 --2- 172.21.15.84:0/975404327 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c0b40d0 0x7fe51c06dff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009870 tx=0x7fe50c02b980 comp rx=0 tx=0).stop 2023-12-12T09:21:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.102+0000 7fe520e9b640 1 -- 172.21.15.84:0/975404327 shutdown_connections 2023-12-12T09:21:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.102+0000 7fe520e9b640 1 --2- 172.21.15.84:0/975404327 >> v2:172.21.15.99:3300/0 conn(0x7fe51c0ce6f0 0x7fe51c0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.102+0000 7fe520e9b640 1 --2- 172.21.15.84:0/975404327 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c0b40d0 0x7fe51c06dff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.102+0000 7fe520e9b640 1 -- 172.21.15.84:0/975404327 >> 172.21.15.84:0/975404327 conn(0x7fe51c0b0ac0 msgr2=0x7fe51c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:52.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.102+0000 7fe520e9b640 1 -- 172.21.15.84:0/975404327 shutdown_connections 2023-12-12T09:21:52.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.102+0000 7fe520e9b640 1 -- 172.21.15.84:0/975404327 wait complete. 2023-12-12T09:21:52.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.104+0000 7fe520e9b640 1 Processor -- start 2023-12-12T09:21:52.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.104+0000 7fe520e9b640 1 -- start start 2023-12-12T09:21:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe520e9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe51c0b40d0 0x7fe51c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe520e9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c0ce6f0 0x7fe51c152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe520e9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c15be60 0x7fe51c131e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe520e9b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c13cdb0 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe520e9b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c157390 con 0x7fe51c0b40d0 2023-12-12T09:21:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe520e9b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c157670 con 0x7fe51c15be60 2023-12-12T09:21:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe519d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c0ce6f0 0x7fe51c152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe519d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c0ce6f0 0x7fe51c152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46908/0 (socket says 172.21.15.84:46908) 2023-12-12T09:21:52.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe519d9b640 1 -- 172.21.15.84:0/514607127 learned_addr learned my addr 172.21.15.84:0/514607127 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:52.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe51ad9d640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c15be60 0x7fe51c131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.105+0000 7fe51a59c640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe51c0b40d0 0x7fe51c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe519d9b640 1 -- 172.21.15.84:0/514607127 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c15be60 msgr2=0x7fe51c131e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe519d9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c15be60 0x7fe51c131e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe519d9b640 1 -- 172.21.15.84:0/514607127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe51c0b40d0 msgr2=0x7fe51c156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe519d9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe51c0b40d0 0x7fe51c156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe519d9b640 1 -- 172.21.15.84:0/514607127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0094d0 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe519d9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c0ce6f0 0x7fe51c152180 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe50400efc0 tx=0x7fe50400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe512ffd640 1 -- 172.21.15.84:0/514607127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504014480 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe512ffd640 1 -- 172.21.15.84:0/514607127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400f040 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe512ffd640 1 -- 172.21.15.84:0/514607127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe504014800 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51c157950 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.106+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c157f10 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.108+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51c1580d0 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.108+0000 7fe512ffd640 1 -- 172.21.15.84:0/514607127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe504014960 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.109+0000 7fe512ffd640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe4fc06ae40 0x7fe4fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.109+0000 7fe512ffd640 1 -- 172.21.15.84:0/514607127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fe50408a5c0 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.110+0000 7fe51a59c640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe4fc06ae40 0x7fe4fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.110+0000 7fe51a59c640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe4fc06ae40 0x7fe4fc06d300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe50c036000 tx=0x7fe50c03b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.114+0000 7fe512ffd640 1 -- 172.21.15.84:0/514607127 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe504055340 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.306+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe51c0673c0 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.307+0000 7fe512ffd640 1 -- 172.21.15.84:0/514607127 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe504058960 con 0x7fe51c0ce6f0 2023-12-12T09:21:52.307 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:21:52.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.309+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe4fc06ae40 msgr2=0x7fe4fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.309+0000 7fe520e9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe4fc06ae40 0x7fe4fc06d300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe50c036000 tx=0x7fe50c03b040 comp rx=0 tx=0).stop 2023-12-12T09:21:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.309+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c0ce6f0 msgr2=0x7fe51c152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.309+0000 7fe520e9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c0ce6f0 0x7fe51c152180 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe50400efc0 tx=0x7fe50400c490 comp rx=0 tx=0).stop 2023-12-12T09:21:52.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.310+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 shutdown_connections 2023-12-12T09:21:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.310+0000 7fe520e9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe51c15be60 0x7fe51c131e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.310+0000 7fe520e9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe4fc06ae40 0x7fe4fc06d300 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.310+0000 7fe520e9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe51c0ce6f0 0x7fe51c152180 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.310+0000 7fe520e9b640 1 --2- 172.21.15.84:0/514607127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe51c0b40d0 0x7fe51c156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.310+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 >> 172.21.15.84:0/514607127 conn(0x7fe51c0b0ac0 msgr2=0x7fe51c0aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.310+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 shutdown_connections 2023-12-12T09:21:52.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.310+0000 7fe520e9b640 1 -- 172.21.15.84:0/514607127 wait complete. 2023-12-12T09:21:52.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-12T09:21:52.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.544+0000 7f16309e5640 1 Processor -- start 2023-12-12T09:21:52.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.544+0000 7f16309e5640 1 -- start start 2023-12-12T09:21:52.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f16309e5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c06d430 0x7f162c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f16309e5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f162c0b1dc0 0x7f162c0b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f16309e5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162c071c00 con 0x7f162c143860 2023-12-12T09:21:52.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f16309e5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162c06ddb0 con 0x7f162c0b1dc0 2023-12-12T09:21:52.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f16309e5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c143c40 con 0x7f162c06d430 2023-12-12T09:21:52.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f162ad9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f162c0b1dc0 0x7f162c0b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f162ad9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f162c0b1dc0 0x7f162c0b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46924/0 (socket says 172.21.15.84:46924) 2023-12-12T09:21:52.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f162ad9d640 1 -- 172.21.15.84:0/2262046135 learned_addr learned my addr 172.21.15.84:0/2262046135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.546+0000 7f1623fff640 1 --2- 172.21.15.84:0/2262046135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c06d430 0x7f162c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.547+0000 7f162ad9d640 1 -- 172.21.15.84:0/2262046135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c06d430 msgr2=0x7f162c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.547+0000 7f162ad9d640 1 --2- 172.21.15.84:0/2262046135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c06d430 0x7f162c06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.547+0000 7f162ad9d640 1 -- 172.21.15.84:0/2262046135 >> v1:172.21.15.99:6789/0 conn(0x7f162c143860 legacy=0x7f162c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.547+0000 7f162ad9d640 1 -- 172.21.15.84:0/2262046135 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0b4780 con 0x7f162c0b1dc0 2023-12-12T09:21:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.547+0000 7f1623fff640 1 --2- 172.21.15.84:0/2262046135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c06d430 0x7f162c06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:52.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.548+0000 7f162ad9d640 1 --2- 172.21.15.84:0/2262046135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c0b1dc0 0x7f162c0b2250 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1624009e50 tx=0x7f162402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b74b355c7b8ab3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.548+0000 7f1629d9b640 1 -- 172.21.15.84:0/2262046135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162402c960 con 0x7f162c0b1dc0 2023-12-12T09:21:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.548+0000 7f1629d9b640 1 -- 172.21.15.84:0/2262046135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162402cac0 con 0x7f162c0b1dc0 2023-12-12T09:21:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.548+0000 7f1629d9b640 1 -- 172.21.15.84:0/2262046135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162402ce50 con 0x7f162c0b1dc0 2023-12-12T09:21:52.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.549+0000 7f16309e5640 1 -- 172.21.15.84:0/2262046135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c0b1dc0 msgr2=0x7f162c0b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.549+0000 7f16309e5640 1 --2- 172.21.15.84:0/2262046135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c0b1dc0 0x7f162c0b2250 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1624009e50 tx=0x7f162402bdc0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.549+0000 7f16309e5640 1 -- 172.21.15.84:0/2262046135 shutdown_connections 2023-12-12T09:21:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.549+0000 7f16309e5640 1 --2- 172.21.15.84:0/2262046135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c0b1dc0 0x7f162c0b2250 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.549+0000 7f16309e5640 1 --2- 172.21.15.84:0/2262046135 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c06d430 0x7f162c06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.549+0000 7f16309e5640 1 -- 172.21.15.84:0/2262046135 >> 172.21.15.84:0/2262046135 conn(0x7f162c0b0ac0 msgr2=0x7f162c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:52.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.549+0000 7f16309e5640 1 -- 172.21.15.84:0/2262046135 shutdown_connections 2023-12-12T09:21:52.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.549+0000 7f16309e5640 1 -- 172.21.15.84:0/2262046135 wait complete. 2023-12-12T09:21:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.551+0000 7f16309e5640 1 Processor -- start 2023-12-12T09:21:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.552+0000 7f16309e5640 1 -- start start 2023-12-12T09:21:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f16309e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06d430 0x7f162c15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f16309e5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c0b1dc0 0x7f162c159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f16309e5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c143860 0x7f162c13b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f16309e5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c1f2c30 con 0x7f162c143860 2023-12-12T09:21:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f16309e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162c15d540 con 0x7f162c06d430 2023-12-12T09:21:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f16309e5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162c159790 con 0x7f162c0b1dc0 2023-12-12T09:21:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f162ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c143860 0x7f162c13b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f162ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c143860 0x7f162c13b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46930/0 (socket says 172.21.15.84:46930) 2023-12-12T09:21:52.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.553+0000 7f162ad9d640 1 -- 172.21.15.84:0/264296612 learned_addr learned my addr 172.21.15.84:0/264296612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f162a59c640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06d430 0x7f162c15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f1623fff640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c0b1dc0 0x7f162c159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f162ad9d640 1 -- 172.21.15.84:0/264296612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c0b1dc0 msgr2=0x7f162c159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f162ad9d640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c0b1dc0 0x7f162c159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f162ad9d640 1 -- 172.21.15.84:0/264296612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06d430 msgr2=0x7f162c15d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f162ad9d640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06d430 0x7f162c15d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f162ad9d640 1 -- 172.21.15.84:0/264296612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1624009b30 con 0x7f162c143860 2023-12-12T09:21:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f162ad9d640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c143860 0x7f162c13b920 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1624036040 tx=0x7f1624004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.554+0000 7f1622ffd640 1 -- 172.21.15.84:0/264296612 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162403e450 con 0x7f162c143860 2023-12-12T09:21:52.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.555+0000 7f1622ffd640 1 -- 172.21.15.84:0/264296612 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162403e5d0 con 0x7f162c143860 2023-12-12T09:21:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.555+0000 7f1622ffd640 1 -- 172.21.15.84:0/264296612 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162403e980 con 0x7f162c143860 2023-12-12T09:21:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.555+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162c0cc490 con 0x7f162c143860 2023-12-12T09:21:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.555+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162c13c100 con 0x7f162c143860 2023-12-12T09:21:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.556+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162c0cc620 con 0x7f162c143860 2023-12-12T09:21:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.557+0000 7f1622ffd640 1 -- 172.21.15.84:0/264296612 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f162403eae0 con 0x7f162c143860 2023-12-12T09:21:52.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.558+0000 7f1622ffd640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f160c06ae40 0x7f160c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.558+0000 7f1622ffd640 1 -- 172.21.15.84:0/264296612 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f16240ac840 con 0x7f162c143860 2023-12-12T09:21:52.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.558+0000 7f162a59c640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f160c06ae40 0x7f160c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.559+0000 7f162a59c640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f160c06ae40 0x7f160c06d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f161c006fd0 tx=0x7f161c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.562+0000 7f1622ffd640 1 -- 172.21.15.84:0/264296612 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1624077580 con 0x7f162c143860 2023-12-12T09:21:52.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.753+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f162c0673c0 con 0x7f162c143860 2023-12-12T09:21:52.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.754+0000 7f1622ffd640 1 -- 172.21.15.84:0/264296612 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v44) v1 ==== 97+0+11 (secure 0 0 0) 0x7f162407aba0 con 0x7f162c143860 2023-12-12T09:21:52.754 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:21:52.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f160c06ae40 msgr2=0x7f160c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f160c06ae40 0x7f160c06d300 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f161c006fd0 tx=0x7f161c008040 comp rx=0 tx=0).stop 2023-12-12T09:21:52.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c143860 msgr2=0x7f162c13b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c143860 0x7f162c13b920 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1624036040 tx=0x7f1624004a40 comp rx=0 tx=0).stop 2023-12-12T09:21:52.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 shutdown_connections 2023-12-12T09:21:52.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f160c06ae40 0x7f160c06d300 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f162c143860 0x7f162c13b920 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f162c0b1dc0 0x7f162c159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 --2- 172.21.15.84:0/264296612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f162c06d430 0x7f162c15d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.756+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 >> 172.21.15.84:0/264296612 conn(0x7f162c0b0ac0 msgr2=0x7f162c0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:52.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.757+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 shutdown_connections 2023-12-12T09:21:52.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.757+0000 7f16309e5640 1 -- 172.21.15.84:0/264296612 wait complete. 2023-12-12T09:21:52.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:21:52.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.980+0000 7f6e37e00640 1 Processor -- start 2023-12-12T09:21:52.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.980+0000 7f6e37e00640 1 -- start start 2023-12-12T09:21:52.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.981+0000 7f6e37e00640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e300b47e0 0x7f6e30071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e300715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e37e00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e300cea30 con 0x7f6e30143d20 2023-12-12T09:21:52.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e37e00640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300702b0 con 0x7f6e300b47e0 2023-12-12T09:21:52.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e37e00640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e30070590 con 0x7f6e300ce550 2023-12-12T09:21:52.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e3539b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6e300b47e0 0x7f6e30071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e35b9c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6e30143d20 0x7f6e300b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41604/0 (socket says 172.21.15.84:41604) 2023-12-12T09:21:52.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e35b9c640 1 -- 172.21.15.84:0/3492671682 learned_addr learned my addr 172.21.15.84:0/3492671682 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:21:52.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e3639d640 1 --2- 172.21.15.84:0/3492671682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e300715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e3539b640 1 -- 172.21.15.84:0/3492671682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 msgr2=0x7f6e300715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:52.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e3539b640 1 --2- 172.21.15.84:0/3492671682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e300715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e3539b640 1 -- 172.21.15.84:0/3492671682 >> v1:172.21.15.84:6789/0 conn(0x7f6e30143d20 legacy=0x7f6e300b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e3539b640 1 -- 172.21.15.84:0/3492671682 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30070870 con 0x7f6e300b47e0 2023-12-12T09:21:52.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e34b9a640 1 -- 172.21.15.84:0/3492671682 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769603036 0 0) 0x7f6e300cea30 con 0x7f6e30143d20 2023-12-12T09:21:52.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.982+0000 7f6e3639d640 1 --2- 172.21.15.84:0/3492671682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e300715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:52.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.984+0000 7f6e3539b640 1 --2- 172.21.15.84:0/3492671682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e300b47e0 0x7f6e30071070 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6e240097a0 tx=0x7f6e2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d02461f2c8bda05 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.984+0000 7f6e34b9a640 1 -- 172.21.15.84:0/3492671682 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24031830 con 0x7f6e300b47e0 2023-12-12T09:21:52.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.984+0000 7f6e34b9a640 1 -- 172.21.15.84:0/3492671682 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e24031990 con 0x7f6e300b47e0 2023-12-12T09:21:52.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.984+0000 7f6e34b9a640 1 -- 172.21.15.84:0/3492671682 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24031d20 con 0x7f6e300b47e0 2023-12-12T09:21:52.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.984+0000 7f6e37e00640 1 -- 172.21.15.84:0/3492671682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e300b47e0 msgr2=0x7f6e30071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.984+0000 7f6e37e00640 1 --2- 172.21.15.84:0/3492671682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e300b47e0 0x7f6e30071070 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6e240097a0 tx=0x7f6e2402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.985+0000 7f6e37e00640 1 -- 172.21.15.84:0/3492671682 shutdown_connections 2023-12-12T09:21:52.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.985+0000 7f6e37e00640 1 --2- 172.21.15.84:0/3492671682 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e300715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.985+0000 7f6e37e00640 1 --2- 172.21.15.84:0/3492671682 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e300b47e0 0x7f6e30071070 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.985+0000 7f6e37e00640 1 -- 172.21.15.84:0/3492671682 >> 172.21.15.84:0/3492671682 conn(0x7f6e3006c3d0 msgr2=0x7f6e3006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:52.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.985+0000 7f6e37e00640 1 -- 172.21.15.84:0/3492671682 shutdown_connections 2023-12-12T09:21:52.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.985+0000 7f6e37e00640 1 -- 172.21.15.84:0/3492671682 wait complete. 2023-12-12T09:21:52.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.986+0000 7f6e37e00640 1 Processor -- start 2023-12-12T09:21:52.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.987+0000 7f6e37e00640 1 -- start start 2023-12-12T09:21:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e300b47e0 0x7f6e3013e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e3013ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e30143d20 0x7f6e3015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e37e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3013d800 con 0x7f6e30143d20 2023-12-12T09:21:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e37e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3015baf0 con 0x7f6e300b47e0 2023-12-12T09:21:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e37e00640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3013ea80 con 0x7f6e300ce550 2023-12-12T09:21:52.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3639d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e30143d20 0x7f6e3015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3639d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e30143d20 0x7f6e3015da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46934/0 (socket says 172.21.15.84:46934) 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3639d640 1 -- 172.21.15.84:0/2861012302 learned_addr learned my addr 172.21.15.84:0/2861012302 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e35b9c640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e300b47e0 0x7f6e3013e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3539b640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e3013ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3639d640 1 -- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 msgr2=0x7f6e3013ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3639d640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e3013ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3639d640 1 -- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e300b47e0 msgr2=0x7f6e3013e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3639d640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e300b47e0 0x7f6e3013e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e3639d640 1 -- 172.21.15.84:0/2861012302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e24009400 con 0x7f6e30143d20 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.988+0000 7f6e35b9c640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e300b47e0 0x7f6e3013e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.989+0000 7f6e3639d640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e30143d20 0x7f6e3015da10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800ce80 tx=0x7f6e2800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.989+0000 7f6e227fc640 1 -- 172.21.15.84:0/2861012302 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800d840 con 0x7f6e30143d20 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.989+0000 7f6e227fc640 1 -- 172.21.15.84:0/2861012302 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2800d9e0 con 0x7f6e30143d20 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.989+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3013cfd0 con 0x7f6e30143d20 2023-12-12T09:21:52.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.989+0000 7f6e227fc640 1 -- 172.21.15.84:0/2861012302 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800dd90 con 0x7f6e30143d20 2023-12-12T09:21:52.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.989+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3013d520 con 0x7f6e30143d20 2023-12-12T09:21:52.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.990+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e30073200 con 0x7f6e30143d20 2023-12-12T09:21:52.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.991+0000 7f6e227fc640 1 -- 172.21.15.84:0/2861012302 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6e28015440 con 0x7f6e30143d20 2023-12-12T09:21:52.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.992+0000 7f6e227fc640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e1406ae40 0x7f6e1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:52.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.992+0000 7f6e227fc640 1 -- 172.21.15.84:0/2861012302 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f6e2808a230 con 0x7f6e30143d20 2023-12-12T09:21:52.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.992+0000 7f6e35b9c640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e1406ae40 0x7f6e1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:52.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.993+0000 7f6e35b9c640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e1406ae40 0x7f6e1406d300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c000f60 tx=0x7f6e2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:52.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:52.996+0000 7f6e227fc640 1 -- 172.21.15.84:0/2861012302 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6e280550c0 con 0x7f6e30143d20 2023-12-12T09:21:53.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.201+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6e3015bc30 con 0x7f6e30143d20 2023-12-12T09:21:53.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.202+0000 7f6e227fc640 1 -- 172.21.15.84:0/2861012302 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6e3015bc30 con 0x7f6e30143d20 2023-12-12T09:21:53.202 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:21:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e1406ae40 msgr2=0x7f6e1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e1406ae40 0x7f6e1406d300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c000f60 tx=0x7f6e2c009040 comp rx=0 tx=0).stop 2023-12-12T09:21:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e30143d20 msgr2=0x7f6e3015da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e30143d20 0x7f6e3015da10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800ce80 tx=0x7f6e2800a710 comp rx=0 tx=0).stop 2023-12-12T09:21:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 shutdown_connections 2023-12-12T09:21:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6e1406ae40 0x7f6e1406d300 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e30143d20 0x7f6e3015da10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6e300ce550 0x7f6e3013ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 --2- 172.21.15.84:0/2861012302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e300b47e0 0x7f6e3013e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 >> 172.21.15.84:0/2861012302 conn(0x7f6e3006c3d0 msgr2=0x7f6e30070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 shutdown_connections 2023-12-12T09:21:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:53.205+0000 7f6e37e00640 1 -- 172.21.15.84:0/2861012302 wait complete. 2023-12-12T09:21:53.223 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:21:53.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:53.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-12T09:21:53.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[104786]: fuse finished with error 0 and tester_r 0 2023-12-12T09:21:53.310 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:21:58.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:21:58.076 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:21:59.411 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:21:59.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:59.411 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:21:59.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:21:59.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.692+0000 7f2b836c9640 1 Processor -- start 2023-12-12T09:21:59.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.692+0000 7f2b836c9640 1 -- start start 2023-12-12T09:21:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.694+0000 7f2b836c9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b7c0b47e0 0x7f2b7c071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.694+0000 7f2b836c9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0cea30 con 0x7f2b7c0ce550 2023-12-12T09:21:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.694+0000 7f2b836c9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0702b0 con 0x7f2b7c143d20 2023-12-12T09:21:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.694+0000 7f2b836c9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c070590 con 0x7f2b7c0b47e0 2023-12-12T09:21:59.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.694+0000 7f2b80c64640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b7c0b47e0 0x7f2b7c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:59.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.694+0000 7f2b80c64640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b7c0b47e0 0x7f2b7c071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48762/0 (socket says 172.21.15.84:48762) 2023-12-12T09:21:59.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.694+0000 7f2b80c64640 1 -- 172.21.15.84:0/3699169615 learned_addr learned my addr 172.21.15.84:0/3699169615 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:59.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.694+0000 7f2b81c66640 1 --1- 172.21.15.84:0/3699169615 >> v1:172.21.15.84:6789/0 conn(0x7f2b7c0ce550 0x7f2b7c0715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55704/0 (socket says 172.21.15.84:55704) 2023-12-12T09:21:59.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.695+0000 7f2b80c64640 1 -- 172.21.15.84:0/3699169615 >> v1:172.21.15.99:6789/0 conn(0x7f2b7c143d20 legacy=0x7f2b7c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:21:59.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.695+0000 7f2b80c64640 1 -- 172.21.15.84:0/3699169615 >> v1:172.21.15.84:6789/0 conn(0x7f2b7c0ce550 legacy=0x7f2b7c0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:59.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.695+0000 7f2b80c64640 1 -- 172.21.15.84:0/3699169615 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c070870 con 0x7f2b7c0b47e0 2023-12-12T09:21:59.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.696+0000 7f2b80c64640 1 --2- 172.21.15.84:0/3699169615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c0b47e0 0x7f2b7c071070 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009870 tx=0x7f2b6c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a55587c4921cee server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:59.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.696+0000 7f2b73fff640 1 -- 172.21.15.84:0/3699169615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c030860 con 0x7f2b7c0b47e0 2023-12-12T09:21:59.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.696+0000 7f2b73fff640 1 -- 172.21.15.84:0/3699169615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c0309c0 con 0x7f2b7c0b47e0 2023-12-12T09:21:59.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.696+0000 7f2b73fff640 1 -- 172.21.15.84:0/3699169615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c030d50 con 0x7f2b7c0b47e0 2023-12-12T09:21:59.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.697+0000 7f2b836c9640 1 -- 172.21.15.84:0/3699169615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c0b47e0 msgr2=0x7f2b7c071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:59.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.697+0000 7f2b836c9640 1 --2- 172.21.15.84:0/3699169615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c0b47e0 0x7f2b7c071070 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009870 tx=0x7f2b6c02b9a0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.697+0000 7f2b836c9640 1 -- 172.21.15.84:0/3699169615 shutdown_connections 2023-12-12T09:21:59.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.697+0000 7f2b836c9640 1 --2- 172.21.15.84:0/3699169615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c0b47e0 0x7f2b7c071070 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.697+0000 7f2b836c9640 1 -- 172.21.15.84:0/3699169615 >> 172.21.15.84:0/3699169615 conn(0x7f2b7c06c3d0 msgr2=0x7f2b7c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:59.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.697+0000 7f2b836c9640 1 -- 172.21.15.84:0/3699169615 shutdown_connections 2023-12-12T09:21:59.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.697+0000 7f2b836c9640 1 -- 172.21.15.84:0/3699169615 wait complete. 2023-12-12T09:21:59.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.699+0000 7f2b836c9640 1 Processor -- start 2023-12-12T09:21:59.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.699+0000 7f2b836c9640 1 -- start start 2023-12-12T09:21:59.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b836c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7c0b47e0 0x7f2b7c1e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:59.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b836c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b7c0ce550 0x7f2b7c1e7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:59.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b836c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c143d20 0x7f2b7c15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:59.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b836c9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c1e76b0 con 0x7f2b7c143d20 2023-12-12T09:21:59.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b836c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c15e450 con 0x7f2b7c0b47e0 2023-12-12T09:21:59.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b836c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c1e60d0 con 0x7f2b7c0ce550 2023-12-12T09:21:59.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b81c66640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c143d20 0x7f2b7c15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b81c66640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c143d20 0x7f2b7c15df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48776/0 (socket says 172.21.15.84:48776) 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.700+0000 7f2b81c66640 1 -- 172.21.15.84:0/3807954410 learned_addr learned my addr 172.21.15.84:0/3807954410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b81465640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7c0b47e0 0x7f2b7c1e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b81c66640 1 -- 172.21.15.84:0/3807954410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b7c0ce550 msgr2=0x7f2b7c1e7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b81c66640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b7c0ce550 0x7f2b7c1e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b81c66640 1 -- 172.21.15.84:0/3807954410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7c0b47e0 msgr2=0x7f2b7c1e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b81c66640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7c0b47e0 0x7f2b7c1e5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b81c66640 1 -- 172.21.15.84:0/3807954410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c0094d0 con 0x7f2b7c143d20 2023-12-12T09:21:59.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b81c66640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c143d20 0x7f2b7c15df10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c730 tx=0x7f2b7400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:59.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b71ffb640 1 -- 172.21.15.84:0/3807954410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400ce40 con 0x7f2b7c143d20 2023-12-12T09:21:59.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b71ffb640 1 -- 172.21.15.84:0/3807954410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400a640 con 0x7f2b7c143d20 2023-12-12T09:21:59.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b71ffb640 1 -- 172.21.15.84:0/3807954410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400a9f0 con 0x7f2b7c143d20 2023-12-12T09:21:59.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.701+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c1e63b0 con 0x7f2b7c143d20 2023-12-12T09:21:59.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.702+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c1e6970 con 0x7f2b7c143d20 2023-12-12T09:21:59.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.703+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c0673c0 con 0x7f2b7c143d20 2023-12-12T09:21:59.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.704+0000 7f2b71ffb640 1 -- 172.21.15.84:0/3807954410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b7400ab50 con 0x7f2b7c143d20 2023-12-12T09:21:59.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.705+0000 7f2b71ffb640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b6006ae40 0x7f2b6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:21:59.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.705+0000 7f2b71ffb640 1 -- 172.21.15.84:0/3807954410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f2b74089080 con 0x7f2b7c143d20 2023-12-12T09:21:59.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.705+0000 7f2b81465640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b6006ae40 0x7f2b6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:21:59.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.706+0000 7f2b81465640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b6006ae40 0x7f2b6006d300 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2b78006fd0 tx=0x7f2b78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:21:59.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.710+0000 7f2b71ffb640 1 -- 172.21.15.84:0/3807954410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b740bbe90 con 0x7f2b7c143d20 2023-12-12T09:21:59.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.937+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2b7c06e3b0 con 0x7f2b7c143d20 2023-12-12T09:21:59.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.938+0000 7f2b71ffb640 1 -- 172.21.15.84:0/3807954410 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7f2b74017020 con 0x7f2b7c143d20 2023-12-12T09:21:59.940 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-12-12T09:21:59.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.940+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b6006ae40 msgr2=0x7f2b6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:59.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.940+0000 7f2b836c9640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b6006ae40 0x7f2b6006d300 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2b78006fd0 tx=0x7f2b78008040 comp rx=0 tx=0).stop 2023-12-12T09:21:59.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.940+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c143d20 msgr2=0x7f2b7c15df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:21:59.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.940+0000 7f2b836c9640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c143d20 0x7f2b7c15df10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400c730 tx=0x7f2b7400cbf0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.941+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 shutdown_connections 2023-12-12T09:21:59.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.941+0000 7f2b836c9640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b6006ae40 0x7f2b6006d300 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.941+0000 7f2b836c9640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b7c143d20 0x7f2b7c15df10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.941+0000 7f2b836c9640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b7c0ce550 0x7f2b7c1e7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.941+0000 7f2b836c9640 1 --2- 172.21.15.84:0/3807954410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7c0b47e0 0x7f2b7c1e5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:21:59.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.941+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 >> 172.21.15.84:0/3807954410 conn(0x7f2b7c06c3d0 msgr2=0x7f2b7c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:21:59.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.941+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 shutdown_connections 2023-12-12T09:21:59.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:21:59.941+0000 7f2b836c9640 1 -- 172.21.15.84:0/3807954410 wait complete. 2023-12-12T09:21:59.960 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:21:59.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:21:59.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:21:59.960 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:21:59.960 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:21:59.961 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:21:59.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:21:59.961 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:21:59.961 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:21:59.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:21:59.961 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:22:00.016 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:22:00.017 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:22:00.017 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:22:00.017 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:00.017 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:22:00.017 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:00.017 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:22:00.017 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:00.018 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:22:00.018 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:22:00.018 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:00.018 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:22:00.018 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:22:00.018 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:00.019 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:22:00.019 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:00.019 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:22:00.019 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42084sec preferred_lft 42084sec 2023-12-12T09:22:00.019 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:22:00.019 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:00.019 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:22:00.020 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:00.020 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:22:00.020 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:00.020 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c8b:52ff:fef6:cd60/64 scope link 2023-12-12T09:22:00.020 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:00.020 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:22:00.020 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c2:ab:b4:6c:14:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:00.020 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c0ab:b4ff:fe6c:1499/64 scope link 2023-12-12T09:22:00.021 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:00.021 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:22:00.021 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:00.021 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3c57:6bff:fed3:b000/64 scope link 2023-12-12T09:22:00.021 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:00.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:00.023 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:22:00.118 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:22:00.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:00.122 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:22:00.177 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:22:00.177 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:22:00.177 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:22:00.177 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:22:00.177 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:22:00.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:00.178 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:22:00.178 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:22:00.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:22:00.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:22:00.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:22:00.178 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:22:00.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:00.356 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:22:00.408 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:22:00.408 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T09:22:00.409 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:22:00.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:00.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-12-12T09:22:00.505 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T09:22:00.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:22:00.505 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:00.561 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:22:00.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:22:00.561 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:00.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:22:00.715 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:22:00.771 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:22:00.771 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:22:00.772 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:00.773 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:00.774 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:00.774 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:00.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:00.775 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:22:00.826 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:22:00.826 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T09:22:00.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:22:00.907 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:22:00.950 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:22:00.951 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:22:00.952 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:22:00.953 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:22:00.953 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:00.953 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:00.953 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:00.953 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:00.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:00.954 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:22:01.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-12-12T09:22:01.015+0000 7f6dd9e35480 -1 init, newargv = 0x55dbd4d11e10 newargc=15 2023-12-12T09:22:01.016 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[106038]: starting ceph client 2023-12-12T09:22:01.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[106038]: starting fuse 2023-12-12T09:22:01.041 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:22:01.042 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-12T09:22:01.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:22:01.042 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:22:01.042 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:22:01.042 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:22:01.042 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:22:01.042 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:22:01.042 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:22:01.042 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:22:01.043 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:22:01.044 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:22:01.044 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-12-12T09:22:01.044 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:22:01.256 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.106038.asok 2023-12-12T09:22:01.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:22:01.274 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.106038.asok 2023-12-12T09:22:01.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:01.275 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.106038.asok status 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "106038", 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:22:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5886, 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 5886 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3851146341 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:01.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3851146341 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.5886 192.168.0.1:0/3851146341", 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/3851146341", 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 18, 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 44, 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:22:01.519 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:22:01.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:01.532 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:22:01.532 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:01.585 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:22:01.585 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:01.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:01.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:01.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:01.679 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-12-12T09:22:01.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:22:01.735 INFO:teuthology.orchestra.run.smithi084.stderr:setfattr: layoutfile: Permission denied 2023-12-12T09:22:01.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:01.736 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-12-12T09:22:01.790 INFO:teuthology.orchestra.run.smithi084.stderr:setfattr: layoutdir: Permission denied 2023-12-12T09:22:01.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:22:01.792 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:22:01.792 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:01.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:02.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.099+0000 7f713644f640 1 Processor -- start 2023-12-12T09:22:02.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.099+0000 7f713644f640 1 -- start start 2023-12-12T09:22:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.100+0000 7f713644f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f7130071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f713644f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f713013dae0 0x7f713013f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f713644f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71300724d0 con 0x7f71300ce330 2023-12-12T09:22:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f713644f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7130140270 con 0x7f713013dae0 2023-12-12T09:22:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f713644f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300cd850 con 0x7f7130071bb0 2023-12-12T09:22:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f712f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f71300ce330 0x7f713013d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55716/0 (socket says 172.21.15.84:55716) 2023-12-12T09:22:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f712f7fe640 1 -- 172.21.15.84:0/3255318280 learned_addr learned my addr 172.21.15.84:0/3255318280 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:02.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f71349ec640 1 --2- 172.21.15.84:0/3255318280 >> v2:172.21.15.84:3300/0 conn(0x7f713013dae0 0x7f713013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f712ffff640 1 --2- 172.21.15.84:0/3255318280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f7130071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.101+0000 7f712effd640 1 -- 172.21.15.84:0/3255318280 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536010577 0 0) 0x7f71300724d0 con 0x7f71300ce330 2023-12-12T09:22:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.102+0000 7f712effd640 1 -- 172.21.15.84:0/3255318280 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7118005730 con 0x7f71300ce330 2023-12-12T09:22:02.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.102+0000 7f71349ec640 1 -- 172.21.15.84:0/3255318280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 msgr2=0x7f7130071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:02.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.102+0000 7f71349ec640 1 --2- 172.21.15.84:0/3255318280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f7130071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.102+0000 7f71349ec640 1 -- 172.21.15.84:0/3255318280 >> v1:172.21.15.84:6789/0 conn(0x7f71300ce330 legacy=0x7f713013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.102+0000 7f71349ec640 1 -- 172.21.15.84:0/3255318280 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300cdb30 con 0x7f713013dae0 2023-12-12T09:22:02.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.102+0000 7f712ffff640 1 --2- 172.21.15.84:0/3255318280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f7130071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.103+0000 7f71349ec640 1 --2- 172.21.15.84:0/3255318280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f713013dae0 0x7f713013f510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7128009d90 tx=0x7f712802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1384000bb02e3b7e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.103+0000 7f712effd640 1 -- 172.21.15.84:0/3255318280 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712802cc60 con 0x7f713013dae0 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.103+0000 7f712effd640 1 -- 172.21.15.84:0/3255318280 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712802cdc0 con 0x7f713013dae0 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.103+0000 7f712effd640 1 -- 172.21.15.84:0/3255318280 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128034660 con 0x7f713013dae0 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.103+0000 7f713644f640 1 -- 172.21.15.84:0/3255318280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f713013dae0 msgr2=0x7f713013f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.103+0000 7f713644f640 1 --2- 172.21.15.84:0/3255318280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f713013dae0 0x7f713013f510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7128009d90 tx=0x7f712802beb0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.104+0000 7f713644f640 1 -- 172.21.15.84:0/3255318280 shutdown_connections 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.104+0000 7f713644f640 1 --2- 172.21.15.84:0/3255318280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f713013dae0 0x7f713013f510 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.104+0000 7f713644f640 1 --2- 172.21.15.84:0/3255318280 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f7130071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.104+0000 7f713644f640 1 -- 172.21.15.84:0/3255318280 >> 172.21.15.84:0/3255318280 conn(0x7f713006c3d0 msgr2=0x7f713006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:02.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.104+0000 7f713644f640 1 -- 172.21.15.84:0/3255318280 shutdown_connections 2023-12-12T09:22:02.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.104+0000 7f713644f640 1 -- 172.21.15.84:0/3255318280 wait complete. 2023-12-12T09:22:02.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.106+0000 7f713644f640 1 Processor -- start 2023-12-12T09:22:02.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.106+0000 7f713644f640 1 -- start start 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f713644f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f71301537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f713644f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71300ce330 0x7f71301ee870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f713644f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7130153d50 0x7f71301359b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f713644f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130135520 con 0x7f7130153d50 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f713644f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130134910 con 0x7f71300ce330 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f713644f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7130134bf0 con 0x7f7130071bb0 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f71349ec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7130153d50 0x7f71301359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f71349ec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7130153d50 0x7f71301359b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48804/0 (socket says 172.21.15.84:48804) 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f71349ec640 1 -- 172.21.15.84:0/1015118877 learned_addr learned my addr 172.21.15.84:0/1015118877 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f712ffff640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f71301537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f712f7fe640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71300ce330 0x7f71301ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f71349ec640 1 -- 172.21.15.84:0/1015118877 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 msgr2=0x7f71301537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f71349ec640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f71301537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f71349ec640 1 -- 172.21.15.84:0/1015118877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71300ce330 msgr2=0x7f71301ee870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f71349ec640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71300ce330 0x7f71301ee870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.107+0000 7f71349ec640 1 -- 172.21.15.84:0/1015118877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128009a70 con 0x7f7130153d50 2023-12-12T09:22:02.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.108+0000 7f71349ec640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7130153d50 0x7f71301359b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7128009d90 tx=0x7f7128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.108+0000 7f712cff9640 1 -- 172.21.15.84:0/1015118877 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128040650 con 0x7f7130153d50 2023-12-12T09:22:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.108+0000 7f712cff9640 1 -- 172.21.15.84:0/1015118877 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71280407b0 con 0x7f7130153d50 2023-12-12T09:22:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.108+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7130134ed0 con 0x7f7130153d50 2023-12-12T09:22:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.108+0000 7f712cff9640 1 -- 172.21.15.84:0/1015118877 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128040b60 con 0x7f7130153d50 2023-12-12T09:22:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.108+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7130137810 con 0x7f7130153d50 2023-12-12T09:22:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.109+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7130135690 con 0x7f7130153d50 2023-12-12T09:22:02.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.110+0000 7f712cff9640 1 -- 172.21.15.84:0/1015118877 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7128040cc0 con 0x7f7130153d50 2023-12-12T09:22:02.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.111+0000 7f712cff9640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f711c06ae70 0x7f711c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.111+0000 7f712cff9640 1 -- 172.21.15.84:0/1015118877 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f71280ac4c0 con 0x7f7130153d50 2023-12-12T09:22:02.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.111+0000 7f712ffff640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f711c06ae70 0x7f711c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.112+0000 7f712ffff640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f711c06ae70 0x7f711c06d330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7130137660 tx=0x7f7120008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:02.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.116+0000 7f712cff9640 1 -- 172.21.15.84:0/1015118877 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7128077200 con 0x7f7130153d50 2023-12-12T09:22:02.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.309+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71300673c0 con 0x7f7130153d50 2023-12-12T09:22:02.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.311+0000 7f712cff9640 1 -- 172.21.15.84:0/1015118877 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f7128009450 con 0x7f7130153d50 2023-12-12T09:22:02.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:02.313 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.313+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f711c06ae70 msgr2=0x7f711c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.313+0000 7f713644f640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f711c06ae70 0x7f711c06d330 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7130137660 tx=0x7f7120008040 comp rx=0 tx=0).stop 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.313+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7130153d50 msgr2=0x7f71301359b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.313+0000 7f713644f640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7130153d50 0x7f71301359b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7128009d90 tx=0x7f7128004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.314+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 shutdown_connections 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.314+0000 7f713644f640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f711c06ae70 0x7f711c06d330 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.314+0000 7f713644f640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7130153d50 0x7f71301359b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.314+0000 7f713644f640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71300ce330 0x7f71301ee870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.314+0000 7f713644f640 1 --2- 172.21.15.84:0/1015118877 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7130071bb0 0x7f71301537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.314+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 >> 172.21.15.84:0/1015118877 conn(0x7f713006c3d0 msgr2=0x7f71300af160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.314+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 shutdown_connections 2023-12-12T09:22:02.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.314+0000 7f713644f640 1 -- 172.21.15.84:0/1015118877 wait complete. 2023-12-12T09:22:02.335 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:21:28.519227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:21:29.210161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-12T09:21:44.988386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:22:02.335 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:22:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.550+0000 7f8015f06640 1 Processor -- start 2023-12-12T09:22:02.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.551+0000 7f8015f06640 1 -- start start 2023-12-12T09:22:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.552+0000 7f8015f06640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80100cec60 0x7f80100d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.552+0000 7f8015f06640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80100cdc30 con 0x7f80100d3590 2023-12-12T09:22:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.552+0000 7f8015f06640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80100cdea0 con 0x7f80100cf890 2023-12-12T09:22:02.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.552+0000 7f8015f06640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80100ce180 con 0x7f80100cec60 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.552+0000 7f8015705640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f80100d3590 0x7f80100b5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55720/0 (socket says 172.21.15.84:55720) 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.552+0000 7f8015705640 1 -- 172.21.15.84:0/3740620971 learned_addr learned my addr 172.21.15.84:0/3740620971 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800ffff640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80100cec60 0x7f80100d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199050576 0 0) 0x7f80100cdc30 con 0x7f80100d3590 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ffc003520 con 0x7f80100d3590 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3708256712 0 0) 0x7f7ffc003520 con 0x7f80100d3590 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80100cec60 msgr2=0x7f80100d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80100cec60 0x7f80100d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 >> v1:172.21.15.99:6789/0 conn(0x7f80100cf890 legacy=0x7f80100cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80100ce460 con 0x7f80100d3590 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f8008001690 con 0x7f80100d3590 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 >> v1:172.21.15.84:6789/0 conn(0x7f80100d3590 legacy=0x7f80100b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.553+0000 7f800f7fe640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80100cec60 0x7f7ffc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f800f7fe640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ffc003f20 0x7f7ffc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f800f7fe640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc004d00 0x7f7ffc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100ce180 con 0x7f7ffc004d00 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc00ba60 con 0x7f7ffc003f20 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc00bc20 con 0x7f80100cec60 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f8015705640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc004d00 0x7f7ffc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f8014f04640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80100cec60 0x7f7ffc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f800ffff640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ffc003f20 0x7f7ffc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f8015705640 1 -- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80100cec60 msgr2=0x7f7ffc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f8015705640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80100cec60 0x7f7ffc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f8015705640 1 -- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ffc003f20 msgr2=0x7f7ffc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f8015705640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ffc003f20 0x7f7ffc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.554+0000 7f8015705640 1 -- 172.21.15.84:0/3740620971 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc003520 con 0x7f7ffc004d00 2023-12-12T09:22:02.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.555+0000 7f8015705640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc004d00 0x7f7ffc005180 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f801006add0 tx=0x7f7ffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd48792f6d0bee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:02.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.556+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008005ad0 con 0x7f7ffc004d00 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.556+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008005c30 con 0x7f7ffc004d00 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.556+0000 7f800f7fe640 1 -- 172.21.15.84:0/3740620971 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800802c8a0 con 0x7f7ffc004d00 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.556+0000 7f8015f06640 1 -- 172.21.15.84:0/3740620971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc004d00 msgr2=0x7f7ffc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.556+0000 7f8015f06640 1 --2- 172.21.15.84:0/3740620971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ffc004d00 0x7f7ffc005180 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f801006add0 tx=0x7f7ffc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.556+0000 7f8015705640 1 -- 172.21.15.84:0/3740620971 reap_dead start 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.556+0000 7f8015f06640 1 -- 172.21.15.84:0/3740620971 shutdown_connections 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.556+0000 7f8015f06640 1 -- 172.21.15.84:0/3740620971 >> 172.21.15.84:0/3740620971 conn(0x7f801009c1f0 msgr2=0x7f80100d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.557+0000 7f8015f06640 1 -- 172.21.15.84:0/3740620971 shutdown_connections 2023-12-12T09:22:02.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.557+0000 7f8015f06640 1 -- 172.21.15.84:0/3740620971 wait complete. 2023-12-12T09:22:02.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.558+0000 7f8015f06640 1 Processor -- start 2023-12-12T09:22:02.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.558+0000 7f8015f06640 1 -- start start 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.559+0000 7f8015f06640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ffc004d00 0x7f801014e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.559+0000 7f8015f06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010150ba0 0x7f80100b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.559+0000 7f8015f06640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80100b88b0 0x7f801014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.559+0000 7f8015f06640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100b8d30 con 0x7f8010150ba0 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.559+0000 7f8015f06640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801014e810 con 0x7f80100b88b0 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.559+0000 7f8015f06640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801014fb00 con 0x7f7ffc004d00 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010150ba0 0x7f80100b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010150ba0 0x7f80100b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48810/0 (socket says 172.21.15.84:48810) 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 -- 172.21.15.84:0/3581730445 learned_addr learned my addr 172.21.15.84:0/3581730445 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 -- 172.21.15.84:0/3581730445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ffc004d00 msgr2=0x7f801014e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ffc004d00 0x7f801014e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 -- 172.21.15.84:0/3581730445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80100b88b0 msgr2=0x7f801014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f8015705640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80100b88b0 0x7f801014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80100b88b0 0x7f801014ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 -- 172.21.15.84:0/3581730445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801014fde0 con 0x7f8010150ba0 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.560+0000 7f800ffff640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010150ba0 0x7f80100b8370 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8011630 tx=0x7f7ff8011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.561+0000 7f800d7fa640 1 -- 172.21.15.84:0/3581730445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800f920 con 0x7f8010150ba0 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.561+0000 7f800d7fa640 1 -- 172.21.15.84:0/3581730445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800fa80 con 0x7f8010150ba0 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.561+0000 7f800d7fa640 1 -- 172.21.15.84:0/3581730445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800fdf0 con 0x7f8010150ba0 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.561+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80101500c0 con 0x7f8010150ba0 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.561+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8010150680 con 0x7f8010150ba0 2023-12-12T09:22:02.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.562+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80100673c0 con 0x7f8010150ba0 2023-12-12T09:22:02.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.563+0000 7f800d7fa640 1 -- 172.21.15.84:0/3581730445 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ff8015460 con 0x7f8010150ba0 2023-12-12T09:22:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.564+0000 7f800d7fa640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ff006ae40 0x7f7ff006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.564+0000 7f800d7fa640 1 -- 172.21.15.84:0/3581730445 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f7ff8089e80 con 0x7f8010150ba0 2023-12-12T09:22:02.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.564+0000 7f8014f04640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ff006ae40 0x7f7ff006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:02.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.565+0000 7f8014f04640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ff006ae40 0x7f7ff006d300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8000007fd0 tx=0x7f8000009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:02.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.569+0000 7f800d7fa640 1 -- 172.21.15.84:0/3581730445 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ff8054bc0 con 0x7f8010150ba0 2023-12-12T09:22:02.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.758+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80100cf670 con 0x7f8010150ba0 2023-12-12T09:22:02.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.759+0000 7f800d7fa640 1 -- 172.21.15.84:0/3581730445 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ff80220a0 con 0x7f8010150ba0 2023-12-12T09:22:02.760 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:22:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.761+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ff006ae40 msgr2=0x7f7ff006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.761+0000 7f8015f06640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ff006ae40 0x7f7ff006d300 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8000007fd0 tx=0x7f8000009040 comp rx=0 tx=0).stop 2023-12-12T09:22:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010150ba0 msgr2=0x7f80100b8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010150ba0 0x7f80100b8370 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8011630 tx=0x7f7ff8011af0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 shutdown_connections 2023-12-12T09:22:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80100b88b0 0x7f801014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ff006ae40 0x7f7ff006d300 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8010150ba0 0x7f80100b8370 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 --2- 172.21.15.84:0/3581730445 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ffc004d00 0x7f801014e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 >> 172.21.15.84:0/3581730445 conn(0x7f801009c1f0 msgr2=0x7f8010160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 shutdown_connections 2023-12-12T09:22:02.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.762+0000 7f8015f06640 1 -- 172.21.15.84:0/3581730445 wait complete. 2023-12-12T09:22:02.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:22:02.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.996+0000 7f3d490e7640 1 Processor -- start 2023-12-12T09:22:02.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.997+0000 7f3d490e7640 1 -- start start 2023-12-12T09:22:02.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.998+0000 7f3d490e7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d44144b20 0x7f3d440acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.998+0000 7f3d490e7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3d4406ac10 0x7f3d4406d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:02.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.998+0000 7f3d490e7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d44144f00 con 0x7f3d440ad2a0 2023-12-12T09:22:03.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.998+0000 7f3d490e7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d44071400 con 0x7f3d4406ac10 2023-12-12T09:22:03.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.998+0000 7f3d490e7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440716e0 con 0x7f3d44144b20 2023-12-12T09:22:03.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.999+0000 7f3d42d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d44144b20 0x7f3d440acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.999+0000 7f3d4359e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3d4406ac10 0x7f3d4406d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.999+0000 7f3d42d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d44144b20 0x7f3d440acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:55342/0 (socket says 172.21.15.84:55342) 2023-12-12T09:22:03.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:02.999+0000 7f3d42d9d640 1 -- 172.21.15.84:0/3927575484 learned_addr learned my addr 172.21.15.84:0/3927575484 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:03.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.000+0000 7f3d4359e640 1 -- 172.21.15.84:0/3927575484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d44144b20 msgr2=0x7f3d440acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:03.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.000+0000 7f3d4359e640 1 --2- 172.21.15.84:0/3927575484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d44144b20 0x7f3d440acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.000+0000 7f3d4359e640 1 -- 172.21.15.84:0/3927575484 >> v1:172.21.15.99:6789/0 conn(0x7f3d440ad2a0 legacy=0x7f3d4406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.000+0000 7f3d4359e640 1 -- 172.21.15.84:0/3927575484 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440719c0 con 0x7f3d4406ac10 2023-12-12T09:22:03.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.001+0000 7f3d4359e640 1 --2- 172.21.15.84:0/3927575484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 0x7f3d4406d3a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009d90 tx=0x7f3d3c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2321b2b2662f64c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.002+0000 7f3d4259c640 1 -- 172.21.15.84:0/3927575484 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c02cc60 con 0x7f3d4406ac10 2023-12-12T09:22:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.002+0000 7f3d4259c640 1 -- 172.21.15.84:0/3927575484 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c02cdc0 con 0x7f3d4406ac10 2023-12-12T09:22:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.002+0000 7f3d4259c640 1 -- 172.21.15.84:0/3927575484 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c034660 con 0x7f3d4406ac10 2023-12-12T09:22:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.003+0000 7f3d490e7640 1 -- 172.21.15.84:0/3927575484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 msgr2=0x7f3d4406d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.003+0000 7f3d490e7640 1 --2- 172.21.15.84:0/3927575484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 0x7f3d4406d3a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009d90 tx=0x7f3d3c02beb0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.003+0000 7f3d490e7640 1 -- 172.21.15.84:0/3927575484 shutdown_connections 2023-12-12T09:22:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.003+0000 7f3d490e7640 1 --2- 172.21.15.84:0/3927575484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 0x7f3d4406d3a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.003+0000 7f3d490e7640 1 --2- 172.21.15.84:0/3927575484 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d44144b20 0x7f3d440acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.003+0000 7f3d490e7640 1 -- 172.21.15.84:0/3927575484 >> 172.21.15.84:0/3927575484 conn(0x7f3d440b1a80 msgr2=0x7f3d440b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.003+0000 7f3d490e7640 1 -- 172.21.15.84:0/3927575484 shutdown_connections 2023-12-12T09:22:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.003+0000 7f3d490e7640 1 -- 172.21.15.84:0/3927575484 wait complete. 2023-12-12T09:22:03.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.005+0000 7f3d490e7640 1 Processor -- start 2023-12-12T09:22:03.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.005+0000 7f3d490e7640 1 -- start start 2023-12-12T09:22:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.006+0000 7f3d490e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 0x7f3d4409baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.006+0000 7f3d490e7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d440ad2a0 0x7f3d441f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.006+0000 7f3d490e7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d44144b20 0x7f3d441f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.006+0000 7f3d490e7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44099bc0 con 0x7f3d44144b20 2023-12-12T09:22:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.006+0000 7f3d490e7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44099ea0 con 0x7f3d4406ac10 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.006+0000 7f3d490e7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4409a180 con 0x7f3d440ad2a0 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d4359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d44144b20 0x7f3d441f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d4359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d44144b20 0x7f3d441f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48812/0 (socket says 172.21.15.84:48812) 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d4359e640 1 -- 172.21.15.84:0/445333320 learned_addr learned my addr 172.21.15.84:0/445333320 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d42d9d640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 0x7f3d4409baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d3bfff640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d440ad2a0 0x7f3d441f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d4359e640 1 -- 172.21.15.84:0/445333320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d440ad2a0 msgr2=0x7f3d441f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d4359e640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d440ad2a0 0x7f3d441f4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d4359e640 1 -- 172.21.15.84:0/445333320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 msgr2=0x7f3d4409baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d4359e640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 0x7f3d4409baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.007+0000 7f3d4359e640 1 -- 172.21.15.84:0/445333320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c009a70 con 0x7f3d44144b20 2023-12-12T09:22:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.008+0000 7f3d4359e640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d44144b20 0x7f3d441f4840 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009eb0 tx=0x7f3d3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.008+0000 7f3d3b7fe640 1 -- 172.21.15.84:0/445333320 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c03e610 con 0x7f3d44144b20 2023-12-12T09:22:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.008+0000 7f3d3b7fe640 1 -- 172.21.15.84:0/445333320 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c03e770 con 0x7f3d44144b20 2023-12-12T09:22:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.008+0000 7f3d3b7fe640 1 -- 172.21.15.84:0/445333320 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c03eb20 con 0x7f3d44144b20 2023-12-12T09:22:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.008+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4409a460 con 0x7f3d44144b20 2023-12-12T09:22:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.008+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4409ac60 con 0x7f3d44144b20 2023-12-12T09:22:03.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.009+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d440673c0 con 0x7f3d44144b20 2023-12-12T09:22:03.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.010+0000 7f3d3b7fe640 1 -- 172.21.15.84:0/445333320 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d3c03b050 con 0x7f3d44144b20 2023-12-12T09:22:03.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.011+0000 7f3d3b7fe640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3d2406ae40 0x7f3d2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.011+0000 7f3d3b7fe640 1 -- 172.21.15.84:0/445333320 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f3d3c0ac170 con 0x7f3d44144b20 2023-12-12T09:22:03.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.011+0000 7f3d42d9d640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3d2406ae40 0x7f3d2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.012+0000 7f3d42d9d640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3d2406ae40 0x7f3d2406d300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3d4406ee00 tx=0x7f3d34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.015+0000 7f3d3b7fe640 1 -- 172.21.15.84:0/445333320 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d3c077060 con 0x7f3d44144b20 2023-12-12T09:22:03.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.208+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d4406b230 con 0x7f3d44144b20 2023-12-12T09:22:03.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.209+0000 7f3d3b7fe640 1 -- 172.21.15.84:0/445333320 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d3c07a680 con 0x7f3d44144b20 2023-12-12T09:22:03.211 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:03.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3d2406ae40 msgr2=0x7f3d2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3d2406ae40 0x7f3d2406d300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3d4406ee00 tx=0x7f3d34008040 comp rx=0 tx=0).stop 2023-12-12T09:22:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d44144b20 msgr2=0x7f3d441f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d44144b20 0x7f3d441f4840 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009eb0 tx=0x7f3d3c004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 shutdown_connections 2023-12-12T09:22:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3d2406ae40 0x7f3d2406d300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d44144b20 0x7f3d441f4840 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d440ad2a0 0x7f3d441f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 --2- 172.21.15.84:0/445333320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d4406ac10 0x7f3d4409baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.212+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 >> 172.21.15.84:0/445333320 conn(0x7f3d440b1a80 msgr2=0x7f3d4413f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:03.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.213+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 shutdown_connections 2023-12-12T09:22:03.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.213+0000 7f3d490e7640 1 -- 172.21.15.84:0/445333320 wait complete. 2023-12-12T09:22:03.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:22:03.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.440+0000 7f2cbd2c9640 1 Processor -- start 2023-12-12T09:22:03.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.440+0000 7f2cbd2c9640 1 -- start start 2023-12-12T09:22:03.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.442+0000 7f2cbd2c9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cb80b40d0 0x7f2cb806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.442+0000 7f2cbd2c9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80ceb80 con 0x7f2cb815be60 2023-12-12T09:22:03.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.442+0000 7f2cbd2c9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80ce260 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.442+0000 7f2cbd2c9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80cd930 con 0x7f2cb80b40d0 2023-12-12T09:22:03.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.442+0000 7f2cb6ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cb80b40d0 0x7f2cb806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.442+0000 7f2cb6ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2cb80b40d0 0x7f2cb806dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48816/0 (socket says 172.21.15.84:48816) 2023-12-12T09:22:03.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.442+0000 7f2cb77fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2cb815be60 0x7f2cb813e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55722/0 (socket says 172.21.15.84:55722) 2023-12-12T09:22:03.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.442+0000 7f2cb6ffd640 1 -- 172.21.15.84:0/2469225135 learned_addr learned my addr 172.21.15.84:0/2469225135 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:03.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.443+0000 7f2cb6ffd640 1 -- 172.21.15.84:0/2469225135 >> v1:172.21.15.99:6789/0 conn(0x7f2cb80ce6f0 legacy=0x7f2cb80b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:03.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.443+0000 7f2cb6ffd640 1 -- 172.21.15.84:0/2469225135 >> v1:172.21.15.84:6789/0 conn(0x7f2cb815be60 legacy=0x7f2cb813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.443+0000 7f2cb6ffd640 1 -- 172.21.15.84:0/2469225135 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80cdc10 con 0x7f2cb80b40d0 2023-12-12T09:22:03.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.443+0000 7f2cb5ffb640 1 -- 172.21.15.84:0/2469225135 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352603370 0 0) 0x7f2cb80ceb80 con 0x7f2cb815be60 2023-12-12T09:22:03.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.444+0000 7f2cb6ffd640 1 --2- 172.21.15.84:0/2469225135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80b40d0 0x7f2cb806dff0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009870 tx=0x7f2ca802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420581f0e716eb56 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.444+0000 7f2cb5ffb640 1 -- 172.21.15.84:0/2469225135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8030860 con 0x7f2cb80b40d0 2023-12-12T09:22:03.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.444+0000 7f2cb5ffb640 1 -- 172.21.15.84:0/2469225135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca80309c0 con 0x7f2cb80b40d0 2023-12-12T09:22:03.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.444+0000 7f2cb5ffb640 1 -- 172.21.15.84:0/2469225135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8030d50 con 0x7f2cb80b40d0 2023-12-12T09:22:03.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.445+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2469225135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80b40d0 msgr2=0x7f2cb806dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.445+0000 7f2cbd2c9640 1 --2- 172.21.15.84:0/2469225135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80b40d0 0x7f2cb806dff0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009870 tx=0x7f2ca802b9a0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.445+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2469225135 shutdown_connections 2023-12-12T09:22:03.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.445+0000 7f2cbd2c9640 1 --2- 172.21.15.84:0/2469225135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80b40d0 0x7f2cb806dff0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.445+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2469225135 >> 172.21.15.84:0/2469225135 conn(0x7f2cb80b0ac0 msgr2=0x7f2cb80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:03.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.445+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2469225135 shutdown_connections 2023-12-12T09:22:03.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.445+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2469225135 wait complete. 2023-12-12T09:22:03.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.447+0000 7f2cbd2c9640 1 Processor -- start 2023-12-12T09:22:03.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.447+0000 7f2cbd2c9640 1 -- start start 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cbd2c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80b40d0 0x7f2cb8154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cbd2c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80ce6f0 0x7f2cb81f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cbd2c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb815be60 0x7f2cb80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cbd2c9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81f3cb0 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cbd2c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb8154820 con 0x7f2cb815be60 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cbd2c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb8154b00 con 0x7f2cb80b40d0 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cb67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80ce6f0 0x7f2cb81f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cb67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80ce6f0 0x7f2cb81f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48828/0 (socket says 172.21.15.84:48828) 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.448+0000 7f2cb67fc640 1 -- 172.21.15.84:0/2989492394 learned_addr learned my addr 172.21.15.84:0/2989492394 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb77fe640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb815be60 0x7f2cb80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb67fc640 1 -- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80b40d0 msgr2=0x7f2cb8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb6ffd640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80b40d0 0x7f2cb8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb67fc640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80b40d0 0x7f2cb8154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb67fc640 1 -- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb815be60 msgr2=0x7f2cb80b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb67fc640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb815be60 0x7f2cb80b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb67fc640 1 -- 172.21.15.84:0/2989492394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80094d0 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb77fe640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb815be60 0x7f2cb80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2cb67fc640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80ce6f0 0x7f2cb81f3770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00c430 tx=0x7f2cac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2c9f7fe640 1 -- 172.21.15.84:0/2989492394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac011790 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2c9f7fe640 1 -- 172.21.15.84:0/2989492394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac0118f0 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.449+0000 7f2c9f7fe640 1 -- 172.21.15.84:0/2989492394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac011ce0 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.450+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb80aca50 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.450+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb81f3f00 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.451+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb80ac890 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.452+0000 7f2c9f7fe640 1 -- 172.21.15.84:0/2989492394 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2cac01c460 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.452+0000 7f2c9f7fe640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ca406ae40 0x7f2ca406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.453+0000 7f2c9f7fe640 1 -- 172.21.15.84:0/2989492394 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f2cac089950 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.453+0000 7f2cb6ffd640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ca406ae40 0x7f2ca406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.453+0000 7f2cb6ffd640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ca406ae40 0x7f2ca406d300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8036000 tx=0x7f2ca803b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.457+0000 7f2c9f7fe640 1 -- 172.21.15.84:0/2989492394 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2cac054690 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.647+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2cb80673c0 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.648+0000 7f2c9f7fe640 1 -- 172.21.15.84:0/2989492394 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2cac057cb0 con 0x7f2cb80ce6f0 2023-12-12T09:22:03.649 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ca406ae40 msgr2=0x7f2ca406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ca406ae40 0x7f2ca406d300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8036000 tx=0x7f2ca803b040 comp rx=0 tx=0).stop 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80ce6f0 msgr2=0x7f2cb81f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80ce6f0 0x7f2cb81f3770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00c430 tx=0x7f2cac00c8f0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 shutdown_connections 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb815be60 0x7f2cb80b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2ca406ae40 0x7f2ca406d300 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cb80ce6f0 0x7f2cb81f3770 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 --2- 172.21.15.84:0/2989492394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80b40d0 0x7f2cb8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.650+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 >> 172.21.15.84:0/2989492394 conn(0x7f2cb80b0ac0 msgr2=0x7f2cb8152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:03.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.651+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 shutdown_connections 2023-12-12T09:22:03.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.651+0000 7f2cbd2c9640 1 -- 172.21.15.84:0/2989492394 wait complete. 2023-12-12T09:22:03.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-12T09:22:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.887+0000 7fd5b69dc640 1 Processor -- start 2023-12-12T09:22:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.887+0000 7fd5b69dc640 1 -- start start 2023-12-12T09:22:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.889+0000 7fd5b69dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00b40d0 0x7fd5b006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.889+0000 7fd5b69dc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5b00ce6f0 0x7fd5b00b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.889+0000 7fd5b69dc640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b00ceb80 con 0x7fd5b015be60 2023-12-12T09:22:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.889+0000 7fd5b69dc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b00ce260 con 0x7fd5b00ce6f0 2023-12-12T09:22:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.889+0000 7fd5b69dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00b49f0 con 0x7fd5b00b40d0 2023-12-12T09:22:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.889+0000 7fd5af7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5b00ce6f0 0x7fd5b00b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.889+0000 7fd5af7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd5b00ce6f0 0x7fd5b00b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48840/0 (socket says 172.21.15.84:48840) 2023-12-12T09:22:03.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.889+0000 7fd5af7fe640 1 -- 172.21.15.84:0/1762296903 learned_addr learned my addr 172.21.15.84:0/1762296903 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.890+0000 7fd5affff640 1 --2- 172.21.15.84:0/1762296903 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00b40d0 0x7fd5b006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.890+0000 7fd5af7fe640 1 -- 172.21.15.84:0/1762296903 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00b40d0 msgr2=0x7fd5b006dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.890+0000 7fd5af7fe640 1 --2- 172.21.15.84:0/1762296903 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00b40d0 0x7fd5b006dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.890+0000 7fd5af7fe640 1 -- 172.21.15.84:0/1762296903 >> v1:172.21.15.99:6789/0 conn(0x7fd5b015be60 legacy=0x7fd5b013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.890+0000 7fd5af7fe640 1 -- 172.21.15.84:0/1762296903 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b00cd930 con 0x7fd5b00ce6f0 2023-12-12T09:22:03.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.891+0000 7fd5af7fe640 1 --2- 172.21.15.84:0/1762296903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00ce6f0 0x7fd5b00b44b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd598009870 tx=0x7fd59802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243d36594c81e932 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.891+0000 7fd5aeffd640 1 -- 172.21.15.84:0/1762296903 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598031640 con 0x7fd5b00ce6f0 2023-12-12T09:22:03.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.891+0000 7fd5aeffd640 1 -- 172.21.15.84:0/1762296903 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5980317a0 con 0x7fd5b00ce6f0 2023-12-12T09:22:03.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.891+0000 7fd5aeffd640 1 -- 172.21.15.84:0/1762296903 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598031b30 con 0x7fd5b00ce6f0 2023-12-12T09:22:03.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.892+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1762296903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00ce6f0 msgr2=0x7fd5b00b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.892+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1762296903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00ce6f0 0x7fd5b00b44b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd598009870 tx=0x7fd59802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.892+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1762296903 shutdown_connections 2023-12-12T09:22:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.892+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1762296903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00ce6f0 0x7fd5b00b44b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.892+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1762296903 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00b40d0 0x7fd5b006dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.892+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1762296903 >> 172.21.15.84:0/1762296903 conn(0x7fd5b00b0ac0 msgr2=0x7fd5b00b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.892+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1762296903 shutdown_connections 2023-12-12T09:22:03.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.892+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1762296903 wait complete. 2023-12-12T09:22:03.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.894+0000 7fd5b69dc640 1 Processor -- start 2023-12-12T09:22:03.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.894+0000 7fd5b69dc640 1 -- start start 2023-12-12T09:22:03.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5b69dc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00b40d0 0x7fd5b013d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5b69dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00ce6f0 0x7fd5b0071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5b69dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b015be60 0x7fd5b0071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5b69dc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0140bd0 con 0x7fd5b00b40d0 2023-12-12T09:22:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5b69dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b013ffc0 con 0x7fd5b015be60 2023-12-12T09:22:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5b69dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b01402a0 con 0x7fd5b00ce6f0 2023-12-12T09:22:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5affff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00b40d0 0x7fd5b013d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5affff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00b40d0 0x7fd5b013d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48850/0 (socket says 172.21.15.84:48850) 2023-12-12T09:22:03.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.895+0000 7fd5affff640 1 -- 172.21.15.84:0/1896154356 learned_addr learned my addr 172.21.15.84:0/1896154356 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:03.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5af7fe640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00ce6f0 0x7fd5b0071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5affff640 1 -- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00ce6f0 msgr2=0x7fd5b0071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5b4f79640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b015be60 0x7fd5b0071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5affff640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00ce6f0 0x7fd5b0071630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5affff640 1 -- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b015be60 msgr2=0x7fd5b0071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5affff640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b015be60 0x7fd5b0071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5affff640 1 -- 172.21.15.84:0/1896154356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980094d0 con 0x7fd5b00b40d0 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5b4f79640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b015be60 0x7fd5b0071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5affff640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00b40d0 0x7fd5b013d650 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0007e40 tx=0x7fd5a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.896+0000 7fd5acff9640 1 -- 172.21.15.84:0/1896154356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0014620 con 0x7fd5b00b40d0 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.897+0000 7fd5acff9640 1 -- 172.21.15.84:0/1896154356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a000ee90 con 0x7fd5b00b40d0 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.897+0000 7fd5acff9640 1 -- 172.21.15.84:0/1896154356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00149c0 con 0x7fd5b00b40d0 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.897+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b0140580 con 0x7fd5b00b40d0 2023-12-12T09:22:03.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.897+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b013db90 con 0x7fd5b00b40d0 2023-12-12T09:22:03.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.898+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b00673c0 con 0x7fd5b00b40d0 2023-12-12T09:22:03.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.899+0000 7fd5acff9640 1 -- 172.21.15.84:0/1896154356 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5a0014b20 con 0x7fd5b00b40d0 2023-12-12T09:22:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.900+0000 7fd5acff9640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd59006ae70 0x7fd59006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.900+0000 7fd5acff9640 1 -- 172.21.15.84:0/1896154356 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd5a008a2a0 con 0x7fd5b00b40d0 2023-12-12T09:22:03.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.900+0000 7fd5af7fe640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd59006ae70 0x7fd59006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:03.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.901+0000 7fd5af7fe640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd59006ae70 0x7fd59006d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd598036000 tx=0x7fd59803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:03.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:03.904+0000 7fd5acff9640 1 -- 172.21.15.84:0/1896154356 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5a0054ff0 con 0x7fd5b00b40d0 2023-12-12T09:22:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.093+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fd5b00b45e0 con 0x7fd5b00b40d0 2023-12-12T09:22:04.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.094+0000 7fd5acff9640 1 -- 172.21.15.84:0/1896154356 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v44) v1 ==== 97+0+11 (secure 0 0 0) 0x7fd5a0058610 con 0x7fd5b00b40d0 2023-12-12T09:22:04.095 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.096+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd59006ae70 msgr2=0x7fd59006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.096+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd59006ae70 0x7fd59006d330 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd598036000 tx=0x7fd59803c040 comp rx=0 tx=0).stop 2023-12-12T09:22:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.096+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00b40d0 msgr2=0x7fd5b013d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.096+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00b40d0 0x7fd5b013d650 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0007e40 tx=0x7fd5a000e4b0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.097+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 shutdown_connections 2023-12-12T09:22:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.097+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5b015be60 0x7fd5b0071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.097+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd5b00ce6f0 0x7fd5b0071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.097+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd59006ae70 0x7fd59006d330 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.097+0000 7fd5b69dc640 1 --2- 172.21.15.84:0/1896154356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd5b00b40d0 0x7fd5b013d650 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.097+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 >> 172.21.15.84:0/1896154356 conn(0x7fd5b00b0ac0 msgr2=0x7fd5b00b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.097+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 shutdown_connections 2023-12-12T09:22:04.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.097+0000 7fd5b69dc640 1 -- 172.21.15.84:0/1896154356 wait complete. 2023-12-12T09:22:04.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:22:04.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.322+0000 7fb1d9705640 1 Processor -- start 2023-12-12T09:22:04.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.323+0000 7fb1d9705640 1 -- start start 2023-12-12T09:22:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.324+0000 7fb1d9705640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d4159fc0 0x7fb1d4073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.324+0000 7fb1d9705640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb1d406bc20 0x7fb1d4163bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.324+0000 7fb1d9705640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40ccde0 con 0x7fb1d40b4270 2023-12-12T09:22:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.324+0000 7fb1d9705640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d4073db0 con 0x7fb1d406bc20 2023-12-12T09:22:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.324+0000 7fb1d9705640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40cd010 con 0x7fb1d4159fc0 2023-12-12T09:22:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.325+0000 7fb1d2ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d4159fc0 0x7fb1d4073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.325+0000 7fb1d2ffd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d4159fc0 0x7fb1d4073720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:55372/0 (socket says 172.21.15.84:55372) 2023-12-12T09:22:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.325+0000 7fb1d2ffd640 1 -- 172.21.15.84:0/2722281799 learned_addr learned my addr 172.21.15.84:0/2722281799 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.325+0000 7fb1d37fe640 1 --2- 172.21.15.84:0/2722281799 >> v2:172.21.15.99:3300/0 conn(0x7fb1d406bc20 0x7fb1d4163bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.325+0000 7fb1d2ffd640 1 -- 172.21.15.84:0/2722281799 >> v2:172.21.15.99:3300/0 conn(0x7fb1d406bc20 msgr2=0x7fb1d4163bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:04.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.326+0000 7fb1d2ffd640 1 --2- 172.21.15.84:0/2722281799 >> v2:172.21.15.99:3300/0 conn(0x7fb1d406bc20 0x7fb1d4163bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.326+0000 7fb1d2ffd640 1 -- 172.21.15.84:0/2722281799 >> v1:172.21.15.99:6789/0 conn(0x7fb1d40b4270 legacy=0x7fb1d406b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.326+0000 7fb1d2ffd640 1 -- 172.21.15.84:0/2722281799 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d40cd2f0 con 0x7fb1d4159fc0 2023-12-12T09:22:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.327+0000 7fb1d2ffd640 1 --2- 172.21.15.84:0/2722281799 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d4159fc0 0x7fb1d4073720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009e50 tx=0x7fb1c402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d087b0dfb6c7df3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.327+0000 7fb1d1ffb640 1 -- 172.21.15.84:0/2722281799 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c402cb00 con 0x7fb1d4159fc0 2023-12-12T09:22:04.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.327+0000 7fb1d1ffb640 1 -- 172.21.15.84:0/2722281799 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c402cc60 con 0x7fb1d4159fc0 2023-12-12T09:22:04.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.327+0000 7fb1d1ffb640 1 -- 172.21.15.84:0/2722281799 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40343f0 con 0x7fb1d4159fc0 2023-12-12T09:22:04.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.328+0000 7fb1d9705640 1 -- 172.21.15.84:0/2722281799 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d4159fc0 msgr2=0x7fb1d4073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.328+0000 7fb1d9705640 1 --2- 172.21.15.84:0/2722281799 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d4159fc0 0x7fb1d4073720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009e50 tx=0x7fb1c402bf60 comp rx=0 tx=0).stop 2023-12-12T09:22:04.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.328+0000 7fb1d9705640 1 -- 172.21.15.84:0/2722281799 shutdown_connections 2023-12-12T09:22:04.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.328+0000 7fb1d9705640 1 --2- 172.21.15.84:0/2722281799 >> v2:172.21.15.99:3300/0 conn(0x7fb1d406bc20 0x7fb1d4163bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.328+0000 7fb1d9705640 1 --2- 172.21.15.84:0/2722281799 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d4159fc0 0x7fb1d4073720 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.328+0000 7fb1d9705640 1 -- 172.21.15.84:0/2722281799 >> 172.21.15.84:0/2722281799 conn(0x7fb1d4070b20 msgr2=0x7fb1d4070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:04.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.328+0000 7fb1d9705640 1 -- 172.21.15.84:0/2722281799 shutdown_connections 2023-12-12T09:22:04.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.328+0000 7fb1d9705640 1 -- 172.21.15.84:0/2722281799 wait complete. 2023-12-12T09:22:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.330+0000 7fb1d9705640 1 Processor -- start 2023-12-12T09:22:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.330+0000 7fb1d9705640 1 -- start start 2023-12-12T09:22:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d9705640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d406bc20 0x7fb1d413c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d9705640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1d40b4270 0x7fb1d414a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d9705640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1d4159fc0 0x7fb1d414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d9705640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d414b2f0 con 0x7fb1d4159fc0 2023-12-12T09:22:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d9705640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d414b5d0 con 0x7fb1d40b4270 2023-12-12T09:22:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d9705640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d414b8b0 con 0x7fb1d406bc20 2023-12-12T09:22:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1d4159fc0 0x7fb1d414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1d4159fc0 0x7fb1d414acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48862/0 (socket says 172.21.15.84:48862) 2023-12-12T09:22:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.331+0000 7fb1d37fe640 1 -- 172.21.15.84:0/559623873 learned_addr learned my addr 172.21.15.84:0/559623873 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d37fe640 1 -- 172.21.15.84:0/559623873 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d406bc20 msgr2=0x7fb1d413c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d37fe640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d406bc20 0x7fb1d413c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d37fe640 1 -- 172.21.15.84:0/559623873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1d40b4270 msgr2=0x7fb1d414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d27fc640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1d40b4270 0x7fb1d414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d37fe640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1d40b4270 0x7fb1d414a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d37fe640 1 -- 172.21.15.84:0/559623873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4009b30 con 0x7fb1d4159fc0 2023-12-12T09:22:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d27fc640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1d40b4270 0x7fb1d414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d37fe640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1d4159fc0 0x7fb1d414acc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e850 tx=0x7fb1cc00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1cb7fe640 1 -- 172.21.15.84:0/559623873 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc009630 con 0x7fb1d4159fc0 2023-12-12T09:22:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1cb7fe640 1 -- 172.21.15.84:0/559623873 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc00c940 con 0x7fb1d4159fc0 2023-12-12T09:22:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d414bb90 con 0x7fb1d4159fc0 2023-12-12T09:22:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1cb7fe640 1 -- 172.21.15.84:0/559623873 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00ccf0 con 0x7fb1d4159fc0 2023-12-12T09:22:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.332+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d414a120 con 0x7fb1d4159fc0 2023-12-12T09:22:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.333+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d4072eb0 con 0x7fb1d4159fc0 2023-12-12T09:22:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.334+0000 7fb1cb7fe640 1 -- 172.21.15.84:0/559623873 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1cc013470 con 0x7fb1d4159fc0 2023-12-12T09:22:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.335+0000 7fb1cb7fe640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb1b406ae40 0x7fb1b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.335+0000 7fb1cb7fe640 1 -- 172.21.15.84:0/559623873 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fb1cc089b00 con 0x7fb1d4159fc0 2023-12-12T09:22:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.335+0000 7fb1d2ffd640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb1b406ae40 0x7fb1b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.336+0000 7fb1d2ffd640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb1b406ae40 0x7fb1b406d300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4035000 tx=0x7fb1c402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:04.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.340+0000 7fb1cb7fe640 1 -- 172.21.15.84:0/559623873 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1cc08be60 con 0x7fb1d4159fc0 2023-12-12T09:22:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.543+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1d40b1110 con 0x7fb1d4159fc0 2023-12-12T09:22:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.543+0000 7fb1cb7fe640 1 -- 172.21.15.84:0/559623873 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb1cc017080 con 0x7fb1d4159fc0 2023-12-12T09:22:04.545 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:22:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb1b406ae40 msgr2=0x7fb1b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb1b406ae40 0x7fb1b406d300 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4035000 tx=0x7fb1c402e000 comp rx=0 tx=0).stop 2023-12-12T09:22:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1d4159fc0 msgr2=0x7fb1d414acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1d4159fc0 0x7fb1d414acc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00e850 tx=0x7fb1cc00ed10 comp rx=0 tx=0).stop 2023-12-12T09:22:04.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 shutdown_connections 2023-12-12T09:22:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb1b406ae40 0x7fb1b406d300 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1d4159fc0 0x7fb1d414acc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1d40b4270 0x7fb1d414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 --2- 172.21.15.84:0/559623873 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1d406bc20 0x7fb1d413c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 >> 172.21.15.84:0/559623873 conn(0x7fb1d4070b20 msgr2=0x7fb1d40b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 shutdown_connections 2023-12-12T09:22:04.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.546+0000 7fb1d9705640 1 -- 172.21.15.84:0/559623873 wait complete. 2023-12-12T09:22:04.565 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:22:04.565 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:04.615 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:04.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.870+0000 7f3d053be640 1 Processor -- start 2023-12-12T09:22:04.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.870+0000 7f3d053be640 1 -- start start 2023-12-12T09:22:04.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.872+0000 7f3d053be640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3d0013ff90 0x7f3d00142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.872+0000 7f3d053be640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0015e0b0 0x7f3d00142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.872+0000 7f3d053be640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000b3b60 con 0x7f3d000b4ba0 2023-12-12T09:22:04.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.872+0000 7f3d053be640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0015e6d0 con 0x7f3d0013ff90 2023-12-12T09:22:04.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.872+0000 7f3d053be640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d000b3de0 con 0x7f3d0015e0b0 2023-12-12T09:22:04.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.873+0000 7f3cfeffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3d0013ff90 0x7f3d00142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.873+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0015e0b0 0x7f3d00142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.873+0000 7f3cfeffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3d0013ff90 0x7f3d00142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:52324/0 (socket says 172.21.15.84:52324) 2023-12-12T09:22:04.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.873+0000 7f3cfeffd640 1 -- 172.21.15.84:0/3784398200 learned_addr learned my addr 172.21.15.84:0/3784398200 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:04.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.874+0000 7f3cfeffd640 1 -- 172.21.15.84:0/3784398200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0015e0b0 msgr2=0x7f3d00142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:04.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.874+0000 7f3cfeffd640 1 --2- 172.21.15.84:0/3784398200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0015e0b0 0x7f3d00142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.874+0000 7f3cfeffd640 1 -- 172.21.15.84:0/3784398200 >> v1:172.21.15.99:6789/0 conn(0x7f3d000b4ba0 legacy=0x7f3d0015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.874+0000 7f3cfeffd640 1 -- 172.21.15.84:0/3784398200 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000b40c0 con 0x7f3d0013ff90 2023-12-12T09:22:04.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.875+0000 7f3cfeffd640 1 --2- 172.21.15.84:0/3784398200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0013ff90 0x7f3d00142830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009e50 tx=0x7f3cf002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3da71f8dd7758b96 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.876+0000 7f3cfe7fc640 1 -- 172.21.15.84:0/3784398200 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf002cb00 con 0x7f3d0013ff90 2023-12-12T09:22:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.876+0000 7f3cfe7fc640 1 -- 172.21.15.84:0/3784398200 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf002cc60 con 0x7f3d0013ff90 2023-12-12T09:22:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.876+0000 7f3cfe7fc640 1 -- 172.21.15.84:0/3784398200 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00343f0 con 0x7f3d0013ff90 2023-12-12T09:22:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.876+0000 7f3d053be640 1 -- 172.21.15.84:0/3784398200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0013ff90 msgr2=0x7f3d00142830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.876+0000 7f3d053be640 1 --2- 172.21.15.84:0/3784398200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0013ff90 0x7f3d00142830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009e50 tx=0x7f3cf002bf60 comp rx=0 tx=0).stop 2023-12-12T09:22:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.876+0000 7f3d053be640 1 -- 172.21.15.84:0/3784398200 shutdown_connections 2023-12-12T09:22:04.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.877+0000 7f3d053be640 1 --2- 172.21.15.84:0/3784398200 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0015e0b0 0x7f3d00142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.877+0000 7f3d053be640 1 --2- 172.21.15.84:0/3784398200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0013ff90 0x7f3d00142830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.877+0000 7f3d053be640 1 -- 172.21.15.84:0/3784398200 >> 172.21.15.84:0/3784398200 conn(0x7f3d0006c3d0 msgr2=0x7f3d0006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.877+0000 7f3d053be640 1 -- 172.21.15.84:0/3784398200 shutdown_connections 2023-12-12T09:22:04.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.877+0000 7f3d053be640 1 -- 172.21.15.84:0/3784398200 wait complete. 2023-12-12T09:22:04.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.879+0000 7f3d053be640 1 Processor -- start 2023-12-12T09:22:04.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.879+0000 7f3d053be640 1 -- start start 2023-12-12T09:22:04.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3d053be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d000b4ba0 0x7f3d001f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3d053be640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0013ff90 0x7f3d00156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3d053be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015e0b0 0x7f3d00071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3d053be640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d001f3e20 con 0x7f3d000b4ba0 2023-12-12T09:22:04.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3d053be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d001f3b40 con 0x7f3d0015e0b0 2023-12-12T09:22:04.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3d053be640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d001563d0 con 0x7f3d0013ff90 2023-12-12T09:22:04.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3cfeffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d000b4ba0 0x7f3d001f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3cfeffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d000b4ba0 0x7f3d001f0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48874/0 (socket says 172.21.15.84:48874) 2023-12-12T09:22:04.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3cfeffd640 1 -- 172.21.15.84:0/2535021161 learned_addr learned my addr 172.21.15.84:0/2535021161 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:04.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3cff7fe640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015e0b0 0x7f3d00071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.880+0000 7f3cf67fc640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0013ff90 0x7f3d00156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cfeffd640 1 -- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0013ff90 msgr2=0x7f3d00156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cfeffd640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0013ff90 0x7f3d00156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cfeffd640 1 -- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015e0b0 msgr2=0x7f3d00071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:04.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cfeffd640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015e0b0 0x7f3d00071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:04.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cfeffd640 1 -- 172.21.15.84:0/2535021161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0009b30 con 0x7f3d000b4ba0 2023-12-12T09:22:04.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cf67fc640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0013ff90 0x7f3d00156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:04.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cff7fe640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015e0b0 0x7f3d00071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:04.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cfeffd640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d000b4ba0 0x7f3d001f0210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0000f80 tx=0x7f3cf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:04.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cf7fff640 1 -- 172.21.15.84:0/2535021161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0009510 con 0x7f3d000b4ba0 2023-12-12T09:22:04.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cf7fff640 1 -- 172.21.15.84:0/2535021161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf003e450 con 0x7f3d000b4ba0 2023-12-12T09:22:04.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d001566b0 con 0x7f3d000b4ba0 2023-12-12T09:22:04.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3cf7fff640 1 -- 172.21.15.84:0/2535021161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf003e800 con 0x7f3d000b4ba0 2023-12-12T09:22:04.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.881+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d001f0750 con 0x7f3d000b4ba0 2023-12-12T09:22:04.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.883+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d00156bd0 con 0x7f3d000b4ba0 2023-12-12T09:22:04.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.884+0000 7f3cf7fff640 1 -- 172.21.15.84:0/2535021161 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cf003e960 con 0x7f3d000b4ba0 2023-12-12T09:22:04.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.884+0000 7f3cf7fff640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ce006ae40 0x7f3ce006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:04.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.885+0000 7f3cf7fff640 1 -- 172.21.15.84:0/2535021161 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f3cf00ac5e0 con 0x7f3d000b4ba0 2023-12-12T09:22:04.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.885+0000 7f3cf67fc640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ce006ae40 0x7f3ce006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:04.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.885+0000 7f3cf67fc640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ce006ae40 0x7f3ce006d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d0013fcb0 tx=0x7f3ce8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:04.890+0000 7f3cf7fff640 1 -- 172.21.15.84:0/2535021161 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3cf00773d0 con 0x7f3d000b4ba0 2023-12-12T09:22:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.083+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d000673c0 con 0x7f3d000b4ba0 2023-12-12T09:22:05.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.085+0000 7f3cf7fff640 1 -- 172.21.15.84:0/2535021161 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f3cf007a9f0 con 0x7f3d000b4ba0 2023-12-12T09:22:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:05.086 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.087+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ce006ae40 msgr2=0x7f3ce006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.087+0000 7f3d053be640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ce006ae40 0x7f3ce006d300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d0013fcb0 tx=0x7f3ce8009040 comp rx=0 tx=0).stop 2023-12-12T09:22:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.087+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d000b4ba0 msgr2=0x7f3d001f0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.087+0000 7f3d053be640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d000b4ba0 0x7f3d001f0210 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0000f80 tx=0x7f3cf0004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.088+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 shutdown_connections 2023-12-12T09:22:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.088+0000 7f3d053be640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d0015e0b0 0x7f3d00071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.088+0000 7f3d053be640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3d0013ff90 0x7f3d00156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.088+0000 7f3d053be640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3ce006ae40 0x7f3ce006d300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.088+0000 7f3d053be640 1 --2- 172.21.15.84:0/2535021161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d000b4ba0 0x7f3d001f0210 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.088+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 >> 172.21.15.84:0/2535021161 conn(0x7f3d0006c3d0 msgr2=0x7f3d0013e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.088+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 shutdown_connections 2023-12-12T09:22:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.088+0000 7f3d053be640 1 -- 172.21.15.84:0/2535021161 wait complete. 2023-12-12T09:22:05.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:21:28.519227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:21:29.210161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-12T09:21:44.988386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:22:05.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:22:05.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.327+0000 7f24026a2640 1 Processor -- start 2023-12-12T09:22:05.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.327+0000 7f24026a2640 1 -- start start 2023-12-12T09:22:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.329+0000 7f24026a2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23fc06d430 0x7f23fc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.329+0000 7f24026a2640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc071c00 con 0x7f23fc0b1dc0 2023-12-12T09:22:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.329+0000 7f24026a2640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23fc06ddb0 con 0x7f23fc143860 2023-12-12T09:22:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.329+0000 7f24026a2640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc143c40 con 0x7f23fc06d430 2023-12-12T09:22:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.329+0000 7f2400c3f640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f23fc0b1dc0 0x7f23fc0b2250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55728/0 (socket says 172.21.15.84:55728) 2023-12-12T09:22:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.329+0000 7f2400c3f640 1 -- 172.21.15.84:0/3961541136 learned_addr learned my addr 172.21.15.84:0/3961541136 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:05.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.329+0000 7f23fb7fe640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23fc06d430 0x7f23fc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.329+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774310757 0 0) 0x7f23fc071c00 con 0x7f23fc0b1dc0 2023-12-12T09:22:05.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e4003520 con 0x7f23fc0b1dc0 2023-12-12T09:22:05.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 47054531 0 0) 0x7f23e4003520 con 0x7f23fc0b1dc0 2023-12-12T09:22:05.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23fc06d430 msgr2=0x7f23fc06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:05.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23fc06d430 0x7f23fc06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 >> v1:172.21.15.99:6789/0 conn(0x7f23fc143860 legacy=0x7f23fc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc0b4780 con 0x7f23fc0b1dc0 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f23f40019f0 con 0x7f23fc0b1dc0 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 >> v1:172.21.15.84:6789/0 conn(0x7f23fc0b1dc0 legacy=0x7f23fc0b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23e40039a0 0x7f23e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23e40047c0 0x7f23e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e4005250 0x7f23e400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc143c40 con 0x7f23e4005250 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e400e380 con 0x7f23e40039a0 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e400e540 con 0x7f23e40047c0 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f23fb7fe640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23fc06d430 0x7f23fc06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.330+0000 7f2400c3f640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e4005250 0x7f23e400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.331+0000 7f2400c3f640 1 -- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23e40047c0 msgr2=0x7f23e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.331+0000 7f2400c3f640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23e40047c0 0x7f23e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.331+0000 7f2400c3f640 1 -- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23e40039a0 msgr2=0x7f23e4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:05.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.331+0000 7f23fbfff640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23e40039a0 0x7f23e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.331+0000 7f2400c3f640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23e40039a0 0x7f23e4003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.331+0000 7f2400c3f640 1 -- 172.21.15.84:0/3961541136 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4003520 con 0x7f23e4005250 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.332+0000 7f2400c3f640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e4005250 0x7f23e400db90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f23f400a830 tx=0x7f23e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec19f13b05f4b05f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.332+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40072d0 con 0x7f23e4005250 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.332+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f402f070 con 0x7f23e4005250 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.332+0000 7f23faffd640 1 -- 172.21.15.84:0/3961541136 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40076b0 con 0x7f23e4005250 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.333+0000 7f24026a2640 1 -- 172.21.15.84:0/3961541136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e4005250 msgr2=0x7f23e400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.333+0000 7f24026a2640 1 --2- 172.21.15.84:0/3961541136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e4005250 0x7f23e400db90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f23f400a830 tx=0x7f23e40057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.333+0000 7f2400c3f640 1 -- 172.21.15.84:0/3961541136 reap_dead start 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.333+0000 7f24026a2640 1 -- 172.21.15.84:0/3961541136 shutdown_connections 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.333+0000 7f24026a2640 1 -- 172.21.15.84:0/3961541136 >> 172.21.15.84:0/3961541136 conn(0x7f23fc0b0ac0 msgr2=0x7f23fc0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:05.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.333+0000 7f24026a2640 1 -- 172.21.15.84:0/3961541136 shutdown_connections 2023-12-12T09:22:05.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.333+0000 7f24026a2640 1 -- 172.21.15.84:0/3961541136 wait complete. 2023-12-12T09:22:05.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.335+0000 7f24026a2640 1 Processor -- start 2023-12-12T09:22:05.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.335+0000 7f24026a2640 1 -- start start 2023-12-12T09:22:05.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f24026a2640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23e4005250 0x7f23fc15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f24026a2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23fc142e50 0x7f23fc155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f24026a2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc1597d0 0x7f23fc0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f24026a2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc15c930 con 0x7f23fc1597d0 2023-12-12T09:22:05.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f24026a2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc156070 con 0x7f23fc142e50 2023-12-12T09:22:05.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f24026a2640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23fc15cb40 con 0x7f23e4005250 2023-12-12T09:22:05.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f2400c3f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc1597d0 0x7f23fc0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f2400c3f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc1597d0 0x7f23fc0ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48890/0 (socket says 172.21.15.84:48890) 2023-12-12T09:22:05.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f2400c3f640 1 -- 172.21.15.84:0/3030776687 learned_addr learned my addr 172.21.15.84:0/3030776687 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:05.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f23fb7fe640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23fc142e50 0x7f23fc155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.336+0000 7f2400c3f640 1 -- 172.21.15.84:0/3030776687 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23e4005250 msgr2=0x7f23fc15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f2400c3f640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23e4005250 0x7f23fc15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f2400c3f640 1 -- 172.21.15.84:0/3030776687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23fc142e50 msgr2=0x7f23fc155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f2400c3f640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23fc142e50 0x7f23fc155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f2400c3f640 1 -- 172.21.15.84:0/3030776687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23fc142370 con 0x7f23fc1597d0 2023-12-12T09:22:05.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f2400c3f640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc1597d0 0x7f23fc0ad410 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f23f400a830 tx=0x7f23f4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:05.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f23f8ff9640 1 -- 172.21.15.84:0/3030776687 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40019b0 con 0x7f23fc1597d0 2023-12-12T09:22:05.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f23f8ff9640 1 -- 172.21.15.84:0/3030776687 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f40070d0 con 0x7f23fc1597d0 2023-12-12T09:22:05.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23fc142650 con 0x7f23fc1597d0 2023-12-12T09:22:05.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f23f8ff9640 1 -- 172.21.15.84:0/3030776687 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4007460 con 0x7f23fc1597d0 2023-12-12T09:22:05.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.337+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23fc0ad950 con 0x7f23fc1597d0 2023-12-12T09:22:05.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.338+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23fc1421d0 con 0x7f23fc1597d0 2023-12-12T09:22:05.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.339+0000 7f23f8ff9640 1 -- 172.21.15.84:0/3030776687 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f23f4031030 con 0x7f23fc1597d0 2023-12-12T09:22:05.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.340+0000 7f23f8ff9640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f23e806ae40 0x7f23e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.340+0000 7f23f8ff9640 1 -- 172.21.15.84:0/3030776687 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f23f40ab4f0 con 0x7f23fc1597d0 2023-12-12T09:22:05.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.340+0000 7f23fbfff640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f23e806ae40 0x7f23e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.341+0000 7f23fbfff640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f23e806ae40 0x7f23e806d300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0ce6c0 tx=0x7f23ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:05.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.344+0000 7f23f8ff9640 1 -- 172.21.15.84:0/3030776687 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23fc1421d0 con 0x7f23fc1597d0 2023-12-12T09:22:05.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.535+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23fc142b70 con 0x7f23fc1597d0 2023-12-12T09:22:05.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.536+0000 7f23f8ff9640 1 -- 172.21.15.84:0/3030776687 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23fc142b70 con 0x7f23fc1597d0 2023-12-12T09:22:05.537 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:22:05.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f23e806ae40 msgr2=0x7f23e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f23e806ae40 0x7f23e806d300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0ce6c0 tx=0x7f23ec009040 comp rx=0 tx=0).stop 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc1597d0 msgr2=0x7f23fc0ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc1597d0 0x7f23fc0ad410 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f23f400a830 tx=0x7f23f4001d80 comp rx=0 tx=0).stop 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 shutdown_connections 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f23e806ae40 0x7f23e806d300 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23fc1597d0 0x7f23fc0ad410 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23fc142e50 0x7f23fc155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 --2- 172.21.15.84:0/3030776687 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f23e4005250 0x7f23fc15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 >> 172.21.15.84:0/3030776687 conn(0x7f23fc0b0ac0 msgr2=0x7f23fc0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 shutdown_connections 2023-12-12T09:22:05.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.539+0000 7f24026a2640 1 -- 172.21.15.84:0/3030776687 wait complete. 2023-12-12T09:22:05.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:22:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.770+0000 7f5ab0dea640 1 Processor -- start 2023-12-12T09:22:05.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.771+0000 7f5ab0dea640 1 -- start start 2023-12-12T09:22:05.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.772+0000 7f5ab0dea640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5aac155690 0x7f5aac06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.772+0000 7f5ab0dea640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5aac0cde40 0x7f5aac0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.772+0000 7f5ab0dea640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aac155a70 con 0x7f5aac15b4f0 2023-12-12T09:22:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.772+0000 7f5ab0dea640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac0ce830 con 0x7f5aac0cde40 2023-12-12T09:22:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.772+0000 7f5ab0dea640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac15c120 con 0x7f5aac155690 2023-12-12T09:22:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.772+0000 7f5aa3fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5aac0cde40 0x7f5aac0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.773+0000 7f5aaad9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5aac15b4f0 0x7f5aac15b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55734/0 (socket says 172.21.15.84:55734) 2023-12-12T09:22:05.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.773+0000 7f5aaad9d640 1 -- 172.21.15.84:0/2817298730 learned_addr learned my addr 172.21.15.84:0/2817298730 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.773+0000 7f5aaa59c640 1 --2- 172.21.15.84:0/2817298730 >> v2:172.21.15.99:3300/0 conn(0x7f5aac155690 0x7f5aac06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.773+0000 7f5aa3fff640 1 -- 172.21.15.84:0/2817298730 >> v2:172.21.15.99:3300/0 conn(0x7f5aac155690 msgr2=0x7f5aac06ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.773+0000 7f5aa3fff640 1 --2- 172.21.15.84:0/2817298730 >> v2:172.21.15.99:3300/0 conn(0x7f5aac155690 0x7f5aac06ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.773+0000 7f5aa3fff640 1 -- 172.21.15.84:0/2817298730 >> v1:172.21.15.84:6789/0 conn(0x7f5aac15b4f0 legacy=0x7f5aac15b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.773+0000 7f5aa3fff640 1 -- 172.21.15.84:0/2817298730 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac15c400 con 0x7f5aac0cde40 2023-12-12T09:22:05.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.773+0000 7f5aa9d9b640 1 -- 172.21.15.84:0/2817298730 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740702593 0 0) 0x7f5aac155a70 con 0x7f5aac15b4f0 2023-12-12T09:22:05.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.774+0000 7f5aa3fff640 1 --2- 172.21.15.84:0/2817298730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac0cde40 0x7f5aac0ce2f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5aac066b00 tx=0x7f5a9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce34a7ea8d5f8c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:05.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.774+0000 7f5aa9d9b640 1 -- 172.21.15.84:0/2817298730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94031830 con 0x7f5aac0cde40 2023-12-12T09:22:05.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5aa9d9b640 1 -- 172.21.15.84:0/2817298730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a94031990 con 0x7f5aac0cde40 2023-12-12T09:22:05.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5aa9d9b640 1 -- 172.21.15.84:0/2817298730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94031d20 con 0x7f5aac0cde40 2023-12-12T09:22:05.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5ab0dea640 1 -- 172.21.15.84:0/2817298730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac0cde40 msgr2=0x7f5aac0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/2817298730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac0cde40 0x7f5aac0ce2f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5aac066b00 tx=0x7f5a9402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5ab0dea640 1 -- 172.21.15.84:0/2817298730 shutdown_connections 2023-12-12T09:22:05.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/2817298730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac0cde40 0x7f5aac0ce2f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/2817298730 >> v2:172.21.15.99:3300/0 conn(0x7f5aac155690 0x7f5aac06ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5ab0dea640 1 -- 172.21.15.84:0/2817298730 >> 172.21.15.84:0/2817298730 conn(0x7f5aac0b0900 msgr2=0x7f5aac0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:05.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5ab0dea640 1 -- 172.21.15.84:0/2817298730 shutdown_connections 2023-12-12T09:22:05.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.775+0000 7f5ab0dea640 1 -- 172.21.15.84:0/2817298730 wait complete. 2023-12-12T09:22:05.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.777+0000 7f5ab0dea640 1 Processor -- start 2023-12-12T09:22:05.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.777+0000 7f5ab0dea640 1 -- start start 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5ab0dea640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5aac0cde40 0x7f5aac1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5ab0dea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac155690 0x7f5aac09bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5ab0dea640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aac15b4f0 0x7f5aac157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5ab0dea640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac146be0 con 0x7f5aac155690 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5ab0dea640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac099dc0 con 0x7f5aac15b4f0 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5ab0dea640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac09a0a0 con 0x7f5aac0cde40 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5aa3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac155690 0x7f5aac09bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5aa3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac155690 0x7f5aac09bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48896/0 (socket says 172.21.15.84:48896) 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.778+0000 7f5aa3fff640 1 -- 172.21.15.84:0/145333084 learned_addr learned my addr 172.21.15.84:0/145333084 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa3fff640 1 -- 172.21.15.84:0/145333084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5aac0cde40 msgr2=0x7f5aac1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa3fff640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5aac0cde40 0x7f5aac1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa3fff640 1 -- 172.21.15.84:0/145333084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aac15b4f0 msgr2=0x7f5aac157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa3fff640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aac15b4f0 0x7f5aac157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa3fff640 1 -- 172.21.15.84:0/145333084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94009400 con 0x7f5aac155690 2023-12-12T09:22:05.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa3fff640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac155690 0x7f5aac09bd40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009890 tx=0x7f5a940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa2ffd640 1 -- 172.21.15.84:0/145333084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9403ba70 con 0x7f5aac155690 2023-12-12T09:22:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa2ffd640 1 -- 172.21.15.84:0/145333084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9403bbf0 con 0x7f5aac155690 2023-12-12T09:22:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5aa2ffd640 1 -- 172.21.15.84:0/145333084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94045400 con 0x7f5aac155690 2023-12-12T09:22:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.779+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aac09a380 con 0x7f5aac155690 2023-12-12T09:22:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.780+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aac09a940 con 0x7f5aac155690 2023-12-12T09:22:05.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.781+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aac09ab00 con 0x7f5aac155690 2023-12-12T09:22:05.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.782+0000 7f5aa2ffd640 1 -- 172.21.15.84:0/145333084 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a9404e440 con 0x7f5aac155690 2023-12-12T09:22:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.782+0000 7f5aa2ffd640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a8c06ae40 0x7f5a8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.783+0000 7f5aa2ffd640 1 -- 172.21.15.84:0/145333084 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f5a940abb50 con 0x7f5aac155690 2023-12-12T09:22:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.783+0000 7f5aaa59c640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a8c06ae40 0x7f5a8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:05.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.783+0000 7f5aaa59c640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a8c06ae40 0x7f5a8c06d300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0098f0 tx=0x7f5a9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:05.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.787+0000 7f5aa2ffd640 1 -- 172.21.15.84:0/145333084 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a94076930 con 0x7f5aac155690 2023-12-12T09:22:05.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.975+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5aac0673c0 con 0x7f5aac155690 2023-12-12T09:22:05.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.976+0000 7f5aa2ffd640 1 -- 172.21.15.84:0/145333084 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a94035020 con 0x7f5aac155690 2023-12-12T09:22:05.977 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.978+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a8c06ae40 msgr2=0x7f5a8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.978+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a8c06ae40 0x7f5a8c06d300 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0098f0 tx=0x7f5a9c008040 comp rx=0 tx=0).stop 2023-12-12T09:22:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.978+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac155690 msgr2=0x7f5aac09bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.978+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac155690 0x7f5aac09bd40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5a94009890 tx=0x7f5a940046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.979+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 shutdown_connections 2023-12-12T09:22:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.979+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aac15b4f0 0x7f5aac157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.979+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a8c06ae40 0x7f5a8c06d300 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.979+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5aac155690 0x7f5aac09bd40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.979+0000 7f5ab0dea640 1 --2- 172.21.15.84:0/145333084 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5aac0cde40 0x7f5aac1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.979+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 >> 172.21.15.84:0/145333084 conn(0x7f5aac0b0900 msgr2=0x7f5aac15c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.979+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 shutdown_connections 2023-12-12T09:22:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:05.979+0000 7f5ab0dea640 1 -- 172.21.15.84:0/145333084 wait complete. 2023-12-12T09:22:05.997 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:22:06.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.190+0000 7f3c14ba9640 1 Processor -- start 2023-12-12T09:22:06.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.190+0000 7f3c14ba9640 1 -- start start 2023-12-12T09:22:06.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.191+0000 7f3c14ba9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3c1006db40 0x7f3c10070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.191+0000 7f3c14ba9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3c1014af70 0x7f3c10071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.191+0000 7f3c14ba9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c10070730 con 0x7f3c1014a4a0 2023-12-12T09:22:06.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.191+0000 7f3c14ba9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1014a880 con 0x7f3c1006db40 2023-12-12T09:22:06.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.191+0000 7f3c14ba9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c100b1f60 con 0x7f3c1014af70 2023-12-12T09:22:06.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0e59c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3c1014a4a0 0x7f3c1006d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36126/0 (socket says 172.21.15.84:36126) 2023-12-12T09:22:06.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0e59c640 1 -- 172.21.15.84:0/4127043850 learned_addr learned my addr 172.21.15.84:0/4127043850 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:06.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0dd9b640 1 --2- 172.21.15.84:0/4127043850 >> v2:172.21.15.84:3300/0 conn(0x7f3c1006db40 0x7f3c10070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0d59a640 1 -- 172.21.15.84:0/4127043850 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576477057 0 0) 0x7f3c10070730 con 0x7f3c1014a4a0 2023-12-12T09:22:06.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0d59a640 1 -- 172.21.15.84:0/4127043850 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf8003520 con 0x7f3c1014a4a0 2023-12-12T09:22:06.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0dd9b640 1 -- 172.21.15.84:0/4127043850 >> v2:172.21.15.99:3300/0 conn(0x7f3c1014af70 msgr2=0x7f3c10071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:06.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0ed9d640 1 --2- 172.21.15.84:0/4127043850 >> v2:172.21.15.99:3300/0 conn(0x7f3c1014af70 0x7f3c10071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0dd9b640 1 --2- 172.21.15.84:0/4127043850 >> v2:172.21.15.99:3300/0 conn(0x7f3c1014af70 0x7f3c10071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0dd9b640 1 -- 172.21.15.84:0/4127043850 >> v1:172.21.15.84:6789/0 conn(0x7f3c1014a4a0 legacy=0x7f3c1006d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.192+0000 7f3c0dd9b640 1 -- 172.21.15.84:0/4127043850 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c100700e0 con 0x7f3c1006db40 2023-12-12T09:22:06.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.193+0000 7f3c0dd9b640 1 --2- 172.21.15.84:0/4127043850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1006db40 0x7f3c10070bc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b16d0 tx=0x7f3c0402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd1b8a3c61dc838 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c0d59a640 1 -- 172.21.15.84:0/4127043850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04031710 con 0x7f3c1006db40 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c0d59a640 1 -- 172.21.15.84:0/4127043850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0402f050 con 0x7f3c1006db40 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c0d59a640 1 -- 172.21.15.84:0/4127043850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04031a90 con 0x7f3c1006db40 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c14ba9640 1 -- 172.21.15.84:0/4127043850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1006db40 msgr2=0x7f3c10070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/4127043850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1006db40 0x7f3c10070bc0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b16d0 tx=0x7f3c0402b7b0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c14ba9640 1 -- 172.21.15.84:0/4127043850 shutdown_connections 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/4127043850 >> v2:172.21.15.99:3300/0 conn(0x7f3c1014af70 0x7f3c10071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/4127043850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1006db40 0x7f3c10070bc0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c14ba9640 1 -- 172.21.15.84:0/4127043850 >> 172.21.15.84:0/4127043850 conn(0x7f3c100b0ac0 msgr2=0x7f3c100b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:06.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c14ba9640 1 -- 172.21.15.84:0/4127043850 shutdown_connections 2023-12-12T09:22:06.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.194+0000 7f3c14ba9640 1 -- 172.21.15.84:0/4127043850 wait complete. 2023-12-12T09:22:06.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.196+0000 7f3c14ba9640 1 Processor -- start 2023-12-12T09:22:06.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.196+0000 7f3c14ba9640 1 -- start start 2023-12-12T09:22:06.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c14ba9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c1006db40 0x7f3c10144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c14ba9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c1014a4a0 0x7f3c100a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c14ba9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1014af70 0x7f3c100a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c14ba9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c100aa380 con 0x7f3c1014af70 2023-12-12T09:22:06.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c14ba9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101f7200 con 0x7f3c1014a4a0 2023-12-12T09:22:06.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c14ba9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101f7490 con 0x7f3c1006db40 2023-12-12T09:22:06.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c0ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1014af70 0x7f3c100a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c0ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1014af70 0x7f3c100a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56666/0 (socket says 172.21.15.84:56666) 2023-12-12T09:22:06.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.197+0000 7f3c0ed9d640 1 -- 172.21.15.84:0/1986457840 learned_addr learned my addr 172.21.15.84:0/1986457840 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3c0dd9b640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c1014a4a0 0x7f3c100a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3c0ed9d640 1 -- 172.21.15.84:0/1986457840 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c1006db40 msgr2=0x7f3c10144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3c0ed9d640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c1006db40 0x7f3c10144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3c0ed9d640 1 -- 172.21.15.84:0/1986457840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c1014a4a0 msgr2=0x7f3c100a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3c0ed9d640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c1014a4a0 0x7f3c100a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3c0ed9d640 1 -- 172.21.15.84:0/1986457840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04009400 con 0x7f3c1014af70 2023-12-12T09:22:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3c0ed9d640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1014af70 0x7f3c100a89c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800cc30 tx=0x7f3c0800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3bfeffd640 1 -- 172.21.15.84:0/1986457840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800ce40 con 0x7f3c1014af70 2023-12-12T09:22:06.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3bfeffd640 1 -- 172.21.15.84:0/1986457840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08003990 con 0x7f3c1014af70 2023-12-12T09:22:06.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c101f7770 con 0x7f3c1014af70 2023-12-12T09:22:06.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.198+0000 7f3bfeffd640 1 -- 172.21.15.84:0/1986457840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08003d20 con 0x7f3c1014af70 2023-12-12T09:22:06.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.199+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c101f7d30 con 0x7f3c1014af70 2023-12-12T09:22:06.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.200+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c100673c0 con 0x7f3c1014af70 2023-12-12T09:22:06.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.201+0000 7f3bfeffd640 1 -- 172.21.15.84:0/1986457840 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c08003e80 con 0x7f3c1014af70 2023-12-12T09:22:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.202+0000 7f3bfeffd640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bf006ae40 0x7f3bf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.202+0000 7f3bfeffd640 1 -- 172.21.15.84:0/1986457840 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f3c08089c20 con 0x7f3c1014af70 2023-12-12T09:22:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.202+0000 7f3c0e59c640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bf006ae40 0x7f3bf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.203+0000 7f3c0e59c640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bf006ae40 0x7f3bf006d300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3c00001610 tx=0x7f3c00007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.206+0000 7f3bfeffd640 1 -- 172.21.15.84:0/1986457840 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c08054a90 con 0x7f3c1014af70 2023-12-12T09:22:06.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.386+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c100b29e0 con 0x7f3c1014af70 2023-12-12T09:22:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.387+0000 7f3bfeffd640 1 -- 172.21.15.84:0/1986457840 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c0801d070 con 0x7f3c1014af70 2023-12-12T09:22:06.388 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bf006ae40 msgr2=0x7f3bf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bf006ae40 0x7f3bf006d300 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3c00001610 tx=0x7f3c00007930 comp rx=0 tx=0).stop 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1014af70 msgr2=0x7f3c100a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1014af70 0x7f3c100a89c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800cc30 tx=0x7f3c0800a5c0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 shutdown_connections 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3bf006ae40 0x7f3bf006d300 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c1014af70 0x7f3c100a89c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c1014a4a0 0x7f3c100a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 --2- 172.21.15.84:0/1986457840 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3c1006db40 0x7f3c10144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 >> 172.21.15.84:0/1986457840 conn(0x7f3c100b0ac0 msgr2=0x7f3c1006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 shutdown_connections 2023-12-12T09:22:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.389+0000 7f3c14ba9640 1 -- 172.21.15.84:0/1986457840 wait complete. 2023-12-12T09:22:06.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-12T09:22:06.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.617+0000 7f4845f01640 1 Processor -- start 2023-12-12T09:22:06.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.617+0000 7f4845f01640 1 -- start start 2023-12-12T09:22:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f4845f01640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f48400b40d0 0x7f484006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f4845f01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400ce6f0 0x7f48400b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f4845f01640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f484015be60 0x7f484013e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f4845f01640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400ceb80 con 0x7f484015be60 2023-12-12T09:22:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f4845f01640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400ce260 con 0x7f48400b40d0 2023-12-12T09:22:06.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f4845f01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48400b49f0 con 0x7f48400ce6f0 2023-12-12T09:22:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f483ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f484015be60 0x7f484013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f483ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f484015be60 0x7f484013e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56674/0 (socket says 172.21.15.84:56674) 2023-12-12T09:22:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.619+0000 7f483ffff640 1 -- 172.21.15.84:0/534725389 learned_addr learned my addr 172.21.15.84:0/534725389 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.620+0000 7f4837fff640 1 --2- 172.21.15.84:0/534725389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400ce6f0 0x7f48400b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.620+0000 7f483f7fe640 1 --2- 172.21.15.84:0/534725389 >> v2:172.21.15.99:3300/0 conn(0x7f48400b40d0 0x7f484006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.620+0000 7f483ffff640 1 -- 172.21.15.84:0/534725389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400ce6f0 msgr2=0x7f48400b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:06.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.620+0000 7f483ffff640 1 --2- 172.21.15.84:0/534725389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400ce6f0 0x7f48400b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.620+0000 7f483ffff640 1 -- 172.21.15.84:0/534725389 >> v2:172.21.15.99:3300/0 conn(0x7f48400b40d0 msgr2=0x7f484006dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.620+0000 7f483ffff640 1 --2- 172.21.15.84:0/534725389 >> v2:172.21.15.99:3300/0 conn(0x7f48400b40d0 0x7f484006dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.620+0000 7f483ffff640 1 -- 172.21.15.84:0/534725389 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400cd930 con 0x7f484015be60 2023-12-12T09:22:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.620+0000 7f483f7fe640 1 --2- 172.21.15.84:0/534725389 >> v2:172.21.15.99:3300/0 conn(0x7f48400b40d0 0x7f484006dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:06.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.621+0000 7f483ffff640 1 --2- 172.21.15.84:0/534725389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f484013e750 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f48400b4d90 tx=0x7f483802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e9c35fac8ea8e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f483effd640 1 -- 172.21.15.84:0/534725389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483802ca70 con 0x7f484015be60 2023-12-12T09:22:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f483effd640 1 -- 172.21.15.84:0/534725389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483802cbd0 con 0x7f484015be60 2023-12-12T09:22:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f483effd640 1 -- 172.21.15.84:0/534725389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380343f0 con 0x7f484015be60 2023-12-12T09:22:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f4845f01640 1 -- 172.21.15.84:0/534725389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 msgr2=0x7f484013e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f4845f01640 1 --2- 172.21.15.84:0/534725389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f484013e750 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f48400b4d90 tx=0x7f483802bed0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f4845f01640 1 -- 172.21.15.84:0/534725389 shutdown_connections 2023-12-12T09:22:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f4845f01640 1 --2- 172.21.15.84:0/534725389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f484013e750 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f4845f01640 1 --2- 172.21.15.84:0/534725389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400ce6f0 0x7f48400b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f4845f01640 1 --2- 172.21.15.84:0/534725389 >> v2:172.21.15.99:3300/0 conn(0x7f48400b40d0 0x7f484006dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f4845f01640 1 -- 172.21.15.84:0/534725389 >> 172.21.15.84:0/534725389 conn(0x7f48400b0ac0 msgr2=0x7f48400b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.622+0000 7f4845f01640 1 -- 172.21.15.84:0/534725389 shutdown_connections 2023-12-12T09:22:06.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.623+0000 7f4845f01640 1 -- 172.21.15.84:0/534725389 wait complete. 2023-12-12T09:22:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.624+0000 7f4845f01640 1 Processor -- start 2023-12-12T09:22:06.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.624+0000 7f4845f01640 1 -- start start 2023-12-12T09:22:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.625+0000 7f4845f01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400b40d0 0x7f4840158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.625+0000 7f4845f01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48400ce6f0 0x7f4840140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.625+0000 7f4845f01640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f48401411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.625+0000 7f4845f01640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4840130550 con 0x7f484015be60 2023-12-12T09:22:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.625+0000 7f4845f01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400b2dd0 con 0x7f48400ce6f0 2023-12-12T09:22:06.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.625+0000 7f4845f01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48400b30b0 con 0x7f48400b40d0 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f48401411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f48401411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56690/0 (socket says 172.21.15.84:56690) 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 -- 172.21.15.84:0/1745767236 learned_addr learned my addr 172.21.15.84:0/1745767236 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483f7fe640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400b40d0 0x7f4840158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 -- 172.21.15.84:0/1745767236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400b40d0 msgr2=0x7f4840158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400b40d0 0x7f4840158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f4837fff640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48400ce6f0 0x7f4840140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 -- 172.21.15.84:0/1745767236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48400ce6f0 msgr2=0x7f4840140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48400ce6f0 0x7f4840140c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 -- 172.21.15.84:0/1745767236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838009b30 con 0x7f484015be60 2023-12-12T09:22:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.626+0000 7f483ffff640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f48401411b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4838036040 tx=0x7f4838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.627+0000 7f483cff9640 1 -- 172.21.15.84:0/1745767236 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838009510 con 0x7f484015be60 2023-12-12T09:22:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.627+0000 7f483cff9640 1 -- 172.21.15.84:0/1745767236 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483803e450 con 0x7f484015be60 2023-12-12T09:22:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.627+0000 7f483cff9640 1 -- 172.21.15.84:0/1745767236 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483803e800 con 0x7f484015be60 2023-12-12T09:22:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.627+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48400b3390 con 0x7f484015be60 2023-12-12T09:22:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.627+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484013dbb0 con 0x7f484015be60 2023-12-12T09:22:06.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.628+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48401306c0 con 0x7f484015be60 2023-12-12T09:22:06.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.629+0000 7f483cff9640 1 -- 172.21.15.84:0/1745767236 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f483803e960 con 0x7f484015be60 2023-12-12T09:22:06.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.630+0000 7f483cff9640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f482006ae40 0x7f482006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:06.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.630+0000 7f483cff9640 1 -- 172.21.15.84:0/1745767236 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f48380aca60 con 0x7f484015be60 2023-12-12T09:22:06.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.630+0000 7f483f7fe640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f482006ae40 0x7f482006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:06.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.630+0000 7f483f7fe640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f482006ae40 0x7f482006d300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f483000b7c0 tx=0x7f4830008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:06.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.634+0000 7f483cff9640 1 -- 172.21.15.84:0/1745767236 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f48401306c0 con 0x7f484015be60 2023-12-12T09:22:06.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.822+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7f48401306c0 con 0x7f484015be60 2023-12-12T09:22:06.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.822+0000 7f483cff9640 1 -- 172.21.15.84:0/1745767236 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v44) v1 ==== 97+0+11 (secure 0 0 0) 0x7f4838043020 con 0x7f484015be60 2023-12-12T09:22:06.826 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f482006ae40 msgr2=0x7f482006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f482006ae40 0x7f482006d300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f483000b7c0 tx=0x7f4830008040 comp rx=0 tx=0).stop 2023-12-12T09:22:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 msgr2=0x7f48401411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f48401411b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4838036040 tx=0x7f4838004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 shutdown_connections 2023-12-12T09:22:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f482006ae40 0x7f482006d300 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f484015be60 0x7f48401411b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48400ce6f0 0x7f4840140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 --2- 172.21.15.84:0/1745767236 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f48400b40d0 0x7f4840158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.825+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 >> 172.21.15.84:0/1745767236 conn(0x7f48400b0ac0 msgr2=0x7f48400aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.826+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 shutdown_connections 2023-12-12T09:22:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:06.826+0000 7f4845f01640 1 -- 172.21.15.84:0/1745767236 wait complete. 2023-12-12T09:22:06.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:22:07.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.047+0000 7fc9ccb97640 1 Processor -- start 2023-12-12T09:22:07.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.047+0000 7fc9ccb97640 1 -- start start 2023-12-12T09:22:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.049+0000 7fc9ccb97640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9c8071bb0 0x7fc9c8071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.049+0000 7fc9ccb97640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80724d0 con 0x7fc9c813dae0 2023-12-12T09:22:07.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.049+0000 7fc9ccb97640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c8140270 con 0x7fc9c80ce330 2023-12-12T09:22:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.049+0000 7fc9ccb97640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80cd850 con 0x7fc9c8071bb0 2023-12-12T09:22:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.049+0000 7fc9c659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9c8071bb0 0x7fc9c8071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.049+0000 7fc9c6d9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc9c813dae0 0x7fc9c813f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36140/0 (socket says 172.21.15.84:36140) 2023-12-12T09:22:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.049+0000 7fc9c6d9d640 1 -- 172.21.15.84:0/4171724197 learned_addr learned my addr 172.21.15.84:0/4171724197 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.050+0000 7fc9c659c640 1 -- 172.21.15.84:0/4171724197 >> v1:172.21.15.99:6789/0 conn(0x7fc9c80ce330 legacy=0x7fc9c813d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.050+0000 7fc9c659c640 1 -- 172.21.15.84:0/4171724197 >> v1:172.21.15.84:6789/0 conn(0x7fc9c813dae0 legacy=0x7fc9c813f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:07.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.050+0000 7fc9c659c640 1 -- 172.21.15.84:0/4171724197 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80cdb30 con 0x7fc9c8071bb0 2023-12-12T09:22:07.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.051+0000 7fc9c659c640 1 --2- 172.21.15.84:0/4171724197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8071bb0 0x7fc9c8071f90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80097a0 tx=0x7fc9b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f16e7c7b53bbff3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.051+0000 7fc9c5d9b640 1 -- 172.21.15.84:0/4171724197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8031830 con 0x7fc9c8071bb0 2023-12-12T09:22:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.051+0000 7fc9c5d9b640 1 -- 172.21.15.84:0/4171724197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8031990 con 0x7fc9c8071bb0 2023-12-12T09:22:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.052+0000 7fc9c5d9b640 1 -- 172.21.15.84:0/4171724197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8031d20 con 0x7fc9c8071bb0 2023-12-12T09:22:07.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.052+0000 7fc9ccb97640 1 -- 172.21.15.84:0/4171724197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8071bb0 msgr2=0x7fc9c8071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.052+0000 7fc9ccb97640 1 --2- 172.21.15.84:0/4171724197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8071bb0 0x7fc9c8071f90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80097a0 tx=0x7fc9b802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.052+0000 7fc9ccb97640 1 -- 172.21.15.84:0/4171724197 shutdown_connections 2023-12-12T09:22:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.052+0000 7fc9ccb97640 1 --2- 172.21.15.84:0/4171724197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8071bb0 0x7fc9c8071f90 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.052+0000 7fc9ccb97640 1 -- 172.21.15.84:0/4171724197 >> 172.21.15.84:0/4171724197 conn(0x7fc9c806c3d0 msgr2=0x7fc9c806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.052+0000 7fc9ccb97640 1 -- 172.21.15.84:0/4171724197 shutdown_connections 2023-12-12T09:22:07.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.052+0000 7fc9ccb97640 1 -- 172.21.15.84:0/4171724197 wait complete. 2023-12-12T09:22:07.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.054+0000 7fc9ccb97640 1 Processor -- start 2023-12-12T09:22:07.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.055+0000 7fc9ccb97640 1 -- start start 2023-12-12T09:22:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9ccb97640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8071bb0 0x7fc9c812af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9ccb97640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c80ce330 0x7fc9c8151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9ccb97640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8154080 0x7fc9c8159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:07.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9ccb97640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8152b20 con 0x7fc9c8154080 2023-12-12T09:22:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9ccb97640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8151ea0 con 0x7fc9c80ce330 2023-12-12T09:22:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9ccb97640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8152180 con 0x7fc9c8071bb0 2023-12-12T09:22:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9c6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8154080 0x7fc9c8159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9c6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8154080 0x7fc9c8159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56710/0 (socket says 172.21.15.84:56710) 2023-12-12T09:22:07.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.056+0000 7fc9c6d9d640 1 -- 172.21.15.84:0/2014680450 learned_addr learned my addr 172.21.15.84:0/2014680450 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9bffff640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c80ce330 0x7fc9c8151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9c659c640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8071bb0 0x7fc9c812af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9c6d9d640 1 -- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8071bb0 msgr2=0x7fc9c812af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9c6d9d640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8071bb0 0x7fc9c812af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9c6d9d640 1 -- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c80ce330 msgr2=0x7fc9c8151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9c6d9d640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c80ce330 0x7fc9c8151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9c6d9d640 1 -- 172.21.15.84:0/2014680450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8009400 con 0x7fc9c8154080 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9c659c640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8071bb0 0x7fc9c812af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:07.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9c6d9d640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8154080 0x7fc9c8159030 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000cbc0 tx=0x7fc9c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9beffd640 1 -- 172.21.15.84:0/2014680450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000ad40 con 0x7fc9c8154080 2023-12-12T09:22:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9beffd640 1 -- 172.21.15.84:0/2014680450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0012400 con 0x7fc9c8154080 2023-12-12T09:22:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9beffd640 1 -- 172.21.15.84:0/2014680450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000aea0 con 0x7fc9c8154080 2023-12-12T09:22:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c8152460 con 0x7fc9c8154080 2023-12-12T09:22:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.057+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c8151950 con 0x7fc9c8154080 2023-12-12T09:22:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.059+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c80673c0 con 0x7fc9c8154080 2023-12-12T09:22:07.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.060+0000 7fc9beffd640 1 -- 172.21.15.84:0/2014680450 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc9c0007070 con 0x7fc9c8154080 2023-12-12T09:22:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.060+0000 7fc9beffd640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc9a806ae40 0x7fc9a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.061+0000 7fc9beffd640 1 -- 172.21.15.84:0/2014680450 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fc9c00897e0 con 0x7fc9c8154080 2023-12-12T09:22:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.061+0000 7fc9c659c640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc9a806ae40 0x7fc9a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:07.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.061+0000 7fc9c659c640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc9a806ae40 0x7fc9a806d300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8036000 tx=0x7fc9b803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:07.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.066+0000 7fc9beffd640 1 -- 172.21.15.84:0/2014680450 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9c00545e0 con 0x7fc9c8154080 2023-12-12T09:22:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.270+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc9c80ae710 con 0x7fc9c8154080 2023-12-12T09:22:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.271+0000 7fc9beffd640 1 -- 172.21.15.84:0/2014680450 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc9c0017020 con 0x7fc9c8154080 2023-12-12T09:22:07.272 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:22:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc9a806ae40 msgr2=0x7fc9a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc9a806ae40 0x7fc9a806d300 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8036000 tx=0x7fc9b803c040 comp rx=0 tx=0).stop 2023-12-12T09:22:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8154080 msgr2=0x7fc9c8159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:07.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8154080 0x7fc9c8159030 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000cbc0 tx=0x7fc9c000a430 comp rx=0 tx=0).stop 2023-12-12T09:22:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 shutdown_connections 2023-12-12T09:22:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc9a806ae40 0x7fc9a806d300 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9c8154080 0x7fc9c8159030 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9c80ce330 0x7fc9c8151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 --2- 172.21.15.84:0/2014680450 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc9c8071bb0 0x7fc9c812af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 >> 172.21.15.84:0/2014680450 conn(0x7fc9c806c3d0 msgr2=0x7fc9c8070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 shutdown_connections 2023-12-12T09:22:07.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:07.274+0000 7fc9ccb97640 1 -- 172.21.15.84:0/2014680450 wait complete. 2023-12-12T09:22:07.292 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:22:07.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:07.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:07.382 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[106038]: fuse finished with error 0 and tester_r 0 2023-12-12T09:22:07.387 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:22:13.489 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:22:13.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:13.489 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:22:13.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-12-12T09:22:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.776+0000 7fbb5b59e640 1 Processor -- start 2023-12-12T09:22:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.776+0000 7fbb5b59e640 1 -- start start 2023-12-12T09:22:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb5b59e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbb5c157790 0x7fbb5c070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb5b59e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb5c06c4d0 0x7fbb5c06da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb5b59e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c071230 con 0x7fbb5c15b000 2023-12-12T09:22:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb5b59e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c15a350 con 0x7fbb5c06c4d0 2023-12-12T09:22:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb5b59e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c15a560 con 0x7fbb5c157790 2023-12-12T09:22:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb53fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb5c06c4d0 0x7fbb5c06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb53fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbb5c06c4d0 0x7fbb5c06da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56720/0 (socket says 172.21.15.84:56720) 2023-12-12T09:22:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb53fff640 1 -- 172.21.15.84:0/3486170734 learned_addr learned my addr 172.21.15.84:0/3486170734 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb5a59c640 1 --2- 172.21.15.84:0/3486170734 >> v2:172.21.15.99:3300/0 conn(0x7fbb5c157790 0x7fbb5c070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb53fff640 1 -- 172.21.15.84:0/3486170734 >> v2:172.21.15.99:3300/0 conn(0x7fbb5c157790 msgr2=0x7fbb5c070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb53fff640 1 --2- 172.21.15.84:0/3486170734 >> v2:172.21.15.99:3300/0 conn(0x7fbb5c157790 0x7fbb5c070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb53fff640 1 -- 172.21.15.84:0/3486170734 >> v1:172.21.15.99:6789/0 conn(0x7fbb5c15b000 legacy=0x7fbb5c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.778+0000 7fbb53fff640 1 -- 172.21.15.84:0/3486170734 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0701f0 con 0x7fbb5c06c4d0 2023-12-12T09:22:13.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.780+0000 7fbb53fff640 1 --2- 172.21.15.84:0/3486170734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c06c4d0 0x7fbb5c06da10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0cc560 tx=0x7fbb4402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f37859b6f744b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.780+0000 7fbb59d9b640 1 -- 172.21.15.84:0/3486170734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4402ee90 con 0x7fbb5c06c4d0 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.780+0000 7fbb59d9b640 1 -- 172.21.15.84:0/3486170734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44036440 con 0x7fbb5c06c4d0 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.780+0000 7fbb59d9b640 1 -- 172.21.15.84:0/3486170734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440367d0 con 0x7fbb5c06c4d0 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.781+0000 7fbb5b59e640 1 -- 172.21.15.84:0/3486170734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c06c4d0 msgr2=0x7fbb5c06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.781+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/3486170734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c06c4d0 0x7fbb5c06da10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0cc560 tx=0x7fbb4402e0e0 comp rx=0 tx=0).stop 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.781+0000 7fbb5b59e640 1 -- 172.21.15.84:0/3486170734 shutdown_connections 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.781+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/3486170734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c06c4d0 0x7fbb5c06da10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.781+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/3486170734 >> v2:172.21.15.99:3300/0 conn(0x7fbb5c157790 0x7fbb5c070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.781+0000 7fbb5b59e640 1 -- 172.21.15.84:0/3486170734 >> 172.21.15.84:0/3486170734 conn(0x7fbb5c0cea50 msgr2=0x7fbb5c0cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.781+0000 7fbb5b59e640 1 -- 172.21.15.84:0/3486170734 shutdown_connections 2023-12-12T09:22:13.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.781+0000 7fbb5b59e640 1 -- 172.21.15.84:0/3486170734 wait complete. 2023-12-12T09:22:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.783+0000 7fbb5b59e640 1 Processor -- start 2023-12-12T09:22:13.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.783+0000 7fbb5b59e640 1 -- start start 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb5b59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c06c4d0 0x7fbb5c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb5b59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c157790 0x7fbb5c15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb5b59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb5c15b000 0x7fbb5c1484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb5b59e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c1471f0 con 0x7fbb5c157790 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb5b59e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c146f80 con 0x7fbb5c06c4d0 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb5b59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c15b990 con 0x7fbb5c15b000 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb53fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c157790 0x7fbb5c15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb53fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c157790 0x7fbb5c15b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56736/0 (socket says 172.21.15.84:56736) 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb53fff640 1 -- 172.21.15.84:0/862704796 learned_addr learned my addr 172.21.15.84:0/862704796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb53fff640 1 -- 172.21.15.84:0/862704796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb5c15b000 msgr2=0x7fbb5c1484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb53fff640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb5c15b000 0x7fbb5c1484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb53fff640 1 -- 172.21.15.84:0/862704796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c06c4d0 msgr2=0x7fbb5c146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:13.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb5a59c640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c06c4d0 0x7fbb5c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb53fff640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c06c4d0 0x7fbb5c146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.784+0000 7fbb53fff640 1 -- 172.21.15.84:0/862704796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4400b770 con 0x7fbb5c157790 2023-12-12T09:22:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.785+0000 7fbb53fff640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c157790 0x7fbb5c15b450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbb4402e120 tx=0x7fbb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.785+0000 7fbb52ffd640 1 -- 172.21.15.84:0/862704796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44034b80 con 0x7fbb5c157790 2023-12-12T09:22:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.785+0000 7fbb52ffd640 1 -- 172.21.15.84:0/862704796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44034d00 con 0x7fbb5c157790 2023-12-12T09:22:13.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.785+0000 7fbb52ffd640 1 -- 172.21.15.84:0/862704796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44041680 con 0x7fbb5c157790 2023-12-12T09:22:13.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.785+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c147400 con 0x7fbb5c157790 2023-12-12T09:22:13.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.785+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c1479c0 con 0x7fbb5c157790 2023-12-12T09:22:13.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.786+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c0745a0 con 0x7fbb5c157790 2023-12-12T09:22:13.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.787+0000 7fbb52ffd640 1 -- 172.21.15.84:0/862704796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb440403e0 con 0x7fbb5c157790 2023-12-12T09:22:13.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.788+0000 7fbb52ffd640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb3c06ae70 0x7fbb3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:13.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.788+0000 7fbb52ffd640 1 -- 172.21.15.84:0/862704796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fbb440abe30 con 0x7fbb5c157790 2023-12-12T09:22:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.789+0000 7fbb5a59c640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb3c06ae70 0x7fbb3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:13.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.789+0000 7fbb5a59c640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb3c06ae70 0x7fbb3c06d330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c006fd0 tx=0x7fbb4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:13.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:13.793+0000 7fbb52ffd640 1 -- 172.21.15.84:0/862704796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb44076b70 con 0x7fbb5c157790 2023-12-12T09:22:14.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.051+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7fbb5c04e840 con 0x7fbb5c157790 2023-12-12T09:22:14.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.056+0000 7fbb52ffd640 1 -- 172.21.15.84:0/862704796 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v15) v1 ==== 211+0+168 (secure 0 0 0) 0x7fbb4403b100 con 0x7fbb5c157790 2023-12-12T09:22:14.057 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:22:14.057 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:22:14.058 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow rwp" 2023-12-12T09:22:14.058 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-12-12T09:22:14.058 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw pool=cephfs_data,allow rw pool=data_new" 2023-12-12T09:22:14.058 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb3c06ae70 msgr2=0x7fbb3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb3c06ae70 0x7fbb3c06d330 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c006fd0 tx=0x7fbb4c008040 comp rx=0 tx=0).stop 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c157790 msgr2=0x7fbb5c15b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c157790 0x7fbb5c15b450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbb4402e120 tx=0x7fbb440046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 shutdown_connections 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb5c15b000 0x7fbb5c1484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb3c06ae70 0x7fbb3c06d330 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb5c157790 0x7fbb5c15b450 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 --2- 172.21.15.84:0/862704796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb5c06c4d0 0x7fbb5c146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 >> 172.21.15.84:0/862704796 conn(0x7fbb5c0cea50 msgr2=0x7fbb5c0cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:14.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 shutdown_connections 2023-12-12T09:22:14.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.059+0000 7fbb5b59e640 1 -- 172.21.15.84:0/862704796 wait complete. 2023-12-12T09:22:14.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:22:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.295+0000 7f1dbaacf640 1 Processor -- start 2023-12-12T09:22:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.295+0000 7f1dbaacf640 1 -- start start 2023-12-12T09:22:14.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.296+0000 7f1dbaacf640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1db4071bb0 0x7f1db4071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:14.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.296+0000 7f1dbaacf640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1db40ce330 0x7f1db413d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:14.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.296+0000 7f1dbaacf640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db40724d0 con 0x7f1db40ce7c0 2023-12-12T09:22:14.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.296+0000 7f1dbaacf640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db4140270 con 0x7f1db40ce330 2023-12-12T09:22:14.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.296+0000 7f1dbaacf640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db40cd850 con 0x7f1db4071bb0 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db3fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1db40ce330 0x7f1db413d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db3fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1db40ce330 0x7f1db413d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56742/0 (socket says 172.21.15.84:56742) 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db3fff640 1 -- 172.21.15.84:0/3605773639 learned_addr learned my addr 172.21.15.84:0/3605773639 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db3fff640 1 -- 172.21.15.84:0/3605773639 >> v2:172.21.15.99:3300/0 conn(0x7f1db4071bb0 msgr2=0x7f1db4071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db886b640 1 --2- 172.21.15.84:0/3605773639 >> v2:172.21.15.99:3300/0 conn(0x7f1db4071bb0 0x7f1db4071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db3fff640 1 --2- 172.21.15.84:0/3605773639 >> v2:172.21.15.99:3300/0 conn(0x7f1db4071bb0 0x7f1db4071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db3fff640 1 -- 172.21.15.84:0/3605773639 >> v1:172.21.15.84:6789/0 conn(0x7f1db40ce7c0 legacy=0x7f1db413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db3fff640 1 -- 172.21.15.84:0/3605773639 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40cdb30 con 0x7f1db40ce330 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db37fe640 1 -- 172.21.15.84:0/3605773639 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915496720 0 0) 0x7f1db40724d0 con 0x7f1db40ce7c0 2023-12-12T09:22:14.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.297+0000 7f1db886b640 1 --2- 172.21.15.84:0/3605773639 >> v2:172.21.15.99:3300/0 conn(0x7f1db4071bb0 0x7f1db4071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:14.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.298+0000 7f1db3fff640 1 --2- 172.21.15.84:0/3605773639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce330 0x7f1db413d3d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1db40744b0 tx=0x7f1da002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fe1e174cde8bdc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1db37fe640 1 -- 172.21.15.84:0/3605773639 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0030870 con 0x7f1db40ce330 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1db37fe640 1 -- 172.21.15.84:0/3605773639 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da00309d0 con 0x7f1db40ce330 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1db37fe640 1 -- 172.21.15.84:0/3605773639 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0030d60 con 0x7f1db40ce330 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1dbaacf640 1 -- 172.21.15.84:0/3605773639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce330 msgr2=0x7f1db413d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/3605773639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce330 0x7f1db413d3d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1db40744b0 tx=0x7f1da002b9b0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1dbaacf640 1 -- 172.21.15.84:0/3605773639 shutdown_connections 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/3605773639 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce330 0x7f1db413d3d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/3605773639 >> v2:172.21.15.99:3300/0 conn(0x7f1db4071bb0 0x7f1db4071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1dbaacf640 1 -- 172.21.15.84:0/3605773639 >> 172.21.15.84:0/3605773639 conn(0x7f1db406c3d0 msgr2=0x7f1db406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1dbaacf640 1 -- 172.21.15.84:0/3605773639 shutdown_connections 2023-12-12T09:22:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.299+0000 7f1dbaacf640 1 -- 172.21.15.84:0/3605773639 wait complete. 2023-12-12T09:22:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.301+0000 7f1dbaacf640 1 Processor -- start 2023-12-12T09:22:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.301+0000 7f1dbaacf640 1 -- start start 2023-12-12T09:22:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1dbaacf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1db4071bb0 0x7f1db414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1dbaacf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1db40ce330 0x7f1db40afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1dbaacf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce7c0 0x7f1db40aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1dbaacf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4152f80 con 0x7f1db40ce7c0 2023-12-12T09:22:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1dbaacf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4152370 con 0x7f1db4071bb0 2023-12-12T09:22:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1dbaacf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4152650 con 0x7f1db40ce330 2023-12-12T09:22:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1db906c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce7c0 0x7f1db40aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1db906c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce7c0 0x7f1db40aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56744/0 (socket says 172.21.15.84:56744) 2023-12-12T09:22:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.302+0000 7f1db906c640 1 -- 172.21.15.84:0/2034298126 learned_addr learned my addr 172.21.15.84:0/2034298126 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db886b640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1db4071bb0 0x7f1db414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db906c640 1 -- 172.21.15.84:0/2034298126 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1db40ce330 msgr2=0x7f1db40afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db906c640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1db40ce330 0x7f1db40afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db906c640 1 -- 172.21.15.84:0/2034298126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1db4071bb0 msgr2=0x7f1db414f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db906c640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1db4071bb0 0x7f1db414f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db906c640 1 -- 172.21.15.84:0/2034298126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00094d0 con 0x7f1db40ce7c0 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db906c640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce7c0 0x7f1db40aff60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1dac001560 tx=0x7f1dac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db17fa640 1 -- 172.21.15.84:0/2034298126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac003da0 con 0x7f1db40ce7c0 2023-12-12T09:22:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db17fa640 1 -- 172.21.15.84:0/2034298126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac005070 con 0x7f1db40ce7c0 2023-12-12T09:22:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1db17fa640 1 -- 172.21.15.84:0/2034298126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac005420 con 0x7f1db40ce7c0 2023-12-12T09:22:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db4152930 con 0x7f1db40ce7c0 2023-12-12T09:22:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.303+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db414fb50 con 0x7f1db40ce7c0 2023-12-12T09:22:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.304+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db40ccdd0 con 0x7f1db40ce7c0 2023-12-12T09:22:14.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.305+0000 7f1db17fa640 1 -- 172.21.15.84:0/2034298126 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dac005580 con 0x7f1db40ce7c0 2023-12-12T09:22:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.306+0000 7f1db17fa640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1d9806ae40 0x7f1d9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:14.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.306+0000 7f1db17fa640 1 -- 172.21.15.84:0/2034298126 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f1dac089230 con 0x7f1db40ce7c0 2023-12-12T09:22:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.307+0000 7f1db886b640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1d9806ae40 0x7f1d9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:14.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.307+0000 7f1db886b640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1d9806ae40 0x7f1d9806d300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1da800b840 tx=0x7f1da8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:14.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.311+0000 7f1db17fa640 1 -- 172.21.15.84:0/2034298126 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1dac053f70 con 0x7f1db40ce7c0 2023-12-12T09:22:14.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.538+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1db40673c0 con 0x7f1db40ce7c0 2023-12-12T09:22:14.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.539+0000 7f1db17fa640 1 -- 172.21.15.84:0/2034298126 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+82 (secure 0 0 0) 0x7f1dac017070 con 0x7f1db40ce7c0 2023-12-12T09:22:14.541 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1d9806ae40 msgr2=0x7f1d9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1d9806ae40 0x7f1d9806d300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1da800b840 tx=0x7f1da8008040 comp rx=0 tx=0).stop 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce7c0 msgr2=0x7f1db40aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce7c0 0x7f1db40aff60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1dac001560 tx=0x7f1dac00cc70 comp rx=0 tx=0).stop 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 shutdown_connections 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1d9806ae40 0x7f1d9806d300 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1db40ce7c0 0x7f1db40aff60 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1db40ce330 0x7f1db40afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 --2- 172.21.15.84:0/2034298126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1db4071bb0 0x7f1db414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 >> 172.21.15.84:0/2034298126 conn(0x7f1db406c3d0 msgr2=0x7f1db406d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.542+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 shutdown_connections 2023-12-12T09:22:14.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:14.543+0000 7f1dbaacf640 1 -- 172.21.15.84:0/2034298126 wait complete. 2023-12-12T09:22:14.563 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:22:14.563 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:22:14.563 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:22:14.563 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:22:14.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:14.564 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:22:14.564 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:22:14.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:22:14.564 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:22:14.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:14.564 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:22:14.613 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:22:14.613 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:22:14.613 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:22:14.614 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42069sec preferred_lft 42069sec 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c8b:52ff:fef6:cd60/64 scope link 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c2:ab:b4:6c:14:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c0ab:b4ff:fe6c:1499/64 scope link 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:14.615 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:22:14.616 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:14.616 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3c57:6bff:fed3:b000/64 scope link 2023-12-12T09:22:14.616 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:22:14.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:14.617 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:22:14.697 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:22:14.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:14.701 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:22:14.751 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:22:14.751 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:22:14.751 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:22:14.751 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:22:14.751 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:22:14.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:14.753 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:22:14.753 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:22:14.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:22:14.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:22:14.753 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:22:14.753 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:22:14.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:14.930 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:22:14.981 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:22:14.981 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T09:22:14.981 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:22:14.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:14.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-12-12T09:22:15.071 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T09:22:15.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:22:15.071 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:15.126 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:22:15.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:22:15.126 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:15.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:22:15.314 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:22:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:22:15.373 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:22:15.374 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:22:15.374 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:22:15.374 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:22:15.374 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:15.374 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:15.374 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:15.374 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:15.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:15.375 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:22:15.426 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:22:15.426 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T09:22:15.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:22:15.508 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:22:15.549 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:22:15.549 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:22:15.550 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:15.551 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:22:15.552 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:15.552 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:22:15.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:15.553 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:22:15.618 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-12-12T09:22:15.616+0000 7f6ef603d480 -1 init, newargv = 0x55d88fbb8910 newargc=15 2023-12-12T09:22:15.618 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[107102]: starting ceph client 2023-12-12T09:22:15.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[107102]: starting fuse 2023-12-12T09:22:15.643 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:22:15.643 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-12T09:22:15.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:22:15.643 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:22:15.644 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:22:15.645 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:22:15.645 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:22:15.645 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:22:15.645 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:22:15.645 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:22:15.645 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:22:15.645 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-12-12T09:22:15.645 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:22:15.845 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.107102.asok 2023-12-12T09:22:15.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:22:15.862 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.107102.asok 2023-12-12T09:22:15.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:15.862 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.107102.asok status 2023-12-12T09:22:16.101 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:22:16.101 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:22:16.101 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:22:16.101 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:22:16.101 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-12-12T09:22:16.101 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:22:16.101 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "107102", 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5985, 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 5985 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:22:16.102 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1489962414 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1489962414 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.5985 192.168.0.1:0/1489962414", 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/1489962414", 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 18, 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 44, 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:22:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:22:16.104 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:22:16.104 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:22:16.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:16.116 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:22:16.116 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:16.172 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:22:16.172 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:16.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:16.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:16.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:16.267 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-12-12T09:22:16.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:16.324 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-12-12T09:22:16.389 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:22:16.389 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:16.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.656+0000 7f2faea31640 1 Processor -- start 2023-12-12T09:22:16.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.657+0000 7f2faea31640 1 -- start start 2023-12-12T09:22:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.658+0000 7f2faea31640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa8143d20 0x7f2fa80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.658+0000 7f2faea31640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fa80ce550 0x7f2fa80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.658+0000 7f2faea31640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2fa81447f0 0x7f2fa815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.658+0000 7f2faea31640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa80cea30 con 0x7f2fa80ce550 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.658+0000 7f2faea31640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa80702b0 con 0x7f2fa81447f0 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.658+0000 7f2faea31640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8070590 con 0x7f2fa8143d20 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2f9f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fa80ce550 0x7f2fa80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2f9f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fa80ce550 0x7f2fa80b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42964/0 (socket says 172.21.15.84:42964) 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2f9f7fe640 1 -- 172.21.15.84:0/60992299 learned_addr learned my addr 172.21.15.84:0/60992299 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2fa7fff640 1 --2- 172.21.15.84:0/60992299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa8143d20 0x7f2fa80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2facfce640 1 --2- 172.21.15.84:0/60992299 >> v2:172.21.15.99:3300/0 conn(0x7f2fa81447f0 0x7f2fa815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2f9f7fe640 1 -- 172.21.15.84:0/60992299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa8143d20 msgr2=0x7f2fa80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2f9f7fe640 1 --2- 172.21.15.84:0/60992299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa8143d20 0x7f2fa80b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2f9f7fe640 1 -- 172.21.15.84:0/60992299 >> v2:172.21.15.99:3300/0 conn(0x7f2fa81447f0 msgr2=0x7f2fa815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2f9f7fe640 1 --2- 172.21.15.84:0/60992299 >> v2:172.21.15.99:3300/0 conn(0x7f2fa81447f0 0x7f2fa815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.659+0000 7f2f9f7fe640 1 -- 172.21.15.84:0/60992299 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8070870 con 0x7f2fa80ce550 2023-12-12T09:22:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.661+0000 7f2f9f7fe640 1 --2- 172.21.15.84:0/60992299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa80ce550 0x7f2fa80b4610 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80b1e50 tx=0x7f2f9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63423c2b9629bfd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.661+0000 7f2fa77fe640 1 -- 172.21.15.84:0/60992299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90031870 con 0x7f2fa80ce550 2023-12-12T09:22:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.661+0000 7f2fa77fe640 1 -- 172.21.15.84:0/60992299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900319d0 con 0x7f2fa80ce550 2023-12-12T09:22:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.661+0000 7f2fa77fe640 1 -- 172.21.15.84:0/60992299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90031d60 con 0x7f2fa80ce550 2023-12-12T09:22:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 -- 172.21.15.84:0/60992299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa80ce550 msgr2=0x7f2fa80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 --2- 172.21.15.84:0/60992299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa80ce550 0x7f2fa80b4610 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80b1e50 tx=0x7f2f9002b910 comp rx=0 tx=0).stop 2023-12-12T09:22:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 -- 172.21.15.84:0/60992299 shutdown_connections 2023-12-12T09:22:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 --2- 172.21.15.84:0/60992299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa80ce550 0x7f2fa80b4610 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 --2- 172.21.15.84:0/60992299 >> v2:172.21.15.99:3300/0 conn(0x7f2fa81447f0 0x7f2fa815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 --2- 172.21.15.84:0/60992299 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa8143d20 0x7f2fa80b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 -- 172.21.15.84:0/60992299 >> 172.21.15.84:0/60992299 conn(0x7f2fa806c3d0 msgr2=0x7f2fa806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 -- 172.21.15.84:0/60992299 shutdown_connections 2023-12-12T09:22:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.662+0000 7f2faea31640 1 -- 172.21.15.84:0/60992299 wait complete. 2023-12-12T09:22:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.664+0000 7f2faea31640 1 Processor -- start 2023-12-12T09:22:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.664+0000 7f2faea31640 1 -- start start 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.665+0000 7f2faea31640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fa80ce550 0x7f2fa81f1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2faea31640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa8143d20 0x7f2fa815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2faea31640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa81447f0 0x7f2fa815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2faea31640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa815e7f0 con 0x7f2fa8143d20 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2faea31640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa813acd0 con 0x7f2fa80ce550 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2faea31640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa813afb0 con 0x7f2fa81447f0 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa8143d20 0x7f2fa815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa8143d20 0x7f2fa815dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42968/0 (socket says 172.21.15.84:42968) 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2f9f7fe640 1 -- 172.21.15.84:0/4247316417 learned_addr learned my addr 172.21.15.84:0/4247316417 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2fa7fff640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fa80ce550 0x7f2fa81f1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:16.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2f9f7fe640 1 -- 172.21.15.84:0/4247316417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa81447f0 msgr2=0x7f2fa815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:16.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2f9f7fe640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa81447f0 0x7f2fa815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2f9f7fe640 1 -- 172.21.15.84:0/4247316417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fa80ce550 msgr2=0x7f2fa81f1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:16.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2f9f7fe640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fa80ce550 0x7f2fa81f1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.666+0000 7f2f9f7fe640 1 -- 172.21.15.84:0/4247316417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f900094d0 con 0x7f2fa8143d20 2023-12-12T09:22:16.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.667+0000 7f2f9f7fe640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa8143d20 0x7f2fa815dd70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2f9002b950 tx=0x7f2f900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:16.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.667+0000 7f2fa57fa640 1 -- 172.21.15.84:0/4247316417 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9003ad30 con 0x7f2fa8143d20 2023-12-12T09:22:16.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.667+0000 7f2fa57fa640 1 -- 172.21.15.84:0/4247316417 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f900443f0 con 0x7f2fa8143d20 2023-12-12T09:22:16.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.667+0000 7f2fa57fa640 1 -- 172.21.15.84:0/4247316417 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900447a0 con 0x7f2fa8143d20 2023-12-12T09:22:16.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.667+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa813b290 con 0x7f2fa8143d20 2023-12-12T09:22:16.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.667+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa81f1760 con 0x7f2fa8143d20 2023-12-12T09:22:16.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.668+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa80673c0 con 0x7f2fa8143d20 2023-12-12T09:22:16.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.669+0000 7f2fa57fa640 1 -- 172.21.15.84:0/4247316417 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f90044900 con 0x7f2fa8143d20 2023-12-12T09:22:16.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.670+0000 7f2fa57fa640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2f8806ae40 0x7f2f8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:16.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.670+0000 7f2fa57fa640 1 -- 172.21.15.84:0/4247316417 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f2f9002d040 con 0x7f2fa8143d20 2023-12-12T09:22:16.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.671+0000 7f2fa7fff640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2f8806ae40 0x7f2f8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:16.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.671+0000 7f2fa7fff640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2f8806ae40 0x7f2f8806d300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2fa806d5b0 tx=0x7f2f9800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:16.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.675+0000 7f2fa57fa640 1 -- 172.21.15.84:0/4247316417 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f90076d70 con 0x7f2fa8143d20 2023-12-12T09:22:16.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.865+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fa806e3b0 con 0x7f2fa8143d20 2023-12-12T09:22:16.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.869+0000 7f2fa57fa640 1 -- 172.21.15.84:0/4247316417 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7f2f900ad020 con 0x7f2fa8143d20 2023-12-12T09:22:16.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:16.871 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.871+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2f8806ae40 msgr2=0x7f2f8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.871+0000 7f2faea31640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2f8806ae40 0x7f2f8806d300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2fa806d5b0 tx=0x7f2f9800b040 comp rx=0 tx=0).stop 2023-12-12T09:22:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.871+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa8143d20 msgr2=0x7f2fa815dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.871+0000 7f2faea31640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa8143d20 0x7f2fa815dd70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2f9002b950 tx=0x7f2f900046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.872+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 shutdown_connections 2023-12-12T09:22:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.872+0000 7f2faea31640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2fa81447f0 0x7f2fa815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.872+0000 7f2faea31640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2f8806ae40 0x7f2f8806d300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.872+0000 7f2faea31640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fa8143d20 0x7f2fa815dd70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.872+0000 7f2faea31640 1 --2- 172.21.15.84:0/4247316417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2fa80ce550 0x7f2fa81f1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.872+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 >> 172.21.15.84:0/4247316417 conn(0x7f2fa806c3d0 msgr2=0x7f2fa815ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.872+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 shutdown_connections 2023-12-12T09:22:16.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:16.872+0000 7f2faea31640 1 -- 172.21.15.84:0/4247316417 wait complete. 2023-12-12T09:22:16.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:21:28.519227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:21:29.210161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-12T09:21:44.988386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:22:16.893 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:22:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.104+0000 7f7e55a1e640 1 Processor -- start 2023-12-12T09:22:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.104+0000 7f7e55a1e640 1 -- start start 2023-12-12T09:22:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.105+0000 7f7e55a1e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014a4a0 0x7f7e5006d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.105+0000 7f7e55a1e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7e5014af70 0x7f7e5006d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.105+0000 7f7e55a1e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e5014aa20 0x7f7e50165280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e55a1e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5014a880 con 0x7f7e5014aa20 2023-12-12T09:22:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e55a1e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e50070730 con 0x7f7e5014af70 2023-12-12T09:22:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e55a1e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500b1f60 con 0x7f7e5014a4a0 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e5014aa20 0x7f7e50165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7e5014aa20 0x7f7e50165280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42972/0 (socket says 172.21.15.84:42972) 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4f7fe640 1 -- 172.21.15.84:0/3580095331 learned_addr learned my addr 172.21.15.84:0/3580095331 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4effd640 1 --2- 172.21.15.84:0/3580095331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014a4a0 0x7f7e5006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4f7fe640 1 -- 172.21.15.84:0/3580095331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014a4a0 msgr2=0x7f7e5006d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e47fff640 1 --2- 172.21.15.84:0/3580095331 >> v2:172.21.15.99:3300/0 conn(0x7f7e5014af70 0x7f7e5006d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4f7fe640 1 --2- 172.21.15.84:0/3580095331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014a4a0 0x7f7e5006d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4f7fe640 1 -- 172.21.15.84:0/3580095331 >> v2:172.21.15.99:3300/0 conn(0x7f7e5014af70 msgr2=0x7f7e5006d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4f7fe640 1 --2- 172.21.15.84:0/3580095331 >> v2:172.21.15.99:3300/0 conn(0x7f7e5014af70 0x7f7e5006d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4f7fe640 1 -- 172.21.15.84:0/3580095331 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e500700e0 con 0x7f7e5014aa20 2023-12-12T09:22:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.106+0000 7f7e4effd640 1 --2- 172.21.15.84:0/3580095331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014a4a0 0x7f7e5006d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.107+0000 7f7e4f7fe640 1 --2- 172.21.15.84:0/3580095331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014aa20 0x7f7e50165280 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7e5006b470 tx=0x7f7e4802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9d960fe959fcd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e4e7fc640 1 -- 172.21.15.84:0/3580095331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4802c9e0 con 0x7f7e5014aa20 2023-12-12T09:22:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e4e7fc640 1 -- 172.21.15.84:0/3580095331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4802cb40 con 0x7f7e5014aa20 2023-12-12T09:22:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e4e7fc640 1 -- 172.21.15.84:0/3580095331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e480343f0 con 0x7f7e5014aa20 2023-12-12T09:22:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e55a1e640 1 -- 172.21.15.84:0/3580095331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014aa20 msgr2=0x7f7e50165280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/3580095331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014aa20 0x7f7e50165280 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7e5006b470 tx=0x7f7e4802be40 comp rx=0 tx=0).stop 2023-12-12T09:22:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e55a1e640 1 -- 172.21.15.84:0/3580095331 shutdown_connections 2023-12-12T09:22:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/3580095331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014aa20 0x7f7e50165280 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/3580095331 >> v2:172.21.15.99:3300/0 conn(0x7f7e5014af70 0x7f7e5006d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/3580095331 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014a4a0 0x7f7e5006d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.108+0000 7f7e55a1e640 1 -- 172.21.15.84:0/3580095331 >> 172.21.15.84:0/3580095331 conn(0x7f7e500b0ac0 msgr2=0x7f7e500b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.109+0000 7f7e55a1e640 1 -- 172.21.15.84:0/3580095331 shutdown_connections 2023-12-12T09:22:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.109+0000 7f7e55a1e640 1 -- 172.21.15.84:0/3580095331 wait complete. 2023-12-12T09:22:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.110+0000 7f7e55a1e640 1 Processor -- start 2023-12-12T09:22:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.110+0000 7f7e55a1e640 1 -- start start 2023-12-12T09:22:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.111+0000 7f7e55a1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5014a4a0 0x7f7e501f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.111+0000 7f7e55a1e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014aa20 0x7f7e501ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.111+0000 7f7e55a1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014af70 0x7f7e501ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.111+0000 7f7e55a1e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500ae7c0 con 0x7f7e5014af70 2023-12-12T09:22:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.111+0000 7f7e55a1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e501fbac0 con 0x7f7e5014a4a0 2023-12-12T09:22:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.111+0000 7f7e55a1e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e501f76f0 con 0x7f7e5014aa20 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014af70 0x7f7e501ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014af70 0x7f7e501ecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42974/0 (socket says 172.21.15.84:42974) 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 -- 172.21.15.84:0/100433180 learned_addr learned my addr 172.21.15.84:0/100433180 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4effd640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5014a4a0 0x7f7e501f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e47fff640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014aa20 0x7f7e501ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 -- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014aa20 msgr2=0x7f7e501ec9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014aa20 0x7f7e501ec9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 -- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5014a4a0 msgr2=0x7f7e501f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5014a4a0 0x7f7e501f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 -- 172.21.15.84:0/100433180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48009b30 con 0x7f7e5014af70 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e47fff640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014aa20 0x7f7e501ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.112+0000 7f7e4f7fe640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014af70 0x7f7e501ecf30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7e48036040 tx=0x7f7e48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.113+0000 7f7e4cff9640 1 -- 172.21.15.84:0/100433180 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4803e450 con 0x7f7e5014af70 2023-12-12T09:22:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.113+0000 7f7e4cff9640 1 -- 172.21.15.84:0/100433180 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4803e5d0 con 0x7f7e5014af70 2023-12-12T09:22:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.113+0000 7f7e4cff9640 1 -- 172.21.15.84:0/100433180 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4803e980 con 0x7f7e5014af70 2023-12-12T09:22:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.113+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e501f79d0 con 0x7f7e5014af70 2023-12-12T09:22:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.113+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e501f7f90 con 0x7f7e5014af70 2023-12-12T09:22:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.114+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e500673c0 con 0x7f7e5014af70 2023-12-12T09:22:17.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.115+0000 7f7e4cff9640 1 -- 172.21.15.84:0/100433180 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e4803eae0 con 0x7f7e5014af70 2023-12-12T09:22:17.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.116+0000 7f7e4cff9640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7e3006ae40 0x7f7e3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.116+0000 7f7e4cff9640 1 -- 172.21.15.84:0/100433180 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f7e480ac870 con 0x7f7e5014af70 2023-12-12T09:22:17.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.116+0000 7f7e4effd640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7e3006ae40 0x7f7e3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.117+0000 7f7e4effd640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7e3006ae40 0x7f7e3006d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006b10 tx=0x7f7e40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:17.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.121+0000 7f7e4cff9640 1 -- 172.21.15.84:0/100433180 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e480775b0 con 0x7f7e5014af70 2023-12-12T09:22:17.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.312+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e500aa520 con 0x7f7e5014af70 2023-12-12T09:22:17.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.313+0000 7f7e4cff9640 1 -- 172.21.15.84:0/100433180 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e4807abd0 con 0x7f7e5014af70 2023-12-12T09:22:17.315 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:22:17.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7e3006ae40 msgr2=0x7f7e3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7e3006ae40 0x7f7e3006d300 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006b10 tx=0x7f7e40008040 comp rx=0 tx=0).stop 2023-12-12T09:22:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014af70 msgr2=0x7f7e501ecf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014af70 0x7f7e501ecf30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7e48036040 tx=0x7f7e48004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 shutdown_connections 2023-12-12T09:22:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7e3006ae40 0x7f7e3006d300 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e5014af70 0x7f7e501ecf30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7e5014aa20 0x7f7e501ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 --2- 172.21.15.84:0/100433180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5014a4a0 0x7f7e501f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 >> 172.21.15.84:0/100433180 conn(0x7f7e500b0ac0 msgr2=0x7f7e50147e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:17.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 shutdown_connections 2023-12-12T09:22:17.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.316+0000 7f7e55a1e640 1 -- 172.21.15.84:0/100433180 wait complete. 2023-12-12T09:22:17.335 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:22:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.546+0000 7f307867c640 1 Processor -- start 2023-12-12T09:22:17.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.546+0000 7f307867c640 1 -- start start 2023-12-12T09:22:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.548+0000 7f307867c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f30700cde40 0x7f30700ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.548+0000 7f307867c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3070155a70 con 0x7f307015b4f0 2023-12-12T09:22:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.548+0000 7f307867c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307015c120 con 0x7f3070155690 2023-12-12T09:22:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.548+0000 7f307867c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30700ce830 con 0x7f30700cde40 2023-12-12T09:22:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.548+0000 7f3076c19640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f307015b4f0 0x7f307015b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36476/0 (socket says 172.21.15.84:36476) 2023-12-12T09:22:17.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.548+0000 7f3076c19640 1 -- 172.21.15.84:0/3195583666 learned_addr learned my addr 172.21.15.84:0/3195583666 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075c17640 1 --2- 172.21.15.84:0/3195583666 >> v2:172.21.15.99:3300/0 conn(0x7f30700cde40 0x7f30700ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474057859 0 0) 0x7f3070155a70 con 0x7f307015b4f0 2023-12-12T09:22:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f305c003520 con 0x7f307015b4f0 2023-12-12T09:22:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610888624 0 0) 0x7f305c003520 con 0x7f307015b4f0 2023-12-12T09:22:17.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 >> v2:172.21.15.99:3300/0 conn(0x7f30700cde40 msgr2=0x7f30700ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 --2- 172.21.15.84:0/3195583666 >> v2:172.21.15.99:3300/0 conn(0x7f30700cde40 0x7f30700ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 >> v1:172.21.15.99:6789/0 conn(0x7f3070155690 legacy=0x7f307006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307015c400 con 0x7f307015b4f0 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f30680019f0 con 0x7f307015b4f0 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075c17640 1 --2- 172.21.15.84:0/3195583666 >> v2:172.21.15.99:3300/0 conn(0x7f30700cde40 0x7f30700ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 >> v1:172.21.15.84:6789/0 conn(0x7f307015b4f0 legacy=0x7f307015b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f305c003970 0x7f305c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.549+0000 7f3075416640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0047c0 0x7f305c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075416640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c005180 0x7f305c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700ce830 con 0x7f305c0047c0 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c00c0d0 con 0x7f305c005180 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c00c290 con 0x7f305c003970 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075c17640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0047c0 0x7f305c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3076418640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f305c003970 0x7f305c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3076c19640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c005180 0x7f305c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075c17640 1 -- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f305c003970 msgr2=0x7f305c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075c17640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f305c003970 0x7f305c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075c17640 1 -- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c005180 msgr2=0x7f305c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075c17640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c005180 0x7f305c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3075c17640 1 -- 172.21.15.84:0/3195583666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c003520 con 0x7f305c0047c0 2023-12-12T09:22:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3076c19640 1 -- 172.21.15.84:0/3195583666 reap_dead start 2023-12-12T09:22:17.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.550+0000 7f3076418640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f305c003970 0x7f305c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.551+0000 7f3075c17640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0047c0 0x7f305c004c40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f30600098a0 tx=0x7f305c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0674c293a013ba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060004230 con 0x7f305c0047c0 2023-12-12T09:22:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060004390 con 0x7f305c0047c0 2023-12-12T09:22:17.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f3075416640 1 -- 172.21.15.84:0/3195583666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060003830 con 0x7f305c0047c0 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f307867c640 1 -- 172.21.15.84:0/3195583666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0047c0 msgr2=0x7f305c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f307867c640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0047c0 0x7f305c004c40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f30600098a0 tx=0x7f305c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f307867c640 1 -- 172.21.15.84:0/3195583666 shutdown_connections 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f307867c640 1 --2- 172.21.15.84:0/3195583666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f305c0047c0 0x7f305c004c40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f307867c640 1 -- 172.21.15.84:0/3195583666 >> 172.21.15.84:0/3195583666 conn(0x7f30700b0900 msgr2=0x7f30700b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f307867c640 1 -- 172.21.15.84:0/3195583666 shutdown_connections 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.552+0000 7f307867c640 1 -- 172.21.15.84:0/3195583666 wait complete. 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.554+0000 7f307867c640 1 Processor -- start 2023-12-12T09:22:17.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.554+0000 7f307867c640 1 -- start start 2023-12-12T09:22:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.555+0000 7f307867c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c0047c0 0x7f307014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.555+0000 7f307867c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3070151390 0x7f3070151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.555+0000 7f307867c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30701521a0 0x7f3070152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.555+0000 7f307867c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070152b60 con 0x7f30701521a0 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.555+0000 7f307867c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3070155a70 con 0x7f305c0047c0 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.555+0000 7f307867c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3070155cc0 con 0x7f3070151390 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30701521a0 0x7f3070152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30701521a0 0x7f3070152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42994/0 (socket says 172.21.15.84:42994) 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 -- 172.21.15.84:0/4280068547 learned_addr learned my addr 172.21.15.84:0/4280068547 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076418640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c0047c0 0x7f307014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3075c17640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3070151390 0x7f3070151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 -- 172.21.15.84:0/4280068547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3070151390 msgr2=0x7f3070151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3070151390 0x7f3070151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 -- 172.21.15.84:0/4280068547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c0047c0 msgr2=0x7f307014cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c0047c0 0x7f307014cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 -- 172.21.15.84:0/4280068547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3070155fa0 con 0x7f30701521a0 2023-12-12T09:22:17.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.556+0000 7f3076c19640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30701521a0 0x7f3070152620 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f30700b40d0 tx=0x7f306800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.557+0000 7f3066ffd640 1 -- 172.21.15.84:0/4280068547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800eb10 con 0x7f30701521a0 2023-12-12T09:22:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.557+0000 7f3066ffd640 1 -- 172.21.15.84:0/4280068547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800ec70 con 0x7f30701521a0 2023-12-12T09:22:17.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.557+0000 7f3066ffd640 1 -- 172.21.15.84:0/4280068547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068013420 con 0x7f30701521a0 2023-12-12T09:22:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.557+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3070156280 con 0x7f30701521a0 2023-12-12T09:22:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.557+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307014d100 con 0x7f30701521a0 2023-12-12T09:22:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.558+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3070158d90 con 0x7f30701521a0 2023-12-12T09:22:17.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.559+0000 7f3066ffd640 1 -- 172.21.15.84:0/4280068547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3068013580 con 0x7f30701521a0 2023-12-12T09:22:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.560+0000 7f3066ffd640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f305406ae70 0x7f305406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.560+0000 7f3066ffd640 1 -- 172.21.15.84:0/4280068547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f3068089bb0 con 0x7f30701521a0 2023-12-12T09:22:17.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.560+0000 7f3076418640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f305406ae70 0x7f305406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.561+0000 7f3076418640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f305406ae70 0x7f305406d330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3070069200 tx=0x7f306c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:17.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.565+0000 7f3066ffd640 1 -- 172.21.15.84:0/4280068547 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3068058410 con 0x7f30701521a0 2023-12-12T09:22:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.754+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30701567a0 con 0x7f30701521a0 2023-12-12T09:22:17.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.755+0000 7f3066ffd640 1 -- 172.21.15.84:0/4280068547 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30701567a0 con 0x7f30701521a0 2023-12-12T09:22:17.756 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f305406ae70 msgr2=0x7f305406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f305406ae70 0x7f305406d330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3070069200 tx=0x7f306c009040 comp rx=0 tx=0).stop 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30701521a0 msgr2=0x7f3070152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30701521a0 0x7f3070152620 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f30700b40d0 tx=0x7f306800e530 comp rx=0 tx=0).stop 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 shutdown_connections 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f305406ae70 0x7f305406d330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30701521a0 0x7f3070152620 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3070151390 0x7f3070151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 --2- 172.21.15.84:0/4280068547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f305c0047c0 0x7f307014cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:17.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 >> 172.21.15.84:0/4280068547 conn(0x7f30700b0900 msgr2=0x7f30700ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:17.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 shutdown_connections 2023-12-12T09:22:17.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.758+0000 7f307867c640 1 -- 172.21.15.84:0/4280068547 wait complete. 2023-12-12T09:22:17.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:22:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.995+0000 7fdad910f640 1 Processor -- start 2023-12-12T09:22:17.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.996+0000 7fdad910f640 1 -- start start 2023-12-12T09:22:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.997+0000 7fdad910f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdad415b0c0 0x7fdad40701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.997+0000 7fdad910f640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdad40cf980 0x7fdad415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:17.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.997+0000 7fdad910f640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad406eef0 con 0x7fdad406ea60 2023-12-12T09:22:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.997+0000 7fdad910f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad415fb90 con 0x7fdad415b0c0 2023-12-12T09:22:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.997+0000 7fdad910f640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad406f120 con 0x7fdad40cf980 2023-12-12T09:22:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.997+0000 7fdad2d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdad415b0c0 0x7fdad40701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.997+0000 7fdad2d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdad415b0c0 0x7fdad40701c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43004/0 (socket says 172.21.15.84:43004) 2023-12-12T09:22:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.997+0000 7fdad2d9d640 1 -- 172.21.15.84:0/1953819043 learned_addr learned my addr 172.21.15.84:0/1953819043 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:17.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.998+0000 7fdad359e640 1 --2- 172.21.15.84:0/1953819043 >> v2:172.21.15.99:3300/0 conn(0x7fdad40cf980 0x7fdad415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.998+0000 7fdad2d9d640 1 -- 172.21.15.84:0/1953819043 >> v2:172.21.15.99:3300/0 conn(0x7fdad40cf980 msgr2=0x7fdad415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.998+0000 7fdad2d9d640 1 --2- 172.21.15.84:0/1953819043 >> v2:172.21.15.99:3300/0 conn(0x7fdad40cf980 0x7fdad415f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.998+0000 7fdad2d9d640 1 -- 172.21.15.84:0/1953819043 >> v1:172.21.15.99:6789/0 conn(0x7fdad406ea60 legacy=0x7fdad40cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.998+0000 7fdad2d9d640 1 -- 172.21.15.84:0/1953819043 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad406f400 con 0x7fdad415b0c0 2023-12-12T09:22:18.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.999+0000 7fdad2d9d640 1 --2- 172.21.15.84:0/1953819043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40701c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdad40ce990 tx=0x7fdac402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c41ece8474ee3f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.999+0000 7fdad1d9b640 1 -- 172.21.15.84:0/1953819043 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac402cb20 con 0x7fdad415b0c0 2023-12-12T09:22:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.999+0000 7fdad1d9b640 1 -- 172.21.15.84:0/1953819043 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac402cc80 con 0x7fdad415b0c0 2023-12-12T09:22:18.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:17.999+0000 7fdad1d9b640 1 -- 172.21.15.84:0/1953819043 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40343f0 con 0x7fdad415b0c0 2023-12-12T09:22:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.000+0000 7fdad910f640 1 -- 172.21.15.84:0/1953819043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 msgr2=0x7fdad40701c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.000+0000 7fdad910f640 1 --2- 172.21.15.84:0/1953819043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40701c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fdad40ce990 tx=0x7fdac402bf80 comp rx=0 tx=0).stop 2023-12-12T09:22:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.000+0000 7fdad910f640 1 -- 172.21.15.84:0/1953819043 shutdown_connections 2023-12-12T09:22:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.000+0000 7fdad910f640 1 --2- 172.21.15.84:0/1953819043 >> v2:172.21.15.99:3300/0 conn(0x7fdad40cf980 0x7fdad415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.000+0000 7fdad910f640 1 --2- 172.21.15.84:0/1953819043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40701c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.000+0000 7fdad910f640 1 -- 172.21.15.84:0/1953819043 >> 172.21.15.84:0/1953819043 conn(0x7fdad40b2a20 msgr2=0x7fdad40b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.000+0000 7fdad910f640 1 -- 172.21.15.84:0/1953819043 shutdown_connections 2023-12-12T09:22:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.000+0000 7fdad910f640 1 -- 172.21.15.84:0/1953819043 wait complete. 2023-12-12T09:22:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.002+0000 7fdad910f640 1 Processor -- start 2023-12-12T09:22:18.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.002+0000 7fdad910f640 1 -- start start 2023-12-12T09:22:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad910f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdad406ea60 0x7fdad414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad910f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdad40cf980 0x7fdad414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad910f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad910f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414f870 con 0x7fdad415b0c0 2023-12-12T09:22:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad910f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415c670 con 0x7fdad406ea60 2023-12-12T09:22:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad910f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415c950 con 0x7fdad40cf980 2023-12-12T09:22:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43020/0 (socket says 172.21.15.84:43020) 2023-12-12T09:22:18.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.003+0000 7fdad359e640 1 -- 172.21.15.84:0/2641384526 learned_addr learned my addr 172.21.15.84:0/2641384526 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad2d9d640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdad406ea60 0x7fdad414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad259c640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdad40cf980 0x7fdad414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad359e640 1 -- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdad40cf980 msgr2=0x7fdad414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad359e640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdad40cf980 0x7fdad414ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad359e640 1 -- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdad406ea60 msgr2=0x7fdad414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad359e640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdad406ea60 0x7fdad414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad359e640 1 -- 172.21.15.84:0/2641384526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009b30 con 0x7fdad415b0c0 2023-12-12T09:22:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad2d9d640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdad406ea60 0x7fdad414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad359e640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40c53f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c7f0 tx=0x7fdacc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdacb7fe640 1 -- 172.21.15.84:0/2641384526 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc004220 con 0x7fdad415b0c0 2023-12-12T09:22:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdacb7fe640 1 -- 172.21.15.84:0/2641384526 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc004380 con 0x7fdad415b0c0 2023-12-12T09:22:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad415cc30 con 0x7fdad415b0c0 2023-12-12T09:22:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.004+0000 7fdacb7fe640 1 -- 172.21.15.84:0/2641384526 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc007860 con 0x7fdad415b0c0 2023-12-12T09:22:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.005+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad415d1f0 con 0x7fdad415b0c0 2023-12-12T09:22:18.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.006+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad415d410 con 0x7fdad415b0c0 2023-12-12T09:22:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.007+0000 7fdacb7fe640 1 -- 172.21.15.84:0/2641384526 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdacc0079c0 con 0x7fdad415b0c0 2023-12-12T09:22:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.007+0000 7fdacb7fe640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdab406ae40 0x7fdab406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.008+0000 7fdacb7fe640 1 -- 172.21.15.84:0/2641384526 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fdacc089670 con 0x7fdad415b0c0 2023-12-12T09:22:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.008+0000 7fdad2d9d640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdab406ae40 0x7fdab406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.009+0000 7fdad2d9d640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdab406ae40 0x7fdab406d300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdac4035000 tx=0x7fdac4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.013+0000 7fdacb7fe640 1 -- 172.21.15.84:0/2641384526 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdacc054450 con 0x7fdad415b0c0 2023-12-12T09:22:18.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.200+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdad40673c0 con 0x7fdad415b0c0 2023-12-12T09:22:18.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.202+0000 7fdacb7fe640 1 -- 172.21.15.84:0/2641384526 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdacc057a70 con 0x7fdad415b0c0 2023-12-12T09:22:18.203 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:22:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdab406ae40 msgr2=0x7fdab406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdab406ae40 0x7fdab406d300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdac4035000 tx=0x7fdac4030000 comp rx=0 tx=0).stop 2023-12-12T09:22:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 msgr2=0x7fdad40c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40c53f0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c7f0 tx=0x7fdacc00ccb0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 shutdown_connections 2023-12-12T09:22:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fdab406ae40 0x7fdab406d300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdad415b0c0 0x7fdad40c53f0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fdad40cf980 0x7fdad414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 --2- 172.21.15.84:0/2641384526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdad406ea60 0x7fdad414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.204+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 >> 172.21.15.84:0/2641384526 conn(0x7fdad40b2a20 msgr2=0x7fdad4159640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.205+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 shutdown_connections 2023-12-12T09:22:18.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.205+0000 7fdad910f640 1 -- 172.21.15.84:0/2641384526 wait complete. 2023-12-12T09:22:18.224 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-12T09:22:18.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.424+0000 7fb02d010640 1 Processor -- start 2023-12-12T09:22:18.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.425+0000 7fb02d010640 1 -- start start 2023-12-12T09:22:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02d010640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02815d350 0x7fb0280d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02d010640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0280b67c0 con 0x7fb0280d3c10 2023-12-12T09:22:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02d010640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0280d1f90 con 0x7fb0280d0140 2023-12-12T09:22:18.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02d010640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280b5e90 con 0x7fb02815d350 2023-12-12T09:22:18.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb01ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb0280d3c10 0x7fb0280cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36486/0 (socket says 172.21.15.84:36486) 2023-12-12T09:22:18.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb01ffff640 1 -- 172.21.15.84:0/2217178582 learned_addr learned my addr 172.21.15.84:0/2217178582 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:18.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb026d9d640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02815d350 0x7fb0280d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033101972 0 0) 0x7fb0280b67c0 con 0x7fb0280d3c10 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb014003520 con 0x7fb0280d3c10 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 952266533 0 0) 0x7fb014003520 con 0x7fb0280d3c10 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02815d350 msgr2=0x7fb0280d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02815d350 0x7fb0280d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 >> v1:172.21.15.99:6789/0 conn(0x7fb0280d0140 legacy=0x7fb028166ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280b6170 con 0x7fb0280d3c10 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fb010001670 con 0x7fb0280d3c10 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 >> v1:172.21.15.84:6789/0 conn(0x7fb0280d3c10 legacy=0x7fb0280cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0140039a0 0x7fb014003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140047c0 0x7fb014004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.427+0000 7fb02659c640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02815d350 0x7fb014005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280b5e90 con 0x7fb0140039a0 2023-12-12T09:22:18.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01400ba30 con 0x7fb0140047c0 2023-12-12T09:22:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01400bbf0 con 0x7fb02815d350 2023-12-12T09:22:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb026d9d640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0140039a0 0x7fb014003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb026d9d640 1 -- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02815d350 msgr2=0x7fb014005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb026d9d640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02815d350 0x7fb014005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb026d9d640 1 -- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140047c0 msgr2=0x7fb014004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb01ffff640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140047c0 0x7fb014004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb026d9d640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140047c0 0x7fb014004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.428+0000 7fb026d9d640 1 -- 172.21.15.84:0/2217178582 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014003520 con 0x7fb0140039a0 2023-12-12T09:22:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.429+0000 7fb026d9d640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0140039a0 0x7fb014003dc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb018009a90 tx=0x7fb0140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359996131631d4c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.429+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01802c6b0 con 0x7fb0140039a0 2023-12-12T09:22:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01802c810 con 0x7fb0140039a0 2023-12-12T09:22:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02659c640 1 -- 172.21.15.84:0/2217178582 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01802cba0 con 0x7fb0140039a0 2023-12-12T09:22:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02d010640 1 -- 172.21.15.84:0/2217178582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0140039a0 msgr2=0x7fb014003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02d010640 1 --2- 172.21.15.84:0/2217178582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0140039a0 0x7fb014003dc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb018009a90 tx=0x7fb0140057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02759e640 1 -- 172.21.15.84:0/2217178582 reap_dead start 2023-12-12T09:22:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02d010640 1 -- 172.21.15.84:0/2217178582 shutdown_connections 2023-12-12T09:22:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02d010640 1 -- 172.21.15.84:0/2217178582 >> 172.21.15.84:0/2217178582 conn(0x7fb0280d3040 msgr2=0x7fb0280d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02d010640 1 -- 172.21.15.84:0/2217178582 shutdown_connections 2023-12-12T09:22:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.430+0000 7fb02d010640 1 -- 172.21.15.84:0/2217178582 wait complete. 2023-12-12T09:22:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.432+0000 7fb02d010640 1 Processor -- start 2023-12-12T09:22:18.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.432+0000 7fb02d010640 1 -- start start 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb02d010640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140039a0 0x7fb02815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb02d010640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb02809e3b0 0x7fb0280cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb02d010640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02809e830 0x7fb0280cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb02d010640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280ccb10 con 0x7fb02809e3b0 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb02d010640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280c8090 con 0x7fb0140039a0 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb02d010640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02815bba0 con 0x7fb02809e830 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb01ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb02809e3b0 0x7fb0280cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb01ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb02809e3b0 0x7fb0280cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43034/0 (socket says 172.21.15.84:43034) 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.433+0000 7fb01ffff640 1 -- 172.21.15.84:0/654609410 learned_addr learned my addr 172.21.15.84:0/654609410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb02759e640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02809e830 0x7fb0280cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb026d9d640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140039a0 0x7fb02815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb01ffff640 1 -- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02809e830 msgr2=0x7fb0280cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb01ffff640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02809e830 0x7fb0280cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb01ffff640 1 -- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140039a0 msgr2=0x7fb02815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb01ffff640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140039a0 0x7fb02815b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb01ffff640 1 -- 172.21.15.84:0/654609410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280c9050 con 0x7fb02809e3b0 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb026d9d640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140039a0 0x7fb02815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb02759e640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02809e830 0x7fb0280cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb01ffff640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb02809e3b0 0x7fb0280cc090 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb010001eb0 tx=0x7fb01000dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.434+0000 7fb01f7fe640 1 -- 172.21.15.84:0/654609410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100074e0 con 0x7fb02809e3b0 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.435+0000 7fb01f7fe640 1 -- 172.21.15.84:0/654609410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010007640 con 0x7fb02809e3b0 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.435+0000 7fb01f7fe640 1 -- 172.21.15.84:0/654609410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100049e0 con 0x7fb02809e3b0 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.435+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0280c9330 con 0x7fb02809e3b0 2023-12-12T09:22:18.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.435+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0280cbb70 con 0x7fb02809e3b0 2023-12-12T09:22:18.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.436+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0280673c0 con 0x7fb02809e3b0 2023-12-12T09:22:18.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.437+0000 7fb01f7fe640 1 -- 172.21.15.84:0/654609410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb010004b40 con 0x7fb02809e3b0 2023-12-12T09:22:18.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.437+0000 7fb01f7fe640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb00806ae70 0x7fb00806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.438+0000 7fb01f7fe640 1 -- 172.21.15.84:0/654609410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fb0100891e0 con 0x7fb02809e3b0 2023-12-12T09:22:18.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.438+0000 7fb026d9d640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb00806ae70 0x7fb00806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.438+0000 7fb026d9d640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb00806ae70 0x7fb00806d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb018036000 tx=0x7fb018030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.443+0000 7fb01f7fe640 1 -- 172.21.15.84:0/654609410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb010053fc0 con 0x7fb02809e3b0 2023-12-12T09:22:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.634+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fb028073050 con 0x7fb02809e3b0 2023-12-12T09:22:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.635+0000 7fb01f7fe640 1 -- 172.21.15.84:0/654609410 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v44) v1 ==== 97+0+11 (secure 0 0 0) 0x7fb0100575e0 con 0x7fb02809e3b0 2023-12-12T09:22:18.636 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb00806ae70 msgr2=0x7fb00806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb00806ae70 0x7fb00806d330 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb018036000 tx=0x7fb018030000 comp rx=0 tx=0).stop 2023-12-12T09:22:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb02809e3b0 msgr2=0x7fb0280cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb02809e3b0 0x7fb0280cc090 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb010001eb0 tx=0x7fb01000dc70 comp rx=0 tx=0).stop 2023-12-12T09:22:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 shutdown_connections 2023-12-12T09:22:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb02809e830 0x7fb0280cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb00806ae70 0x7fb00806d330 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb02809e3b0 0x7fb0280cc090 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 --2- 172.21.15.84:0/654609410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0140039a0 0x7fb02815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.637+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 >> 172.21.15.84:0/654609410 conn(0x7fb0280d3040 msgr2=0x7fb0280d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.638+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 shutdown_connections 2023-12-12T09:22:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.638+0000 7fb02d010640 1 -- 172.21.15.84:0/654609410 wait complete. 2023-12-12T09:22:18.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:22:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.873+0000 7fd204e6b640 1 Processor -- start 2023-12-12T09:22:18.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.873+0000 7fd204e6b640 1 -- start start 2023-12-12T09:22:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.875+0000 7fd204e6b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20013ff90 0x7fd200142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.875+0000 7fd204e6b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd20015e0b0 0x7fd200142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.875+0000 7fd204e6b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000b3b60 con 0x7fd2000b4ba0 2023-12-12T09:22:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.875+0000 7fd204e6b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20015e6d0 con 0x7fd20015e0b0 2023-12-12T09:22:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.875+0000 7fd204e6b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000b3de0 con 0x7fd20013ff90 2023-12-12T09:22:18.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.875+0000 7fd1fed9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd20015e0b0 0x7fd200142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.876+0000 7fd1fed9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd20015e0b0 0x7fd200142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43046/0 (socket says 172.21.15.84:43046) 2023-12-12T09:22:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.876+0000 7fd1fed9d640 1 -- 172.21.15.84:0/3053507312 learned_addr learned my addr 172.21.15.84:0/3053507312 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.876+0000 7fd1fe59c640 1 --2- 172.21.15.84:0/3053507312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20013ff90 0x7fd200142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.876+0000 7fd1fed9d640 1 -- 172.21.15.84:0/3053507312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20013ff90 msgr2=0x7fd200142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.876+0000 7fd1fed9d640 1 --2- 172.21.15.84:0/3053507312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20013ff90 0x7fd200142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.876+0000 7fd1fed9d640 1 -- 172.21.15.84:0/3053507312 >> v1:172.21.15.99:6789/0 conn(0x7fd2000b4ba0 legacy=0x7fd20015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.876+0000 7fd1fed9d640 1 -- 172.21.15.84:0/3053507312 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000b40c0 con 0x7fd20015e0b0 2023-12-12T09:22:18.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.876+0000 7fd1fe59c640 1 --2- 172.21.15.84:0/3053507312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20013ff90 0x7fd200142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:18.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.877+0000 7fd1fed9d640 1 --2- 172.21.15.84:0/3053507312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20015e0b0 0x7fd200142d70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009870 tx=0x7fd1f802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b225677c22c721c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.877+0000 7fd1fd59a640 1 -- 172.21.15.84:0/3053507312 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8031640 con 0x7fd20015e0b0 2023-12-12T09:22:18.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.877+0000 7fd1fd59a640 1 -- 172.21.15.84:0/3053507312 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80317a0 con 0x7fd20015e0b0 2023-12-12T09:22:18.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.877+0000 7fd1fd59a640 1 -- 172.21.15.84:0/3053507312 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8031b30 con 0x7fd20015e0b0 2023-12-12T09:22:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.878+0000 7fd204e6b640 1 -- 172.21.15.84:0/3053507312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20015e0b0 msgr2=0x7fd200142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.878+0000 7fd204e6b640 1 --2- 172.21.15.84:0/3053507312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20015e0b0 0x7fd200142d70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8009870 tx=0x7fd1f802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.878+0000 7fd204e6b640 1 -- 172.21.15.84:0/3053507312 shutdown_connections 2023-12-12T09:22:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.878+0000 7fd204e6b640 1 --2- 172.21.15.84:0/3053507312 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd20015e0b0 0x7fd200142d70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.878+0000 7fd204e6b640 1 --2- 172.21.15.84:0/3053507312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20013ff90 0x7fd200142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.878+0000 7fd204e6b640 1 -- 172.21.15.84:0/3053507312 >> 172.21.15.84:0/3053507312 conn(0x7fd20006c3d0 msgr2=0x7fd20006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.878+0000 7fd204e6b640 1 -- 172.21.15.84:0/3053507312 shutdown_connections 2023-12-12T09:22:18.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.879+0000 7fd204e6b640 1 -- 172.21.15.84:0/3053507312 wait complete. 2023-12-12T09:22:18.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.880+0000 7fd204e6b640 1 Processor -- start 2023-12-12T09:22:18.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.881+0000 7fd204e6b640 1 -- start start 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd204e6b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2000b4ba0 0x7fd200152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd204e6b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20013ff90 0x7fd2001f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd204e6b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20015e0b0 0x7fd2001f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd204e6b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2001f4450 con 0x7fd2000b4ba0 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd204e6b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd200153110 con 0x7fd20013ff90 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd204e6b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd200157550 con 0x7fd20015e0b0 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd1fe59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2000b4ba0 0x7fd200152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd1fe59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2000b4ba0 0x7fd200152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43062/0 (socket says 172.21.15.84:43062) 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.882+0000 7fd1fe59c640 1 -- 172.21.15.84:0/2092873187 learned_addr learned my addr 172.21.15.84:0/2092873187 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1fe59c640 1 -- 172.21.15.84:0/2092873187 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20015e0b0 msgr2=0x7fd2001f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1fe59c640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20015e0b0 0x7fd2001f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1fe59c640 1 -- 172.21.15.84:0/2092873187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20013ff90 msgr2=0x7fd2001f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1fe59c640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20013ff90 0x7fd2001f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1fe59c640 1 -- 172.21.15.84:0/2092873187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80094d0 con 0x7fd2000b4ba0 2023-12-12T09:22:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1fe59c640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2000b4ba0 0x7fd200152bd0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000cf60 tx=0x7fd1f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1f6ffd640 1 -- 172.21.15.84:0/2092873187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000d840 con 0x7fd2000b4ba0 2023-12-12T09:22:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1f6ffd640 1 -- 172.21.15.84:0/2092873187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f000d9a0 con 0x7fd2000b4ba0 2023-12-12T09:22:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd1f6ffd640 1 -- 172.21.15.84:0/2092873187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000dd30 con 0x7fd2000b4ba0 2023-12-12T09:22:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd200157830 con 0x7fd2000b4ba0 2023-12-12T09:22:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.883+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20013d640 con 0x7fd2000b4ba0 2023-12-12T09:22:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.884+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2000673c0 con 0x7fd2000b4ba0 2023-12-12T09:22:18.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.885+0000 7fd1f6ffd640 1 -- 172.21.15.84:0/2092873187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1f0015440 con 0x7fd2000b4ba0 2023-12-12T09:22:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.886+0000 7fd1f6ffd640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd1e006ae40 0x7fd1e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.886+0000 7fd1f6ffd640 1 -- 172.21.15.84:0/2092873187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd1f008a280 con 0x7fd2000b4ba0 2023-12-12T09:22:18.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.886+0000 7fd1fdd9b640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd1e006ae40 0x7fd1e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:18.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.887+0000 7fd1fdd9b640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd1e006ae40 0x7fd1e006d300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd200141eb0 tx=0x7fd1e80079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:18.891+0000 7fd1f6ffd640 1 -- 172.21.15.84:0/2092873187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1f0055180 con 0x7fd2000b4ba0 2023-12-12T09:22:19.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.090+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd2001427c0 con 0x7fd2000b4ba0 2023-12-12T09:22:19.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.092+0000 7fd1f6ffd640 1 -- 172.21.15.84:0/2092873187 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd1f00587a0 con 0x7fd2000b4ba0 2023-12-12T09:22:19.093 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:22:19.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd1e006ae40 msgr2=0x7fd1e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd1e006ae40 0x7fd1e006d300 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd200141eb0 tx=0x7fd1e80079b0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2000b4ba0 msgr2=0x7fd200152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2000b4ba0 0x7fd200152bd0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000cf60 tx=0x7fd1f000cf90 comp rx=0 tx=0).stop 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 shutdown_connections 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd20015e0b0 0x7fd2001f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20013ff90 0x7fd2001f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd1e006ae40 0x7fd1e006d300 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 --2- 172.21.15.84:0/2092873187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2000b4ba0 0x7fd200152bd0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 >> 172.21.15.84:0/2092873187 conn(0x7fd20006c3d0 msgr2=0x7fd20015f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 shutdown_connections 2023-12-12T09:22:19.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.095+0000 7fd204e6b640 1 -- 172.21.15.84:0/2092873187 wait complete. 2023-12-12T09:22:19.115 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:22:19.115 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:19.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.373+0000 7feea2b81640 1 Processor -- start 2023-12-12T09:22:19.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.373+0000 7feea2b81640 1 -- start start 2023-12-12T09:22:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.374+0000 7feea2b81640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee9c15d160 0x7fee9c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.374+0000 7feea2b81640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c15d870 con 0x7fee9c0b3140 2023-12-12T09:22:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.374+0000 7feea2b81640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0b28e0 con 0x7fee9c0706b0 2023-12-12T09:22:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.374+0000 7feea2b81640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c15e1d0 con 0x7fee9c15d160 2023-12-12T09:22:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.375+0000 7feea1b7f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee9c15d160 0x7fee9c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.375+0000 7feea1b7f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fee9c15d160 0x7fee9c06d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43074/0 (socket says 172.21.15.84:43074) 2023-12-12T09:22:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.375+0000 7feea137e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fee9c0b3140 0x7fee9c070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36490/0 (socket says 172.21.15.84:36490) 2023-12-12T09:22:19.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.375+0000 7feea1b7f640 1 -- 172.21.15.84:0/1424263578 learned_addr learned my addr 172.21.15.84:0/1424263578 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.375+0000 7feea1b7f640 1 -- 172.21.15.84:0/1424263578 >> v1:172.21.15.99:6789/0 conn(0x7fee9c0706b0 legacy=0x7fee9c071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.375+0000 7feea1b7f640 1 -- 172.21.15.84:0/1424263578 >> v1:172.21.15.84:6789/0 conn(0x7fee9c0b3140 legacy=0x7fee9c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.375+0000 7feea1b7f640 1 -- 172.21.15.84:0/1424263578 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c15db10 con 0x7fee9c15d160 2023-12-12T09:22:19.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.376+0000 7feea1b7f640 1 --2- 172.21.15.84:0/1424263578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c15d160 0x7fee9c06d710 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fee98009870 tx=0x7fee9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831064b7464913e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea0b7d640 1 -- 172.21.15.84:0/1424263578 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98031870 con 0x7fee9c15d160 2023-12-12T09:22:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea0b7d640 1 -- 172.21.15.84:0/1424263578 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee980319d0 con 0x7fee9c15d160 2023-12-12T09:22:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea0b7d640 1 -- 172.21.15.84:0/1424263578 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98031d60 con 0x7fee9c15d160 2023-12-12T09:22:19.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea2b81640 1 -- 172.21.15.84:0/1424263578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c15d160 msgr2=0x7fee9c06d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea2b81640 1 --2- 172.21.15.84:0/1424263578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c15d160 0x7fee9c06d710 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fee98009870 tx=0x7fee9802b910 comp rx=0 tx=0).stop 2023-12-12T09:22:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea2b81640 1 -- 172.21.15.84:0/1424263578 shutdown_connections 2023-12-12T09:22:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea2b81640 1 --2- 172.21.15.84:0/1424263578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c15d160 0x7fee9c06d710 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea2b81640 1 -- 172.21.15.84:0/1424263578 >> 172.21.15.84:0/1424263578 conn(0x7fee9c0b07f0 msgr2=0x7fee9c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea2b81640 1 -- 172.21.15.84:0/1424263578 shutdown_connections 2023-12-12T09:22:19.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.377+0000 7feea2b81640 1 -- 172.21.15.84:0/1424263578 wait complete. 2023-12-12T09:22:19.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.379+0000 7feea2b81640 1 Processor -- start 2023-12-12T09:22:19.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.379+0000 7feea2b81640 1 -- start start 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.380+0000 7feea2b81640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9c0706b0 0x7fee9c14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.380+0000 7feea2b81640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c0b3140 0x7fee9c0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.380+0000 7feea2b81640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee9c15d160 0x7fee9c15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.380+0000 7feea2b81640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c06ccb0 con 0x7fee9c0b3140 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.380+0000 7feea2b81640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c06cf80 con 0x7fee9c0706b0 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.380+0000 7feea2b81640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c06d260 con 0x7fee9c15d160 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.380+0000 7feea137e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c0b3140 0x7fee9c0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.380+0000 7feea137e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c0b3140 0x7fee9c0adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43088/0 (socket says 172.21.15.84:43088) 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7feea137e640 1 -- 172.21.15.84:0/3157142888 learned_addr learned my addr 172.21.15.84:0/3157142888 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7feea137e640 1 -- 172.21.15.84:0/3157142888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee9c15d160 msgr2=0x7fee9c15bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7feea137e640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee9c15d160 0x7fee9c15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7feea137e640 1 -- 172.21.15.84:0/3157142888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9c0706b0 msgr2=0x7fee9c14cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7feea137e640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9c0706b0 0x7fee9c14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7feea137e640 1 -- 172.21.15.84:0/3157142888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee980094d0 con 0x7fee9c0b3140 2023-12-12T09:22:19.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7feea137e640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c0b3140 0x7fee9c0adda0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00c450 tx=0x7fee8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7fee927fc640 1 -- 172.21.15.84:0/3157142888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c007480 con 0x7fee9c0b3140 2023-12-12T09:22:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7fee927fc640 1 -- 172.21.15.84:0/3157142888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c0075e0 con 0x7fee9c0b3140 2023-12-12T09:22:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7fee927fc640 1 -- 172.21.15.84:0/3157142888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c004a00 con 0x7fee9c0b3140 2023-12-12T09:22:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.381+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c06d540 con 0x7fee9c0b3140 2023-12-12T09:22:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.382+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c06db00 con 0x7fee9c0b3140 2023-12-12T09:22:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.383+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c06dd20 con 0x7fee9c0b3140 2023-12-12T09:22:19.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.383+0000 7fee927fc640 1 -- 172.21.15.84:0/3157142888 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee8c004b60 con 0x7fee9c0b3140 2023-12-12T09:22:19.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.384+0000 7fee927fc640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee8006ae40 0x7fee8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.384+0000 7fee927fc640 1 -- 172.21.15.84:0/3157142888 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fee8c088aa0 con 0x7fee9c0b3140 2023-12-12T09:22:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.385+0000 7feea1b7f640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee8006ae40 0x7fee8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.385+0000 7feea1b7f640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee8006ae40 0x7fee8006d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fee98036000 tx=0x7fee98030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:19.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.389+0000 7fee927fc640 1 -- 172.21.15.84:0/3157142888 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee8c053870 con 0x7fee9c0b3140 2023-12-12T09:22:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.579+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee9c0673c0 con 0x7fee9c0b3140 2023-12-12T09:22:19.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.581+0000 7fee927fc640 1 -- 172.21.15.84:0/3157142888 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7fee8c018020 con 0x7fee9c0b3140 2023-12-12T09:22:19.582 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:19.582 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.583+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee8006ae40 msgr2=0x7fee8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.583+0000 7feea2b81640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee8006ae40 0x7fee8006d300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fee98036000 tx=0x7fee98030000 comp rx=0 tx=0).stop 2023-12-12T09:22:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.583+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c0b3140 msgr2=0x7fee9c0adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.583+0000 7feea2b81640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c0b3140 0x7fee9c0adda0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00c450 tx=0x7fee8c00c910 comp rx=0 tx=0).stop 2023-12-12T09:22:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.584+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 shutdown_connections 2023-12-12T09:22:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.584+0000 7feea2b81640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fee9c15d160 0x7fee9c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.584+0000 7feea2b81640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fee8006ae40 0x7fee8006d300 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.584+0000 7feea2b81640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee9c0b3140 0x7fee9c0adda0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.584+0000 7feea2b81640 1 --2- 172.21.15.84:0/3157142888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee9c0706b0 0x7fee9c14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.584+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 >> 172.21.15.84:0/3157142888 conn(0x7fee9c0b07f0 msgr2=0x7fee9c0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.584+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 shutdown_connections 2023-12-12T09:22:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.584+0000 7feea2b81640 1 -- 172.21.15.84:0/3157142888 wait complete. 2023-12-12T09:22:19.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:21:28.519227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:21:29.210161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-12T09:21:44.988386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:22:19.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:22:19.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.815+0000 7febb45ec640 1 Processor -- start 2023-12-12T09:22:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.815+0000 7febb45ec640 1 -- start start 2023-12-12T09:22:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.817+0000 7febb45ec640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7febac15d810 0x7febac0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.817+0000 7febb45ec640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7febac06d5e0 0x7febac06da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.817+0000 7febb45ec640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0b4e80 con 0x7febac0b4560 2023-12-12T09:22:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.817+0000 7febb45ec640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac15e8a0 con 0x7febac06d5e0 2023-12-12T09:22:19.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.817+0000 7febb45ec640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac15dc90 con 0x7febac15d810 2023-12-12T09:22:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.817+0000 7febb2b89640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7febac06d5e0 0x7febac06da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.817+0000 7febb2b89640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7febac06d5e0 0x7febac06da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43090/0 (socket says 172.21.15.84:43090) 2023-12-12T09:22:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.817+0000 7febb2b89640 1 -- 172.21.15.84:0/197129844 learned_addr learned my addr 172.21.15.84:0/197129844 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.818+0000 7febb1b87640 1 --2- 172.21.15.84:0/197129844 >> v2:172.21.15.99:3300/0 conn(0x7febac15d810 0x7febac0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.818+0000 7febb2b89640 1 -- 172.21.15.84:0/197129844 >> v2:172.21.15.99:3300/0 conn(0x7febac15d810 msgr2=0x7febac0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.818+0000 7febb2b89640 1 --2- 172.21.15.84:0/197129844 >> v2:172.21.15.99:3300/0 conn(0x7febac15d810 0x7febac0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.818+0000 7febb2b89640 1 -- 172.21.15.84:0/197129844 >> v1:172.21.15.84:6789/0 conn(0x7febac0b4560 legacy=0x7febac0b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.818+0000 7febb2b89640 1 -- 172.21.15.84:0/197129844 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac15df70 con 0x7febac06d5e0 2023-12-12T09:22:19.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.818+0000 7febb1b87640 1 --2- 172.21.15.84:0/197129844 >> v2:172.21.15.99:3300/0 conn(0x7febac15d810 0x7febac0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.819+0000 7febb2b89640 1 --2- 172.21.15.84:0/197129844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac06d5e0 0x7febac06da10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7febac04e9c0 tx=0x7feba402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0829393374b37a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.819+0000 7febb1386640 1 -- 172.21.15.84:0/197129844 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba402ca80 con 0x7febac06d5e0 2023-12-12T09:22:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.819+0000 7febb1386640 1 -- 172.21.15.84:0/197129844 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba402cbe0 con 0x7febac06d5e0 2023-12-12T09:22:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.819+0000 7febb1386640 1 -- 172.21.15.84:0/197129844 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba40343f0 con 0x7febac06d5e0 2023-12-12T09:22:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.820+0000 7febb45ec640 1 -- 172.21.15.84:0/197129844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac06d5e0 msgr2=0x7febac06da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.820+0000 7febb45ec640 1 --2- 172.21.15.84:0/197129844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac06d5e0 0x7febac06da10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7febac04e9c0 tx=0x7feba402bee0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.820+0000 7febb45ec640 1 -- 172.21.15.84:0/197129844 shutdown_connections 2023-12-12T09:22:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.820+0000 7febb45ec640 1 --2- 172.21.15.84:0/197129844 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac06d5e0 0x7febac06da10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.820+0000 7febb45ec640 1 --2- 172.21.15.84:0/197129844 >> v2:172.21.15.99:3300/0 conn(0x7febac15d810 0x7febac0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.820+0000 7febb45ec640 1 -- 172.21.15.84:0/197129844 >> 172.21.15.84:0/197129844 conn(0x7febac0b0ac0 msgr2=0x7febac0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.820+0000 7febb45ec640 1 -- 172.21.15.84:0/197129844 shutdown_connections 2023-12-12T09:22:19.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.820+0000 7febb45ec640 1 -- 172.21.15.84:0/197129844 wait complete. 2023-12-12T09:22:19.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.822+0000 7febb45ec640 1 Processor -- start 2023-12-12T09:22:19.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.822+0000 7febb45ec640 1 -- start start 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb45ec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac06d5e0 0x7febac13e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb45ec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac0b4560 0x7febac14c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb45ec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac15d810 0x7febac14c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb45ec640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac15a160 con 0x7febac0b4560 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb45ec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac15a440 con 0x7febac15d810 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb45ec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac15a720 con 0x7febac06d5e0 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb1b87640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac0b4560 0x7febac14c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb1b87640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac0b4560 0x7febac14c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43094/0 (socket says 172.21.15.84:43094) 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.823+0000 7febb1b87640 1 -- 172.21.15.84:0/1147338915 learned_addr learned my addr 172.21.15.84:0/1147338915 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb1b87640 1 -- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac06d5e0 msgr2=0x7febac13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb2388640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac06d5e0 0x7febac13e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb2b89640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac15d810 0x7febac14c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb1b87640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac06d5e0 0x7febac13e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb1b87640 1 -- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac15d810 msgr2=0x7febac14c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb1b87640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac15d810 0x7febac14c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb1b87640 1 -- 172.21.15.84:0/1147338915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4009b30 con 0x7febac0b4560 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb2388640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac06d5e0 0x7febac13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb2b89640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac15d810 0x7febac14c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb1b87640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac0b4560 0x7febac14c350 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00c7f0 tx=0x7feb9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7feba2ffd640 1 -- 172.21.15.84:0/1147338915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c007820 con 0x7febac0b4560 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7feba2ffd640 1 -- 172.21.15.84:0/1147338915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c007980 con 0x7febac0b4560 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7feba2ffd640 1 -- 172.21.15.84:0/1147338915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c007d30 con 0x7febac0b4560 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac15aa00 con 0x7febac0b4560 2023-12-12T09:22:19.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.824+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac13e5d0 con 0x7febac0b4560 2023-12-12T09:22:19.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.826+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac0673c0 con 0x7febac0b4560 2023-12-12T09:22:19.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.826+0000 7feba2ffd640 1 -- 172.21.15.84:0/1147338915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb9c0113f0 con 0x7febac0b4560 2023-12-12T09:22:19.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.827+0000 7feba2ffd640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb9006ae40 0x7feb9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:19.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.827+0000 7feba2ffd640 1 -- 172.21.15.84:0/1147338915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7feb9c089cb0 con 0x7febac0b4560 2023-12-12T09:22:19.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.828+0000 7febb2388640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb9006ae40 0x7feb9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:19.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.828+0000 7febb2388640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb9006ae40 0x7feb9006d300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7febac15af40 tx=0x7feba8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:19.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:19.832+0000 7feba2ffd640 1 -- 172.21.15.84:0/1147338915 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb9c0549f0 con 0x7febac0b4560 2023-12-12T09:22:20.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.024+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febac0afaf0 con 0x7febac0b4560 2023-12-12T09:22:20.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.025+0000 7feba2ffd640 1 -- 172.21.15.84:0/1147338915 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb9c058010 con 0x7febac0b4560 2023-12-12T09:22:20.026 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:22:20.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb9006ae40 msgr2=0x7feb9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb9006ae40 0x7feb9006d300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7febac15af40 tx=0x7feba8009040 comp rx=0 tx=0).stop 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac0b4560 msgr2=0x7febac14c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac0b4560 0x7febac14c350 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00c7f0 tx=0x7feb9c00ccb0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 shutdown_connections 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febac15d810 0x7febac14c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb9006ae40 0x7feb9006d300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febac0b4560 0x7febac14c350 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 --2- 172.21.15.84:0/1147338915 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7febac06d5e0 0x7febac13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 >> 172.21.15.84:0/1147338915 conn(0x7febac0b0ac0 msgr2=0x7febac0ad230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 shutdown_connections 2023-12-12T09:22:20.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.028+0000 7febb45ec640 1 -- 172.21.15.84:0/1147338915 wait complete. 2023-12-12T09:22:20.047 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:22:20.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.264+0000 7f80fccbb640 1 Processor -- start 2023-12-12T09:22:20.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.264+0000 7f80fccbb640 1 -- start start 2023-12-12T09:22:20.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80fccbb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f80f80ad610 0x7f80f80ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80fccbb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80f8070130 0x7f80f8070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80fccbb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 0x7f80f8071370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80fccbb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f80b3c40 con 0x7f80f8070130 2023-12-12T09:22:20.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80fccbb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f8070ad0 con 0x7f80f80ad610 2023-12-12T09:22:20.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80fccbb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80acbe0 con 0x7f80f8070f30 2023-12-12T09:22:20.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80f5d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80f8070130 0x7f80f8070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80f5d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f80f8070130 0x7f80f8070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43102/0 (socket says 172.21.15.84:43102) 2023-12-12T09:22:20.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.266+0000 7f80f5d9b640 1 -- 172.21.15.84:0/4013515139 learned_addr learned my addr 172.21.15.84:0/4013515139 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:20.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.267+0000 7f80f659c640 1 --2- 172.21.15.84:0/4013515139 >> v2:172.21.15.99:3300/0 conn(0x7f80f80ad610 0x7f80f80ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.267+0000 7f80f5d9b640 1 -- 172.21.15.84:0/4013515139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 msgr2=0x7f80f8071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:20.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.267+0000 7f80f6d9d640 1 --2- 172.21.15.84:0/4013515139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 0x7f80f8071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.267+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/4013515139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 0x7f80f8071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.267+0000 7f80f5d9b640 1 -- 172.21.15.84:0/4013515139 >> v2:172.21.15.99:3300/0 conn(0x7f80f80ad610 msgr2=0x7f80f80ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:20.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.267+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/4013515139 >> v2:172.21.15.99:3300/0 conn(0x7f80f80ad610 0x7f80f80ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.267+0000 7f80f5d9b640 1 -- 172.21.15.84:0/4013515139 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80b2fc0 con 0x7f80f8070130 2023-12-12T09:22:20.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.267+0000 7f80f659c640 1 --2- 172.21.15.84:0/4013515139 >> v2:172.21.15.99:3300/0 conn(0x7f80f80ad610 0x7f80f80ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:20.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.268+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/4013515139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8070590 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f80f80b1580 tx=0x7f80ec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5eab44fb059483 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.268+0000 7f80f559a640 1 -- 172.21.15.84:0/4013515139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec0317e0 con 0x7f80f8070130 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.268+0000 7f80f559a640 1 -- 172.21.15.84:0/4013515139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ec031940 con 0x7f80f8070130 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.268+0000 7f80f559a640 1 -- 172.21.15.84:0/4013515139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ec031cd0 con 0x7f80f8070130 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 -- 172.21.15.84:0/4013515139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 msgr2=0x7f80f8070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 --2- 172.21.15.84:0/4013515139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8070590 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f80f80b1580 tx=0x7f80ec02b880 comp rx=0 tx=0).stop 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 -- 172.21.15.84:0/4013515139 shutdown_connections 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 --2- 172.21.15.84:0/4013515139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8070590 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 --2- 172.21.15.84:0/4013515139 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 0x7f80f8071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 --2- 172.21.15.84:0/4013515139 >> v2:172.21.15.99:3300/0 conn(0x7f80f80ad610 0x7f80f80ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 -- 172.21.15.84:0/4013515139 >> 172.21.15.84:0/4013515139 conn(0x7f80f80b0900 msgr2=0x7f80f80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 -- 172.21.15.84:0/4013515139 shutdown_connections 2023-12-12T09:22:20.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.269+0000 7f80fccbb640 1 -- 172.21.15.84:0/4013515139 wait complete. 2023-12-12T09:22:20.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.271+0000 7f80fccbb640 1 Processor -- start 2023-12-12T09:22:20.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.271+0000 7f80fccbb640 1 -- start start 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80fccbb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80fccbb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 0x7f80f815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80fccbb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80ad610 0x7f80f815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80fccbb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f815c5c0 con 0x7f80f8070130 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80fccbb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81f65e0 con 0x7f80f80ad610 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80fccbb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f81f5fd0 con 0x7f80f8070f30 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80f659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80f659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43112/0 (socket says 172.21.15.84:43112) 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80f659c640 1 -- 172.21.15.84:0/1393831604 learned_addr learned my addr 172.21.15.84:0/1393831604 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 0x7f80f815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.272+0000 7f80f659c640 1 -- 172.21.15.84:0/1393831604 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 msgr2=0x7f80f815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80f659c640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 0x7f80f815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80f659c640 1 -- 172.21.15.84:0/1393831604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80ad610 msgr2=0x7f80f815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80f6d9d640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80ad610 0x7f80f815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80f659c640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80ad610 0x7f80f815bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80f659c640 1 -- 172.21.15.84:0/1393831604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec0094d0 con 0x7f80f8070130 2023-12-12T09:22:20.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80f659c640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8150ad0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c7f0 tx=0x7f80e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:20.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80e6ffd640 1 -- 172.21.15.84:0/1393831604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e8007a30 con 0x7f80f8070130 2023-12-12T09:22:20.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80e6ffd640 1 -- 172.21.15.84:0/1393831604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e8007b90 con 0x7f80f8070130 2023-12-12T09:22:20.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f8153ba0 con 0x7f80f8070130 2023-12-12T09:22:20.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80e6ffd640 1 -- 172.21.15.84:0/1393831604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800ce40 con 0x7f80f8070130 2023-12-12T09:22:20.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.273+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f81f6270 con 0x7f80f8070130 2023-12-12T09:22:20.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.274+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f81f5e30 con 0x7f80f8070130 2023-12-12T09:22:20.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.275+0000 7f80e6ffd640 1 -- 172.21.15.84:0/1393831604 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80e80113f0 con 0x7f80f8070130 2023-12-12T09:22:20.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.276+0000 7f80e6ffd640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f80d806ae40 0x7f80d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.276+0000 7f80e6ffd640 1 -- 172.21.15.84:0/1393831604 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f80e8089a30 con 0x7f80f8070130 2023-12-12T09:22:20.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.276+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f80d806ae40 0x7f80d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.277+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f80d806ae40 0x7f80d806d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f80ec036000 tx=0x7f80ec03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:20.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.280+0000 7f80e6ffd640 1 -- 172.21.15.84:0/1393831604 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80f81f5e30 con 0x7f80f8070130 2023-12-12T09:22:20.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.475+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80f81f5e30 con 0x7f80f8070130 2023-12-12T09:22:20.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.475+0000 7f80e6ffd640 1 -- 172.21.15.84:0/1393831604 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80e801f020 con 0x7f80f8070130 2023-12-12T09:22:20.476 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f80d806ae40 msgr2=0x7f80d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f80d806ae40 0x7f80d806d300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f80ec036000 tx=0x7f80ec03d040 comp rx=0 tx=0).stop 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 msgr2=0x7f80f8150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8150ad0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c7f0 tx=0x7f80e800cbf0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 shutdown_connections 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80f80ad610 0x7f80f815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f80f8070f30 0x7f80f815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f80d806ae40 0x7f80d806d300 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 --2- 172.21.15.84:0/1393831604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f80f8070130 0x7f80f8150ad0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.478+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 >> 172.21.15.84:0/1393831604 conn(0x7f80f80b0900 msgr2=0x7f80f80adc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.479+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 shutdown_connections 2023-12-12T09:22:20.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.479+0000 7f80fccbb640 1 -- 172.21.15.84:0/1393831604 wait complete. 2023-12-12T09:22:20.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:22:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.709+0000 7fbdef79e640 1 Processor -- start 2023-12-12T09:22:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.709+0000 7fbdef79e640 1 -- start start 2023-12-12T09:22:20.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.710+0000 7fbdef79e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbde806dff0 0x7fbde80ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.710+0000 7fbdef79e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde80ce260 con 0x7fbde80b40d0 2023-12-12T09:22:20.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.710+0000 7fbdef79e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde80cd930 con 0x7fbde815be60 2023-12-12T09:22:20.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.710+0000 7fbdef79e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde806e480 con 0x7fbde806dff0 2023-12-12T09:22:20.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.711+0000 7fbded53a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbde80b40d0 0x7fbde80b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36502/0 (socket says 172.21.15.84:36502) 2023-12-12T09:22:20.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.711+0000 7fbded53a640 1 -- 172.21.15.84:0/4090703586 learned_addr learned my addr 172.21.15.84:0/4090703586 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:20.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.711+0000 7fbdecd39640 1 --2- 172.21.15.84:0/4090703586 >> v2:172.21.15.99:3300/0 conn(0x7fbde806dff0 0x7fbde80ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.711+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415842826 0 0) 0x7fbde80ce260 con 0x7fbde80b40d0 2023-12-12T09:22:20.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.711+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd4003520 con 0x7fbde80b40d0 2023-12-12T09:22:20.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2735065367 0 0) 0x7fbdd4003520 con 0x7fbde80b40d0 2023-12-12T09:22:20.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 >> v2:172.21.15.99:3300/0 conn(0x7fbde806dff0 msgr2=0x7fbde80ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:20.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 --2- 172.21.15.84:0/4090703586 >> v2:172.21.15.99:3300/0 conn(0x7fbde806dff0 0x7fbde80ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 >> v1:172.21.15.99:6789/0 conn(0x7fbde815be60 legacy=0x7fbde813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80cdc10 con 0x7fbde80b40d0 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fbde4001670 con 0x7fbde80b40d0 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 >> v1:172.21.15.84:6789/0 conn(0x7fbde80b40d0 legacy=0x7fbde80b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbdd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd40047c0 0x7fbdd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdd4005180 0x7fbdd400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde806e480 con 0x7fbdd4003970 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd400c020 con 0x7fbdd40047c0 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd400c1e0 con 0x7fbdd4005180 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.712+0000 7fbded53a640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbdd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbdecd39640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd40047c0 0x7fbdd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbdedd3b640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdd4005180 0x7fbdd400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbded53a640 1 -- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdd4005180 msgr2=0x7fbdd400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:20.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbded53a640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdd4005180 0x7fbdd400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbded53a640 1 -- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd40047c0 msgr2=0x7fbdd4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:20.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbded53a640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdd40047c0 0x7fbdd4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbded53a640 1 -- 172.21.15.84:0/4090703586 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd4003520 con 0x7fbdd4003970 2023-12-12T09:22:20.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbdedd3b640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbdd4005180 0x7fbdd400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:20.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.713+0000 7fbdedd3b640 1 -- 172.21.15.84:0/4090703586 reap_dead start 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.714+0000 7fbded53a640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbdd4003d90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c240 tx=0x7fbdd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89522d02becba29f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4005ad0 con 0x7fbdd4003970 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde4005c30 con 0x7fbdd4003970 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbddffff640 1 -- 172.21.15.84:0/4090703586 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde402caf0 con 0x7fbdd4003970 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbdef79e640 1 -- 172.21.15.84:0/4090703586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 msgr2=0x7fbdd4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbdef79e640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbdd4003d90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c240 tx=0x7fbdd40057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbdef79e640 1 -- 172.21.15.84:0/4090703586 shutdown_connections 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbdef79e640 1 --2- 172.21.15.84:0/4090703586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbdd4003d90 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbdef79e640 1 -- 172.21.15.84:0/4090703586 >> 172.21.15.84:0/4090703586 conn(0x7fbde80b0ac0 msgr2=0x7fbde80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:20.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbdef79e640 1 -- 172.21.15.84:0/4090703586 shutdown_connections 2023-12-12T09:22:20.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.715+0000 7fbdef79e640 1 -- 172.21.15.84:0/4090703586 wait complete. 2023-12-12T09:22:20.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.717+0000 7fbdef79e640 1 Processor -- start 2023-12-12T09:22:20.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.717+0000 7fbdef79e640 1 -- start start 2023-12-12T09:22:20.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.718+0000 7fbdef79e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbde81f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.718+0000 7fbdef79e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde8071e00 0x7fbde813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.718+0000 7fbdef79e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbde81405c0 0x7fbde81edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.718+0000 7fbdef79e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde81f2c90 con 0x7fbdd4003970 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.718+0000 7fbdef79e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde813b520 con 0x7fbde8071e00 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.718+0000 7fbdef79e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8072280 con 0x7fbde81405c0 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbde81f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbde81f1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43136/0 (socket says 172.21.15.84:43136) 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 -- 172.21.15.84:0/78692288 learned_addr learned my addr 172.21.15.84:0/78692288 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbdedd3b640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbde81405c0 0x7fbde81edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbdecd39640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde8071e00 0x7fbde813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 -- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbde81405c0 msgr2=0x7fbde81edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbde81405c0 0x7fbde81edc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 -- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde8071e00 msgr2=0x7fbde813afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde8071e00 0x7fbde813afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 -- 172.21.15.84:0/78692288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde81f23f0 con 0x7fbdd4003970 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbdecd39640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde8071e00 0x7fbde813afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:20.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.719+0000 7fbded53a640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbde81f1d80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c240 tx=0x7fbde402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:20.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.720+0000 7fbdddffb640 1 -- 172.21.15.84:0/78692288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde403c040 con 0x7fbdd4003970 2023-12-12T09:22:20.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.720+0000 7fbdddffb640 1 -- 172.21.15.84:0/78692288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde402cd80 con 0x7fbdd4003970 2023-12-12T09:22:20.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.720+0000 7fbdddffb640 1 -- 172.21.15.84:0/78692288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde40072b0 con 0x7fbdd4003970 2023-12-12T09:22:20.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.720+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde81f26d0 con 0x7fbdd4003970 2023-12-12T09:22:20.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.720+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde80a85b0 con 0x7fbdd4003970 2023-12-12T09:22:20.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.721+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde80a8740 con 0x7fbdd4003970 2023-12-12T09:22:20.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.722+0000 7fbdddffb640 1 -- 172.21.15.84:0/78692288 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbde4032070 con 0x7fbdd4003970 2023-12-12T09:22:20.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.723+0000 7fbdddffb640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbdcc06ae40 0x7fbdcc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:20.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.723+0000 7fbdddffb640 1 -- 172.21.15.84:0/78692288 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fbde40aaa30 con 0x7fbdd4003970 2023-12-12T09:22:20.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.723+0000 7fbdecd39640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbdcc06ae40 0x7fbdcc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:20.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.724+0000 7fbdecd39640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbdcc06ae40 0x7fbdcc06d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbde81402e0 tx=0x7fbdd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:20.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.727+0000 7fbdddffb640 1 -- 172.21.15.84:0/78692288 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbde4075950 con 0x7fbdd4003970 2023-12-12T09:22:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.918+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbde80673c0 con 0x7fbdd4003970 2023-12-12T09:22:20.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.918+0000 7fbdddffb640 1 -- 172.21.15.84:0/78692288 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbde4078f70 con 0x7fbdd4003970 2023-12-12T09:22:20.919 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbdcc06ae40 msgr2=0x7fbdcc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbdcc06ae40 0x7fbdcc06d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbde81402e0 tx=0x7fbdd8008040 comp rx=0 tx=0).stop 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 msgr2=0x7fbde81f1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbde81f1d80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c240 tx=0x7fbde402e070 comp rx=0 tx=0).stop 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 shutdown_connections 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbde81405c0 0x7fbde81edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde8071e00 0x7fbde813afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbdcc06ae40 0x7fbdcc06d300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 --2- 172.21.15.84:0/78692288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbdd4003970 0x7fbde81f1d80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:20.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.921+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 >> 172.21.15.84:0/78692288 conn(0x7fbde80b0ac0 msgr2=0x7fbde8151ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:20.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.922+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 shutdown_connections 2023-12-12T09:22:20.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:20.922+0000 7fbdef79e640 1 -- 172.21.15.84:0/78692288 wait complete. 2023-12-12T09:22:20.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-12T09:22:21.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.148+0000 7fd10c856640 1 Processor -- start 2023-12-12T09:22:21.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.149+0000 7fd10c856640 1 -- start start 2023-12-12T09:22:21.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.150+0000 7fd10c856640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd1080b40d0 0x7fd10806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.150+0000 7fd10c856640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080ce6f0 0x7fd1080b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.150+0000 7fd10c856640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd10815be60 0x7fd10813e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.150+0000 7fd10c856640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080ceb80 con 0x7fd10815be60 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.150+0000 7fd10c856640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080ce260 con 0x7fd1080b40d0 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.150+0000 7fd10c856640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080b49f0 con 0x7fd1080ce6f0 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd106d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd10815be60 0x7fd10813e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd106d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd10815be60 0x7fd10813e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43152/0 (socket says 172.21.15.84:43152) 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd106d9d640 1 -- 172.21.15.84:0/2562400922 learned_addr learned my addr 172.21.15.84:0/2562400922 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd10659c640 1 --2- 172.21.15.84:0/2562400922 >> v2:172.21.15.99:3300/0 conn(0x7fd1080b40d0 0x7fd10806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd0fffff640 1 --2- 172.21.15.84:0/2562400922 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080ce6f0 0x7fd1080b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd106d9d640 1 -- 172.21.15.84:0/2562400922 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080ce6f0 msgr2=0x7fd1080b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd106d9d640 1 --2- 172.21.15.84:0/2562400922 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080ce6f0 0x7fd1080b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd106d9d640 1 -- 172.21.15.84:0/2562400922 >> v2:172.21.15.99:3300/0 conn(0x7fd1080b40d0 msgr2=0x7fd10806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd106d9d640 1 --2- 172.21.15.84:0/2562400922 >> v2:172.21.15.99:3300/0 conn(0x7fd1080b40d0 0x7fd10806dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd106d9d640 1 -- 172.21.15.84:0/2562400922 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080cd930 con 0x7fd10815be60 2023-12-12T09:22:21.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.151+0000 7fd10659c640 1 --2- 172.21.15.84:0/2562400922 >> v2:172.21.15.99:3300/0 conn(0x7fd1080b40d0 0x7fd10806dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:22:21.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.152+0000 7fd106d9d640 1 --2- 172.21.15.84:0/2562400922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd10815be60 0x7fd10813e750 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd1080b4d90 tx=0x7fd10002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a71fb53d88ff53e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:21.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.153+0000 7fd105d9b640 1 -- 172.21.15.84:0/2562400922 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10002ca70 con 0x7fd10815be60 2023-12-12T09:22:21.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.153+0000 7fd105d9b640 1 -- 172.21.15.84:0/2562400922 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10002cbd0 con 0x7fd10815be60 2023-12-12T09:22:21.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.153+0000 7fd105d9b640 1 -- 172.21.15.84:0/2562400922 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000343f0 con 0x7fd10815be60 2023-12-12T09:22:21.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.153+0000 7fd10c856640 1 -- 172.21.15.84:0/2562400922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd10815be60 msgr2=0x7fd10813e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.153+0000 7fd10c856640 1 --2- 172.21.15.84:0/2562400922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd10815be60 0x7fd10813e750 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd1080b4d90 tx=0x7fd10002bed0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.154+0000 7fd10c856640 1 -- 172.21.15.84:0/2562400922 shutdown_connections 2023-12-12T09:22:21.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.154+0000 7fd10c856640 1 --2- 172.21.15.84:0/2562400922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd10815be60 0x7fd10813e750 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.154+0000 7fd10c856640 1 --2- 172.21.15.84:0/2562400922 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080ce6f0 0x7fd1080b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.154+0000 7fd10c856640 1 --2- 172.21.15.84:0/2562400922 >> v2:172.21.15.99:3300/0 conn(0x7fd1080b40d0 0x7fd10806dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.154+0000 7fd10c856640 1 -- 172.21.15.84:0/2562400922 >> 172.21.15.84:0/2562400922 conn(0x7fd1080b0ac0 msgr2=0x7fd1080b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:21.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.154+0000 7fd10c856640 1 -- 172.21.15.84:0/2562400922 shutdown_connections 2023-12-12T09:22:21.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.154+0000 7fd10c856640 1 -- 172.21.15.84:0/2562400922 wait complete. 2023-12-12T09:22:21.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.156+0000 7fd10c856640 1 Processor -- start 2023-12-12T09:22:21.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.156+0000 7fd10c856640 1 -- start start 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.157+0000 7fd10c856640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080b40d0 0x7fd10813b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd10c856640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1080ce6f0 0x7fd108140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd10c856640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd10815be60 0x7fd1080ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd10c856640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10813be40 con 0x7fd1080ce6f0 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd10c856640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10813ea00 con 0x7fd10815be60 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd10c856640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd108140f70 con 0x7fd1080b40d0 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd0fffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1080ce6f0 0x7fd108140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd0fffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1080ce6f0 0x7fd108140600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43168/0 (socket says 172.21.15.84:43168) 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd0fffff640 1 -- 172.21.15.84:0/3660615629 learned_addr learned my addr 172.21.15.84:0/3660615629 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd10659c640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080b40d0 0x7fd10813b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd106d9d640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd10815be60 0x7fd1080ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd0fffff640 1 -- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080b40d0 msgr2=0x7fd10813b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd0fffff640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080b40d0 0x7fd10813b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd0fffff640 1 -- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd10815be60 msgr2=0x7fd1080ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd0fffff640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd10815be60 0x7fd1080ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd0fffff640 1 -- 172.21.15.84:0/3660615629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100009b30 con 0x7fd1080ce6f0 2023-12-12T09:22:21.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.158+0000 7fd106d9d640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd10815be60 0x7fd1080ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:21.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.159+0000 7fd0fffff640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1080ce6f0 0x7fd108140600 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000d5f0 tx=0x7fd0f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:21.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.159+0000 7fd0feffd640 1 -- 172.21.15.84:0/3660615629 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00125f0 con 0x7fd1080ce6f0 2023-12-12T09:22:21.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.159+0000 7fd0feffd640 1 -- 172.21.15.84:0/3660615629 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0012750 con 0x7fd1080ce6f0 2023-12-12T09:22:21.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.159+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd108141250 con 0x7fd1080ce6f0 2023-12-12T09:22:21.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.159+0000 7fd0feffd640 1 -- 172.21.15.84:0/3660615629 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0012b00 con 0x7fd1080ce6f0 2023-12-12T09:22:21.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.159+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd108141530 con 0x7fd1080ce6f0 2023-12-12T09:22:21.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.160+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10813ebb0 con 0x7fd1080ce6f0 2023-12-12T09:22:21.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.161+0000 7fd0feffd640 1 -- 172.21.15.84:0/3660615629 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0f0012c60 con 0x7fd1080ce6f0 2023-12-12T09:22:21.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.162+0000 7fd0feffd640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd0e806ae70 0x7fd0e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.162+0000 7fd0feffd640 1 -- 172.21.15.84:0/3660615629 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd0f0089dd0 con 0x7fd1080ce6f0 2023-12-12T09:22:21.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.162+0000 7fd10659c640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd0e806ae70 0x7fd0e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.163+0000 7fd10659c640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd0e806ae70 0x7fd0e806d330 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8006fd0 tx=0x7fd0f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:21.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.166+0000 7fd0feffd640 1 -- 172.21.15.84:0/3660615629 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0f0054b10 con 0x7fd1080ce6f0 2023-12-12T09:22:21.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.357+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fd1080673c0 con 0x7fd1080ce6f0 2023-12-12T09:22:21.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.358+0000 7fd0feffd640 1 -- 172.21.15.84:0/3660615629 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v44) v1 ==== 97+0+11 (secure 0 0 0) 0x7fd0f0058130 con 0x7fd1080ce6f0 2023-12-12T09:22:21.359 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:21.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd0e806ae70 msgr2=0x7fd0e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd0e806ae70 0x7fd0e806d330 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8006fd0 tx=0x7fd0f8008040 comp rx=0 tx=0).stop 2023-12-12T09:22:21.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1080ce6f0 msgr2=0x7fd108140600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1080ce6f0 0x7fd108140600 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000d5f0 tx=0x7fd0f000dab0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 shutdown_connections 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd10815be60 0x7fd1080ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd0e806ae70 0x7fd0e806d330 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1080ce6f0 0x7fd108140600 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 --2- 172.21.15.84:0/3660615629 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd1080b40d0 0x7fd10813b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 >> 172.21.15.84:0/3660615629 conn(0x7fd1080b0ac0 msgr2=0x7fd10815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 shutdown_connections 2023-12-12T09:22:21.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.361+0000 7fd10c856640 1 -- 172.21.15.84:0/3660615629 wait complete. 2023-12-12T09:22:21.380 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:22:21.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.588+0000 7fe97b383640 1 Processor -- start 2023-12-12T09:22:21.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.588+0000 7fe97b383640 1 -- start start 2023-12-12T09:22:21.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.590+0000 7fe97b383640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe974143d20 0x7fe9740b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.590+0000 7fe97b383640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe9741447f0 0x7fe9740b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.590+0000 7fe97b383640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9740cea30 con 0x7fe9740ce550 2023-12-12T09:22:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.590+0000 7fe97b383640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9740702b0 con 0x7fe974143d20 2023-12-12T09:22:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.590+0000 7fe97b383640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe974070590 con 0x7fe9741447f0 2023-12-12T09:22:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.590+0000 7fe97891e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe9740ce550 0x7fe97415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36506/0 (socket says 172.21.15.84:36506) 2023-12-12T09:22:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.590+0000 7fe97911f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe974143d20 0x7fe9740b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.590+0000 7fe97891e640 1 -- 172.21.15.84:0/3276503874 learned_addr learned my addr 172.21.15.84:0/3276503874 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.591+0000 7fe979920640 1 --2- 172.21.15.84:0/3276503874 >> v2:172.21.15.99:3300/0 conn(0x7fe9741447f0 0x7fe9740b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.591+0000 7fe97911f640 1 -- 172.21.15.84:0/3276503874 >> v2:172.21.15.99:3300/0 conn(0x7fe9741447f0 msgr2=0x7fe9740b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.591+0000 7fe97911f640 1 --2- 172.21.15.84:0/3276503874 >> v2:172.21.15.99:3300/0 conn(0x7fe9741447f0 0x7fe9740b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.591+0000 7fe97911f640 1 -- 172.21.15.84:0/3276503874 >> v1:172.21.15.84:6789/0 conn(0x7fe9740ce550 legacy=0x7fe97415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.591+0000 7fe97911f640 1 -- 172.21.15.84:0/3276503874 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe974070870 con 0x7fe974143d20 2023-12-12T09:22:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.591+0000 7fe96bfff640 1 -- 172.21.15.84:0/3276503874 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032308811 0 0) 0x7fe9740cea30 con 0x7fe9740ce550 2023-12-12T09:22:21.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.592+0000 7fe97911f640 1 --2- 172.21.15.84:0/3276503874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740b40d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe9740ae330 tx=0x7fe97002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d866dacb2fb48e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.592+0000 7fe96bfff640 1 -- 172.21.15.84:0/3276503874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970031830 con 0x7fe974143d20 2023-12-12T09:22:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.592+0000 7fe96bfff640 1 -- 172.21.15.84:0/3276503874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970031990 con 0x7fe974143d20 2023-12-12T09:22:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.592+0000 7fe96bfff640 1 -- 172.21.15.84:0/3276503874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970031d20 con 0x7fe974143d20 2023-12-12T09:22:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.593+0000 7fe97b383640 1 -- 172.21.15.84:0/3276503874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 msgr2=0x7fe9740b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.593+0000 7fe97b383640 1 --2- 172.21.15.84:0/3276503874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740b40d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe9740ae330 tx=0x7fe97002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.593+0000 7fe97b383640 1 -- 172.21.15.84:0/3276503874 shutdown_connections 2023-12-12T09:22:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.593+0000 7fe97b383640 1 --2- 172.21.15.84:0/3276503874 >> v2:172.21.15.99:3300/0 conn(0x7fe9741447f0 0x7fe9740b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.593+0000 7fe97b383640 1 --2- 172.21.15.84:0/3276503874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740b40d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.593+0000 7fe97b383640 1 -- 172.21.15.84:0/3276503874 >> 172.21.15.84:0/3276503874 conn(0x7fe97406c3d0 msgr2=0x7fe97406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.593+0000 7fe97b383640 1 -- 172.21.15.84:0/3276503874 shutdown_connections 2023-12-12T09:22:21.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.593+0000 7fe97b383640 1 -- 172.21.15.84:0/3276503874 wait complete. 2023-12-12T09:22:21.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.595+0000 7fe97b383640 1 Processor -- start 2023-12-12T09:22:21.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.595+0000 7fe97b383640 1 -- start start 2023-12-12T09:22:21.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97b383640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740ce550 0x7fe97413c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97b383640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97b383640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe9741447f0 0x7fe9740b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97b383640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe974151e00 con 0x7fe974143d20 2023-12-12T09:22:21.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97b383640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe974152c70 con 0x7fe9740ce550 2023-12-12T09:22:21.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97b383640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe974152f50 con 0x7fe9741447f0 2023-12-12T09:22:21.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97891e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97891e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43186/0 (socket says 172.21.15.84:43186) 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.596+0000 7fe97891e640 1 -- 172.21.15.84:0/2357523229 learned_addr learned my addr 172.21.15.84:0/2357523229 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe97911f640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740ce550 0x7fe97413c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe97891e640 1 -- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe9741447f0 msgr2=0x7fe9740b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe979920640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe9741447f0 0x7fe9740b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe97891e640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe9741447f0 0x7fe9740b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe97891e640 1 -- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740ce550 msgr2=0x7fe97413c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe97891e640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740ce550 0x7fe97413c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe97891e640 1 -- 172.21.15.84:0/2357523229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970009400 con 0x7fe974143d20 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe97911f640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740ce550 0x7fe97413c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:21.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe97891e640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740afd70 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe96400c4d0 tx=0x7fe96400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe969ffb640 1 -- 172.21.15.84:0/2357523229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9640074e0 con 0x7fe974143d20 2023-12-12T09:22:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe969ffb640 1 -- 172.21.15.84:0/2357523229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe964007660 con 0x7fe974143d20 2023-12-12T09:22:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.597+0000 7fe969ffb640 1 -- 172.21.15.84:0/2357523229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964004a20 con 0x7fe974143d20 2023-12-12T09:22:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.598+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe974153230 con 0x7fe974143d20 2023-12-12T09:22:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.598+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe974152890 con 0x7fe974143d20 2023-12-12T09:22:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.599+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97413e510 con 0x7fe974143d20 2023-12-12T09:22:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.600+0000 7fe969ffb640 1 -- 172.21.15.84:0/2357523229 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe964004b80 con 0x7fe974143d20 2023-12-12T09:22:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.601+0000 7fe969ffb640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe95806ae40 0x7fe95806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.601+0000 7fe969ffb640 1 -- 172.21.15.84:0/2357523229 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fe964088a70 con 0x7fe974143d20 2023-12-12T09:22:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.601+0000 7fe97911f640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe95806ae40 0x7fe95806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:21.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.602+0000 7fe97911f640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe95806ae40 0x7fe95806d300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe970036000 tx=0x7fe970008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:21.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.605+0000 7fe969ffb640 1 -- 172.21.15.84:0/2357523229 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe964053850 con 0x7fe974143d20 2023-12-12T09:22:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.809+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe9740673c0 con 0x7fe974143d20 2023-12-12T09:22:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.810+0000 7fe969ffb640 1 -- 172.21.15.84:0/2357523229 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe964018020 con 0x7fe974143d20 2023-12-12T09:22:21.810 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe95806ae40 msgr2=0x7fe95806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe95806ae40 0x7fe95806d300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe970036000 tx=0x7fe970008030 comp rx=0 tx=0).stop 2023-12-12T09:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 msgr2=0x7fe9740afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740afd70 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe96400c4d0 tx=0x7fe96400c990 comp rx=0 tx=0).stop 2023-12-12T09:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 shutdown_connections 2023-12-12T09:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe9741447f0 0x7fe9740b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe95806ae40 0x7fe95806d300 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe974143d20 0x7fe9740afd70 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 --2- 172.21.15.84:0/2357523229 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9740ce550 0x7fe97413c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 >> 172.21.15.84:0/2357523229 conn(0x7fe97406c3d0 msgr2=0x7fe97413e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 shutdown_connections 2023-12-12T09:22:21.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:21.813+0000 7fe97b383640 1 -- 172.21.15.84:0/2357523229 wait complete. 2023-12-12T09:22:21.832 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:22:21.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:21.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-12T09:22:21.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[107102]: fuse finished with error 0 and tester_r 0 2023-12-12T09:22:21.925 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:22:22.016 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:22:22.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:22.016 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:22:22.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-12-12T09:22:22.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.294+0000 7f156c9ae640 1 Processor -- start 2023-12-12T09:22:22.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.294+0000 7f156c9ae640 1 -- start start 2023-12-12T09:22:22.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.296+0000 7f156c9ae640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f15681576c0 0x7f15680ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:22.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.296+0000 7f156c9ae640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f15680addc0 0x7f1568160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:22.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.296+0000 7f156c9ae640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1568161490 con 0x7f1568160af0 2023-12-12T09:22:22.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.296+0000 7f156c9ae640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1568161990 con 0x7f15680addc0 2023-12-12T09:22:22.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.296+0000 7f156c9ae640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15680cd3a0 con 0x7f15681576c0 2023-12-12T09:22:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.296+0000 7f1567fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f15680addc0 0x7f1568160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.296+0000 7f1567fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f15680addc0 0x7f1568160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43202/0 (socket says 172.21.15.84:43202) 2023-12-12T09:22:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.296+0000 7f1567fff640 1 -- 172.21.15.84:0/1295255694 learned_addr learned my addr 172.21.15.84:0/1295255694 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.297+0000 7f15677fe640 1 --2- 172.21.15.84:0/1295255694 >> v2:172.21.15.99:3300/0 conn(0x7f15681576c0 0x7f15680ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.297+0000 7f1567fff640 1 -- 172.21.15.84:0/1295255694 >> v2:172.21.15.99:3300/0 conn(0x7f15681576c0 msgr2=0x7f15680ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:22.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.297+0000 7f1567fff640 1 --2- 172.21.15.84:0/1295255694 >> v2:172.21.15.99:3300/0 conn(0x7f15681576c0 0x7f15680ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.297+0000 7f1567fff640 1 -- 172.21.15.84:0/1295255694 >> v1:172.21.15.99:6789/0 conn(0x7f1568160af0 legacy=0x7f156815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.297+0000 7f1567fff640 1 -- 172.21.15.84:0/1295255694 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15680cd680 con 0x7f15680addc0 2023-12-12T09:22:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.298+0000 7f1567fff640 1 --2- 172.21.15.84:0/1295255694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f1568160f50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f15680cfaf0 tx=0x7f156002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c717d96ec134389 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:22.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.298+0000 7f15667fc640 1 -- 172.21.15.84:0/1295255694 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156002c9f0 con 0x7f15680addc0 2023-12-12T09:22:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.298+0000 7f15667fc640 1 -- 172.21.15.84:0/1295255694 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156002cb50 con 0x7f15680addc0 2023-12-12T09:22:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.298+0000 7f15667fc640 1 -- 172.21.15.84:0/1295255694 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15600343f0 con 0x7f15680addc0 2023-12-12T09:22:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.299+0000 7f156c9ae640 1 -- 172.21.15.84:0/1295255694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 msgr2=0x7f1568160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.299+0000 7f156c9ae640 1 --2- 172.21.15.84:0/1295255694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f1568160f50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f15680cfaf0 tx=0x7f156002be50 comp rx=0 tx=0).stop 2023-12-12T09:22:22.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.299+0000 7f156c9ae640 1 -- 172.21.15.84:0/1295255694 shutdown_connections 2023-12-12T09:22:22.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.299+0000 7f156c9ae640 1 --2- 172.21.15.84:0/1295255694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f1568160f50 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.299+0000 7f156c9ae640 1 --2- 172.21.15.84:0/1295255694 >> v2:172.21.15.99:3300/0 conn(0x7f15681576c0 0x7f15680ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.299+0000 7f156c9ae640 1 -- 172.21.15.84:0/1295255694 >> 172.21.15.84:0/1295255694 conn(0x7f15680cea50 msgr2=0x7f15680cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:22.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.299+0000 7f156c9ae640 1 -- 172.21.15.84:0/1295255694 shutdown_connections 2023-12-12T09:22:22.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.299+0000 7f156c9ae640 1 -- 172.21.15.84:0/1295255694 wait complete. 2023-12-12T09:22:22.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.301+0000 7f156c9ae640 1 Processor -- start 2023-12-12T09:22:22.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.301+0000 7f156c9ae640 1 -- start start 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f156c9ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f15681456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f156c9ae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15681576c0 0x7f156815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f156c9ae640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1568160af0 0x7f15680b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f156c9ae640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156815aac0 con 0x7f15680addc0 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f156c9ae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15681594e0 con 0x7f15681576c0 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f156c9ae640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15681597c0 con 0x7f1568160af0 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f15677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f15681456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f15677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f15681456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43214/0 (socket says 172.21.15.84:43214) 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.302+0000 7f15677fe640 1 -- 172.21.15.84:0/4043119077 learned_addr learned my addr 172.21.15.84:0/4043119077 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f15677fe640 1 -- 172.21.15.84:0/4043119077 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1568160af0 msgr2=0x7f15680b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f15677fe640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1568160af0 0x7f15680b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f15677fe640 1 -- 172.21.15.84:0/4043119077 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15681576c0 msgr2=0x7f156815a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:22.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f15677fe640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15681576c0 0x7f156815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f15677fe640 1 -- 172.21.15.84:0/4043119077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560009b30 con 0x7f15680addc0 2023-12-12T09:22:22.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f15677fe640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f15681456e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f155800d800 tx=0x7f155800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:22.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f155ffff640 1 -- 172.21.15.84:0/4043119077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155800b6c0 con 0x7f15680addc0 2023-12-12T09:22:22.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f155ffff640 1 -- 172.21.15.84:0/4043119077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155800b820 con 0x7f15680addc0 2023-12-12T09:22:22.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f155ffff640 1 -- 172.21.15.84:0/4043119077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155800bb90 con 0x7f15680addc0 2023-12-12T09:22:22.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1568159aa0 con 0x7f15680addc0 2023-12-12T09:22:22.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.303+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156815a060 con 0x7f15680addc0 2023-12-12T09:22:22.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.304+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156815a220 con 0x7f15680addc0 2023-12-12T09:22:22.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.306+0000 7f155ffff640 1 -- 172.21.15.84:0/4043119077 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f155800bcf0 con 0x7f15680addc0 2023-12-12T09:22:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.307+0000 7f155ffff640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f154806ae40 0x7f154806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.307+0000 7f155ffff640 1 -- 172.21.15.84:0/4043119077 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f1558089e70 con 0x7f15680addc0 2023-12-12T09:22:22.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.307+0000 7f1566ffd640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f154806ae40 0x7f154806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.308+0000 7f1566ffd640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f154806ae40 0x7f154806d300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f15680b0390 tx=0x7f15500079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:22.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.312+0000 7f155ffff640 1 -- 172.21.15.84:0/4043119077 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1558054c50 con 0x7f15680addc0 2023-12-12T09:22:22.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.579+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f156804e840 con 0x7f15680addc0 2023-12-12T09:22:22.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.584+0000 7f155ffff640 1 -- 172.21.15.84:0/4043119077 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+141 (secure 0 0 0) 0x7f1558058270 con 0x7f15680addc0 2023-12-12T09:22:22.584 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:22:22.584 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:22:22.584 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-12-12T09:22:22.584 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-12-12T09:22:22.584 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw pool=cephfs_data" 2023-12-12T09:22:22.585 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-12-12T09:22:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.586+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f154806ae40 msgr2=0x7f154806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.586+0000 7f156c9ae640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f154806ae40 0x7f154806d300 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f15680b0390 tx=0x7f15500079b0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.586+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 msgr2=0x7f15681456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.586+0000 7f156c9ae640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f15681456e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f155800d800 tx=0x7f155800dcc0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.587+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 shutdown_connections 2023-12-12T09:22:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.587+0000 7f156c9ae640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1568160af0 0x7f15680b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.587+0000 7f156c9ae640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15681576c0 0x7f156815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.587+0000 7f156c9ae640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f154806ae40 0x7f154806d300 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.587+0000 7f156c9ae640 1 --2- 172.21.15.84:0/4043119077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15680addc0 0x7f15681456e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.587+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 >> 172.21.15.84:0/4043119077 conn(0x7f15680cea50 msgr2=0x7f15680cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.587+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 shutdown_connections 2023-12-12T09:22:22.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:22.587+0000 7f156c9ae640 1 -- 172.21.15.84:0/4043119077 wait complete. 2023-12-12T09:22:22.605 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:22:22.606 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:22:22.719 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:22:22.844 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:22:22.844 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:22:22.844 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:22.903 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T09:22:22.903 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:22:22.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:22.903 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:22:22.954 INFO:teuthology.orchestra.run.smithi084.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-12T09:22:22.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:22:22.955 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:22:22.955 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:23.013 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T09:22:23.013 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:22:23.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:23.013 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:22:23.062 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-12T09:22:23.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:22:23.063 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:22:23.063 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:23.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T09:22:23.124 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:22:23.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:23.124 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-12T09:22:23.178 INFO:teuthology.orchestra.run.smithi084.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-12T09:22:23.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:22:23.180 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:22:23.180 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:23.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T09:22:23.241 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:22:23.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:22:23.241 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-12T09:22:23.295 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-12T09:22:23.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:22:23.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:22:23.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.515+0000 7fc730f97640 1 Processor -- start 2023-12-12T09:22:23.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.516+0000 7fc730f97640 1 -- start start 2023-12-12T09:22:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.517+0000 7fc730f97640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc72c13ff90 0x7fc72c142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.517+0000 7fc730f97640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c0b4ba0 0x7fc72c142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.517+0000 7fc730f97640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c0b3b60 con 0x7fc72c15d9a0 2023-12-12T09:22:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.517+0000 7fc730f97640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c15e6d0 con 0x7fc72c13ff90 2023-12-12T09:22:23.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.517+0000 7fc730f97640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0b3de0 con 0x7fc72c0b4ba0 2023-12-12T09:22:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.518+0000 7fc721d9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c0b4ba0 0x7fc72c142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.518+0000 7fc72a59c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc72c13ff90 0x7fc72c142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.518+0000 7fc72a59c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc72c13ff90 0x7fc72c142830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:60482/0 (socket says 172.21.15.84:60482) 2023-12-12T09:22:23.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.518+0000 7fc72a59c640 1 -- 172.21.15.84:0/2708627461 learned_addr learned my addr 172.21.15.84:0/2708627461 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.519+0000 7fc721d9b640 1 -- 172.21.15.84:0/2708627461 >> v2:172.21.15.99:3300/0 conn(0x7fc72c13ff90 msgr2=0x7fc72c142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.519+0000 7fc721d9b640 1 --2- 172.21.15.84:0/2708627461 >> v2:172.21.15.99:3300/0 conn(0x7fc72c13ff90 0x7fc72c142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.519+0000 7fc721d9b640 1 -- 172.21.15.84:0/2708627461 >> v1:172.21.15.99:6789/0 conn(0x7fc72c15d9a0 legacy=0x7fc72c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:23.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.519+0000 7fc721d9b640 1 -- 172.21.15.84:0/2708627461 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0b40c0 con 0x7fc72c0b4ba0 2023-12-12T09:22:23.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.520+0000 7fc721d9b640 1 --2- 172.21.15.84:0/2708627461 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c0b4ba0 0x7fc72c142d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc7140097a0 tx=0x7fc71402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f338d98ce5c5d561 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.521+0000 7fc729d9b640 1 -- 172.21.15.84:0/2708627461 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714031830 con 0x7fc72c0b4ba0 2023-12-12T09:22:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.521+0000 7fc729d9b640 1 -- 172.21.15.84:0/2708627461 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc714031990 con 0x7fc72c0b4ba0 2023-12-12T09:22:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.521+0000 7fc729d9b640 1 -- 172.21.15.84:0/2708627461 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714031d20 con 0x7fc72c0b4ba0 2023-12-12T09:22:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.521+0000 7fc730f97640 1 -- 172.21.15.84:0/2708627461 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c0b4ba0 msgr2=0x7fc72c142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.521+0000 7fc730f97640 1 --2- 172.21.15.84:0/2708627461 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c0b4ba0 0x7fc72c142d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc7140097a0 tx=0x7fc71402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.522+0000 7fc730f97640 1 -- 172.21.15.84:0/2708627461 shutdown_connections 2023-12-12T09:22:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.522+0000 7fc730f97640 1 --2- 172.21.15.84:0/2708627461 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c0b4ba0 0x7fc72c142d70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.522+0000 7fc730f97640 1 --2- 172.21.15.84:0/2708627461 >> v2:172.21.15.99:3300/0 conn(0x7fc72c13ff90 0x7fc72c142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.522+0000 7fc730f97640 1 -- 172.21.15.84:0/2708627461 >> 172.21.15.84:0/2708627461 conn(0x7fc72c06c3d0 msgr2=0x7fc72c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.522+0000 7fc730f97640 1 -- 172.21.15.84:0/2708627461 shutdown_connections 2023-12-12T09:22:23.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.522+0000 7fc730f97640 1 -- 172.21.15.84:0/2708627461 wait complete. 2023-12-12T09:22:23.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.523+0000 7fc730f97640 1 Processor -- start 2023-12-12T09:22:23.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.524+0000 7fc730f97640 1 -- start start 2023-12-12T09:22:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc730f97640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72c0b4ba0 0x7fc72c13d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc730f97640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc72c13ff90 0x7fc72c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc730f97640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c15d9a0 0x7fc72c1419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc730f97640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c1406a0 con 0x7fc72c13ff90 2023-12-12T09:22:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc730f97640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c140940 con 0x7fc72c0b4ba0 2023-12-12T09:22:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc730f97640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c140c20 con 0x7fc72c15d9a0 2023-12-12T09:22:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc721d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc72c13ff90 0x7fc72c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc721d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc72c13ff90 0x7fc72c157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43216/0 (socket says 172.21.15.84:43216) 2023-12-12T09:22:23.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc721d9b640 1 -- 172.21.15.84:0/136496764 learned_addr learned my addr 172.21.15.84:0/136496764 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc72a59c640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72c0b4ba0 0x7fc72c13d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc72ad9d640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c15d9a0 0x7fc72c1419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc721d9b640 1 -- 172.21.15.84:0/136496764 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c15d9a0 msgr2=0x7fc72c1419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc721d9b640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c15d9a0 0x7fc72c1419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc721d9b640 1 -- 172.21.15.84:0/136496764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72c0b4ba0 msgr2=0x7fc72c13d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc721d9b640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72c0b4ba0 0x7fc72c13d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.525+0000 7fc721d9b640 1 -- 172.21.15.84:0/136496764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc714009400 con 0x7fc72c13ff90 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.526+0000 7fc721d9b640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc72c13ff90 0x7fc72c157f60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc71402b910 tx=0x7fc7140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.526+0000 7fc7237fe640 1 -- 172.21.15.84:0/136496764 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71403a630 con 0x7fc72c13ff90 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.526+0000 7fc7237fe640 1 -- 172.21.15.84:0/136496764 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71403a7d0 con 0x7fc72c13ff90 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.526+0000 7fc7237fe640 1 -- 172.21.15.84:0/136496764 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71403ab80 con 0x7fc72c13ff90 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.526+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c140f00 con 0x7fc72c13ff90 2023-12-12T09:22:23.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.526+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c1414c0 con 0x7fc72c13ff90 2023-12-12T09:22:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.527+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c15ff60 con 0x7fc72c13ff90 2023-12-12T09:22:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.528+0000 7fc7237fe640 1 -- 172.21.15.84:0/136496764 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc71403ace0 con 0x7fc72c13ff90 2023-12-12T09:22:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.529+0000 7fc7237fe640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc70c06ae40 0x7fc70c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.529+0000 7fc7237fe640 1 -- 172.21.15.84:0/136496764 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fc7140ab280 con 0x7fc72c13ff90 2023-12-12T09:22:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.529+0000 7fc72a59c640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc70c06ae40 0x7fc70c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.530+0000 7fc72a59c640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc70c06ae40 0x7fc70c06d300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc72c13de90 tx=0x7fc71c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:23.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.533+0000 7fc7237fe640 1 -- 172.21.15.84:0/136496764 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc714076070 con 0x7fc72c13ff90 2023-12-12T09:22:23.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.760+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc72c0673c0 con 0x7fc72c13ff90 2023-12-12T09:22:23.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.762+0000 7fc7237fe640 1 -- 172.21.15.84:0/136496764 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4915 (secure 0 0 0) 0x7fc714079690 con 0x7fc72c13ff90 2023-12-12T09:22:23.762 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:23.762 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6834/3349912921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3349912921},{"type":"v1","addr":"172.21.15.99:6834","nonce":3349912921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3102874305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6833","nonce":3102874305},{"type":"v1","addr":"172.21.15.99:6835","nonce":3102874305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2816609542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2816609542},{"type":"v1","addr":"172.21.15.84:6837","nonce":2816609542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:21:30.192583+0000","modified":"2023-12-12T09:21:45.673958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6836/1717242900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1717242900},{"type":"v1","addr":"172.21.15.84:6836","nonce":1717242900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:22:23.763 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-12-12T09:22:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc70c06ae40 msgr2=0x7fc70c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc70c06ae40 0x7fc70c06d300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc72c13de90 tx=0x7fc71c008040 comp rx=0 tx=0).stop 2023-12-12T09:22:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc72c13ff90 msgr2=0x7fc72c157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:23.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc72c13ff90 0x7fc72c157f60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc71402b910 tx=0x7fc7140046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 shutdown_connections 2023-12-12T09:22:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc72c15d9a0 0x7fc72c1419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc70c06ae40 0x7fc70c06d300 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc72c13ff90 0x7fc72c157f60 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 --2- 172.21.15.84:0/136496764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72c0b4ba0 0x7fc72c13d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.764+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 >> 172.21.15.84:0/136496764 conn(0x7fc72c06c3d0 msgr2=0x7fc72c142b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.765+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 shutdown_connections 2023-12-12T09:22:23.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.765+0000 7fc730f97640 1 -- 172.21.15.84:0/136496764 wait complete. 2023-12-12T09:22:23.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.987+0000 7fc2469ec640 1 Processor -- start 2023-12-12T09:22:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.987+0000 7fc2469ec640 1 -- start start 2023-12-12T09:22:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc2469ec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc240143d20 0x7fc2400b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc2469ec640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2400ce550 0x7fc2400b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc2469ec640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2401447f0 0x7fc24015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc2469ec640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2400cea30 con 0x7fc2401447f0 2023-12-12T09:22:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc2469ec640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2400702b0 con 0x7fc2400ce550 2023-12-12T09:22:23.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc2469ec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc240070590 con 0x7fc240143d20 2023-12-12T09:22:23.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc244f89640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2401447f0 0x7fc24015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc244f89640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2401447f0 0x7fc24015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43220/0 (socket says 172.21.15.84:43220) 2023-12-12T09:22:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc244f89640 1 -- 172.21.15.84:0/3433872876 learned_addr learned my addr 172.21.15.84:0/3433872876 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc23ffff640 1 --2- 172.21.15.84:0/3433872876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc240143d20 0x7fc2400b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.989+0000 7fc23f7fe640 1 --2- 172.21.15.84:0/3433872876 >> v2:172.21.15.99:3300/0 conn(0x7fc2400ce550 0x7fc2400b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.990+0000 7fc244f89640 1 -- 172.21.15.84:0/3433872876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc240143d20 msgr2=0x7fc2400b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.990+0000 7fc244f89640 1 --2- 172.21.15.84:0/3433872876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc240143d20 0x7fc2400b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.990+0000 7fc244f89640 1 -- 172.21.15.84:0/3433872876 >> v2:172.21.15.99:3300/0 conn(0x7fc2400ce550 msgr2=0x7fc2400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.990+0000 7fc244f89640 1 --2- 172.21.15.84:0/3433872876 >> v2:172.21.15.99:3300/0 conn(0x7fc2400ce550 0x7fc2400b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.990+0000 7fc244f89640 1 -- 172.21.15.84:0/3433872876 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240070870 con 0x7fc2401447f0 2023-12-12T09:22:23.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.991+0000 7fc244f89640 1 --2- 172.21.15.84:0/3433872876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2401447f0 0x7fc24015eaf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc24006bd40 tx=0x7fc23802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18ac93bd71ba93e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:23.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc23effd640 1 -- 172.21.15.84:0/3433872876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23802ca70 con 0x7fc2401447f0 2023-12-12T09:22:23.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc23effd640 1 -- 172.21.15.84:0/3433872876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23802cbd0 con 0x7fc2401447f0 2023-12-12T09:22:23.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc23effd640 1 -- 172.21.15.84:0/3433872876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380343f0 con 0x7fc2401447f0 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc2469ec640 1 -- 172.21.15.84:0/3433872876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2401447f0 msgr2=0x7fc24015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc2469ec640 1 --2- 172.21.15.84:0/3433872876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2401447f0 0x7fc24015eaf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc24006bd40 tx=0x7fc23802bed0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc2469ec640 1 -- 172.21.15.84:0/3433872876 shutdown_connections 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc2469ec640 1 --2- 172.21.15.84:0/3433872876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2401447f0 0x7fc24015eaf0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc2469ec640 1 --2- 172.21.15.84:0/3433872876 >> v2:172.21.15.99:3300/0 conn(0x7fc2400ce550 0x7fc2400b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc2469ec640 1 --2- 172.21.15.84:0/3433872876 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc240143d20 0x7fc2400b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc2469ec640 1 -- 172.21.15.84:0/3433872876 >> 172.21.15.84:0/3433872876 conn(0x7fc24006c3d0 msgr2=0x7fc24006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.992+0000 7fc2469ec640 1 -- 172.21.15.84:0/3433872876 shutdown_connections 2023-12-12T09:22:23.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.993+0000 7fc2469ec640 1 -- 172.21.15.84:0/3433872876 wait complete. 2023-12-12T09:22:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.994+0000 7fc2469ec640 1 Processor -- start 2023-12-12T09:22:23.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.994+0000 7fc2469ec640 1 -- start start 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.995+0000 7fc2469ec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2400ce550 0x7fc24015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.995+0000 7fc2469ec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240143d20 0x7fc24015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.995+0000 7fc2469ec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2401447f0 0x7fc2401f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.995+0000 7fc2469ec640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc240138bc0 con 0x7fc240143d20 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.995+0000 7fc2469ec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24015b550 con 0x7fc2401447f0 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.995+0000 7fc2469ec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2401f3f60 con 0x7fc2400ce550 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240143d20 0x7fc24015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240143d20 0x7fc24015a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43236/0 (socket says 172.21.15.84:43236) 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 -- 172.21.15.84:0/2723633910 learned_addr learned my addr 172.21.15.84:0/2723633910 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc244f89640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2401447f0 0x7fc2401f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23ffff640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2400ce550 0x7fc24015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 -- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2400ce550 msgr2=0x7fc24015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2400ce550 0x7fc24015bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 -- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2401447f0 msgr2=0x7fc2401f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2401447f0 0x7fc2401f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 -- 172.21.15.84:0/2723633910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc238009b30 con 0x7fc240143d20 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc244f89640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2401447f0 0x7fc2401f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23f7fe640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240143d20 0x7fc24015a4a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc22800d830 tx=0x7fc22800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.996+0000 7fc23cff9640 1 -- 172.21.15.84:0/2723633910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800b6c0 con 0x7fc240143d20 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.997+0000 7fc23cff9640 1 -- 172.21.15.84:0/2723633910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22800b820 con 0x7fc240143d20 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.997+0000 7fc23cff9640 1 -- 172.21.15.84:0/2723633910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800bbb0 con 0x7fc240143d20 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.997+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2401f4240 con 0x7fc240143d20 2023-12-12T09:22:23.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.997+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24015ba80 con 0x7fc240143d20 2023-12-12T09:22:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.998+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2401f4430 con 0x7fc240143d20 2023-12-12T09:22:23.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:23.999+0000 7fc23cff9640 1 -- 172.21.15.84:0/2723633910 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc22801e460 con 0x7fc240143d20 2023-12-12T09:22:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.000+0000 7fc23cff9640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc22006ae40 0x7fc22006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.000+0000 7fc23cff9640 1 -- 172.21.15.84:0/2723633910 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fc22808a100 con 0x7fc240143d20 2023-12-12T09:22:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.000+0000 7fc23ffff640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc22006ae40 0x7fc22006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.001+0000 7fc23ffff640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc22006ae40 0x7fc22006d300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc230006fd0 tx=0x7fc230008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:24.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.004+0000 7fc23cff9640 1 -- 172.21.15.84:0/2723633910 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc228054e40 con 0x7fc240143d20 2023-12-12T09:22:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.195+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc24015bc10 con 0x7fc240143d20 2023-12-12T09:22:24.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.197+0000 7fc23cff9640 1 -- 172.21.15.84:0/2723633910 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7fc228058460 con 0x7fc240143d20 2023-12-12T09:22:24.198 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:24.198 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:24.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc22006ae40 msgr2=0x7fc22006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc22006ae40 0x7fc22006d300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc230006fd0 tx=0x7fc230008040 comp rx=0 tx=0).stop 2023-12-12T09:22:24.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240143d20 msgr2=0x7fc24015a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240143d20 0x7fc24015a4a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc22800d830 tx=0x7fc22800dcf0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 shutdown_connections 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2401447f0 0x7fc2401f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc22006ae40 0x7fc22006d300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240143d20 0x7fc24015a4a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 --2- 172.21.15.84:0/2723633910 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc2400ce550 0x7fc24015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 >> 172.21.15.84:0/2723633910 conn(0x7fc24006c3d0 msgr2=0x7fc240070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 shutdown_connections 2023-12-12T09:22:24.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.200+0000 7fc2469ec640 1 -- 172.21.15.84:0/2723633910 wait complete. 2023-12-12T09:22:24.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:21:28.519227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:21:29.210161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'data_new', 'create_time': '2023-12-12T09:21:44.988386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:22:24.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:22:24.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.440+0000 7f0f40d16640 1 Processor -- start 2023-12-12T09:22:24.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.441+0000 7f0f40d16640 1 -- start start 2023-12-12T09:22:24.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.442+0000 7f0f40d16640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0f3c0b40d0 0x7f0f3c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.442+0000 7f0f40d16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f3c15be60 0x7f0f3c13e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.442+0000 7f0f40d16640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c0ceb80 con 0x7f0f3c0ce6f0 2023-12-12T09:22:24.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.442+0000 7f0f40d16640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0ce260 con 0x7f0f3c0b40d0 2023-12-12T09:22:24.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.442+0000 7f0f40d16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0cd930 con 0x7f0f3c15be60 2023-12-12T09:22:24.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.442+0000 7f0f31d9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0f3c0ce6f0 0x7f0f3c0b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36516/0 (socket says 172.21.15.84:36516) 2023-12-12T09:22:24.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f31d9b640 1 -- 172.21.15.84:0/3964444749 learned_addr learned my addr 172.21.15.84:0/3964444749 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f3a59c640 1 --2- 172.21.15.84:0/3964444749 >> v2:172.21.15.99:3300/0 conn(0x7f0f3c0b40d0 0x7f0f3c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f3ad9d640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f3c15be60 0x7f0f3c13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998739775 0 0) 0x7f0f3c0ceb80 con 0x7f0f3c0ce6f0 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f28003520 con 0x7f0f3c0ce6f0 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 384565771 0 0) 0x7f0f28003520 con 0x7f0f3c0ce6f0 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f3c15be60 msgr2=0x7f0f3c13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f3c15be60 0x7f0f3c13e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 >> v2:172.21.15.99:3300/0 conn(0x7f0f3c0b40d0 msgr2=0x7f0f3c06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 --2- 172.21.15.84:0/3964444749 >> v2:172.21.15.99:3300/0 conn(0x7f0f3c0b40d0 0x7f0f3c06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0cdc10 con 0x7f0f3c0ce6f0 2023-12-12T09:22:24.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f0f24001670 con 0x7f0f3c0ce6f0 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.443+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 >> v1:172.21.15.84:6789/0 conn(0x7f0f3c0ce6f0 legacy=0x7f0f3c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f39d9b640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f28003970 0x7f0f28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f39d9b640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f3c15be60 0x7f0f280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f39d9b640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f28004d00 0x7f0f28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0ce260 con 0x7f0f28003970 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0cd930 con 0x7f0f28004d00 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2800b980 con 0x7f0f3c15be60 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f3a59c640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f28003970 0x7f0f28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f3a59c640 1 -- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f3c15be60 msgr2=0x7f0f280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f31d9b640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f3c15be60 0x7f0f280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f3a59c640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f3c15be60 0x7f0f280047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f3a59c640 1 -- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f28004d00 msgr2=0x7f0f28005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f3a59c640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f28004d00 0x7f0f28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.444+0000 7f0f3a59c640 1 -- 172.21.15.84:0/3964444749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28003520 con 0x7f0f28003970 2023-12-12T09:22:24.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.445+0000 7f0f3a59c640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f28003970 0x7f0f28003d90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009ac0 tx=0x7f0f280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192f0e9edc15f272 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.446+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c02c710 con 0x7f0f28003970 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.446+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c02c870 con 0x7f0f28003970 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.446+0000 7f0f39d9b640 1 -- 172.21.15.84:0/3964444749 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c02cc00 con 0x7f0f28003970 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.446+0000 7f0f40d16640 1 -- 172.21.15.84:0/3964444749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f28003970 msgr2=0x7f0f28003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.446+0000 7f0f40d16640 1 --2- 172.21.15.84:0/3964444749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f28003970 0x7f0f28003d90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009ac0 tx=0x7f0f280057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.446+0000 7f0f3ad9d640 1 -- 172.21.15.84:0/3964444749 reap_dead start 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.446+0000 7f0f40d16640 1 -- 172.21.15.84:0/3964444749 shutdown_connections 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.446+0000 7f0f40d16640 1 -- 172.21.15.84:0/3964444749 >> 172.21.15.84:0/3964444749 conn(0x7f0f3c0b0ac0 msgr2=0x7f0f3c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.447+0000 7f0f40d16640 1 -- 172.21.15.84:0/3964444749 shutdown_connections 2023-12-12T09:22:24.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.447+0000 7f0f40d16640 1 -- 172.21.15.84:0/3964444749 wait complete. 2023-12-12T09:22:24.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.448+0000 7f0f40d16640 1 Processor -- start 2023-12-12T09:22:24.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.449+0000 7f0f40d16640 1 -- start start 2023-12-12T09:22:24.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f40d16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f28003970 0x7f0f3c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f40d16640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1555c0 0x7f0f3c1f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f40d16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f3c1f65e0 0x7f0f3c13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f40d16640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c155130 con 0x7f0f3c1555c0 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f40d16640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1f6b20 con 0x7f0f3c1f65e0 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f40d16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1f6e00 con 0x7f0f28003970 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f31d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1555c0 0x7f0f3c1f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f31d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1555c0 0x7f0f3c1f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43250/0 (socket says 172.21.15.84:43250) 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f31d9b640 1 -- 172.21.15.84:0/1820443491 learned_addr learned my addr 172.21.15.84:0/1820443491 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f3a59c640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f28003970 0x7f0f3c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f31d9b640 1 -- 172.21.15.84:0/1820443491 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f28003970 msgr2=0x7f0f3c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f31d9b640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f28003970 0x7f0f3c13a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f31d9b640 1 -- 172.21.15.84:0/1820443491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f3c1f65e0 msgr2=0x7f0f3c13bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f31d9b640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f3c1f65e0 0x7f0f3c13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.450+0000 7f0f31d9b640 1 -- 172.21.15.84:0/1820443491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c154dc0 con 0x7f0f3c1555c0 2023-12-12T09:22:24.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.451+0000 7f0f31d9b640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1555c0 0x7f0f3c1f60a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400d7c0 tx=0x7f0f2400dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:24.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.451+0000 7f0f337fe640 1 -- 172.21.15.84:0/1820443491 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240074e0 con 0x7f0f3c1555c0 2023-12-12T09:22:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.451+0000 7f0f337fe640 1 -- 172.21.15.84:0/1820443491 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24007640 con 0x7f0f3c1555c0 2023-12-12T09:22:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.451+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c155a40 con 0x7f0f3c1555c0 2023-12-12T09:22:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.451+0000 7f0f337fe640 1 -- 172.21.15.84:0/1820443491 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24004a00 con 0x7f0f3c1555c0 2023-12-12T09:22:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.451+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c0ae100 con 0x7f0f3c1555c0 2023-12-12T09:22:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.452+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c0673c0 con 0x7f0f3c1555c0 2023-12-12T09:22:24.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.453+0000 7f0f337fe640 1 -- 172.21.15.84:0/1820443491 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f24004b60 con 0x7f0f3c1555c0 2023-12-12T09:22:24.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.454+0000 7f0f337fe640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f1c06ae40 0x7f0f1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.454+0000 7f0f337fe640 1 -- 172.21.15.84:0/1820443491 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f0f24089680 con 0x7f0f3c1555c0 2023-12-12T09:22:24.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.454+0000 7f0f3a59c640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f1c06ae40 0x7f0f1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.455+0000 7f0f3a59c640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f1c06ae40 0x7f0f1c06d300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c036000 tx=0x7f0f2c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:24.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.458+0000 7f0f337fe640 1 -- 172.21.15.84:0/1820443491 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f240543c0 con 0x7f0f3c1555c0 2023-12-12T09:22:24.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.649+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f3c154f50 con 0x7f0f3c1555c0 2023-12-12T09:22:24.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.650+0000 7f0f337fe640 1 -- 172.21.15.84:0/1820443491 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f240579e0 con 0x7f0f3c1555c0 2023-12-12T09:22:24.651 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:22:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f1c06ae40 msgr2=0x7f0f1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f1c06ae40 0x7f0f1c06d300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c036000 tx=0x7f0f2c030000 comp rx=0 tx=0).stop 2023-12-12T09:22:24.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1555c0 msgr2=0x7f0f3c1f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1555c0 0x7f0f3c1f60a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400d7c0 tx=0x7f0f2400dc80 comp rx=0 tx=0).stop 2023-12-12T09:22:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 shutdown_connections 2023-12-12T09:22:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f3c1f65e0 0x7f0f3c13bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f1c06ae40 0x7f0f1c06d300 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1555c0 0x7f0f3c1f60a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 --2- 172.21.15.84:0/1820443491 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0f28003970 0x7f0f3c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 >> 172.21.15.84:0/1820443491 conn(0x7f0f3c0b0ac0 msgr2=0x7f0f3c0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 shutdown_connections 2023-12-12T09:22:24.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.653+0000 7f0f40d16640 1 -- 172.21.15.84:0/1820443491 wait complete. 2023-12-12T09:22:24.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:22:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.885+0000 7ff94905d640 1 Processor -- start 2023-12-12T09:22:24.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.885+0000 7ff94905d640 1 -- start start 2023-12-12T09:22:24.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.886+0000 7ff94905d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9440ad610 0x7ff9440ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.886+0000 7ff94905d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff944071640 0x7ff944070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.886+0000 7ff94905d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff944070ad0 con 0x7ff944070130 2023-12-12T09:22:24.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.887+0000 7ff94905d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9440b3c40 con 0x7ff944071640 2023-12-12T09:22:24.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.887+0000 7ff94905d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944071ab0 con 0x7ff9440ad610 2023-12-12T09:22:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.887+0000 7ff942d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9440ad610 0x7ff9440ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.887+0000 7ff94359e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff944071640 0x7ff944070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.887+0000 7ff942d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9440ad610 0x7ff9440ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:41374/0 (socket says 172.21.15.84:41374) 2023-12-12T09:22:24.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.887+0000 7ff94359e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff944071640 0x7ff944070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:60534/0 (socket says 172.21.15.84:60534) 2023-12-12T09:22:24.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.887+0000 7ff942d9d640 1 -- 172.21.15.84:0/528377270 learned_addr learned my addr 172.21.15.84:0/528377270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:24.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.888+0000 7ff942d9d640 1 -- 172.21.15.84:0/528377270 >> v2:172.21.15.99:3300/0 conn(0x7ff944071640 msgr2=0x7ff944070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:24.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.888+0000 7ff942d9d640 1 --2- 172.21.15.84:0/528377270 >> v2:172.21.15.99:3300/0 conn(0x7ff944071640 0x7ff944070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.888+0000 7ff942d9d640 1 -- 172.21.15.84:0/528377270 >> v1:172.21.15.99:6789/0 conn(0x7ff944070130 legacy=0x7ff944070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.888+0000 7ff942d9d640 1 -- 172.21.15.84:0/528377270 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440acbe0 con 0x7ff9440ad610 2023-12-12T09:22:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.890+0000 7ff942d9d640 1 --2- 172.21.15.84:0/528377270 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9440ad610 0x7ff9440ac6a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff9440acdd0 tx=0x7ff93402db00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61a566485d281537 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.890+0000 7ff94259c640 1 -- 172.21.15.84:0/528377270 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93402f8c0 con 0x7ff9440ad610 2023-12-12T09:22:24.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.890+0000 7ff94259c640 1 -- 172.21.15.84:0/528377270 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93402fa20 con 0x7ff9440ad610 2023-12-12T09:22:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94259c640 1 -- 172.21.15.84:0/528377270 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93402fdb0 con 0x7ff9440ad610 2023-12-12T09:22:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94905d640 1 -- 172.21.15.84:0/528377270 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9440ad610 msgr2=0x7ff9440ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94905d640 1 --2- 172.21.15.84:0/528377270 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9440ad610 0x7ff9440ac6a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff9440acdd0 tx=0x7ff93402db00 comp rx=0 tx=0).stop 2023-12-12T09:22:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94905d640 1 -- 172.21.15.84:0/528377270 shutdown_connections 2023-12-12T09:22:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94905d640 1 --2- 172.21.15.84:0/528377270 >> v2:172.21.15.99:3300/0 conn(0x7ff944071640 0x7ff944070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94905d640 1 --2- 172.21.15.84:0/528377270 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff9440ad610 0x7ff9440ac6a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94905d640 1 -- 172.21.15.84:0/528377270 >> 172.21.15.84:0/528377270 conn(0x7ff9440b0900 msgr2=0x7ff9440b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94905d640 1 -- 172.21.15.84:0/528377270 shutdown_connections 2023-12-12T09:22:24.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.891+0000 7ff94905d640 1 -- 172.21.15.84:0/528377270 wait complete. 2023-12-12T09:22:24.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.893+0000 7ff94905d640 1 Processor -- start 2023-12-12T09:22:24.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.893+0000 7ff94905d640 1 -- start start 2023-12-12T09:22:24.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.894+0000 7ff94905d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff944070130 0x7ff94415d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.894+0000 7ff94905d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff944071640 0x7ff94414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.894+0000 7ff94905d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9440ad610 0x7ff9441f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.894+0000 7ff94905d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441f3d80 con 0x7ff944070130 2023-12-12T09:22:24.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.894+0000 7ff94905d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441f2d80 con 0x7ff9440ad610 2023-12-12T09:22:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.894+0000 7ff94905d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff944151e50 con 0x7ff944071640 2023-12-12T09:22:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff942d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff944070130 0x7ff94415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff942d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff944070130 0x7ff94415d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43256/0 (socket says 172.21.15.84:43256) 2023-12-12T09:22:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff942d9d640 1 -- 172.21.15.84:0/1156278577 learned_addr learned my addr 172.21.15.84:0/1156278577 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff93bfff640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff944071640 0x7ff94414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff94359e640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9440ad610 0x7ff9441f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff942d9d640 1 -- 172.21.15.84:0/1156278577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff944071640 msgr2=0x7ff94414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff942d9d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff944071640 0x7ff94414e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff942d9d640 1 -- 172.21.15.84:0/1156278577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9440ad610 msgr2=0x7ff9441f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff942d9d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9440ad610 0x7ff9441f3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.895+0000 7ff942d9d640 1 -- 172.21.15.84:0/1156278577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9340094d0 con 0x7ff944070130 2023-12-12T09:22:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.896+0000 7ff942d9d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff944070130 0x7ff94415d080 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff934000c00 tx=0x7ff9340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:24.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.896+0000 7ff93b7fe640 1 -- 172.21.15.84:0/1156278577 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934042880 con 0x7ff944070130 2023-12-12T09:22:24.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.896+0000 7ff93b7fe640 1 -- 172.21.15.84:0/1156278577 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934042a20 con 0x7ff944070130 2023-12-12T09:22:24.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.896+0000 7ff93b7fe640 1 -- 172.21.15.84:0/1156278577 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934042dd0 con 0x7ff944070130 2023-12-12T09:22:24.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.896+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff944152130 con 0x7ff944070130 2023-12-12T09:22:24.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.896+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9441f3320 con 0x7ff944070130 2023-12-12T09:22:24.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.897+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9441f34b0 con 0x7ff944070130 2023-12-12T09:22:24.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.898+0000 7ff93b7fe640 1 -- 172.21.15.84:0/1156278577 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff934040440 con 0x7ff944070130 2023-12-12T09:22:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.899+0000 7ff93b7fe640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92406ae40 0x7ff92406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.899+0000 7ff93b7fe640 1 -- 172.21.15.84:0/1156278577 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7ff934033070 con 0x7ff944070130 2023-12-12T09:22:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.899+0000 7ff93bfff640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92406ae40 0x7ff92406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.900+0000 7ff93bfff640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92406ae40 0x7ff92406d300 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007fd0 tx=0x7ff92c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:24.903+0000 7ff93b7fe640 1 -- 172.21.15.84:0/1156278577 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9340772f0 con 0x7ff944070130 2023-12-12T09:22:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.095+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9440673c0 con 0x7ff944070130 2023-12-12T09:22:25.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.095+0000 7ff93b7fe640 1 -- 172.21.15.84:0/1156278577 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff93407a910 con 0x7ff944070130 2023-12-12T09:22:25.096 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92406ae40 msgr2=0x7ff92406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92406ae40 0x7ff92406d300 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff92c007fd0 tx=0x7ff92c009040 comp rx=0 tx=0).stop 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff944070130 msgr2=0x7ff94415d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff944070130 0x7ff94415d080 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff934000c00 tx=0x7ff9340046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 shutdown_connections 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9440ad610 0x7ff9441f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff944071640 0x7ff94414e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92406ae40 0x7ff92406d300 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 --2- 172.21.15.84:0/1156278577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff944070130 0x7ff94415d080 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 >> 172.21.15.84:0/1156278577 conn(0x7ff9440b0900 msgr2=0x7ff94415a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:25.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 shutdown_connections 2023-12-12T09:22:25.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.098+0000 7ff94905d640 1 -- 172.21.15.84:0/1156278577 wait complete. 2023-12-12T09:22:25.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:22:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.327+0000 7f584e87c640 1 Processor -- start 2023-12-12T09:22:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.328+0000 7f584e87c640 1 -- start start 2023-12-12T09:22:25.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.329+0000 7f584e87c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f58480b4560 0x7f58480b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.329+0000 7f584e87c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58480b30a0 con 0x7f584815d810 2023-12-12T09:22:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.329+0000 7f584e87c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584815dc90 con 0x7f584806d5e0 2023-12-12T09:22:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.329+0000 7f584e87c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584815e8a0 con 0x7f58480b4560 2023-12-12T09:22:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f583ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f584815d810 0x7f58480b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36530/0 (socket says 172.21.15.84:36530) 2023-12-12T09:22:25.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f583ffff640 1 -- 172.21.15.84:0/1064685201 learned_addr learned my addr 172.21.15.84:0/1064685201 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f5847fff640 1 --2- 172.21.15.84:0/1064685201 >> v2:172.21.15.99:3300/0 conn(0x7f58480b4560 0x7f58480b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195376997 0 0) 0x7f58480b30a0 con 0x7f584815d810 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5834003520 con 0x7f584815d810 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 581862081 0 0) 0x7f5834003520 con 0x7f584815d810 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 >> v2:172.21.15.99:3300/0 conn(0x7f58480b4560 msgr2=0x7f58480b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f58477fe640 1 --2- 172.21.15.84:0/1064685201 >> v2:172.21.15.99:3300/0 conn(0x7f58480b4560 0x7f58480b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 >> v1:172.21.15.99:6789/0 conn(0x7f584806d5e0 legacy=0x7f5848070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584815df70 con 0x7f584815d810 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f5830001670 con 0x7f584815d810 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.330+0000 7f5847fff640 1 --2- 172.21.15.84:0/1064685201 >> v2:172.21.15.99:3300/0 conn(0x7f58480b4560 0x7f58480b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:22:25.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 >> v1:172.21.15.84:6789/0 conn(0x7f584815d810 legacy=0x7f58480b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f58477fe640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5834003970 0x7f5834003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f58477fe640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58340047c0 0x7f5834004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f58477fe640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58340052a0 0x7f583400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584815e8a0 con 0x7f5834003970 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583400c170 con 0x7f58340052a0 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583400c330 con 0x7f58340047c0 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f5847fff640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5834003970 0x7f5834003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f583ffff640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58340047c0 0x7f5834004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f584ce19640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58340052a0 0x7f583400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f5847fff640 1 -- 172.21.15.84:0/1064685201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58340047c0 msgr2=0x7f5834004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f5847fff640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f58340047c0 0x7f5834004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f5847fff640 1 -- 172.21.15.84:0/1064685201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58340052a0 msgr2=0x7f583400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f5847fff640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58340052a0 0x7f583400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f584ce19640 1 -- 172.21.15.84:0/1064685201 reap_dead start 2023-12-12T09:22:25.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.331+0000 7f5847fff640 1 -- 172.21.15.84:0/1064685201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834003520 con 0x7f5834003970 2023-12-12T09:22:25.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.333+0000 7f5847fff640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5834003970 0x7f5834003d90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5838006fd0 tx=0x7f58340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62be972c927525e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:25.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.333+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838004030 con 0x7f5834003970 2023-12-12T09:22:25.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.333+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5838004190 con 0x7f5834003970 2023-12-12T09:22:25.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.333+0000 7f58477fe640 1 -- 172.21.15.84:0/1064685201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838003610 con 0x7f5834003970 2023-12-12T09:22:25.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.334+0000 7f584e87c640 1 -- 172.21.15.84:0/1064685201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5834003970 msgr2=0x7f5834003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.334+0000 7f584e87c640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5834003970 0x7f5834003d90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5838006fd0 tx=0x7f58340057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.334+0000 7f584e87c640 1 -- 172.21.15.84:0/1064685201 shutdown_connections 2023-12-12T09:22:25.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.334+0000 7f584e87c640 1 --2- 172.21.15.84:0/1064685201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5834003970 0x7f5834003d90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.334+0000 7f584e87c640 1 -- 172.21.15.84:0/1064685201 >> 172.21.15.84:0/1064685201 conn(0x7f58480b0ac0 msgr2=0x7f58480b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:25.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.334+0000 7f584e87c640 1 -- 172.21.15.84:0/1064685201 shutdown_connections 2023-12-12T09:22:25.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.334+0000 7f584e87c640 1 -- 172.21.15.84:0/1064685201 wait complete. 2023-12-12T09:22:25.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.336+0000 7f584e87c640 1 Processor -- start 2023-12-12T09:22:25.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.336+0000 7f584e87c640 1 -- start start 2023-12-12T09:22:25.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f584e87c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5834003970 0x7f5848159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f584e87c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848156920 0x7f5848140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f584e87c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5848156da0 0x7f5848140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f584e87c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58481598f0 con 0x7f5848156920 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f584e87c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584814d120 con 0x7f5848156da0 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f584e87c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5848159300 con 0x7f5834003970 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f583ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848156920 0x7f5848140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f583ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848156920 0x7f5848140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43286/0 (socket says 172.21.15.84:43286) 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f583ffff640 1 -- 172.21.15.84:0/1202294721 learned_addr learned my addr 172.21.15.84:0/1202294721 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f5847fff640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5834003970 0x7f5848159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f583ffff640 1 -- 172.21.15.84:0/1202294721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5834003970 msgr2=0x7f5848159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f584ce19640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5848156da0 0x7f5848140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f583ffff640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5834003970 0x7f5848159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f583ffff640 1 -- 172.21.15.84:0/1202294721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5848156da0 msgr2=0x7f5848140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f583ffff640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5848156da0 0x7f5848140c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.337+0000 7f583ffff640 1 -- 172.21.15.84:0/1202294721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584814cb60 con 0x7f5848156920 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.338+0000 7f583ffff640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848156920 0x7f5848140710 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5830001200 tx=0x7f583000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.338+0000 7f58457fa640 1 -- 172.21.15.84:0/1202294721 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300072d0 con 0x7f5848156920 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.338+0000 7f58457fa640 1 -- 172.21.15.84:0/1202294721 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830007430 con 0x7f5848156920 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.338+0000 7f58457fa640 1 -- 172.21.15.84:0/1202294721 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300047e0 con 0x7f5848156920 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.338+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584814ce40 con 0x7f5848156920 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.338+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584814c830 con 0x7f5848156920 2023-12-12T09:22:25.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.339+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5848159a30 con 0x7f5848156920 2023-12-12T09:22:25.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.340+0000 7f58457fa640 1 -- 172.21.15.84:0/1202294721 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5830004940 con 0x7f5848156920 2023-12-12T09:22:25.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.342+0000 7f58457fa640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f582806ae90 0x7f582806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.342+0000 7f58457fa640 1 -- 172.21.15.84:0/1202294721 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f58300893d0 con 0x7f5848156920 2023-12-12T09:22:25.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.342+0000 7f5847fff640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f582806ae90 0x7f582806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.343+0000 7f5847fff640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f582806ae90 0x7f582806d350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5838035000 tx=0x7f583803a040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:25.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.347+0000 7f58457fa640 1 -- 172.21.15.84:0/1202294721 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5848159a30 con 0x7f5848156920 2023-12-12T09:22:25.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.538+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5848159a30 con 0x7f5848156920 2023-12-12T09:22:25.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.539+0000 7f58457fa640 1 -- 172.21.15.84:0/1202294721 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5848159a30 con 0x7f5848156920 2023-12-12T09:22:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:22:25.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f582806ae90 msgr2=0x7f582806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f582806ae90 0x7f582806d350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5838035000 tx=0x7f583803a040 comp rx=0 tx=0).stop 2023-12-12T09:22:25.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848156920 msgr2=0x7f5848140710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848156920 0x7f5848140710 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f5830001200 tx=0x7f583000dc00 comp rx=0 tx=0).stop 2023-12-12T09:22:25.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 shutdown_connections 2023-12-12T09:22:25.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5848156da0 0x7f5848140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f582806ae90 0x7f582806d350 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5848156920 0x7f5848140710 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 --2- 172.21.15.84:0/1202294721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5834003970 0x7f5848159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.541+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 >> 172.21.15.84:0/1202294721 conn(0x7f58480b0ac0 msgr2=0x7f58480b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:25.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.542+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 shutdown_connections 2023-12-12T09:22:25.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.542+0000 7f584e87c640 1 -- 172.21.15.84:0/1202294721 wait complete. 2023-12-12T09:22:25.561 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-12-12T09:22:25.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.781+0000 7fe3dffff640 1 Processor -- start 2023-12-12T09:22:25.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.782+0000 7fe3dffff640 1 -- start start 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.783+0000 7fe3dffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3e015d130 0x7fe3e00ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.783+0000 7fe3dffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe3e00d0000 0x7fe3e006bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.783+0000 7fe3dffff640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e006af10 con 0x7fe3e015d510 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.783+0000 7fe3dffff640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e00afc80 con 0x7fe3e015d130 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.783+0000 7fe3dffff640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e00d1ea0 con 0x7fe3e00d0000 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.783+0000 7fe3deffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3e015d130 0x7fe3e00ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.783+0000 7fe3de7fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe3e015d510 0x7fe3e00cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:36534/0 (socket says 172.21.15.84:36534) 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3de7fc640 1 -- 172.21.15.84:0/1676201777 learned_addr learned my addr 172.21.15.84:0/1676201777 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:25.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3deffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3e015d130 0x7fe3e00ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43298/0 (socket says 172.21.15.84:43298) 2023-12-12T09:22:25.785 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3df7fe640 1 --2- 172.21.15.84:0/1676201777 >> v2:172.21.15.99:3300/0 conn(0x7fe3e00d0000 0x7fe3e006bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3ddffb640 1 -- 172.21.15.84:0/1676201777 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440760939 0 0) 0x7fe3e006af10 con 0x7fe3e015d510 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3ddffb640 1 -- 172.21.15.84:0/1676201777 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3cc003520 con 0x7fe3e015d510 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3deffd640 1 -- 172.21.15.84:0/1676201777 >> v2:172.21.15.99:3300/0 conn(0x7fe3e00d0000 msgr2=0x7fe3e006bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3deffd640 1 --2- 172.21.15.84:0/1676201777 >> v2:172.21.15.99:3300/0 conn(0x7fe3e00d0000 0x7fe3e006bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3deffd640 1 -- 172.21.15.84:0/1676201777 >> v1:172.21.15.84:6789/0 conn(0x7fe3e015d510 legacy=0x7fe3e00cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.784+0000 7fe3deffd640 1 -- 172.21.15.84:0/1676201777 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e00cedd0 con 0x7fe3e015d130 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.785+0000 7fe3deffd640 1 --2- 172.21.15.84:0/1676201777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e015d130 0x7fe3e00ce6d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00b29b0 tx=0x7fe3c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5396cf5cd5b5e439 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.785+0000 7fe3ddffb640 1 -- 172.21.15.84:0/1676201777 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8031830 con 0x7fe3e015d130 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3ddffb640 1 -- 172.21.15.84:0/1676201777 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8031990 con 0x7fe3e015d130 2023-12-12T09:22:25.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3ddffb640 1 -- 172.21.15.84:0/1676201777 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8031d20 con 0x7fe3e015d130 2023-12-12T09:22:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3dffff640 1 -- 172.21.15.84:0/1676201777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e015d130 msgr2=0x7fe3e00ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3dffff640 1 --2- 172.21.15.84:0/1676201777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e015d130 0x7fe3e00ce6d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00b29b0 tx=0x7fe3c802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3dffff640 1 -- 172.21.15.84:0/1676201777 shutdown_connections 2023-12-12T09:22:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3dffff640 1 --2- 172.21.15.84:0/1676201777 >> v2:172.21.15.99:3300/0 conn(0x7fe3e00d0000 0x7fe3e006bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3dffff640 1 --2- 172.21.15.84:0/1676201777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e015d130 0x7fe3e00ce6d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3dffff640 1 -- 172.21.15.84:0/1676201777 >> 172.21.15.84:0/1676201777 conn(0x7fe3e00d2fb0 msgr2=0x7fe3e00d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3dffff640 1 -- 172.21.15.84:0/1676201777 shutdown_connections 2023-12-12T09:22:25.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.786+0000 7fe3dffff640 1 -- 172.21.15.84:0/1676201777 wait complete. 2023-12-12T09:22:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.788+0000 7fe3dffff640 1 Processor -- start 2023-12-12T09:22:25.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.788+0000 7fe3dffff640 1 -- start start 2023-12-12T09:22:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00d0000 0x7fe3e00c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3dffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3e015d130 0x7fe3e00b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3dffff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3e015d510 0x7fe3e00b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3dffff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e00c7ab0 con 0x7fe3e00d0000 2023-12-12T09:22:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3dffff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e00c7d00 con 0x7fe3e015d130 2023-12-12T09:22:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3dffff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e00c7fe0 con 0x7fe3e015d510 2023-12-12T09:22:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3deffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00d0000 0x7fe3e00c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3deffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00d0000 0x7fe3e00c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43314/0 (socket says 172.21.15.84:43314) 2023-12-12T09:22:25.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.789+0000 7fe3deffd640 1 -- 172.21.15.84:0/334730015 learned_addr learned my addr 172.21.15.84:0/334730015 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3deffd640 1 -- 172.21.15.84:0/334730015 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3e015d510 msgr2=0x7fe3e00b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3deffd640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3e015d510 0x7fe3e00b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3deffd640 1 -- 172.21.15.84:0/334730015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3e015d130 msgr2=0x7fe3e00b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3deffd640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3e015d130 0x7fe3e00b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3deffd640 1 -- 172.21.15.84:0/334730015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009400 con 0x7fe3e00d0000 2023-12-12T09:22:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3deffd640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00d0000 0x7fe3e00c8da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009890 tx=0x7fe3c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3d7fff640 1 -- 172.21.15.84:0/334730015 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c803a6f0 con 0x7fe3e00d0000 2023-12-12T09:22:25.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3d7fff640 1 -- 172.21.15.84:0/334730015 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c803a870 con 0x7fe3e00d0000 2023-12-12T09:22:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3d7fff640 1 -- 172.21.15.84:0/334730015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c803ac20 con 0x7fe3e00d0000 2023-12-12T09:22:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.790+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e00c82c0 con 0x7fe3e00d0000 2023-12-12T09:22:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.791+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e00c8880 con 0x7fe3e00d0000 2023-12-12T09:22:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.792+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e00c8aa0 con 0x7fe3e00d0000 2023-12-12T09:22:25.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.792+0000 7fe3d7fff640 1 -- 172.21.15.84:0/334730015 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3c8043410 con 0x7fe3e00d0000 2023-12-12T09:22:25.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.793+0000 7fe3d7fff640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe3c006ae40 0x7fe3c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.793+0000 7fe3d7fff640 1 -- 172.21.15.84:0/334730015 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fe3c80ab410 con 0x7fe3e00d0000 2023-12-12T09:22:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.794+0000 7fe3de7fc640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe3c006ae40 0x7fe3c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:25.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.794+0000 7fe3de7fc640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe3c006ae40 0x7fe3c006d300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe3e01f6270 tx=0x7fe3d00015f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:25.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.798+0000 7fe3d7fff640 1 -- 172.21.15.84:0/334730015 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3c8076310 con 0x7fe3e00d0000 2023-12-12T09:22:25.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.987+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fe3e00673c0 con 0x7fe3e00d0000 2023-12-12T09:22:25.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.988+0000 7fe3d7fff640 1 -- 172.21.15.84:0/334730015 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v44) v1 ==== 97+0+11 (secure 0 0 0) 0x7fe3c807ee60 con 0x7fe3e00d0000 2023-12-12T09:22:25.988 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:22:25.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.990+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe3c006ae40 msgr2=0x7fe3c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.990+0000 7fe3dffff640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe3c006ae40 0x7fe3c006d300 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe3e01f6270 tx=0x7fe3d00015f0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.990+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00d0000 msgr2=0x7fe3e00c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:25.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.990+0000 7fe3dffff640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00d0000 0x7fe3e00c8da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009890 tx=0x7fe3c80046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.991+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 shutdown_connections 2023-12-12T09:22:25.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.991+0000 7fe3dffff640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe3e015d510 0x7fe3e00b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.991+0000 7fe3dffff640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3e015d130 0x7fe3e00b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.991+0000 7fe3dffff640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe3c006ae40 0x7fe3c006d300 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.991+0000 7fe3dffff640 1 --2- 172.21.15.84:0/334730015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3e00d0000 0x7fe3e00c8da0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:25.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.991+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 >> 172.21.15.84:0/334730015 conn(0x7fe3e00d2fb0 msgr2=0x7fe3e00d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:25.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.991+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 shutdown_connections 2023-12-12T09:22:25.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:25.991+0000 7fe3dffff640 1 -- 172.21.15.84:0/334730015 wait complete. 2023-12-12T09:22:26.008 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:22:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.215+0000 7f22cd9f5640 1 Processor -- start 2023-12-12T09:22:26.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.215+0000 7f22cd9f5640 1 -- start start 2023-12-12T09:22:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.217+0000 7f22cd9f5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f22c80b47e0 0x7f22c8071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.217+0000 7f22cd9f5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22c80ce550 0x7f22c80715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.217+0000 7f22cd9f5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c80cea30 con 0x7f22c8143d20 2023-12-12T09:22:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.217+0000 7f22cd9f5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c80702b0 con 0x7f22c80ce550 2023-12-12T09:22:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.217+0000 7f22cd9f5640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c8070590 con 0x7f22c80b47e0 2023-12-12T09:22:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.217+0000 7f22c77fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22c80ce550 0x7f22c80715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.217+0000 7f22c77fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f22c80ce550 0x7f22c80715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36578/0 (socket says 172.21.15.84:36578) 2023-12-12T09:22:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.217+0000 7f22c77fe640 1 -- 172.21.15.84:0/3104239318 learned_addr learned my addr 172.21.15.84:0/3104239318 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.218+0000 7f22c67fc640 1 --2- 172.21.15.84:0/3104239318 >> v2:172.21.15.99:3300/0 conn(0x7f22c80b47e0 0x7f22c8071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.218+0000 7f22c77fe640 1 -- 172.21.15.84:0/3104239318 >> v2:172.21.15.99:3300/0 conn(0x7f22c80b47e0 msgr2=0x7f22c8071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.218+0000 7f22c77fe640 1 --2- 172.21.15.84:0/3104239318 >> v2:172.21.15.99:3300/0 conn(0x7f22c80b47e0 0x7f22c8071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.218+0000 7f22c77fe640 1 -- 172.21.15.84:0/3104239318 >> v1:172.21.15.99:6789/0 conn(0x7f22c8143d20 legacy=0x7f22c80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.218+0000 7f22c77fe640 1 -- 172.21.15.84:0/3104239318 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8070870 con 0x7f22c80ce550 2023-12-12T09:22:26.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.218+0000 7f22c67fc640 1 --2- 172.21.15.84:0/3104239318 >> v2:172.21.15.99:3300/0 conn(0x7f22c80b47e0 0x7f22c8071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.219+0000 7f22c77fe640 1 --2- 172.21.15.84:0/3104239318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c80715b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f22c806be30 tx=0x7f22c002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64fc1c9833bef89 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.219+0000 7f22c5ffb640 1 -- 172.21.15.84:0/3104239318 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c002ca80 con 0x7f22c80ce550 2023-12-12T09:22:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.219+0000 7f22c5ffb640 1 -- 172.21.15.84:0/3104239318 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c002cbe0 con 0x7f22c80ce550 2023-12-12T09:22:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.219+0000 7f22c5ffb640 1 -- 172.21.15.84:0/3104239318 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c00343f0 con 0x7f22c80ce550 2023-12-12T09:22:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.220+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3104239318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 msgr2=0x7f22c80715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.220+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3104239318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c80715b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f22c806be30 tx=0x7f22c002bee0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.220+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3104239318 shutdown_connections 2023-12-12T09:22:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.220+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3104239318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c80715b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.220+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3104239318 >> v2:172.21.15.99:3300/0 conn(0x7f22c80b47e0 0x7f22c8071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.220+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3104239318 >> 172.21.15.84:0/3104239318 conn(0x7f22c806c3d0 msgr2=0x7f22c806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.220+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3104239318 shutdown_connections 2023-12-12T09:22:26.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.220+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3104239318 wait complete. 2023-12-12T09:22:26.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.222+0000 7f22cd9f5640 1 Processor -- start 2023-12-12T09:22:26.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.222+0000 7f22cd9f5640 1 -- start start 2023-12-12T09:22:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22cd9f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c80b47e0 0x7f22c813f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22cd9f5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c815d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22cd9f5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22c8143d20 0x7f22c814cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22cd9f5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c813feb0 con 0x7f22c80ce550 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22cd9f5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c813e7a0 con 0x7f22c80b47e0 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22cd9f5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c813ea80 con 0x7f22c8143d20 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22c67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c815d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22c67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c815d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36594/0 (socket says 172.21.15.84:36594) 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22c67fc640 1 -- 172.21.15.84:0/3824806344 learned_addr learned my addr 172.21.15.84:0/3824806344 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.223+0000 7f22c6ffd640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c80b47e0 0x7f22c813f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22c67fc640 1 -- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22c8143d20 msgr2=0x7f22c814cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22c77fe640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22c8143d20 0x7f22c814cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22c67fc640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22c8143d20 0x7f22c814cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22c67fc640 1 -- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c80b47e0 msgr2=0x7f22c813f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22c67fc640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c80b47e0 0x7f22c813f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22c67fc640 1 -- 172.21.15.84:0/3824806344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0009b30 con 0x7f22c80ce550 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22c6ffd640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c80b47e0 0x7f22c813f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:26.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22c67fc640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c815d380 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00c7f0 tx=0x7f22bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22affff640 1 -- 172.21.15.84:0/3824806344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc007a30 con 0x7f22c80ce550 2023-12-12T09:22:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22affff640 1 -- 172.21.15.84:0/3824806344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc007b90 con 0x7f22c80ce550 2023-12-12T09:22:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22affff640 1 -- 172.21.15.84:0/3824806344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00ce40 con 0x7f22c80ce550 2023-12-12T09:22:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c813ed60 con 0x7f22c80ce550 2023-12-12T09:22:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.224+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c815a890 con 0x7f22c80ce550 2023-12-12T09:22:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.225+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c813f280 con 0x7f22c80ce550 2023-12-12T09:22:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.226+0000 7f22affff640 1 -- 172.21.15.84:0/3824806344 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22bc0113f0 con 0x7f22c80ce550 2023-12-12T09:22:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.227+0000 7f22affff640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b406ae40 0x7f22b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.227+0000 7f22affff640 1 -- 172.21.15.84:0/3824806344 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f22bc089c00 con 0x7f22c80ce550 2023-12-12T09:22:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.228+0000 7f22c6ffd640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b406ae40 0x7f22b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.228+0000 7f22c6ffd640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b406ae40 0x7f22b406d300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f22b800a810 tx=0x7f22b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:26.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.232+0000 7f22affff640 1 -- 172.21.15.84:0/3824806344 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22c813f280 con 0x7f22c80ce550 2023-12-12T09:22:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.461+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22c813f280 con 0x7f22c80ce550 2023-12-12T09:22:26.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.462+0000 7f22affff640 1 -- 172.21.15.84:0/3824806344 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f22c813f280 con 0x7f22c80ce550 2023-12-12T09:22:26.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:26.463 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6834/3349912921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3349912921},{"type":"v1","addr":"172.21.15.99:6834","nonce":3349912921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3102874305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6833","nonce":3102874305},{"type":"v1","addr":"172.21.15.99:6835","nonce":3102874305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2816609542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2816609542},{"type":"v1","addr":"172.21.15.84:6837","nonce":2816609542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:21:30.192583+0000","modified":"2023-12-12T09:21:45.673958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6836/1717242900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1717242900},{"type":"v1","addr":"172.21.15.84:6836","nonce":1717242900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:22:26.463 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b406ae40 msgr2=0x7f22b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b406ae40 0x7f22b406d300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f22b800a810 tx=0x7f22b8008040 comp rx=0 tx=0).stop 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 msgr2=0x7f22c815d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c815d380 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00c7f0 tx=0x7f22bc00cbf0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 shutdown_connections 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f22c8143d20 0x7f22c814cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f22b406ae40 0x7f22b406d300 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c80ce550 0x7f22c815d380 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 --2- 172.21.15.84:0/3824806344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22c80b47e0 0x7f22c813f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 >> 172.21.15.84:0/3824806344 conn(0x7f22c806c3d0 msgr2=0x7f22c80ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:26.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 shutdown_connections 2023-12-12T09:22:26.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.465+0000 7f22cd9f5640 1 -- 172.21.15.84:0/3824806344 wait complete. 2023-12-12T09:22:26.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.689+0000 7fad60733640 1 Processor -- start 2023-12-12T09:22:26.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.689+0000 7fad60733640 1 -- start start 2023-12-12T09:22:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad60733640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad58143d20 0x7fad580b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad60733640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5815f910 con 0x7fad581447f0 2023-12-12T09:22:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad60733640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad580cea30 con 0x7fad580ce550 2023-12-12T09:22:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad60733640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580702b0 con 0x7fad58143d20 2023-12-12T09:22:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad5ecd0640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fad581447f0 0x7fad5815f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39126/0 (socket says 172.21.15.84:39126) 2023-12-12T09:22:26.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad5ecd0640 1 -- 172.21.15.84:0/3070155025 learned_addr learned my addr 172.21.15.84:0/3070155025 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:26.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999552811 0 0) 0x7fad5815f910 con 0x7fad581447f0 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad44003520 con 0x7fad581447f0 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.691+0000 7fad5e4cf640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad58143d20 0x7fad580b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042153887 0 0) 0x7fad44003520 con 0x7fad581447f0 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad58143d20 msgr2=0x7fad580b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad58143d20 0x7fad580b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 >> v1:172.21.15.99:6789/0 conn(0x7fad580ce550 legacy=0x7fad5815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58070590 con 0x7fad581447f0 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fad500019f0 con 0x7fad581447f0 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 >> v1:172.21.15.84:6789/0 conn(0x7fad581447f0 legacy=0x7fad5815f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad440039a0 0x7fad44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad440047c0 0x7fad44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad58143d20 0x7fad440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580702b0 con 0x7fad440039a0 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4400bab0 con 0x7fad440047c0 2023-12-12T09:22:26.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4400bc70 con 0x7fad58143d20 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.692+0000 7fad5e4cf640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad440039a0 0x7fad44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.693+0000 7fad5dcce640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad440047c0 0x7fad44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.693+0000 7fad5e4cf640 1 -- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad58143d20 msgr2=0x7fad440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.693+0000 7fad5ecd0640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad58143d20 0x7fad440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.693+0000 7fad5e4cf640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad58143d20 0x7fad440051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.693+0000 7fad5e4cf640 1 -- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad440047c0 msgr2=0x7fad44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.693+0000 7fad5e4cf640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad440047c0 0x7fad44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.693+0000 7fad5e4cf640 1 -- 172.21.15.84:0/3070155025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44003520 con 0x7fad440039a0 2023-12-12T09:22:26.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.693+0000 7fad5dcce640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad440047c0 0x7fad44004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.694+0000 7fad5e4cf640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad440039a0 0x7fad44003dc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fad5400ba30 tx=0x7fad440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4909f79ab696f3ad server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.694+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54032640 con 0x7fad440039a0 2023-12-12T09:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.694+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad540327a0 con 0x7fad440039a0 2023-12-12T09:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.694+0000 7fad5d4cd640 1 -- 172.21.15.84:0/3070155025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54032b30 con 0x7fad440039a0 2023-12-12T09:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.695+0000 7fad60733640 1 -- 172.21.15.84:0/3070155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad440039a0 msgr2=0x7fad44003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.695+0000 7fad60733640 1 --2- 172.21.15.84:0/3070155025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad440039a0 0x7fad44003dc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fad5400ba30 tx=0x7fad440057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.695+0000 7fad5ecd0640 1 -- 172.21.15.84:0/3070155025 reap_dead start 2023-12-12T09:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.695+0000 7fad60733640 1 -- 172.21.15.84:0/3070155025 shutdown_connections 2023-12-12T09:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.695+0000 7fad60733640 1 -- 172.21.15.84:0/3070155025 >> 172.21.15.84:0/3070155025 conn(0x7fad5806c3d0 msgr2=0x7fad5806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.695+0000 7fad60733640 1 -- 172.21.15.84:0/3070155025 shutdown_connections 2023-12-12T09:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.695+0000 7fad60733640 1 -- 172.21.15.84:0/3070155025 wait complete. 2023-12-12T09:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.697+0000 7fad60733640 1 Processor -- start 2023-12-12T09:22:26.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.697+0000 7fad60733640 1 -- start start 2023-12-12T09:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad60733640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad440039a0 0x7fad581f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad60733640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad581389f0 0x7fad58138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad60733640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad5815d540 0x7fad5815d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad60733640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58135e90 con 0x7fad5815d540 2023-12-12T09:22:26.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad60733640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad581393b0 con 0x7fad581389f0 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad60733640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad581f3480 con 0x7fad440039a0 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5ecd0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad5815d540 0x7fad5815d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5ecd0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad5815d540 0x7fad5815d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36602/0 (socket says 172.21.15.84:36602) 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5ecd0640 1 -- 172.21.15.84:0/639460666 learned_addr learned my addr 172.21.15.84:0/639460666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5dcce640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad581389f0 0x7fad58138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5e4cf640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad440039a0 0x7fad581f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5ecd0640 1 -- 172.21.15.84:0/639460666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad440039a0 msgr2=0x7fad581f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5ecd0640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad440039a0 0x7fad581f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5ecd0640 1 -- 172.21.15.84:0/639460666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad581389f0 msgr2=0x7fad58138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5ecd0640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad581389f0 0x7fad58138e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.698+0000 7fad5ecd0640 1 -- 172.21.15.84:0/639460666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58136cb0 con 0x7fad5815d540 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.699+0000 7fad5ecd0640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad5815d540 0x7fad5815d9c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fad50000f80 tx=0x7fad5000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.699+0000 7fad4effd640 1 -- 172.21.15.84:0/639460666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000bb80 con 0x7fad5815d540 2023-12-12T09:22:26.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.699+0000 7fad4effd640 1 -- 172.21.15.84:0/639460666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5000bce0 con 0x7fad5815d540 2023-12-12T09:22:26.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.699+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5815df00 con 0x7fad5815d540 2023-12-12T09:22:26.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.699+0000 7fad4effd640 1 -- 172.21.15.84:0/639460666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50007290 con 0x7fad5815d540 2023-12-12T09:22:26.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.699+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad58136380 con 0x7fad5815d540 2023-12-12T09:22:26.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.700+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58136e40 con 0x7fad5815d540 2023-12-12T09:22:26.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.702+0000 7fad4effd640 1 -- 172.21.15.84:0/639460666 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad500073f0 con 0x7fad5815d540 2023-12-12T09:22:26.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.702+0000 7fad4effd640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad3c06ae70 0x7fad3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.703+0000 7fad4effd640 1 -- 172.21.15.84:0/639460666 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fad50089e20 con 0x7fad5815d540 2023-12-12T09:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.703+0000 7fad5e4cf640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad3c06ae70 0x7fad3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:26.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.703+0000 7fad5e4cf640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad3c06ae70 0x7fad3c06d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad5400ba00 tx=0x7fad5403d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:26.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.707+0000 7fad4effd640 1 -- 172.21.15.84:0/639460666 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad50054b60 con 0x7fad5815d540 2023-12-12T09:22:26.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.906+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad580673c0 con 0x7fad5815d540 2023-12-12T09:22:26.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.909+0000 7fad4effd640 1 -- 172.21.15.84:0/639460666 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7fad50058180 con 0x7fad5815d540 2023-12-12T09:22:26.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad3c06ae70 msgr2=0x7fad3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad3c06ae70 0x7fad3c06d330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fad5400ba00 tx=0x7fad5403d040 comp rx=0 tx=0).stop 2023-12-12T09:22:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad5815d540 msgr2=0x7fad5815d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad5815d540 0x7fad5815d9c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fad50000f80 tx=0x7fad5000b4a0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 shutdown_connections 2023-12-12T09:22:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad3c06ae70 0x7fad3c06d330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad5815d540 0x7fad5815d9c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad581389f0 0x7fad58138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 --2- 172.21.15.84:0/639460666 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fad440039a0 0x7fad581f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 >> 172.21.15.84:0/639460666 conn(0x7fad5806c3d0 msgr2=0x7fad580b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 shutdown_connections 2023-12-12T09:22:26.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:26.912+0000 7fad60733640 1 -- 172.21.15.84:0/639460666 wait complete. 2023-12-12T09:22:26.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:22:26.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:22:27.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.147+0000 7ff573c87640 1 Processor -- start 2023-12-12T09:22:27.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.148+0000 7ff573c87640 1 -- start start 2023-12-12T09:22:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.149+0000 7ff573c87640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff56c071bb0 0x7ff56c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.149+0000 7ff573c87640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c0724d0 con 0x7ff56c13dae0 2023-12-12T09:22:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.149+0000 7ff573c87640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c140270 con 0x7ff56c0ce330 2023-12-12T09:22:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.149+0000 7ff573c87640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0cd850 con 0x7ff56c071bb0 2023-12-12T09:22:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff572224640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff56c13dae0 0x7ff56c13f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39142/0 (socket says 172.21.15.84:39142) 2023-12-12T09:22:27.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff572224640 1 -- 172.21.15.84:0/1572132397 learned_addr learned my addr 172.21.15.84:0/1572132397 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff571a23640 1 --2- 172.21.15.84:0/1572132397 >> v2:172.21.15.99:3300/0 conn(0x7ff56c071bb0 0x7ff56c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938382571 0 0) 0x7ff56c0724d0 con 0x7ff56c13dae0 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff558003520 con 0x7ff56c13dae0 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972487906 0 0) 0x7ff558003520 con 0x7ff56c13dae0 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 >> v2:172.21.15.99:3300/0 conn(0x7ff56c071bb0 msgr2=0x7ff56c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 --2- 172.21.15.84:0/1572132397 >> v2:172.21.15.99:3300/0 conn(0x7ff56c071bb0 0x7ff56c071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 >> v1:172.21.15.99:6789/0 conn(0x7ff56c0ce330 legacy=0x7ff56c13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0cdb30 con 0x7ff56c13dae0 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7ff5640019f0 con 0x7ff56c13dae0 2023-12-12T09:22:27.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.150+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 >> v1:172.21.15.84:6789/0 conn(0x7ff56c13dae0 legacy=0x7ff56c13f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff570a21640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558003970 0x7ff558003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff570a21640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff570a21640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558005180 0x7ff55800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0cd850 con 0x7ff558003970 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800c0d0 con 0x7ff558005180 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800c290 con 0x7ff5580047c0 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff571a23640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558003970 0x7ff558003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff572224640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558005180 0x7ff55800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff571a23640 1 -- 172.21.15.84:0/1572132397 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5580047c0 msgr2=0x7ff558004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff571a23640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff571a23640 1 -- 172.21.15.84:0/1572132397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558005180 msgr2=0x7ff55800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff571a23640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558005180 0x7ff55800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff571a23640 1 -- 172.21.15.84:0/1572132397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558003520 con 0x7ff558003970 2023-12-12T09:22:27.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff572224640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558005180 0x7ff55800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:27.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.151+0000 7ff572224640 1 -- 172.21.15.84:0/1572132397 reap_dead start 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.152+0000 7ff571a23640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558003970 0x7ff558003d90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff56800ba30 tx=0x7ff5580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd4647c3ad22648 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568032640 con 0x7ff558003970 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5680327a0 con 0x7ff558003970 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff570a21640 1 -- 172.21.15.84:0/1572132397 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568032b30 con 0x7ff558003970 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff573c87640 1 -- 172.21.15.84:0/1572132397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558003970 msgr2=0x7ff558003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff573c87640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558003970 0x7ff558003d90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff56800ba30 tx=0x7ff5580057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff573c87640 1 -- 172.21.15.84:0/1572132397 shutdown_connections 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff573c87640 1 --2- 172.21.15.84:0/1572132397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff558003970 0x7ff558003d90 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff573c87640 1 -- 172.21.15.84:0/1572132397 >> 172.21.15.84:0/1572132397 conn(0x7ff56c06c3d0 msgr2=0x7ff56c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff573c87640 1 -- 172.21.15.84:0/1572132397 shutdown_connections 2023-12-12T09:22:27.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.153+0000 7ff573c87640 1 -- 172.21.15.84:0/1572132397 wait complete. 2023-12-12T09:22:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.155+0000 7ff573c87640 1 Processor -- start 2023-12-12T09:22:27.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.155+0000 7ff573c87640 1 -- start start 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.156+0000 7ff573c87640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558003970 0x7ff56c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.156+0000 7ff573c87640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56c151410 0x7ff56c1371e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.156+0000 7ff573c87640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff56c151890 0x7ff56c137720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.156+0000 7ff573c87640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c151db0 con 0x7ff56c151890 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.156+0000 7ff573c87640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c152090 con 0x7ff558003970 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.156+0000 7ff573c87640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c152370 con 0x7ff56c151410 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.156+0000 7ff572224640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff56c151890 0x7ff56c137720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff572224640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff56c151890 0x7ff56c137720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36632/0 (socket says 172.21.15.84:36632) 2023-12-12T09:22:27.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff572224640 1 -- 172.21.15.84:0/121926273 learned_addr learned my addr 172.21.15.84:0/121926273 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:27.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff571a23640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558003970 0x7ff56c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff572224640 1 -- 172.21.15.84:0/121926273 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56c151410 msgr2=0x7ff56c1371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff571222640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56c151410 0x7ff56c1371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff572224640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56c151410 0x7ff56c1371e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff572224640 1 -- 172.21.15.84:0/121926273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558003970 msgr2=0x7ff56c159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff572224640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558003970 0x7ff56c159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff572224640 1 -- 172.21.15.84:0/121926273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c152650 con 0x7ff56c151890 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff572224640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff56c151890 0x7ff56c137720 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0ae9e0 tx=0x7ff56400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.157+0000 7ff5627fc640 1 -- 172.21.15.84:0/121926273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564004d60 con 0x7ff56c151890 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.158+0000 7ff5627fc640 1 -- 172.21.15.84:0/121926273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400bb80 con 0x7ff56c151890 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.158+0000 7ff5627fc640 1 -- 172.21.15.84:0/121926273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564007070 con 0x7ff56c151890 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.158+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c152930 con 0x7ff56c151890 2023-12-12T09:22:27.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.158+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c159870 con 0x7ff56c151890 2023-12-12T09:22:27.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.159+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c152b20 con 0x7ff56c151890 2023-12-12T09:22:27.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.160+0000 7ff5627fc640 1 -- 172.21.15.84:0/121926273 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5640071d0 con 0x7ff56c151890 2023-12-12T09:22:27.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.161+0000 7ff5627fc640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff55006ae70 0x7ff55006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.161+0000 7ff5627fc640 1 -- 172.21.15.84:0/121926273 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7ff564089cd0 con 0x7ff56c151890 2023-12-12T09:22:27.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.161+0000 7ff571a23640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff55006ae70 0x7ff55006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.162+0000 7ff571a23640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff55006ae70 0x7ff55006d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff56800ba00 tx=0x7ff568030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:27.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.165+0000 7ff5627fc640 1 -- 172.21.15.84:0/121926273 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff564054ab0 con 0x7ff56c151890 2023-12-12T09:22:27.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.397+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff56c0673c0 con 0x7ff56c151890 2023-12-12T09:22:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.398+0000 7ff5627fc640 1 -- 172.21.15.84:0/121926273 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4915 (secure 0 0 0) 0x7ff5640580d0 con 0x7ff56c151890 2023-12-12T09:22:27.398 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:27.398 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6834/3349912921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3349912921},{"type":"v1","addr":"172.21.15.99:6834","nonce":3349912921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3102874305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6833","nonce":3102874305},{"type":"v1","addr":"172.21.15.99:6835","nonce":3102874305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2816609542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2816609542},{"type":"v1","addr":"172.21.15.84:6837","nonce":2816609542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:21:30.192583+0000","modified":"2023-12-12T09:21:45.673958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6836/1717242900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1717242900},{"type":"v1","addr":"172.21.15.84:6836","nonce":1717242900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:22:27.398 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-12-12T09:22:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.400+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff55006ae70 msgr2=0x7ff55006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.400+0000 7ff573c87640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff55006ae70 0x7ff55006d330 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff56800ba00 tx=0x7ff568030000 comp rx=0 tx=0).stop 2023-12-12T09:22:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.400+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff56c151890 msgr2=0x7ff56c137720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.400+0000 7ff573c87640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff56c151890 0x7ff56c137720 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0ae9e0 tx=0x7ff56400b4a0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.401+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 shutdown_connections 2023-12-12T09:22:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.401+0000 7ff573c87640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff55006ae70 0x7ff55006d330 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.401+0000 7ff573c87640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff56c151890 0x7ff56c137720 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.401+0000 7ff573c87640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff56c151410 0x7ff56c1371e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.401+0000 7ff573c87640 1 --2- 172.21.15.84:0/121926273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff558003970 0x7ff56c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.401+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 >> 172.21.15.84:0/121926273 conn(0x7ff56c06c3d0 msgr2=0x7ff56c13eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.401+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 shutdown_connections 2023-12-12T09:22:27.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.401+0000 7ff573c87640 1 -- 172.21.15.84:0/121926273 wait complete. 2023-12-12T09:22:27.420 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:22:27.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.626+0000 7f3b377dc640 1 Processor -- start 2023-12-12T09:22:27.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.627+0000 7f3b377dc640 1 -- start start 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.628+0000 7f3b377dc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3b30099a20 0x7f3b300cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.628+0000 7f3b377dc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b3006b7c0 0x7f3b3006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.628+0000 7f3b377dc640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b300cf7c0 con 0x7f3b30160dc0 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.628+0000 7f3b377dc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3015b350 con 0x7f3b3006b7c0 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.628+0000 7f3b377dc640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b300cfaa0 con 0x7f3b30099a20 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b34d77640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f3b30160dc0 0x7f3b30099e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39154/0 (socket says 172.21.15.84:39154) 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b34d77640 1 -- 172.21.15.84:0/88858940 learned_addr learned my addr 172.21.15.84:0/88858940 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b35d79640 1 --2- 172.21.15.84:0/88858940 >> v2:172.21.15.84:3300/0 conn(0x7f3b3006b7c0 0x7f3b3006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b35578640 1 --2- 172.21.15.84:0/88858940 >> v2:172.21.15.99:3300/0 conn(0x7f3b30099a20 0x7f3b300cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b2ffff640 1 -- 172.21.15.84:0/88858940 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184788198 0 0) 0x7f3b300cf7c0 con 0x7f3b30160dc0 2023-12-12T09:22:27.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b2ffff640 1 -- 172.21.15.84:0/88858940 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b18003520 con 0x7f3b30160dc0 2023-12-12T09:22:27.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b35d79640 1 -- 172.21.15.84:0/88858940 >> v2:172.21.15.99:3300/0 conn(0x7f3b30099a20 msgr2=0x7f3b300cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:27.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b35d79640 1 --2- 172.21.15.84:0/88858940 >> v2:172.21.15.99:3300/0 conn(0x7f3b30099a20 0x7f3b300cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b35d79640 1 -- 172.21.15.84:0/88858940 >> v1:172.21.15.84:6789/0 conn(0x7f3b30160dc0 legacy=0x7f3b30099e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.629+0000 7f3b35d79640 1 -- 172.21.15.84:0/88858940 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b300cfd80 con 0x7f3b3006b7c0 2023-12-12T09:22:27.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.630+0000 7f3b35d79640 1 --2- 172.21.15.84:0/88858940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3006b7c0 0x7f3b3006bbd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3b300b3640 tx=0x7f3b2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45027610354bac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:27.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b2ffff640 1 -- 172.21.15.84:0/88858940 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28031830 con 0x7f3b3006b7c0 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b2ffff640 1 -- 172.21.15.84:0/88858940 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28031990 con 0x7f3b3006b7c0 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b2ffff640 1 -- 172.21.15.84:0/88858940 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28031d20 con 0x7f3b3006b7c0 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b377dc640 1 -- 172.21.15.84:0/88858940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3006b7c0 msgr2=0x7f3b3006bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b377dc640 1 --2- 172.21.15.84:0/88858940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3006b7c0 0x7f3b3006bbd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3b300b3640 tx=0x7f3b2802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b377dc640 1 -- 172.21.15.84:0/88858940 shutdown_connections 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b377dc640 1 --2- 172.21.15.84:0/88858940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b3006b7c0 0x7f3b3006bbd0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b377dc640 1 --2- 172.21.15.84:0/88858940 >> v2:172.21.15.99:3300/0 conn(0x7f3b30099a20 0x7f3b300cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b377dc640 1 -- 172.21.15.84:0/88858940 >> 172.21.15.84:0/88858940 conn(0x7f3b300b2990 msgr2=0x7f3b300b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b377dc640 1 -- 172.21.15.84:0/88858940 shutdown_connections 2023-12-12T09:22:27.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.631+0000 7f3b377dc640 1 -- 172.21.15.84:0/88858940 wait complete. 2023-12-12T09:22:27.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.633+0000 7f3b377dc640 1 Processor -- start 2023-12-12T09:22:27.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.633+0000 7f3b377dc640 1 -- start start 2023-12-12T09:22:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.634+0000 7f3b377dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b3006b7c0 0x7f3b300b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.634+0000 7f3b377dc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30099a20 0x7f3b301f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.634+0000 7f3b377dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b30160dc0 0x7f3b300ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.634+0000 7f3b377dc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30150e10 con 0x7f3b30099a20 2023-12-12T09:22:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.634+0000 7f3b377dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300b5a80 con 0x7f3b3006b7c0 2023-12-12T09:22:27.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.634+0000 7f3b377dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300b5d60 con 0x7f3b30160dc0 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30099a20 0x7f3b301f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30099a20 0x7f3b301f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36648/0 (socket says 172.21.15.84:36648) 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 -- 172.21.15.84:0/404073165 learned_addr learned my addr 172.21.15.84:0/404073165 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b35578640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b3006b7c0 0x7f3b300b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b35d79640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b30160dc0 0x7f3b300ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 -- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b30160dc0 msgr2=0x7f3b300ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b30160dc0 0x7f3b300ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 -- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b3006b7c0 msgr2=0x7f3b300b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b3006b7c0 0x7f3b300b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 -- 172.21.15.84:0/404073165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009400 con 0x7f3b30099a20 2023-12-12T09:22:27.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b35d79640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b30160dc0 0x7f3b300ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:27.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.635+0000 7f3b34d77640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30099a20 0x7f3b301f3210 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400c410 tx=0x7f3b2400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:27.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.636+0000 7f3b2dffb640 1 -- 172.21.15.84:0/404073165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24005ce0 con 0x7f3b30099a20 2023-12-12T09:22:27.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.636+0000 7f3b2dffb640 1 -- 172.21.15.84:0/404073165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24005e40 con 0x7f3b30099a20 2023-12-12T09:22:27.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.636+0000 7f3b2dffb640 1 -- 172.21.15.84:0/404073165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b240072f0 con 0x7f3b30099a20 2023-12-12T09:22:27.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.636+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b300b6040 con 0x7f3b30099a20 2023-12-12T09:22:27.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.636+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b300c7f70 con 0x7f3b30099a20 2023-12-12T09:22:27.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.637+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b30067e30 con 0x7f3b30099a20 2023-12-12T09:22:27.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.638+0000 7f3b2dffb640 1 -- 172.21.15.84:0/404073165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b24007510 con 0x7f3b30099a20 2023-12-12T09:22:27.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.639+0000 7f3b2dffb640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b1c06ae40 0x7f3b1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:27.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.639+0000 7f3b2dffb640 1 -- 172.21.15.84:0/404073165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f3b24088fc0 con 0x7f3b30099a20 2023-12-12T09:22:27.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.640+0000 7f3b35578640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b1c06ae40 0x7f3b1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:27.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.640+0000 7f3b35578640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b1c06ae40 0x7f3b1c06d300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b200099c0 tx=0x7f3b20003990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:27.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.644+0000 7f3b2dffb640 1 -- 172.21.15.84:0/404073165 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b24053e50 con 0x7f3b30099a20 2023-12-12T09:22:27.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.873+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b30072eb0 con 0x7f3b30099a20 2023-12-12T09:22:27.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.874+0000 7f3b2dffb640 1 -- 172.21.15.84:0/404073165 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f3b24017090 con 0x7f3b30099a20 2023-12-12T09:22:27.874 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:27.875 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6834/3349912921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3349912921},{"type":"v1","addr":"172.21.15.99:6834","nonce":3349912921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3102874305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6833","nonce":3102874305},{"type":"v1","addr":"172.21.15.99:6835","nonce":3102874305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2816609542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2816609542},{"type":"v1","addr":"172.21.15.84:6837","nonce":2816609542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:21:30.192583+0000","modified":"2023-12-12T09:21:45.673958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.84:6836/1717242900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1717242900},{"type":"v1","addr":"172.21.15.84:6836","nonce":1717242900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T09:22:27.875 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-12-12T09:22:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b1c06ae40 msgr2=0x7f3b1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b1c06ae40 0x7f3b1c06d300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3b200099c0 tx=0x7f3b20003990 comp rx=0 tx=0).stop 2023-12-12T09:22:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30099a20 msgr2=0x7f3b301f3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30099a20 0x7f3b301f3210 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400c410 tx=0x7f3b2400c8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 shutdown_connections 2023-12-12T09:22:27.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b30160dc0 0x7f3b300ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b1c06ae40 0x7f3b1c06d300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b30099a20 0x7f3b301f3210 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 --2- 172.21.15.84:0/404073165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b3006b7c0 0x7f3b300b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:27.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 >> 172.21.15.84:0/404073165 conn(0x7f3b300b2990 msgr2=0x7f3b300b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:27.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 shutdown_connections 2023-12-12T09:22:27.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:27.877+0000 7f3b377dc640 1 -- 172.21.15.84:0/404073165 wait complete. 2023-12-12T09:22:27.896 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.104+0000 7fd68d2a6640 1 Processor -- start 2023-12-12T09:22:28.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.104+0000 7fd68d2a6640 1 -- start start 2023-12-12T09:22:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd68d2a6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd68815d490 0x7fd6880d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd68d2a6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6880d3d60 0x7fd6880d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd68d2a6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6880afd40 con 0x7fd6880d1c30 2023-12-12T09:22:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd68d2a6640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6880b0090 con 0x7fd68815d490 2023-12-12T09:22:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd68d2a6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880d20a0 con 0x7fd6880d3d60 2023-12-12T09:22:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd686ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd68815d490 0x7fd6880d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd686ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd68815d490 0x7fd6880d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36654/0 (socket says 172.21.15.84:36654) 2023-12-12T09:22:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd6877fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd6880d1c30 0x7fd6880cf740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39156/0 (socket says 172.21.15.84:39156) 2023-12-12T09:22:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.106+0000 7fd686ffd640 1 -- 172.21.15.84:0/597800798 learned_addr learned my addr 172.21.15.84:0/597800798 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.107+0000 7fd67e7fc640 1 --2- 172.21.15.84:0/597800798 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6880d3d60 0x7fd6880d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.107+0000 7fd686ffd640 1 -- 172.21.15.84:0/597800798 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6880d3d60 msgr2=0x7fd6880d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.107+0000 7fd686ffd640 1 --2- 172.21.15.84:0/597800798 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6880d3d60 0x7fd6880d16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.107+0000 7fd686ffd640 1 -- 172.21.15.84:0/597800798 >> v1:172.21.15.84:6789/0 conn(0x7fd6880d1c30 legacy=0x7fd6880cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.107+0000 7fd686ffd640 1 -- 172.21.15.84:0/597800798 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880ce860 con 0x7fd68815d490 2023-12-12T09:22:28.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.108+0000 7fd686ffd640 1 --2- 172.21.15.84:0/597800798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd68815d490 0x7fd6880d3820 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd6780098a0 tx=0x7fd67802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755f2bd2a0f122fc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:28.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.108+0000 7fd6867fc640 1 -- 172.21.15.84:0/597800798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678031640 con 0x7fd68815d490 2023-12-12T09:22:28.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.108+0000 7fd6867fc640 1 -- 172.21.15.84:0/597800798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6780317a0 con 0x7fd68815d490 2023-12-12T09:22:28.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.108+0000 7fd6867fc640 1 -- 172.21.15.84:0/597800798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678031b30 con 0x7fd68815d490 2023-12-12T09:22:28.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.109+0000 7fd68d2a6640 1 -- 172.21.15.84:0/597800798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd68815d490 msgr2=0x7fd6880d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.109+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/597800798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd68815d490 0x7fd6880d3820 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd6780098a0 tx=0x7fd67802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.109+0000 7fd68d2a6640 1 -- 172.21.15.84:0/597800798 shutdown_connections 2023-12-12T09:22:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.109+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/597800798 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd6880d3d60 0x7fd6880d16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.109+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/597800798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd68815d490 0x7fd6880d3820 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.109+0000 7fd68d2a6640 1 -- 172.21.15.84:0/597800798 >> 172.21.15.84:0/597800798 conn(0x7fd68809c450 msgr2=0x7fd6880d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.109+0000 7fd68d2a6640 1 -- 172.21.15.84:0/597800798 shutdown_connections 2023-12-12T09:22:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.109+0000 7fd68d2a6640 1 -- 172.21.15.84:0/597800798 wait complete. 2023-12-12T09:22:28.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.111+0000 7fd68d2a6640 1 Processor -- start 2023-12-12T09:22:28.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.112+0000 7fd68d2a6640 1 -- start start 2023-12-12T09:22:28.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd68d2a6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6880d1c30 0x7fd688152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd68d2a6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6880d3d60 0x7fd6880cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd68d2a6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd68815d490 0x7fd6880cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd68d2a6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880cb920 con 0x7fd6880d3d60 2023-12-12T09:22:28.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd68d2a6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688152690 con 0x7fd6880d1c30 2023-12-12T09:22:28.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd68d2a6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880cd0c0 con 0x7fd68815d490 2023-12-12T09:22:28.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd67e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6880d3d60 0x7fd6880cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd67e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6880d3d60 0x7fd6880cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36670/0 (socket says 172.21.15.84:36670) 2023-12-12T09:22:28.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd67e7fc640 1 -- 172.21.15.84:0/2201567499 learned_addr learned my addr 172.21.15.84:0/2201567499 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.113+0000 7fd686ffd640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6880d1c30 0x7fd688152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd6877fe640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd68815d490 0x7fd6880cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67e7fc640 1 -- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd68815d490 msgr2=0x7fd6880cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67e7fc640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd68815d490 0x7fd6880cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67e7fc640 1 -- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6880d1c30 msgr2=0x7fd688152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67e7fc640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6880d1c30 0x7fd688152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67e7fc640 1 -- 172.21.15.84:0/2201567499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780094d0 con 0x7fd6880d3d60 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd686ffd640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6880d1c30 0x7fd688152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67e7fc640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6880d3d60 0x7fd6880cbfd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd67000ce10 tx=0x7fd67000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:28.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67ffff640 1 -- 172.21.15.84:0/2201567499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670003b90 con 0x7fd6880d3d60 2023-12-12T09:22:28.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67ffff640 1 -- 172.21.15.84:0/2201567499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670003cf0 con 0x7fd6880d3d60 2023-12-12T09:22:28.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd67ffff640 1 -- 172.21.15.84:0/2201567499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670004240 con 0x7fd6880d3d60 2023-12-12T09:22:28.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6880cae40 con 0x7fd6880d3d60 2023-12-12T09:22:28.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.114+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6880cb400 con 0x7fd6880d3d60 2023-12-12T09:22:28.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.116+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd688072b80 con 0x7fd6880d3d60 2023-12-12T09:22:28.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.116+0000 7fd67ffff640 1 -- 172.21.15.84:0/2201567499 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6700043a0 con 0x7fd6880d3d60 2023-12-12T09:22:28.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.117+0000 7fd67ffff640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd66806ae70 0x7fd66806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.117+0000 7fd67ffff640 1 -- 172.21.15.84:0/2201567499 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7fd670012070 con 0x7fd6880d3d60 2023-12-12T09:22:28.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.118+0000 7fd686ffd640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd66806ae70 0x7fd66806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.118+0000 7fd686ffd640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd66806ae70 0x7fd66806d330 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd678036000 tx=0x7fd67803c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:28.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.122+0000 7fd67ffff640 1 -- 172.21.15.84:0/2201567499 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6700550a0 con 0x7fd6880d3d60 2023-12-12T09:22:28.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:22:28.228 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:22:28.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.320+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6880cb620 con 0x7fd6880d3d60 2023-12-12T09:22:28.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.322+0000 7fd67ffff640 1 -- 172.21.15.84:0/2201567499 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18469 (secure 0 0 0) 0x7fd670003e60 con 0x7fd6880d3d60 2023-12-12T09:22:28.326 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:28.326 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":44,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:21:47.226539+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:21:28.519227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T09:21:29.210161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"data_new","create_time":"2023-12-12T09:21:44.988386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:28.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.324+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd66806ae70 msgr2=0x7fd66806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.324+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd66806ae70 0x7fd66806d330 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd678036000 tx=0x7fd67803c040 comp rx=0 tx=0).stop 2023-12-12T09:22:28.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6880d3d60 msgr2=0x7fd6880cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6880d3d60 0x7fd6880cbfd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd67000ce10 tx=0x7fd67000a660 comp rx=0 tx=0).stop 2023-12-12T09:22:28.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 shutdown_connections 2023-12-12T09:22:28.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd68815d490 0x7fd6880cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd66806ae70 0x7fd66806d330 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6880d3d60 0x7fd6880cbfd0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 --2- 172.21.15.84:0/2201567499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6880d1c30 0x7fd688152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 >> 172.21.15.84:0/2201567499 conn(0x7fd68809c450 msgr2=0x7fd6880b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 shutdown_connections 2023-12-12T09:22:28.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.325+0000 7fd68d2a6640 1 -- 172.21.15.84:0/2201567499 wait complete. 2023-12-12T09:22:28.345 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T09:22:28.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.555+0000 7f0a907dc640 1 Processor -- start 2023-12-12T09:22:28.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.556+0000 7f0a907dc640 1 -- start start 2023-12-12T09:22:28.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a907dc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0a8815d490 0x7f0a880d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a907dc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a880d3d60 0x7f0a880d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a907dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a880d1c30 0x7f0a880cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a907dc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a880b0090 con 0x7f0a880d3d60 2023-12-12T09:22:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a907dc640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a880d20c0 con 0x7f0a8815d490 2023-12-12T09:22:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a907dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a880afd40 con 0x7f0a880d1c30 2023-12-12T09:22:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a8dd77640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a880d3d60 0x7f0a880d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a8dd77640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0a880d3d60 0x7f0a880d16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36680/0 (socket says 172.21.15.84:36680) 2023-12-12T09:22:28.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.557+0000 7f0a8dd77640 1 -- 172.21.15.84:0/2649675297 learned_addr learned my addr 172.21.15.84:0/2649675297 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.558+0000 7f0a8dd77640 1 -- 172.21.15.84:0/2649675297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a880d1c30 msgr2=0x7f0a880cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.558+0000 7f0a8dd77640 1 --2- 172.21.15.84:0/2649675297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a880d1c30 0x7f0a880cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.558+0000 7f0a8dd77640 1 -- 172.21.15.84:0/2649675297 >> v2:172.21.15.99:3300/0 conn(0x7f0a8815d490 msgr2=0x7f0a880d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.558+0000 7f0a8e578640 1 --2- 172.21.15.84:0/2649675297 >> v2:172.21.15.99:3300/0 conn(0x7f0a8815d490 0x7f0a880d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.558+0000 7f0a8dd77640 1 --2- 172.21.15.84:0/2649675297 >> v2:172.21.15.99:3300/0 conn(0x7f0a8815d490 0x7f0a880d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.558+0000 7f0a8dd77640 1 -- 172.21.15.84:0/2649675297 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a880ce860 con 0x7f0a880d3d60 2023-12-12T09:22:28.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.559+0000 7f0a8dd77640 1 --2- 172.21.15.84:0/2649675297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d3d60 0x7f0a880d16f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0a880b5cd0 tx=0x7f0a7802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21303decc7a29134 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.559+0000 7f0a8d576640 1 -- 172.21.15.84:0/2649675297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780317e0 con 0x7f0a880d3d60 2023-12-12T09:22:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.559+0000 7f0a8d576640 1 -- 172.21.15.84:0/2649675297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a78031940 con 0x7f0a880d3d60 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.559+0000 7f0a8d576640 1 -- 172.21.15.84:0/2649675297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78031cd0 con 0x7f0a880d3d60 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 -- 172.21.15.84:0/2649675297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d3d60 msgr2=0x7f0a880d16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 --2- 172.21.15.84:0/2649675297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d3d60 0x7f0a880d16f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f0a880b5cd0 tx=0x7f0a7802b880 comp rx=0 tx=0).stop 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 -- 172.21.15.84:0/2649675297 shutdown_connections 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 --2- 172.21.15.84:0/2649675297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d3d60 0x7f0a880d16f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 --2- 172.21.15.84:0/2649675297 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a880d1c30 0x7f0a880cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 --2- 172.21.15.84:0/2649675297 >> v2:172.21.15.99:3300/0 conn(0x7f0a8815d490 0x7f0a880d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 -- 172.21.15.84:0/2649675297 >> 172.21.15.84:0/2649675297 conn(0x7f0a8809c450 msgr2=0x7f0a880d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 -- 172.21.15.84:0/2649675297 shutdown_connections 2023-12-12T09:22:28.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.560+0000 7f0a907dc640 1 -- 172.21.15.84:0/2649675297 wait complete. 2023-12-12T09:22:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.562+0000 7f0a907dc640 1 Processor -- start 2023-12-12T09:22:28.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.562+0000 7f0a907dc640 1 -- start start 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a907dc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d1c30 0x7f0a880ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a907dc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a880d3d60 0x7f0a880cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a907dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8815d490 0x7f0a881f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a907dc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8815db90 con 0x7f0a880d1c30 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a907dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a880ca720 con 0x7f0a8815d490 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a907dc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a880ca950 con 0x7f0a880d3d60 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a8e578640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d1c30 0x7f0a880ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a8e578640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d1c30 0x7f0a880ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36694/0 (socket says 172.21.15.84:36694) 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.563+0000 7f0a8e578640 1 -- 172.21.15.84:0/1983052645 learned_addr learned my addr 172.21.15.84:0/1983052645 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a8e578640 1 -- 172.21.15.84:0/1983052645 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a880d3d60 msgr2=0x7f0a880cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a8e578640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a880d3d60 0x7f0a880cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a8e578640 1 -- 172.21.15.84:0/1983052645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8815d490 msgr2=0x7f0a881f2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a8e578640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8815d490 0x7f0a881f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a8e578640 1 -- 172.21.15.84:0/1983052645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780094d0 con 0x7f0a880d1c30 2023-12-12T09:22:28.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a8e578640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d1c30 0x7f0a880ca1e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c7f0 tx=0x7f0a8400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a7effd640 1 -- 172.21.15.84:0/1983052645 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84004220 con 0x7f0a880d1c30 2023-12-12T09:22:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a7effd640 1 -- 172.21.15.84:0/1983052645 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a840043a0 con 0x7f0a880d1c30 2023-12-12T09:22:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a880cac30 con 0x7f0a880d1c30 2023-12-12T09:22:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a7effd640 1 -- 172.21.15.84:0/1983052645 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84007860 con 0x7f0a880d1c30 2023-12-12T09:22:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.564+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a880cb1f0 con 0x7f0a880d1c30 2023-12-12T09:22:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.566+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a88072b80 con 0x7f0a880d1c30 2023-12-12T09:22:28.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.567+0000 7f0a7effd640 1 -- 172.21.15.84:0/1983052645 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a84007bd0 con 0x7f0a880d1c30 2023-12-12T09:22:28.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.567+0000 7f0a7effd640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a6c06ae40 0x7f0a6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.567+0000 7f0a7effd640 1 -- 172.21.15.84:0/1983052645 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6424+0+0 (secure 0 0 0) 0x7f0a840897d0 con 0x7f0a880d1c30 2023-12-12T09:22:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.568+0000 7f0a8dd77640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a6c06ae40 0x7f0a6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:28.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.568+0000 7f0a8dd77640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a6c06ae40 0x7f0a6c06d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0a78036000 tx=0x7f0a78030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:28.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.572+0000 7f0a7effd640 1 -- 172.21.15.84:0/1983052645 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a84054640 con 0x7f0a880d1c30 2023-12-12T09:22:28.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.809+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0a880673c0 con 0x7f0a880d1c30 2023-12-12T09:22:28.810 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-12-12T09:22:28.810+0000 7f59e3967640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:22:28.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.814+0000 7f0a7effd640 1 -- 172.21.15.84:0/1983052645 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0a8401e090 con 0x7f0a880d1c30 2023-12-12T09:22:28.814 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:22:28.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a6c06ae40 msgr2=0x7f0a6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a6c06ae40 0x7f0a6c06d300 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0a78036000 tx=0x7f0a78030000 comp rx=0 tx=0).stop 2023-12-12T09:22:28.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d1c30 msgr2=0x7f0a880ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:28.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d1c30 0x7f0a880ca1e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c7f0 tx=0x7f0a8400ccb0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 shutdown_connections 2023-12-12T09:22:28.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8815d490 0x7f0a881f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0a880d3d60 0x7f0a880cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0a6c06ae40 0x7f0a6c06d300 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 --2- 172.21.15.84:0/1983052645 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a880d1c30 0x7f0a880ca1e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:28.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 >> 172.21.15.84:0/1983052645 conn(0x7f0a8809c450 msgr2=0x7f0a8806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:28.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 shutdown_connections 2023-12-12T09:22:28.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:28.818+0000 7f0a907dc640 1 -- 172.21.15.84:0/1983052645 wait complete. 2023-12-12T09:22:28.830 INFO:tasks.ceph.mds.a.smithi084.stderr: -4075> 2023-12-12T09:21:32.484+0000 7f4fab9b3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:22:28.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T09:22:28.890 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-12-12T09:22:29.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.041+0000 7f5a9b553640 1 Processor -- start 2023-12-12T09:22:29.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.041+0000 7f5a9b553640 1 -- start start 2023-12-12T09:22:29.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.043+0000 7f5a9b553640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a940b4560 0x7f5a940b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:29.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.043+0000 7f5a9b553640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a940b30a0 con 0x7f5a9406d5e0 2023-12-12T09:22:29.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.043+0000 7f5a9b553640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9415dc90 con 0x7f5a9415d810 2023-12-12T09:22:29.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.043+0000 7f5a9b553640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9415e8a0 con 0x7f5a940b4560 2023-12-12T09:22:29.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.043+0000 7f5a992ef640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a940b4560 0x7f5a940b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:29.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.043+0000 7f5a992ef640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5a940b4560 0x7f5a940b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36716/0 (socket says 172.21.15.84:36716) 2023-12-12T09:22:29.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.043+0000 7f5a992ef640 1 -- 172.21.15.84:0/4136691552 learned_addr learned my addr 172.21.15.84:0/4136691552 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:29.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.043+0000 7f5a99af0640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5a9406d5e0 0x7f5a94070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39182/0 (socket says 172.21.15.84:39182) 2023-12-12T09:22:29.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.044+0000 7f5a992ef640 1 -- 172.21.15.84:0/4136691552 >> v1:172.21.15.99:6789/0 conn(0x7f5a9415d810 legacy=0x7f5a940b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:29.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.044+0000 7f5a992ef640 1 -- 172.21.15.84:0/4136691552 >> v1:172.21.15.84:6789/0 conn(0x7f5a9406d5e0 legacy=0x7f5a94070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:29.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.044+0000 7f5a992ef640 1 -- 172.21.15.84:0/4136691552 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9415df70 con 0x7f5a940b4560 2023-12-12T09:22:29.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.044+0000 7f5a8bfff640 1 -- 172.21.15.84:0/4136691552 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064519034 0 0) 0x7f5a940b30a0 con 0x7f5a9406d5e0 2023-12-12T09:22:29.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.045+0000 7f5a992ef640 1 --2- 172.21.15.84:0/4136691552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940b2b60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009870 tx=0x7f5a9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec594ac8034b45c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:29.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.045+0000 7f5a8bfff640 1 -- 172.21.15.84:0/4136691552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90031870 con 0x7f5a940b4560 2023-12-12T09:22:29.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.045+0000 7f5a8bfff640 1 -- 172.21.15.84:0/4136691552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a900319d0 con 0x7f5a940b4560 2023-12-12T09:22:29.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.045+0000 7f5a8bfff640 1 -- 172.21.15.84:0/4136691552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90031d60 con 0x7f5a940b4560 2023-12-12T09:22:29.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.046+0000 7f5a9b553640 1 -- 172.21.15.84:0/4136691552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 msgr2=0x7f5a940b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:29.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.046+0000 7f5a9b553640 1 --2- 172.21.15.84:0/4136691552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940b2b60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009870 tx=0x7f5a9002b910 comp rx=0 tx=0).stop 2023-12-12T09:22:29.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.046+0000 7f5a9b553640 1 -- 172.21.15.84:0/4136691552 shutdown_connections 2023-12-12T09:22:29.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.046+0000 7f5a9b553640 1 --2- 172.21.15.84:0/4136691552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940b2b60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:29.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.046+0000 7f5a9b553640 1 -- 172.21.15.84:0/4136691552 >> 172.21.15.84:0/4136691552 conn(0x7f5a940b0ac0 msgr2=0x7f5a940b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:29.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.046+0000 7f5a9b553640 1 -- 172.21.15.84:0/4136691552 shutdown_connections 2023-12-12T09:22:29.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.046+0000 7f5a9b553640 1 -- 172.21.15.84:0/4136691552 wait complete. 2023-12-12T09:22:29.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.048+0000 7f5a9b553640 1 Processor -- start 2023-12-12T09:22:29.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.048+0000 7f5a9b553640 1 -- start start 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a9b553640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a9406d5e0 0x7f5a94156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a9b553640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a9b553640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a9415d810 0x7f5a9414b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a9b553640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94156540 con 0x7f5a940b4560 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a9b553640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94152ca0 con 0x7f5a9406d5e0 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a9b553640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940c4c60 con 0x7f5a9415d810 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a98aee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a98aee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36718/0 (socket says 172.21.15.84:36718) 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a98aee640 1 -- 172.21.15.84:0/3408050205 learned_addr learned my addr 172.21.15.84:0/3408050205 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a98aee640 1 -- 172.21.15.84:0/3408050205 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a9415d810 msgr2=0x7f5a9414b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a98aee640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a9415d810 0x7f5a9414b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:29.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a98aee640 1 -- 172.21.15.84:0/3408050205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a9406d5e0 msgr2=0x7f5a94156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:29.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a98aee640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a9406d5e0 0x7f5a94156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:29.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.049+0000 7f5a98aee640 1 -- 172.21.15.84:0/3408050205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a900094d0 con 0x7f5a940b4560 2023-12-12T09:22:29.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.050+0000 7f5a98aee640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940c4720 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400b3f0 tx=0x7f5a8400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.050+0000 7f5a89ffb640 1 -- 172.21.15.84:0/3408050205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84011830 con 0x7f5a940b4560 2023-12-12T09:22:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.050+0000 7f5a89ffb640 1 -- 172.21.15.84:0/3408050205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a84011990 con 0x7f5a940b4560 2023-12-12T09:22:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.050+0000 7f5a89ffb640 1 -- 172.21.15.84:0/3408050205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a84011d20 con 0x7f5a940b4560 2023-12-12T09:22:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.050+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9414bcb0 con 0x7f5a940b4560 2023-12-12T09:22:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.050+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a94155ba0 con 0x7f5a940b4560 2023-12-12T09:22:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.051+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a941567b0 con 0x7f5a940b4560 2023-12-12T09:22:29.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.052+0000 7f5a89ffb640 1 -- 172.21.15.84:0/3408050205 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a8401a400 con 0x7f5a940b4560 2023-12-12T09:22:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.053+0000 7f5a89ffb640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a7806ae40 0x7f5a7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.053+0000 7f5a89ffb640 1 -- 172.21.15.84:0/3408050205 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6539+0+0 (secure 0 0 0) 0x7f5a84089b20 con 0x7f5a940b4560 2023-12-12T09:22:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.053+0000 7f5a992ef640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a7806ae40 0x7f5a7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:29.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.054+0000 7f5a992ef640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a7806ae40 0x7f5a7806d300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5a90036000 tx=0x7f5a90030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:29.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.058+0000 7f5a89ffb640 1 -- 172.21.15.84:0/3408050205 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a840547f0 con 0x7f5a940b4560 2023-12-12T09:22:29.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.283+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5a9415d630 con 0x7f5a940b4560 2023-12-12T09:22:29.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.817+0000 7f5a89ffb640 1 -- 172.21.15.84:0/3408050205 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5a84057e10 con 0x7f5a940b4560 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a7806ae40 msgr2=0x7f5a7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a7806ae40 0x7f5a7806d300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5a90036000 tx=0x7f5a90030000 comp rx=0 tx=0).stop 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 msgr2=0x7f5a940c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940c4720 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400b3f0 tx=0x7f5a8400b8b0 comp rx=0 tx=0).stop 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 shutdown_connections 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a9415d810 0x7f5a9414b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f5a7806ae40 0x7f5a7806d300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a940b4560 0x7f5a940c4720 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:29.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 --2- 172.21.15.84:0/3408050205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a9406d5e0 0x7f5a94156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:29.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.821+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 >> 172.21.15.84:0/3408050205 conn(0x7f5a940b0ac0 msgr2=0x7f5a940ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:29.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.822+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 shutdown_connections 2023-12-12T09:22:29.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:29.822+0000 7f5a9b553640 1 -- 172.21.15.84:0/3408050205 wait complete. 2023-12-12T09:22:29.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T09:22:30.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.107+0000 7ff0c8000640 1 Processor -- start 2023-12-12T09:22:30.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.107+0000 7ff0c8000640 1 -- start start 2023-12-12T09:22:30.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.109+0000 7ff0c8000640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c015e770 0x7ff0c00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:30.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.109+0000 7ff0c8000640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00b27a0 con 0x7ff0c01439c0 2023-12-12T09:22:30.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.109+0000 7ff0c8000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c00b24c0 con 0x7ff0c00cdc50 2023-12-12T09:22:30.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.109+0000 7ff0c8000640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0143da0 con 0x7ff0c015e770 2023-12-12T09:22:30.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.109+0000 7ff0c5d9c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff0c01439c0 0x7ff0c00b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39196/0 (socket says 172.21.15.84:39196) 2023-12-12T09:22:30.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.109+0000 7ff0c5d9c640 1 -- 172.21.15.84:0/1537565690 learned_addr learned my addr 172.21.15.84:0/1537565690 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:30.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c559b640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c015e770 0x7ff0c00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054272079 0 0) 0x7ff0c00b27a0 con 0x7ff0c01439c0 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0ac005730 con 0x7ff0c01439c0 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2145143758 0 0) 0x7ff0ac005730 con 0x7ff0c01439c0 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c015e770 msgr2=0x7ff0c00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c015e770 0x7ff0c00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 >> v1:172.21.15.99:6789/0 conn(0x7ff0c00cdc50 legacy=0x7ff0c0070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00cb7d0 con 0x7ff0c01439c0 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7ff0bc001670 con 0x7ff0c01439c0 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 >> v1:172.21.15.84:6789/0 conn(0x7ff0c01439c0 legacy=0x7ff0c00b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0ac005c90 0x7ff0ac0060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0ac0069d0 0x7ff0ac006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c015e770 0x7ff0ac00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0143da0 con 0x7ff0ac0069d0 2023-12-12T09:22:30.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0077f0 con 0x7ff0ac005c90 2023-12-12T09:22:30.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac00e0d0 con 0x7ff0c015e770 2023-12-12T09:22:30.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.110+0000 7ff0c559b640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0ac0069d0 0x7ff0ac006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:30.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.111+0000 7ff0c5d9c640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0ac005c90 0x7ff0ac0060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:30.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.111+0000 7ff0c559b640 1 -- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c015e770 msgr2=0x7ff0ac00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:30.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.111+0000 7ff0c559b640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0c015e770 0x7ff0ac00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.111+0000 7ff0c559b640 1 -- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0ac005c90 msgr2=0x7ff0ac0060b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:30.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.111+0000 7ff0c559b640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0ac005c90 0x7ff0ac0060b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.111+0000 7ff0c559b640 1 -- 172.21.15.84:0/1537565690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac005730 con 0x7ff0ac0069d0 2023-12-12T09:22:30.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.112+0000 7ff0c559b640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0ac0069d0 0x7ff0ac006e50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000ba30 tx=0x7ff0ac007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a30c2cdc5e4ade server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.112+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0032680 con 0x7ff0ac0069d0 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.112+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b00327e0 con 0x7ff0ac0069d0 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.112+0000 7ff0c4d9a640 1 -- 172.21.15.84:0/1537565690 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0032b70 con 0x7ff0ac0069d0 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.112+0000 7ff0c8000640 1 -- 172.21.15.84:0/1537565690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0ac0069d0 msgr2=0x7ff0ac006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.112+0000 7ff0c8000640 1 --2- 172.21.15.84:0/1537565690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0ac0069d0 0x7ff0ac006e50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000ba30 tx=0x7ff0ac007a00 comp rx=0 tx=0).stop 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.112+0000 7ff0c659d640 1 -- 172.21.15.84:0/1537565690 reap_dead start 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.113+0000 7ff0c8000640 1 -- 172.21.15.84:0/1537565690 shutdown_connections 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.113+0000 7ff0c8000640 1 -- 172.21.15.84:0/1537565690 >> 172.21.15.84:0/1537565690 conn(0x7ff0c00b0970 msgr2=0x7ff0c00b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.113+0000 7ff0c8000640 1 -- 172.21.15.84:0/1537565690 shutdown_connections 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.113+0000 7ff0c8000640 1 -- 172.21.15.84:0/1537565690 wait complete. 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.114+0000 7ff0c8000640 1 Processor -- start 2023-12-12T09:22:30.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.115+0000 7ff0c8000640 1 -- start start 2023-12-12T09:22:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.115+0000 7ff0c8000640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0ac0069d0 0x7ff0c0070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.115+0000 7ff0c8000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c0142460 0x7ff0c013dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.115+0000 7ff0c8000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c01428e0 0x7ff0c013e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c8000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c013e650 con 0x7ff0c0142460 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c8000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c0141150 con 0x7ff0c01428e0 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c8000640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c01413f0 con 0x7ff0ac0069d0 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c0142460 0x7ff0c013dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c0142460 0x7ff0c013dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36742/0 (socket says 172.21.15.84:36742) 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 -- 172.21.15.84:0/1036010894 learned_addr learned my addr 172.21.15.84:0/1036010894 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c5d9c640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0ac0069d0 0x7ff0c0070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 -- 172.21.15.84:0/1036010894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0ac0069d0 msgr2=0x7ff0c0070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0ac0069d0 0x7ff0c0070a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 -- 172.21.15.84:0/1036010894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c01428e0 msgr2=0x7ff0c013e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c01428e0 0x7ff0c013e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 -- 172.21.15.84:0/1036010894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c01416d0 con 0x7ff0c0142460 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.116+0000 7ff0c559b640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c0142460 0x7ff0c013dbd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0035040 tx=0x7ff0b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.117+0000 7ff0b67fc640 1 -- 172.21.15.84:0/1036010894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0030aa0 con 0x7ff0c0142460 2023-12-12T09:22:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.117+0000 7ff0b67fc640 1 -- 172.21.15.84:0/1036010894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b0030c20 con 0x7ff0c0142460 2023-12-12T09:22:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.117+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c01419b0 con 0x7ff0c0142460 2023-12-12T09:22:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.117+0000 7ff0b67fc640 1 -- 172.21.15.84:0/1036010894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b003b420 con 0x7ff0c0142460 2023-12-12T09:22:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.117+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c013ea50 con 0x7ff0c0142460 2023-12-12T09:22:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.118+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c0067f60 con 0x7ff0c0142460 2023-12-12T09:22:30.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.119+0000 7ff0b67fc640 1 -- 172.21.15.84:0/1036010894 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff0b003b580 con 0x7ff0c0142460 2023-12-12T09:22:30.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.120+0000 7ff0b67fc640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:30.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.120+0000 7ff0b67fc640 1 -- 172.21.15.84:0/1036010894 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6539+0+0 (secure 0 0 0) 0x7ff0b00ac3b0 con 0x7ff0c0142460 2023-12-12T09:22:30.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.121+0000 7ff0c5d9c640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.121+0000 7ff0c5d9c640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0017a0 tx=0x7ff0bc000f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.124+0000 7ff0b67fc640 1 -- 172.21.15.84:0/1036010894 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0b007ac30 con 0x7ff0c0142460 2023-12-12T09:22:30.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.305+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0c00673c0 con 0x7ff0c0142460 2023-12-12T09:22:30.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.828+0000 7ff0b67fc640 1 -- 172.21.15.84:0/1036010894 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff0b007a7c0 con 0x7ff0c0142460 2023-12-12T09:22:30.829 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-12-12T09:22:30.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 msgr2=0x7ff0a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:30.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0017a0 tx=0x7ff0bc000f50 comp rx=0 tx=0).stop 2023-12-12T09:22:30.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c0142460 msgr2=0x7ff0c013dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:30.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c0142460 0x7ff0c013dbd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0035040 tx=0x7ff0b0004730 comp rx=0 tx=0).stop 2023-12-12T09:22:30.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 shutdown_connections 2023-12-12T09:22:30.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0c01428e0 0x7ff0c013e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff0a406ae40 0x7ff0a406d300 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0c0142460 0x7ff0c013dbd0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 --2- 172.21.15.84:0/1036010894 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff0ac0069d0 0x7ff0c0070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:30.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 >> 172.21.15.84:0/1036010894 conn(0x7ff0c00b0970 msgr2=0x7ff0c00acdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:30.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 shutdown_connections 2023-12-12T09:22:30.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:30.832+0000 7ff0c8000640 1 -- 172.21.15.84:0/1036010894 wait complete. 2023-12-12T09:22:30.856 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T09:22:31.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.072+0000 7f4ee70f8640 1 Processor -- start 2023-12-12T09:22:31.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.072+0000 7f4ee70f8640 1 -- start start 2023-12-12T09:22:31.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.073+0000 7f4ee70f8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4ee00ada80 0x7f4ee00adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:31.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.073+0000 7f4ee70f8640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee00ae3e0 con 0x7f4ee015d050 2023-12-12T09:22:31.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.073+0000 7f4ee70f8640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee00cdc90 con 0x7f4ee00ced30 2023-12-12T09:22:31.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.073+0000 7f4ee70f8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee00ad6e0 con 0x7f4ee00ada80 2023-12-12T09:22:31.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.074+0000 7f4ee60f6640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4ee015d050 0x7f4ee00b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39210/0 (socket says 172.21.15.84:39210) 2023-12-12T09:22:31.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.074+0000 7f4ee60f6640 1 -- 172.21.15.84:0/3314827560 learned_addr learned my addr 172.21.15.84:0/3314827560 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:31.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.074+0000 7f4ee58f5640 1 --2- 172.21.15.84:0/3314827560 >> v2:172.21.15.84:3300/0 conn(0x7f4ee00ada80 0x7f4ee00adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:31.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.074+0000 7f4ee50f4640 1 -- 172.21.15.84:0/3314827560 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135855600 0 0) 0x7f4ee00ae3e0 con 0x7f4ee015d050 2023-12-12T09:22:31.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.074+0000 7f4ee58f5640 1 -- 172.21.15.84:0/3314827560 >> v1:172.21.15.99:6789/0 conn(0x7f4ee00ced30 legacy=0x7f4ee00cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:31.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.074+0000 7f4ee58f5640 1 -- 172.21.15.84:0/3314827560 >> v1:172.21.15.84:6789/0 conn(0x7f4ee015d050 legacy=0x7f4ee00b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:31.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.074+0000 7f4ee58f5640 1 -- 172.21.15.84:0/3314827560 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00cdf70 con 0x7f4ee00ada80 2023-12-12T09:22:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.075+0000 7f4ee58f5640 1 --2- 172.21.15.84:0/3314827560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ada80 0x7f4ee00adea0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00097a0 tx=0x7f4ed002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a7c2efdd40952b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.075+0000 7f4ee50f4640 1 -- 172.21.15.84:0/3314827560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed002e070 con 0x7f4ee00ada80 2023-12-12T09:22:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.075+0000 7f4ee50f4640 1 -- 172.21.15.84:0/3314827560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed00315a0 con 0x7f4ee00ada80 2023-12-12T09:22:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.075+0000 7f4ee50f4640 1 -- 172.21.15.84:0/3314827560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0031930 con 0x7f4ee00ada80 2023-12-12T09:22:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.076+0000 7f4ee70f8640 1 -- 172.21.15.84:0/3314827560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ada80 msgr2=0x7f4ee00adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.076+0000 7f4ee70f8640 1 --2- 172.21.15.84:0/3314827560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ada80 0x7f4ee00adea0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00097a0 tx=0x7f4ed002b840 comp rx=0 tx=0).stop 2023-12-12T09:22:31.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.076+0000 7f4ee70f8640 1 -- 172.21.15.84:0/3314827560 shutdown_connections 2023-12-12T09:22:31.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.076+0000 7f4ee70f8640 1 --2- 172.21.15.84:0/3314827560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ada80 0x7f4ee00adea0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:31.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.076+0000 7f4ee70f8640 1 -- 172.21.15.84:0/3314827560 >> 172.21.15.84:0/3314827560 conn(0x7f4ee006a6e0 msgr2=0x7f4ee006aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:31.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.076+0000 7f4ee70f8640 1 -- 172.21.15.84:0/3314827560 shutdown_connections 2023-12-12T09:22:31.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.076+0000 7f4ee70f8640 1 -- 172.21.15.84:0/3314827560 wait complete. 2023-12-12T09:22:31.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.078+0000 7f4ee70f8640 1 Processor -- start 2023-12-12T09:22:31.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.078+0000 7f4ee70f8640 1 -- start start 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee70f8640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ee00ada80 0x7f4ee015e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee70f8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ced30 0x7f4ee015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee70f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ee015d050 0x7f4ee01f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee70f8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0157cb0 con 0x7f4ee00ced30 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee70f8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0155320 con 0x7f4ee015d050 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee70f8640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee015daf0 con 0x7f4ee00ada80 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee58f5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ced30 0x7f4ee015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee58f5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ced30 0x7f4ee015d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36758/0 (socket says 172.21.15.84:36758) 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee58f5640 1 -- 172.21.15.84:0/809136870 learned_addr learned my addr 172.21.15.84:0/809136870 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee58f5640 1 -- 172.21.15.84:0/809136870 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ee00ada80 msgr2=0x7f4ee015e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee58f5640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ee00ada80 0x7f4ee015e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee58f5640 1 -- 172.21.15.84:0/809136870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ee015d050 msgr2=0x7f4ee01f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:31.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee58f5640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ee015d050 0x7f4ee01f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.079+0000 7f4ee58f5640 1 -- 172.21.15.84:0/809136870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0009400 con 0x7f4ee00ced30 2023-12-12T09:22:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.080+0000 7f4ee58f5640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ced30 0x7f4ee015d5b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00097a0 tx=0x7f4ed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.080+0000 7f4ed6ffd640 1 -- 172.21.15.84:0/809136870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0032900 con 0x7f4ee00ced30 2023-12-12T09:22:31.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.080+0000 7f4ed6ffd640 1 -- 172.21.15.84:0/809136870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0032a60 con 0x7f4ee00ced30 2023-12-12T09:22:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.080+0000 7f4ed6ffd640 1 -- 172.21.15.84:0/809136870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0032e10 con 0x7f4ee00ced30 2023-12-12T09:22:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.080+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee0157ec0 con 0x7f4ee00ced30 2023-12-12T09:22:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.080+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee0158480 con 0x7f4ee00ced30 2023-12-12T09:22:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.081+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee00673c0 con 0x7f4ee00ced30 2023-12-12T09:22:31.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.082+0000 7f4ed6ffd640 1 -- 172.21.15.84:0/809136870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ed003b3f0 con 0x7f4ee00ced30 2023-12-12T09:22:31.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.083+0000 7f4ed6ffd640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ec406ae40 0x7f4ec406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:31.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.083+0000 7f4ed6ffd640 1 -- 172.21.15.84:0/809136870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4ed00ab8d0 con 0x7f4ee00ced30 2023-12-12T09:22:31.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.083+0000 7f4ee60f6640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ec406ae40 0x7f4ec406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:31.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.084+0000 7f4ee60f6640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ec406ae40 0x7f4ec406d300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4edc007fd0 tx=0x7f4edc007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:31.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.087+0000 7f4ed6ffd640 1 -- 172.21.15.84:0/809136870 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ed00767e0 con 0x7f4ee00ced30 2023-12-12T09:22:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.280+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ee00cbf40 con 0x7f4ee00ced30 2023-12-12T09:22:31.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.840+0000 7f4ed6ffd640 1 -- 172.21.15.84:0/809136870 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4ed0079e00 con 0x7f4ee00ced30 2023-12-12T09:22:31.840 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-12-12T09:22:31.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.844+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ec406ae40 msgr2=0x7f4ec406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:31.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.844+0000 7f4ee70f8640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ec406ae40 0x7f4ec406d300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4edc007fd0 tx=0x7f4edc007960 comp rx=0 tx=0).stop 2023-12-12T09:22:31.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.844+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ced30 msgr2=0x7f4ee015d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:31.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.844+0000 7f4ee70f8640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ced30 0x7f4ee015d5b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00097a0 tx=0x7f4ed00046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:31.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.845+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 shutdown_connections 2023-12-12T09:22:31.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.845+0000 7f4ee70f8640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ee015d050 0x7f4ee01f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.845+0000 7f4ee70f8640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ec406ae40 0x7f4ec406d300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.845+0000 7f4ee70f8640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ee00ced30 0x7f4ee015d5b0 secure :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00097a0 tx=0x7f4ed00046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.845+0000 7f4ee70f8640 1 --2- 172.21.15.84:0/809136870 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ee00ada80 0x7f4ee015e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.845+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 >> 172.21.15.84:0/809136870 conn(0x7f4ee006a6e0 msgr2=0x7f4ee00ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.846+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 shutdown_connections 2023-12-12T09:22:31.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:31.846+0000 7f4ee70f8640 1 -- 172.21.15.84:0/809136870 wait complete. 2023-12-12T09:22:31.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-12-12T09:22:32.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.087+0000 7f5a1359e640 1 Processor -- start 2023-12-12T09:22:32.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.088+0000 7f5a1359e640 1 -- start start 2023-12-12T09:22:32.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.089+0000 7f5a1359e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:32.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.089+0000 7f5a1359e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5a140cdfd0 0x7f5a140ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:32.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.089+0000 7f5a1359e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a140ce970 con 0x7f5a140cf6c0 2023-12-12T09:22:32.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.089+0000 7f5a1359e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a140d1920 con 0x7f5a140cdfd0 2023-12-12T09:22:32.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.089+0000 7f5a1359e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140d1c00 con 0x7f5a1415d070 2023-12-12T09:22:32.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.090+0000 7f5a11d9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5a140cdfd0 0x7f5a140ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:32.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.090+0000 7f5a1259c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:32.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.090+0000 7f5a12d9d640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5a140cf6c0 0x7f5a140cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:49098/0 (socket says 172.21.15.84:49098) 2023-12-12T09:22:32.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.090+0000 7f5a11d9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5a140cdfd0 0x7f5a140ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:39854/0 (socket says 172.21.15.84:39854) 2023-12-12T09:22:32.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.090+0000 7f5a12d9d640 1 -- 172.21.15.84:0/1743857628 learned_addr learned my addr 172.21.15.84:0/1743857628 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:32.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.091+0000 7f5a1159a640 1 -- 172.21.15.84:0/1743857628 <== mon.1 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334296935 0 0) 0x7f5a140ce970 con 0x7f5a140cf6c0 2023-12-12T09:22:32.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.091+0000 7f5a1159a640 1 -- 172.21.15.84:0/1743857628 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a00003520 con 0x7f5a140cf6c0 2023-12-12T09:22:32.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.091+0000 7f5a11d9b640 1 -- 172.21.15.84:0/1743857628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 msgr2=0x7f5a140cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.091+0000 7f5a11d9b640 1 --2- 172.21.15.84:0/1743857628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.091+0000 7f5a11d9b640 1 -- 172.21.15.84:0/1743857628 >> v1:172.21.15.99:6789/0 conn(0x7f5a140cf6c0 legacy=0x7f5a140cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.091+0000 7f5a11d9b640 1 -- 172.21.15.84:0/1743857628 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140b5ee0 con 0x7f5a140cdfd0 2023-12-12T09:22:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.091+0000 7f5a1259c640 1 --2- 172.21.15.84:0/1743857628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:22:32.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.092+0000 7f5a11d9b640 1 --2- 172.21.15.84:0/1743857628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cdfd0 0x7f5a140ce430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0097a0 tx=0x7f59fc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74d6ba0227428aab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1159a640 1 -- 172.21.15.84:0/1743857628 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc02d040 con 0x7f5a140cdfd0 2023-12-12T09:22:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1159a640 1 -- 172.21.15.84:0/1743857628 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc031810 con 0x7f5a140cdfd0 2023-12-12T09:22:32.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1159a640 1 -- 172.21.15.84:0/1743857628 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc031b80 con 0x7f5a140cdfd0 2023-12-12T09:22:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1359e640 1 -- 172.21.15.84:0/1743857628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cdfd0 msgr2=0x7f5a140ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1743857628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cdfd0 0x7f5a140ce430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f59fc0097a0 tx=0x7f59fc02b8b0 comp rx=0 tx=0).stop 2023-12-12T09:22:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1359e640 1 -- 172.21.15.84:0/1743857628 shutdown_connections 2023-12-12T09:22:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1743857628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cdfd0 0x7f5a140ce430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1743857628 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.093+0000 7f5a1359e640 1 -- 172.21.15.84:0/1743857628 >> 172.21.15.84:0/1743857628 conn(0x7f5a140d2f80 msgr2=0x7f5a140d3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.094+0000 7f5a1359e640 1 -- 172.21.15.84:0/1743857628 shutdown_connections 2023-12-12T09:22:32.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.094+0000 7f5a1359e640 1 -- 172.21.15.84:0/1743857628 wait complete. 2023-12-12T09:22:32.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.095+0000 7f5a1359e640 1 Processor -- start 2023-12-12T09:22:32.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.095+0000 7f5a1359e640 1 -- start start 2023-12-12T09:22:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.096+0000 7f5a1359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140cdfd0 0x7f5a1415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.096+0000 7f5a1359e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cf6c0 0x7f5a141f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.096+0000 7f5a1359e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.096+0000 7f5a1359e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a141ed180 con 0x7f5a140cdfd0 2023-12-12T09:22:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.096+0000 7f5a1359e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140c7370 con 0x7f5a140cf6c0 2023-12-12T09:22:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.096+0000 7f5a1359e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a141f3b90 con 0x7f5a1415d070 2023-12-12T09:22:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140cdfd0 0x7f5a1415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:32.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140cdfd0 0x7f5a1415fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36760/0 (socket says 172.21.15.84:36760) 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 -- 172.21.15.84:0/1144880587 learned_addr learned my addr 172.21.15.84:0/1144880587 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a11d9b640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cf6c0 0x7f5a141f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a12d9d640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 -- 172.21.15.84:0/1144880587 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 msgr2=0x7f5a140ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 -- 172.21.15.84:0/1144880587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cf6c0 msgr2=0x7f5a141f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cf6c0 0x7f5a141f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 -- 172.21.15.84:0/1144880587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04009a70 con 0x7f5a140cdfd0 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.097+0000 7f5a1259c640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140cdfd0 0x7f5a1415fde0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009f60 tx=0x7f5a04009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.098+0000 7f5a0affd640 1 -- 172.21.15.84:0/1144880587 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04014680 con 0x7f5a140cdfd0 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.098+0000 7f5a0affd640 1 -- 172.21.15.84:0/1144880587 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0400f040 con 0x7f5a140cdfd0 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.098+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc009400 con 0x7f5a140cdfd0 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.098+0000 7f5a0affd640 1 -- 172.21.15.84:0/1144880587 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04014a00 con 0x7f5a140cdfd0 2023-12-12T09:22:32.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.098+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1415f300 con 0x7f5a140cdfd0 2023-12-12T09:22:32.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.099+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a140673c0 con 0x7f5a140cdfd0 2023-12-12T09:22:32.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.100+0000 7f5a0affd640 1 -- 172.21.15.84:0/1144880587 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a04014b60 con 0x7f5a140cdfd0 2023-12-12T09:22:32.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.101+0000 7f5a0affd640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f59f406ae40 0x7f59f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:32.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.101+0000 7f5a0affd640 1 -- 172.21.15.84:0/1144880587 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5658+0+0 (secure 0 0 0) 0x7f5a0408a700 con 0x7f5a140cdfd0 2023-12-12T09:22:32.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.101+0000 7f5a11d9b640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f59f406ae40 0x7f59f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:32.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.102+0000 7f5a11d9b640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f59f406ae40 0x7f59f406d300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f59fc036000 tx=0x7f59fc03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:32.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.105+0000 7f5a0affd640 1 -- 172.21.15.84:0/1144880587 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a04055740 con 0x7f5a140cdfd0 2023-12-12T09:22:32.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:32.297+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a140b8a20 con 0x7f5a140cdfd0 2023-12-12T09:22:33.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.183+0000 7f5a0affd640 1 -- 172.21.15.84:0/1144880587 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v49) v1 ==== 160+0+0 (secure 0 0 0) 0x7f5a04058d60 con 0x7f5a140cdfd0 2023-12-12T09:22:33.184 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'data_new' removed 2023-12-12T09:22:33.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f59f406ae40 msgr2=0x7f59f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f59f406ae40 0x7f59f406d300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f59fc036000 tx=0x7f59fc03c040 comp rx=0 tx=0).stop 2023-12-12T09:22:33.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140cdfd0 msgr2=0x7f5a1415fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140cdfd0 0x7f5a1415fde0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009f60 tx=0x7f5a04009f90 comp rx=0 tx=0).stop 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 shutdown_connections 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f5a1415d070 0x7f5a140ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a140cf6c0 0x7f5a141f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f59f406ae40 0x7f59f406d300 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 --2- 172.21.15.84:0/1144880587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a140cdfd0 0x7f5a1415fde0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 >> 172.21.15.84:0/1144880587 conn(0x7f5a140d2f80 msgr2=0x7f5a140b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 shutdown_connections 2023-12-12T09:22:33.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.188+0000 7f5a1359e640 1 -- 172.21.15.84:0/1144880587 wait complete. 2023-12-12T09:22:33.210 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-12T09:22:33.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.412+0000 7f95cee5c640 1 Processor -- start 2023-12-12T09:22:33.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.413+0000 7f95cee5c640 1 -- start start 2023-12-12T09:22:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.414+0000 7f95cee5c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95c815b3d0 0x7f95c80cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.414+0000 7f95cee5c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c80b37f0 0x7f95c815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.414+0000 7f95cee5c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c80cf1e0 con 0x7f95c815f370 2023-12-12T09:22:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.414+0000 7f95cee5c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c809a9f0 con 0x7f95c815b3d0 2023-12-12T09:22:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.414+0000 7f95cee5c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c815c7c0 con 0x7f95c80b37f0 2023-12-12T09:22:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.414+0000 7f95ccbf8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95c815b3d0 0x7f95c80cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.415+0000 7f95ccbf8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f95c815b3d0 0x7f95c80cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36774/0 (socket says 172.21.15.84:36774) 2023-12-12T09:22:33.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.415+0000 7f95ccbf8640 1 -- 172.21.15.84:0/2337413153 learned_addr learned my addr 172.21.15.84:0/2337413153 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:33.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.415+0000 7f95c7fff640 1 --2- 172.21.15.84:0/2337413153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c80b37f0 0x7f95c815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.415+0000 7f95ccbf8640 1 -- 172.21.15.84:0/2337413153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c80b37f0 msgr2=0x7f95c815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:33.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.415+0000 7f95ccbf8640 1 --2- 172.21.15.84:0/2337413153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c80b37f0 0x7f95c815ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.415+0000 7f95ccbf8640 1 -- 172.21.15.84:0/2337413153 >> v1:172.21.15.99:6789/0 conn(0x7f95c815f370 legacy=0x7f95c80cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:33.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.415+0000 7f95ccbf8640 1 -- 172.21.15.84:0/2337413153 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8074460 con 0x7f95c815b3d0 2023-12-12T09:22:33.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.416+0000 7f95ccbf8640 1 --2- 172.21.15.84:0/2337413153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c815b3d0 0x7f95c80cfc80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009e80 tx=0x7f95b802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5206796909e093 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:33.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.416+0000 7f95c77fe640 1 -- 172.21.15.84:0/2337413153 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b802ca50 con 0x7f95c815b3d0 2023-12-12T09:22:33.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.416+0000 7f95c77fe640 1 -- 172.21.15.84:0/2337413153 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b802cbb0 con 0x7f95c815b3d0 2023-12-12T09:22:33.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.416+0000 7f95c77fe640 1 -- 172.21.15.84:0/2337413153 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80343f0 con 0x7f95c815b3d0 2023-12-12T09:22:33.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.417+0000 7f95cee5c640 1 -- 172.21.15.84:0/2337413153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c815b3d0 msgr2=0x7f95c80cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.417+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2337413153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c815b3d0 0x7f95c80cfc80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009e80 tx=0x7f95b802beb0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.417+0000 7f95cee5c640 1 -- 172.21.15.84:0/2337413153 shutdown_connections 2023-12-12T09:22:33.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.417+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2337413153 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c80b37f0 0x7f95c815ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.417+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2337413153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c815b3d0 0x7f95c80cfc80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.417+0000 7f95cee5c640 1 -- 172.21.15.84:0/2337413153 >> 172.21.15.84:0/2337413153 conn(0x7f95c80b2ab0 msgr2=0x7f95c80b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:33.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.417+0000 7f95cee5c640 1 -- 172.21.15.84:0/2337413153 shutdown_connections 2023-12-12T09:22:33.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.417+0000 7f95cee5c640 1 -- 172.21.15.84:0/2337413153 wait complete. 2023-12-12T09:22:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.419+0000 7f95cee5c640 1 Processor -- start 2023-12-12T09:22:33.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.419+0000 7f95cee5c640 1 -- start start 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cee5c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c815b3d0 0x7f95c815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cee5c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c815f370 0x7f95c80c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cee5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c814ef60 0x7f95c80c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cee5c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80ca6c0 con 0x7f95c814ef60 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cee5c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80c9ab0 con 0x7f95c815b3d0 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cee5c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80c9d90 con 0x7f95c815f370 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cd3f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c814ef60 0x7f95c80c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cd3f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c814ef60 0x7f95c80c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36784/0 (socket says 172.21.15.84:36784) 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.420+0000 7f95cd3f9640 1 -- 172.21.15.84:0/2810320661 learned_addr learned my addr 172.21.15.84:0/2810320661 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95ccbf8640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c815b3d0 0x7f95c815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95c7fff640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c815f370 0x7f95c80c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95cd3f9640 1 -- 172.21.15.84:0/2810320661 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c815f370 msgr2=0x7f95c80c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95cd3f9640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c815f370 0x7f95c80c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95cd3f9640 1 -- 172.21.15.84:0/2810320661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c815b3d0 msgr2=0x7f95c815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95cd3f9640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c815b3d0 0x7f95c815e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95cd3f9640 1 -- 172.21.15.84:0/2810320661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009b30 con 0x7f95c814ef60 2023-12-12T09:22:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95cd3f9640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c814ef60 0x7f95c80c6d50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f95c000b410 tx=0x7f95c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95c57fa640 1 -- 172.21.15.84:0/2810320661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0004020 con 0x7f95c814ef60 2023-12-12T09:22:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95c57fa640 1 -- 172.21.15.84:0/2810320661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0004180 con 0x7f95c814ef60 2023-12-12T09:22:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95c57fa640 1 -- 172.21.15.84:0/2810320661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0011630 con 0x7f95c814ef60 2023-12-12T09:22:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.421+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c80ca070 con 0x7f95c814ef60 2023-12-12T09:22:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.422+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c80c5bc0 con 0x7f95c814ef60 2023-12-12T09:22:33.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.423+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c80ca830 con 0x7f95c814ef60 2023-12-12T09:22:33.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.424+0000 7f95c57fa640 1 -- 172.21.15.84:0/2810320661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95c0011790 con 0x7f95c814ef60 2023-12-12T09:22:33.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.425+0000 7f95c57fa640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95b406ae40 0x7f95b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.425+0000 7f95c57fa640 1 -- 172.21.15.84:0/2810320661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f95c0089110 con 0x7f95c814ef60 2023-12-12T09:22:33.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.425+0000 7f95ccbf8640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95b406ae40 0x7f95b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.426+0000 7f95ccbf8640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95b406ae40 0x7f95b406d300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f95b8035000 tx=0x7f95b8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:33.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.429+0000 7f95c57fa640 1 -- 172.21.15.84:0/2810320661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95c0054380 con 0x7f95c814ef60 2023-12-12T09:22:33.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.618+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f95c8072eb0 con 0x7f95c814ef60 2023-12-12T09:22:33.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.625+0000 7f95c57fa640 1 -- 172.21.15.84:0/2810320661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f95c00579a0 con 0x7f95c814ef60 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95b406ae40 msgr2=0x7f95b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95b406ae40 0x7f95b406d300 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f95b8035000 tx=0x7f95b8030000 comp rx=0 tx=0).stop 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c814ef60 msgr2=0x7f95c80c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c814ef60 0x7f95c80c6d50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f95c000b410 tx=0x7f95c000b8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 shutdown_connections 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95b406ae40 0x7f95b406d300 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c814ef60 0x7f95c80c6d50 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f95c815f370 0x7f95c80c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 --2- 172.21.15.84:0/2810320661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c815b3d0 0x7f95c815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.628+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 >> 172.21.15.84:0/2810320661 conn(0x7f95c80b2ab0 msgr2=0x7f95c806baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.629+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 shutdown_connections 2023-12-12T09:22:33.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.629+0000 7f95cee5c640 1 -- 172.21.15.84:0/2810320661 wait complete. 2023-12-12T09:22:33.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-12-12T09:22:33.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.862+0000 7f66fdb8a640 1 Processor -- start 2023-12-12T09:22:33.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.863+0000 7f66fdb8a640 1 -- start start 2023-12-12T09:22:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.864+0000 7f66fdb8a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66f80d1650 0x7f66f80b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.864+0000 7f66fdb8a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.864+0000 7f66fdb8a640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f80b1050 con 0x7f66f815d130 2023-12-12T09:22:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.864+0000 7f66fdb8a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80b3410 con 0x7f66f80d1650 2023-12-12T09:22:33.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.864+0000 7f66fdb8a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80b48b0 con 0x7f66f80cd8a0 2023-12-12T09:22:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.865+0000 7f66f7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66f80d1650 0x7f66f80b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.865+0000 7f66f7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66f80d1650 0x7f66f80b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:39868/0 (socket says 172.21.15.84:39868) 2023-12-12T09:22:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.865+0000 7f66f7fff640 1 -- 172.21.15.84:0/2070111312 learned_addr learned my addr 172.21.15.84:0/2070111312 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:33.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.865+0000 7f66fd389640 1 --2- 172.21.15.84:0/2070111312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.866+0000 7f66fd389640 1 -- 172.21.15.84:0/2070111312 >> v2:172.21.15.99:3300/0 conn(0x7f66f80d1650 msgr2=0x7f66f80b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.866+0000 7f66fd389640 1 --2- 172.21.15.84:0/2070111312 >> v2:172.21.15.99:3300/0 conn(0x7f66f80d1650 0x7f66f80b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.866+0000 7f66fd389640 1 -- 172.21.15.84:0/2070111312 >> v1:172.21.15.99:6789/0 conn(0x7f66f815d130 legacy=0x7f66f80d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.866+0000 7f66fd389640 1 -- 172.21.15.84:0/2070111312 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80b2800 con 0x7f66f80cd8a0 2023-12-12T09:22:33.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.866+0000 7f66f7fff640 1 --2- 172.21.15.84:0/2070111312 >> v2:172.21.15.99:3300/0 conn(0x7f66f80d1650 0x7f66f80b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:22:33.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.867+0000 7f66fd389640 1 --2- 172.21.15.84:0/2070111312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80b2130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3bc8c87706dc1d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.868+0000 7f66f77fe640 1 -- 172.21.15.84:0/2070111312 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f002cce0 con 0x7f66f80cd8a0 2023-12-12T09:22:33.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.868+0000 7f66f77fe640 1 -- 172.21.15.84:0/2070111312 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f002ce40 con 0x7f66f80cd8a0 2023-12-12T09:22:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.868+0000 7f66f77fe640 1 -- 172.21.15.84:0/2070111312 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0034660 con 0x7f66f80cd8a0 2023-12-12T09:22:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.869+0000 7f66fdb8a640 1 -- 172.21.15.84:0/2070111312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 msgr2=0x7f66f80b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.869+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/2070111312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80b2130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009d90 tx=0x7f66f002bf30 comp rx=0 tx=0).stop 2023-12-12T09:22:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.869+0000 7f66fdb8a640 1 -- 172.21.15.84:0/2070111312 shutdown_connections 2023-12-12T09:22:33.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.869+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/2070111312 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80b2130 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.869+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/2070111312 >> v2:172.21.15.99:3300/0 conn(0x7f66f80d1650 0x7f66f80b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.869+0000 7f66fdb8a640 1 -- 172.21.15.84:0/2070111312 >> 172.21.15.84:0/2070111312 conn(0x7f66f809c390 msgr2=0x7f66f80d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.869+0000 7f66fdb8a640 1 -- 172.21.15.84:0/2070111312 shutdown_connections 2023-12-12T09:22:33.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.869+0000 7f66fdb8a640 1 -- 172.21.15.84:0/2070111312 wait complete. 2023-12-12T09:22:33.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.871+0000 7f66fdb8a640 1 Processor -- start 2023-12-12T09:22:33.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.872+0000 7f66fdb8a640 1 -- start start 2023-12-12T09:22:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66fdb8a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66fdb8a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f80d1650 0x7f66f80b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66fdb8a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f815d130 0x7f66f8151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66fdb8a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80b7240 con 0x7f66f80d1650 2023-12-12T09:22:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66fdb8a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80b61a0 con 0x7f66f815d130 2023-12-12T09:22:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66fdb8a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80b6440 con 0x7f66f80cd8a0 2023-12-12T09:22:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66f7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f80d1650 0x7f66f80b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66f7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f80d1650 0x7f66f80b5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36794/0 (socket says 172.21.15.84:36794) 2023-12-12T09:22:33.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.873+0000 7f66f7fff640 1 -- 172.21.15.84:0/497398883 learned_addr learned my addr 172.21.15.84:0/497398883 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66fcb88640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66fd389640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f815d130 0x7f66f8151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f7fff640 1 -- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 msgr2=0x7f66f80cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f7fff640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f7fff640 1 -- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f815d130 msgr2=0x7f66f8151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f7fff640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f815d130 0x7f66f8151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:33.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f7fff640 1 -- 172.21.15.84:0/497398883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40094d0 con 0x7f66f80d1650 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66fcb88640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66fd389640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f815d130 0x7f66f8151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f7fff640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f80d1650 0x7f66f80b5c60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f66e400e9d0 tx=0x7f66e400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f57fa640 1 -- 172.21.15.84:0/497398883 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400ca60 con 0x7f66f80d1650 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f57fa640 1 -- 172.21.15.84:0/497398883 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e400cbc0 con 0x7f66f80d1650 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66f57fa640 1 -- 172.21.15.84:0/497398883 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4013470 con 0x7f66f80d1650 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.874+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f0009a70 con 0x7f66f80d1650 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.875+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f80b6a00 con 0x7f66f80d1650 2023-12-12T09:22:33.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.876+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f80b6c20 con 0x7f66f80d1650 2023-12-12T09:22:33.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.877+0000 7f66f57fa640 1 -- 172.21.15.84:0/497398883 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66e40135d0 con 0x7f66f80d1650 2023-12-12T09:22:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.878+0000 7f66f57fa640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66dc06ae70 0x7f66dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.878+0000 7f66f57fa640 1 -- 172.21.15.84:0/497398883 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f66e4089770 con 0x7f66f80d1650 2023-12-12T09:22:33.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.878+0000 7f66fcb88640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66dc06ae70 0x7f66dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:33.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.879+0000 7f66fcb88640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66dc06ae70 0x7f66dc06d330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0015e0 tx=0x7f66ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:33.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:33.884+0000 7f66f57fa640 1 -- 172.21.15.84:0/497398883 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f66f80b6c20 con 0x7f66f80d1650 2023-12-12T09:22:34.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.144+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f66f80b6c20 con 0x7f66f80d1650 2023-12-12T09:22:34.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.186+0000 7f66f57fa640 1 -- 172.21.15.84:0/497398883 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v173) v1 ==== 147+0+0 (secure 0 0 0) 0x7f66f80b6c20 con 0x7f66f80d1650 2023-12-12T09:22:34.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66dc06ae70 msgr2=0x7f66dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66dc06ae70 0x7f66dc06d330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0015e0 tx=0x7f66ec009040 comp rx=0 tx=0).stop 2023-12-12T09:22:34.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f80d1650 msgr2=0x7f66f80b5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f80d1650 0x7f66f80b5c60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f66e400e9d0 tx=0x7f66e400ee90 comp rx=0 tx=0).stop 2023-12-12T09:22:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 shutdown_connections 2023-12-12T09:22:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f815d130 0x7f66f8151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f66dc06ae70 0x7f66dc06d330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66f80d1650 0x7f66f80b5c60 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 --2- 172.21.15.84:0/497398883 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f66f80cd8a0 0x7f66f80cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 >> 172.21.15.84:0/497398883 conn(0x7f66f809c390 msgr2=0x7f66f80d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 shutdown_connections 2023-12-12T09:22:34.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.189+0000 7f66fdb8a640 1 -- 172.21.15.84:0/497398883 wait complete. 2023-12-12T09:22:34.208 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2023-12-12T09:22:34.208 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-12T09:22:34.208 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:34.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.423+0000 7fcdb19d7640 1 Processor -- start 2023-12-12T09:22:34.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.424+0000 7fcdb19d7640 1 -- start start 2023-12-12T09:22:34.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.426+0000 7fcdb19d7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdac143d20 0x7fcdac0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.426+0000 7fcdb19d7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac15f910 con 0x7fcdac1447f0 2023-12-12T09:22:34.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.426+0000 7fcdb19d7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac0cea30 con 0x7fcdac0ce550 2023-12-12T09:22:34.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.426+0000 7fcdb19d7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0702b0 con 0x7fcdac143d20 2023-12-12T09:22:34.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.426+0000 7fcdaaffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdac143d20 0x7fcdac0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.426+0000 7fcdaaffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcdac143d20 0x7fcdac0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36796/0 (socket says 172.21.15.84:36796) 2023-12-12T09:22:34.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.426+0000 7fcdaaffd640 1 -- 172.21.15.84:0/794720540 learned_addr learned my addr 172.21.15.84:0/794720540 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:34.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.426+0000 7fcdaaffd640 1 -- 172.21.15.84:0/794720540 >> v1:172.21.15.99:6789/0 conn(0x7fcdac0ce550 legacy=0x7fcdac15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:34.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.427+0000 7fcdaaffd640 1 -- 172.21.15.84:0/794720540 >> v1:172.21.15.84:6789/0 conn(0x7fcdac1447f0 legacy=0x7fcdac15f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.427+0000 7fcdaaffd640 1 -- 172.21.15.84:0/794720540 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac070590 con 0x7fcdac143d20 2023-12-12T09:22:34.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.427+0000 7fcdaa7fc640 1 -- 172.21.15.84:0/794720540 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539517908 0 0) 0x7fcdac15f910 con 0x7fcdac1447f0 2023-12-12T09:22:34.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.428+0000 7fcdaaffd640 1 --2- 172.21.15.84:0/794720540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac143d20 0x7fcdac0b40d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b0775cdc197dff server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:34.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.428+0000 7fcdaa7fc640 1 -- 172.21.15.84:0/794720540 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c030860 con 0x7fcdac143d20 2023-12-12T09:22:34.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.428+0000 7fcdaa7fc640 1 -- 172.21.15.84:0/794720540 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0309c0 con 0x7fcdac143d20 2023-12-12T09:22:34.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.428+0000 7fcdaa7fc640 1 -- 172.21.15.84:0/794720540 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c030d50 con 0x7fcdac143d20 2023-12-12T09:22:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.428+0000 7fcdb19d7640 1 -- 172.21.15.84:0/794720540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac143d20 msgr2=0x7fcdac0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.428+0000 7fcdb19d7640 1 --2- 172.21.15.84:0/794720540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac143d20 0x7fcdac0b40d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c02b9a0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.429+0000 7fcdb19d7640 1 -- 172.21.15.84:0/794720540 shutdown_connections 2023-12-12T09:22:34.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.429+0000 7fcdb19d7640 1 --2- 172.21.15.84:0/794720540 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac143d20 0x7fcdac0b40d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.429+0000 7fcdb19d7640 1 -- 172.21.15.84:0/794720540 >> 172.21.15.84:0/794720540 conn(0x7fcdac06c3d0 msgr2=0x7fcdac06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.429+0000 7fcdb19d7640 1 -- 172.21.15.84:0/794720540 shutdown_connections 2023-12-12T09:22:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.429+0000 7fcdb19d7640 1 -- 172.21.15.84:0/794720540 wait complete. 2023-12-12T09:22:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.430+0000 7fcdb19d7640 1 Processor -- start 2023-12-12T09:22:34.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.430+0000 7fcdb19d7640 1 -- start start 2023-12-12T09:22:34.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.431+0000 7fcdb19d7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac0ce550 0x7fcdac13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.431+0000 7fcdb19d7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdac143d20 0x7fcdac1f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.431+0000 7fcdb19d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdac1447f0 0x7fcdac0b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.431+0000 7fcdb19d7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac15b550 con 0x7fcdac0ce550 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.431+0000 7fcdb19d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac13bfe0 con 0x7fcdac1447f0 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.431+0000 7fcdb19d7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1f3720 con 0x7fcdac143d20 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac0ce550 0x7fcdac13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac0ce550 0x7fcdac13baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36812/0 (socket says 172.21.15.84:36812) 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 -- 172.21.15.84:0/4088130658 learned_addr learned my addr 172.21.15.84:0/4088130658 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 -- 172.21.15.84:0/4088130658 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdac143d20 msgr2=0x7fcdac1f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdac143d20 0x7fcdac1f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 -- 172.21.15.84:0/4088130658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdac1447f0 msgr2=0x7fcdac0b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdac1447f0 0x7fcdac0b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 -- 172.21.15.84:0/4088130658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0094d0 con 0x7fcdac0ce550 2023-12-12T09:22:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.432+0000 7fcdaaffd640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac0ce550 0x7fcdac13baa0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:34.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.433+0000 7fcda8ff9640 1 -- 172.21.15.84:0/4088130658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c039d60 con 0x7fcdac0ce550 2023-12-12T09:22:34.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.433+0000 7fcda8ff9640 1 -- 172.21.15.84:0/4088130658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c043400 con 0x7fcdac0ce550 2023-12-12T09:22:34.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.433+0000 7fcda8ff9640 1 -- 172.21.15.84:0/4088130658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0437b0 con 0x7fcdac0ce550 2023-12-12T09:22:34.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.433+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac1f3a00 con 0x7fcdac0ce550 2023-12-12T09:22:34.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.433+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac15b7a0 con 0x7fcdac0ce550 2023-12-12T09:22:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.434+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0673c0 con 0x7fcdac0ce550 2023-12-12T09:22:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.435+0000 7fcda8ff9640 1 -- 172.21.15.84:0/4088130658 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd9c043910 con 0x7fcdac0ce550 2023-12-12T09:22:34.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.436+0000 7fcda8ff9640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd8c06ae40 0x7fcd8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.436+0000 7fcda8ff9640 1 -- 172.21.15.84:0/4088130658 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcd9c03e070 con 0x7fcdac0ce550 2023-12-12T09:22:34.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.436+0000 7fcda27fc640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd8c06ae40 0x7fcd8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.437+0000 7fcda27fc640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd8c06ae40 0x7fcd8c06d300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0ae620 tx=0x7fcd940079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:34.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.440+0000 7fcda8ff9640 1 -- 172.21.15.84:0/4088130658 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd9c077ae0 con 0x7fcdac0ce550 2023-12-12T09:22:34.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.630+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdac06e3b0 con 0x7fcdac0ce550 2023-12-12T09:22:34.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.632+0000 7fcda8ff9640 1 -- 172.21.15.84:0/4088130658 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13107 (secure 0 0 0) 0x7fcd9c07b100 con 0x7fcdac0ce550 2023-12-12T09:22:34.632 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:34.632 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":49,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:33.180128+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6836/1717242900":"2023-12-13T09:22:28.810546+0000","172.21.15.84:6834/1717242900":"2023-12-13T09:22:28.810546+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd8c06ae40 msgr2=0x7fcd8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd8c06ae40 0x7fcd8c06d300 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0ae620 tx=0x7fcd940079b0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac0ce550 msgr2=0x7fcdac13baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac0ce550 0x7fcdac13baa0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c004730 comp rx=0 tx=0).stop 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 shutdown_connections 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdac1447f0 0x7fcdac0b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcdac143d20 0x7fcdac1f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcd8c06ae40 0x7fcd8c06d300 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 --2- 172.21.15.84:0/4088130658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdac0ce550 0x7fcdac13baa0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 >> 172.21.15.84:0/4088130658 conn(0x7fcdac06c3d0 msgr2=0x7fcdac06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.634+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 shutdown_connections 2023-12-12T09:22:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.635+0000 7fcdb19d7640 1 -- 172.21.15.84:0/4088130658 wait complete. 2023-12-12T09:22:34.655 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:22:34.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:22:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.874+0000 7f721ac39640 1 Processor -- start 2023-12-12T09:22:34.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.874+0000 7f721ac39640 1 -- start start 2023-12-12T09:22:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.875+0000 7f721ac39640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7214157860 0x7f721415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.875+0000 7f721ac39640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f72140cef30 0x7f72140cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.875+0000 7f721ac39640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721415ddf0 con 0x7f72140b1a80 2023-12-12T09:22:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.875+0000 7f721ac39640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140cf900 con 0x7f72140cef30 2023-12-12T09:22:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.875+0000 7f721ac39640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721415acb0 con 0x7f7214157860 2023-12-12T09:22:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.876+0000 7f721a438640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f72140cef30 0x7f72140cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.876+0000 7f721a438640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f72140cef30 0x7f72140cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36822/0 (socket says 172.21.15.84:36822) 2023-12-12T09:22:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.876+0000 7f721a438640 1 -- 172.21.15.84:0/50706327 learned_addr learned my addr 172.21.15.84:0/50706327 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.876+0000 7f7219c37640 1 --2- 172.21.15.84:0/50706327 >> v2:172.21.15.99:3300/0 conn(0x7f7214157860 0x7f721415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.876+0000 7f721a438640 1 -- 172.21.15.84:0/50706327 >> v2:172.21.15.99:3300/0 conn(0x7f7214157860 msgr2=0x7f721415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.876+0000 7f721a438640 1 --2- 172.21.15.84:0/50706327 >> v2:172.21.15.99:3300/0 conn(0x7f7214157860 0x7f721415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.876+0000 7f721a438640 1 -- 172.21.15.84:0/50706327 >> v1:172.21.15.99:6789/0 conn(0x7f72140b1a80 legacy=0x7f721415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:34.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.876+0000 7f721a438640 1 -- 172.21.15.84:0/50706327 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721415af90 con 0x7f72140cef30 2023-12-12T09:22:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.878+0000 7f721a438640 1 --2- 172.21.15.84:0/50706327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72140cef30 0x7f72140cf3c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f721406c660 tx=0x7f720c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c99fb7190379f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.878+0000 7f7218c35640 1 -- 172.21.15.84:0/50706327 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c02ca80 con 0x7f72140cef30 2023-12-12T09:22:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.878+0000 7f7218c35640 1 -- 172.21.15.84:0/50706327 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c02cbe0 con 0x7f72140cef30 2023-12-12T09:22:34.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.878+0000 7f7218c35640 1 -- 172.21.15.84:0/50706327 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c0343f0 con 0x7f72140cef30 2023-12-12T09:22:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.879+0000 7f721ac39640 1 -- 172.21.15.84:0/50706327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72140cef30 msgr2=0x7f72140cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.879+0000 7f721ac39640 1 --2- 172.21.15.84:0/50706327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72140cef30 0x7f72140cf3c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f721406c660 tx=0x7f720c02bee0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.879+0000 7f721ac39640 1 -- 172.21.15.84:0/50706327 shutdown_connections 2023-12-12T09:22:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.879+0000 7f721ac39640 1 --2- 172.21.15.84:0/50706327 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72140cef30 0x7f72140cf3c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.879+0000 7f721ac39640 1 --2- 172.21.15.84:0/50706327 >> v2:172.21.15.99:3300/0 conn(0x7f7214157860 0x7f721415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.879+0000 7f721ac39640 1 -- 172.21.15.84:0/50706327 >> 172.21.15.84:0/50706327 conn(0x7f721406a920 msgr2=0x7f721406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.879+0000 7f721ac39640 1 -- 172.21.15.84:0/50706327 shutdown_connections 2023-12-12T09:22:34.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.879+0000 7f721ac39640 1 -- 172.21.15.84:0/50706327 wait complete. 2023-12-12T09:22:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.881+0000 7f721ac39640 1 Processor -- start 2023-12-12T09:22:34.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.881+0000 7f721ac39640 1 -- start start 2023-12-12T09:22:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721ac39640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72140b1a80 0x7f7214147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721ac39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72140cef30 0x7f72140af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721ac39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7214157860 0x7f72140afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721ac39640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721415c0a0 con 0x7f7214157860 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721ac39640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721415b490 con 0x7f72140cef30 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721ac39640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721415b770 con 0x7f72140b1a80 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721a438640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7214157860 0x7f72140afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721a438640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7214157860 0x7f72140afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36824/0 (socket says 172.21.15.84:36824) 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721a438640 1 -- 172.21.15.84:0/35497437 learned_addr learned my addr 172.21.15.84:0/35497437 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f7219c37640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72140b1a80 0x7f7214147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f7219436640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72140cef30 0x7f72140af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721a438640 1 -- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72140b1a80 msgr2=0x7f7214147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721a438640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72140b1a80 0x7f7214147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721a438640 1 -- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72140cef30 msgr2=0x7f72140af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721a438640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72140cef30 0x7f72140af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f721a438640 1 -- 172.21.15.84:0/35497437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c009b30 con 0x7f7214157860 2023-12-12T09:22:34.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.882+0000 7f7219c37640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72140b1a80 0x7f7214147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.883+0000 7f721a438640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7214157860 0x7f72140afb10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f720c036040 tx=0x7f720c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.883+0000 7f720a7fc640 1 -- 172.21.15.84:0/35497437 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c009510 con 0x7f7214157860 2023-12-12T09:22:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.883+0000 7f720a7fc640 1 -- 172.21.15.84:0/35497437 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c03e450 con 0x7f7214157860 2023-12-12T09:22:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.883+0000 7f720a7fc640 1 -- 172.21.15.84:0/35497437 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c03e800 con 0x7f7214157860 2023-12-12T09:22:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.883+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721415ba50 con 0x7f7214157860 2023-12-12T09:22:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.883+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7214147db0 con 0x7f7214157860 2023-12-12T09:22:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.884+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721415c250 con 0x7f7214157860 2023-12-12T09:22:34.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.885+0000 7f720a7fc640 1 -- 172.21.15.84:0/35497437 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f720c02cd50 con 0x7f7214157860 2023-12-12T09:22:34.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.886+0000 7f720a7fc640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f71f806ae40 0x7f71f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:34.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.886+0000 7f720a7fc640 1 -- 172.21.15.84:0/35497437 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f720c0abf10 con 0x7f7214157860 2023-12-12T09:22:34.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.887+0000 7f7219c37640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f71f806ae40 0x7f71f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:34.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.887+0000 7f7219c37640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f71f806ae40 0x7f71f806d300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7210006fd0 tx=0x7f7210008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:34.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:34.891+0000 7f720a7fc640 1 -- 172.21.15.84:0/35497437 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f721415c250 con 0x7f7214157860 2023-12-12T09:22:35.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.081+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72140673c0 con 0x7f7214157860 2023-12-12T09:22:35.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.082+0000 7f720a7fc640 1 -- 172.21.15.84:0/35497437 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f720c043020 con 0x7f7214157860 2023-12-12T09:22:35.082 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f71f806ae40 msgr2=0x7f71f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f71f806ae40 0x7f71f806d300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7210006fd0 tx=0x7f7210008040 comp rx=0 tx=0).stop 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7214157860 msgr2=0x7f72140afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7214157860 0x7f72140afb10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f720c036040 tx=0x7f720c004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 shutdown_connections 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f71f806ae40 0x7f71f806d300 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7214157860 0x7f72140afb10 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72140cef30 0x7f72140af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 --2- 172.21.15.84:0/35497437 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f72140b1a80 0x7f7214147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.084+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 >> 172.21.15.84:0/35497437 conn(0x7f721406a920 msgr2=0x7f7214150ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:35.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.085+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 shutdown_connections 2023-12-12T09:22:35.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.085+0000 7f721ac39640 1 -- 172.21.15.84:0/35497437 wait complete. 2023-12-12T09:22:35.102 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-12-12T09:22:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.305+0000 7f44c47c5640 1 Processor -- start 2023-12-12T09:22:35.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.305+0000 7f44c47c5640 1 -- start start 2023-12-12T09:22:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c47c5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 0x7f44bc142830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c47c5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44bc0b4ba0 0x7f44bc142d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c47c5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44bc15d9a0 0x7f44bc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:35.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c47c5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc15e6d0 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c47c5640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0b3b60 con 0x7f44bc15d9a0 2023-12-12T09:22:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c47c5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0b3de0 con 0x7f44bc13ff90 2023-12-12T09:22:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c1d60640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44bc0b4ba0 0x7f44bc142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c1d60640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44bc0b4ba0 0x7f44bc142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36826/0 (socket says 172.21.15.84:36826) 2023-12-12T09:22:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.307+0000 7f44c1d60640 1 -- 172.21.15.84:0/1892343901 learned_addr learned my addr 172.21.15.84:0/1892343901 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:35.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c2d62640 1 --2- 172.21.15.84:0/1892343901 >> v2:172.21.15.99:3300/0 conn(0x7f44bc15d9a0 0x7f44bc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c2561640 1 --2- 172.21.15.84:0/1892343901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 0x7f44bc142830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c1d60640 1 -- 172.21.15.84:0/1892343901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 msgr2=0x7f44bc142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c1d60640 1 --2- 172.21.15.84:0/1892343901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 0x7f44bc142830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c1d60640 1 -- 172.21.15.84:0/1892343901 >> v2:172.21.15.99:3300/0 conn(0x7f44bc15d9a0 msgr2=0x7f44bc15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c1d60640 1 --2- 172.21.15.84:0/1892343901 >> v2:172.21.15.99:3300/0 conn(0x7f44bc15d9a0 0x7f44bc15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c1d60640 1 -- 172.21.15.84:0/1892343901 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0b40c0 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c2d62640 1 --2- 172.21.15.84:0/1892343901 >> v2:172.21.15.99:3300/0 conn(0x7f44bc15d9a0 0x7f44bc15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:35.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.308+0000 7f44c2561640 1 --2- 172.21.15.84:0/1892343901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 0x7f44bc142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:35.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.309+0000 7f44c1d60640 1 --2- 172.21.15.84:0/1892343901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc142d70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f44bc06e050 tx=0x7f44b802b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91f7ce800089453 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:35.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.309+0000 7f44c155f640 1 -- 172.21.15.84:0/1892343901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8031880 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.309+0000 7f44c155f640 1 -- 172.21.15.84:0/1892343901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b80319e0 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.309+0000 7f44c155f640 1 -- 172.21.15.84:0/1892343901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8031d70 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 -- 172.21.15.84:0/1892343901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 msgr2=0x7f44bc142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 --2- 172.21.15.84:0/1892343901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc142d70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f44bc06e050 tx=0x7f44b802b920 comp rx=0 tx=0).stop 2023-12-12T09:22:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 -- 172.21.15.84:0/1892343901 shutdown_connections 2023-12-12T09:22:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 --2- 172.21.15.84:0/1892343901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc142d70 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 --2- 172.21.15.84:0/1892343901 >> v2:172.21.15.99:3300/0 conn(0x7f44bc15d9a0 0x7f44bc15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 --2- 172.21.15.84:0/1892343901 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 0x7f44bc142830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 -- 172.21.15.84:0/1892343901 >> 172.21.15.84:0/1892343901 conn(0x7f44bc06c3d0 msgr2=0x7f44bc06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 -- 172.21.15.84:0/1892343901 shutdown_connections 2023-12-12T09:22:35.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.310+0000 7f44c47c5640 1 -- 172.21.15.84:0/1892343901 wait complete. 2023-12-12T09:22:35.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.312+0000 7f44c47c5640 1 Processor -- start 2023-12-12T09:22:35.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.312+0000 7f44c47c5640 1 -- start start 2023-12-12T09:22:35.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c47c5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:35.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c47c5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 0x7f44bc156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:35.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c47c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44bc15d9a0 0x7f44bc1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:35.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c47c5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0ad680 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c47c5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0ad960 con 0x7f44bc15d9a0 2023-12-12T09:22:35.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c47c5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0adc40 con 0x7f44bc13ff90 2023-12-12T09:22:35.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c2561640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:35.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c2561640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc0ae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36828/0 (socket says 172.21.15.84:36828) 2023-12-12T09:22:35.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.313+0000 7f44c2561640 1 -- 172.21.15.84:0/3189612652 learned_addr learned my addr 172.21.15.84:0/3189612652 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44c2561640 1 -- 172.21.15.84:0/3189612652 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 msgr2=0x7f44bc156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44c2561640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 0x7f44bc156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44c2561640 1 -- 172.21.15.84:0/3189612652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44bc15d9a0 msgr2=0x7f44bc1567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44c2561640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44bc15d9a0 0x7f44bc1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44c2561640 1 -- 172.21.15.84:0/3189612652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80094d0 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44c2561640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc0ae720 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c7c0 tx=0x7f44ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44b2ffd640 1 -- 172.21.15.84:0/3189612652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac007a30 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44b2ffd640 1 -- 172.21.15.84:0/3189612652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac007b90 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44b2ffd640 1 -- 172.21.15.84:0/3189612652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00ce70 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc0adf20 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.314+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc0aec60 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.316+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc0673c0 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.316+0000 7f44b2ffd640 1 -- 172.21.15.84:0/3189612652 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44ac0113f0 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.317+0000 7f44b2ffd640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44a806ae40 0x7f44a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:35.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.317+0000 7f44b2ffd640 1 -- 172.21.15.84:0/3189612652 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f44ac0895d0 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.318+0000 7f44c1d60640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44a806ae40 0x7f44a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:35.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.318+0000 7f44c1d60640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44a806ae40 0x7f44a806d300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f44b8036000 tx=0x7f44b8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:35.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.321+0000 7f44b2ffd640 1 -- 172.21.15.84:0/3189612652 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44ac054840 con 0x7f44bc0b4ba0 2023-12-12T09:22:35.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:35.577+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f44bc1427b0 con 0x7f44bc0b4ba0 2023-12-12T09:22:36.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.201+0000 7f44b2ffd640 1 -- 172.21.15.84:0/3189612652 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v175) v1 ==== 137+0+0 (secure 0 0 0) 0x7f44ac057e60 con 0x7f44bc0b4ba0 2023-12-12T09:22:36.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44a806ae40 msgr2=0x7f44a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44a806ae40 0x7f44a806d300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f44b8036000 tx=0x7f44b8030000 comp rx=0 tx=0).stop 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 msgr2=0x7f44bc0ae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc0ae720 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c7c0 tx=0x7f44ac00cc80 comp rx=0 tx=0).stop 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 shutdown_connections 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44bc15d9a0 0x7f44bc1567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44bc13ff90 0x7f44bc156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44a806ae40 0x7f44a806d300 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 --2- 172.21.15.84:0/3189612652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44bc0b4ba0 0x7f44bc0ae720 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 >> 172.21.15.84:0/3189612652 conn(0x7f44bc06c3d0 msgr2=0x7f44bc13e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 shutdown_connections 2023-12-12T09:22:36.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.204+0000 7f44c47c5640 1 -- 172.21.15.84:0/3189612652 wait complete. 2023-12-12T09:22:36.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-12T09:22:36.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.440+0000 7fbb2ba9b640 1 Processor -- start 2023-12-12T09:22:36.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.440+0000 7fbb2ba9b640 1 -- start start 2023-12-12T09:22:36.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.442+0000 7fbb2ba9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbb2406e490 0x7fbb2406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:36.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.442+0000 7fbb2ba9b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240cf3e0 con 0x7fbb2415d1c0 2023-12-12T09:22:36.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.442+0000 7fbb2ba9b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2406d600 con 0x7fbb240cd890 2023-12-12T09:22:36.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.442+0000 7fbb2ba9b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2406bfa0 con 0x7fbb2406e490 2023-12-12T09:22:36.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.442+0000 7fbb29837640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbb2415d1c0 0x7fbb2406b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44822/0 (socket says 172.21.15.84:44822) 2023-12-12T09:22:36.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.442+0000 7fbb29837640 1 -- 172.21.15.84:0/3456819165 learned_addr learned my addr 172.21.15.84:0/3456819165 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb29036640 1 --2- 172.21.15.84:0/3456819165 >> v2:172.21.15.99:3300/0 conn(0x7fbb2406e490 0x7fbb2406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469080920 0 0) 0x7fbb240cf3e0 con 0x7fbb2415d1c0 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb10003520 con 0x7fbb2415d1c0 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979859009 0 0) 0x7fbb10003520 con 0x7fbb2415d1c0 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 >> v2:172.21.15.99:3300/0 conn(0x7fbb2406e490 msgr2=0x7fbb2406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 --2- 172.21.15.84:0/3456819165 >> v2:172.21.15.99:3300/0 conn(0x7fbb2406e490 0x7fbb2406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 >> v1:172.21.15.99:6789/0 conn(0x7fbb240cd890 legacy=0x7fbb240cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2406efe0 con 0x7fbb2415d1c0 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fbb20001670 con 0x7fbb2415d1c0 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 >> v1:172.21.15.84:6789/0 conn(0x7fbb2415d1c0 legacy=0x7fbb2406b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.443+0000 7fbb28835640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb100039c0 0x7fbb10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb28835640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb100047c0 0x7fbb10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb28835640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb10005180 0x7fbb1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2406bfa0 con 0x7fbb10005180 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1000c080 con 0x7fbb100039c0 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1000c240 con 0x7fbb100047c0 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb2a038640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb10005180 0x7fbb1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb29837640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb100039c0 0x7fbb10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb2a038640 1 -- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb100047c0 msgr2=0x7fbb10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb29036640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb100047c0 0x7fbb10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb2a038640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb100047c0 0x7fbb10004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb2a038640 1 -- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb100039c0 msgr2=0x7fbb10003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb2a038640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb100039c0 0x7fbb10003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb2a038640 1 -- 172.21.15.84:0/3456819165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10003520 con 0x7fbb10005180 2023-12-12T09:22:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.444+0000 7fbb29837640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb100039c0 0x7fbb10003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:22:36.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.445+0000 7fbb2a038640 1 -- 172.21.15.84:0/3456819165 reap_dead start 2023-12-12T09:22:36.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.445+0000 7fbb2a038640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb10005180 0x7fbb1000b980 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c001e50 tx=0x7fbb100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10db23850286eeb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c003b70 con 0x7fbb10005180 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c003d10 con 0x7fbb10005180 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb28835640 1 -- 172.21.15.84:0/3456819165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c005310 con 0x7fbb10005180 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3456819165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb10005180 msgr2=0x7fbb1000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb2ba9b640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb10005180 0x7fbb1000b980 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c001e50 tx=0x7fbb100057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3456819165 shutdown_connections 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb2ba9b640 1 --2- 172.21.15.84:0/3456819165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb10005180 0x7fbb1000b980 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3456819165 >> 172.21.15.84:0/3456819165 conn(0x7fbb240b2a20 msgr2=0x7fbb240b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3456819165 shutdown_connections 2023-12-12T09:22:36.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.446+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3456819165 wait complete. 2023-12-12T09:22:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.448+0000 7fbb2ba9b640 1 Processor -- start 2023-12-12T09:22:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.448+0000 7fbb2ba9b640 1 -- start start 2023-12-12T09:22:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.449+0000 7fbb2ba9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10005180 0x7fbb2415e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.449+0000 7fbb2ba9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb2414e140 0x7fbb240c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.449+0000 7fbb2ba9b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb2414e5c0 0x7fbb240c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.449+0000 7fbb2ba9b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2415d8b0 con 0x7fbb2414e140 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.449+0000 7fbb2ba9b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2415ff20 con 0x7fbb10005180 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.449+0000 7fbb2ba9b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2415db50 con 0x7fbb2414e5c0 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb2414e140 0x7fbb240c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb2414e140 0x7fbb240c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37482/0 (socket says 172.21.15.84:37482) 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 -- 172.21.15.84:0/3973071474 learned_addr learned my addr 172.21.15.84:0/3973071474 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29837640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10005180 0x7fbb2415e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb2a038640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb2414e5c0 0x7fbb240c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 -- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb2414e5c0 msgr2=0x7fbb240c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb2414e5c0 0x7fbb240c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 -- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10005180 msgr2=0x7fbb2415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10005180 0x7fbb2415e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 -- 172.21.15.84:0/3973071474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2415d720 con 0x7fbb2414e140 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29837640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10005180 0x7fbb2415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.450+0000 7fbb29036640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb2414e140 0x7fbb240c69d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbb14010860 tx=0x7fbb14010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.451+0000 7fbb1a7fc640 1 -- 172.21.15.84:0/3973071474 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14009610 con 0x7fbb2414e140 2023-12-12T09:22:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.451+0000 7fbb1a7fc640 1 -- 172.21.15.84:0/3973071474 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1400eb60 con 0x7fbb2414e140 2023-12-12T09:22:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.451+0000 7fbb1a7fc640 1 -- 172.21.15.84:0/3973071474 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1401c400 con 0x7fbb2414e140 2023-12-12T09:22:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.451+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2415de30 con 0x7fbb2414e140 2023-12-12T09:22:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.451+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2415f260 con 0x7fbb2414e140 2023-12-12T09:22:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.452+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb240673c0 con 0x7fbb2414e140 2023-12-12T09:22:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.453+0000 7fbb1a7fc640 1 -- 172.21.15.84:0/3973071474 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb1401c560 con 0x7fbb2414e140 2023-12-12T09:22:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.454+0000 7fbb1a7fc640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb0806ae40 0x7fbb0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.454+0000 7fbb1a7fc640 1 -- 172.21.15.84:0/3973071474 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbb14089a00 con 0x7fbb2414e140 2023-12-12T09:22:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.454+0000 7fbb29837640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb0806ae40 0x7fbb0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:36.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.455+0000 7fbb29837640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb0806ae40 0x7fbb0806d300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbb200017a0 tx=0x7fbb20001a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:36.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.458+0000 7fbb1a7fc640 1 -- 172.21.15.84:0/3973071474 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb14054d10 con 0x7fbb2414e140 2023-12-12T09:22:36.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.650+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbb2406b670 con 0x7fbb2414e140 2023-12-12T09:22:36.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.657+0000 7fbb1a7fc640 1 -- 172.21.15.84:0/3973071474 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbb14058330 con 0x7fbb2414e140 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb0806ae40 msgr2=0x7fbb0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb0806ae40 0x7fbb0806d300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbb200017a0 tx=0x7fbb20001a50 comp rx=0 tx=0).stop 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb2414e140 msgr2=0x7fbb240c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb2414e140 0x7fbb240c69d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbb14010860 tx=0x7fbb14010d20 comp rx=0 tx=0).stop 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 shutdown_connections 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fbb2414e5c0 0x7fbb240c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fbb0806ae40 0x7fbb0806d300 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb2414e140 0x7fbb240c69d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 --2- 172.21.15.84:0/3973071474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10005180 0x7fbb2415e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:36.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.660+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 >> 172.21.15.84:0/3973071474 conn(0x7fbb240b2a20 msgr2=0x7fbb240b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:36.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.661+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 shutdown_connections 2023-12-12T09:22:36.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:36.661+0000 7fbb2ba9b640 1 -- 172.21.15.84:0/3973071474 wait complete. 2023-12-12T09:22:36.679 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:22:36.680 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:22:36.805 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:22:36.923 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:22:36.923 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:22:36.923 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:36.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T09:22:36.982 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:22:36.982 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:37.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T09:22:37.042 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:22:37.042 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:37.103 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T09:22:37.103 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:22:37.103 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:22:37.163 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T09:22:37.163 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-12T09:22:37.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:22:37.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.385+0000 7f1ba317c640 1 Processor -- start 2023-12-12T09:22:37.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.385+0000 7f1ba317c640 1 -- start start 2023-12-12T09:22:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.386+0000 7f1ba317c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.386+0000 7f1ba317c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b9c13dae0 0x7f1b9c13f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.386+0000 7f1ba317c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0724d0 con 0x7f1b9c0ce330 2023-12-12T09:22:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.386+0000 7f1ba317c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c140270 con 0x7f1b9c13dae0 2023-12-12T09:22:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.386+0000 7f1ba317c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0cd850 con 0x7f1b9c071bb0 2023-12-12T09:22:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1ba1719640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1b9c13dae0 0x7f1b9c13f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1b93fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1b9c0ce330 0x7f1b9c13d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:44836/0 (socket says 172.21.15.84:44836) 2023-12-12T09:22:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1b93fff640 1 -- 172.21.15.84:0/1852084754 learned_addr learned my addr 172.21.15.84:0/1852084754 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1ba0f18640 1 --2- 172.21.15.84:0/1852084754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1ba1719640 1 -- 172.21.15.84:0/1852084754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 msgr2=0x7f1b9c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1ba1719640 1 --2- 172.21.15.84:0/1852084754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1ba1719640 1 -- 172.21.15.84:0/1852084754 >> v1:172.21.15.84:6789/0 conn(0x7f1b9c0ce330 legacy=0x7f1b9c13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1ba1719640 1 -- 172.21.15.84:0/1852084754 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0cdb30 con 0x7f1b9c13dae0 2023-12-12T09:22:37.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.387+0000 7f1ba0f18640 1 --2- 172.21.15.84:0/1852084754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:37.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.388+0000 7f1ba1719640 1 --2- 172.21.15.84:0/1852084754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c13dae0 0x7f1b9c13f510 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009d90 tx=0x7f1b9402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbfd1a035b9d73e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:37.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1b937fe640 1 -- 172.21.15.84:0/1852084754 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9402cc60 con 0x7f1b9c13dae0 2023-12-12T09:22:37.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1b937fe640 1 -- 172.21.15.84:0/1852084754 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9402cdc0 con 0x7f1b9c13dae0 2023-12-12T09:22:37.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1b937fe640 1 -- 172.21.15.84:0/1852084754 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94034660 con 0x7f1b9c13dae0 2023-12-12T09:22:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1ba317c640 1 -- 172.21.15.84:0/1852084754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c13dae0 msgr2=0x7f1b9c13f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1ba317c640 1 --2- 172.21.15.84:0/1852084754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c13dae0 0x7f1b9c13f510 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009d90 tx=0x7f1b9402beb0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1ba317c640 1 -- 172.21.15.84:0/1852084754 shutdown_connections 2023-12-12T09:22:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1ba317c640 1 --2- 172.21.15.84:0/1852084754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c13dae0 0x7f1b9c13f510 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1ba317c640 1 --2- 172.21.15.84:0/1852084754 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1ba317c640 1 -- 172.21.15.84:0/1852084754 >> 172.21.15.84:0/1852084754 conn(0x7f1b9c06c3d0 msgr2=0x7f1b9c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1ba317c640 1 -- 172.21.15.84:0/1852084754 shutdown_connections 2023-12-12T09:22:37.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.389+0000 7f1ba317c640 1 -- 172.21.15.84:0/1852084754 wait complete. 2023-12-12T09:22:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.391+0000 7f1ba317c640 1 Processor -- start 2023-12-12T09:22:37.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.391+0000 7f1ba317c640 1 -- start start 2023-12-12T09:22:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.392+0000 7f1ba317c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c1369c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.392+0000 7f1ba317c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0ce330 0x7f1b9c1f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.392+0000 7f1ba317c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c1f3a70 0x7f1b9c1e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.392+0000 7f1ba317c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0a8480 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.392+0000 7f1ba317c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c1f2d80 con 0x7f1b9c0ce330 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.392+0000 7f1ba317c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c1f35e0 con 0x7f1b9c071bb0 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c1f3a70 0x7f1b9c1e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c1f3a70 0x7f1b9c1e96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37500/0 (socket says 172.21.15.84:37500) 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 -- 172.21.15.84:0/3699310383 learned_addr learned my addr 172.21.15.84:0/3699310383 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba0f18640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c1369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1b93fff640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0ce330 0x7f1b9c1f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 -- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 msgr2=0x7f1b9c1369c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c1369c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 -- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0ce330 msgr2=0x7f1b9c1f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0ce330 0x7f1b9c1f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 -- 172.21.15.84:0/3699310383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94009a70 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba0f18640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c1369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:37.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1ba1719640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c1f3a70 0x7f1b9c1e96f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009d90 tx=0x7f1b94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:37.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.393+0000 7f1b917fa640 1 -- 172.21.15.84:0/3699310383 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94040650 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.394+0000 7f1b917fa640 1 -- 172.21.15.84:0/3699310383 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b940407d0 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.394+0000 7f1b917fa640 1 -- 172.21.15.84:0/3699310383 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b94040b80 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.394+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c1f72c0 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.394+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c1f2f90 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.395+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c0673c0 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.396+0000 7f1b917fa640 1 -- 172.21.15.84:0/3699310383 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b94040ce0 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.397+0000 7f1b917fa640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b8806ae40 0x7f1b8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.397+0000 7f1b917fa640 1 -- 172.21.15.84:0/3699310383 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1b940ac420 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.397+0000 7f1ba0f18640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b8806ae40 0x7f1b8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:37.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.398+0000 7f1ba0f18640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b8806ae40 0x7f1b8806d300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1b98006fd0 tx=0x7f1b98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:37.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.401+0000 7f1b917fa640 1 -- 172.21.15.84:0/3699310383 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b94077600 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.626+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b9c1f3720 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.627+0000 7f1b917fa640 1 -- 172.21.15.84:0/3699310383 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f1b94044e90 con 0x7f1b9c1f3a70 2023-12-12T09:22:37.628 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:37.628 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6834/3349912921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3349912921},{"type":"v1","addr":"172.21.15.99:6834","nonce":3349912921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4849,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/3102874305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6833","nonce":3102874305},{"type":"v1","addr":"172.21.15.99:6835","nonce":3102874305}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2816609542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2816609542},{"type":"v1","addr":"172.21.15.84:6837","nonce":2816609542}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":6153,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1459851142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1459851142},{"type":"v1","addr":"172.21.15.84:6836","nonce":1459851142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-12-12T09:22:37.628 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 20 2023-12-12T09:22:37.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.629+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b8806ae40 msgr2=0x7f1b8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:37.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.629+0000 7f1ba317c640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b8806ae40 0x7f1b8806d300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1b98006fd0 tx=0x7f1b98008040 comp rx=0 tx=0).stop 2023-12-12T09:22:37.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.629+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c1f3a70 msgr2=0x7f1b9c1e96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:37.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.629+0000 7f1ba317c640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c1f3a70 0x7f1b9c1e96f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009d90 tx=0x7f1b94004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:37.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.630+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 shutdown_connections 2023-12-12T09:22:37.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.630+0000 7f1ba317c640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1b8806ae40 0x7f1b8806d300 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.630+0000 7f1ba317c640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1b9c1f3a70 0x7f1b9c1e96f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.630+0000 7f1ba317c640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b9c0ce330 0x7f1b9c1f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.630+0000 7f1ba317c640 1 --2- 172.21.15.84:0/3699310383 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1b9c071bb0 0x7f1b9c1369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:37.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.630+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 >> 172.21.15.84:0/3699310383 conn(0x7f1b9c06c3d0 msgr2=0x7f1b9c0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:37.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.630+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 shutdown_connections 2023-12-12T09:22:37.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:37.630+0000 7f1ba317c640 1 -- 172.21.15.84:0/3699310383 wait complete. 2023-12-12T09:22:37.650 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T09:22:37.650 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-12T09:22:37.650 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T09:22:37.650 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:22:37.651 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T09:22:37.651 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-12T09:22:37.651 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T09:22:37.651 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:22:37.651 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T09:22:37.651 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-12T09:22:37.651 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T09:22:37.652 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:22:37.652 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T09:22:37.652 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-12T09:22:37.652 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T09:22:37.652 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:22:37.667 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T09:22:37.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T09:22:37.674 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T09:22:37.674 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T09:22:37.675 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T09:22:37.675 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T09:22:37.724 INFO:tasks.ceph.mds.a:Started 2023-12-12T09:22:37.724 INFO:tasks.ceph.mds.d:Started 2023-12-12T09:22:37.725 DEBUG:teuthology.parallel:result is None 2023-12-12T09:22:37.725 DEBUG:teuthology.parallel:result is None 2023-12-12T09:22:37.732 INFO:tasks.ceph.mds.c:Started 2023-12-12T09:22:37.732 DEBUG:teuthology.parallel:result is None 2023-12-12T09:22:37.887 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-12-12T09:22:37.888 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-12-12T09:22:37.908 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2023-12-12T09:22:39.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-12T09:22:43.674 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T09:22:43.674 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T09:22:43.683 INFO:tasks.ceph.mds.b:Started 2023-12-12T09:22:43.683 DEBUG:teuthology.parallel:result is None 2023-12-12T09:22:43.684 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-12T09:22:43.868 INFO:tasks.ceph.mds.b.smithi099.stdout:starting mds.b at 2023-12-12T09:22:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.908+0000 7f84ae153640 1 Processor -- start 2023-12-12T09:22:43.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.908+0000 7f84ae153640 1 -- start start 2023-12-12T09:22:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.910+0000 7f84ae153640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f84a80b24f0 0x7f84a80b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.910+0000 7f84ae153640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a80b30b0 0x7f84a815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.910+0000 7f84ae153640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a8153ff0 con 0x7f84a815a800 2023-12-12T09:22:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.910+0000 7f84ae153640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80b3ca0 con 0x7f84a80b24f0 2023-12-12T09:22:43.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.910+0000 7f84ae153640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80b2e10 con 0x7f84a80b30b0 2023-12-12T09:22:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.911+0000 7f849effd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a80b30b0 0x7f84a815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.911+0000 7f84a77fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f84a80b24f0 0x7f84a80b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.911+0000 7f84a77fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f84a80b24f0 0x7f84a80b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:49314/0 (socket says 172.21.15.84:49314) 2023-12-12T09:22:43.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.911+0000 7f84a77fe640 1 -- 172.21.15.84:0/3886621266 learned_addr learned my addr 172.21.15.84:0/3886621266 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.911+0000 7f84a77fe640 1 -- 172.21.15.84:0/3886621266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a80b30b0 msgr2=0x7f84a815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.911+0000 7f84a77fe640 1 --2- 172.21.15.84:0/3886621266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a80b30b0 0x7f84a815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.911+0000 7f84a77fe640 1 -- 172.21.15.84:0/3886621266 >> v1:172.21.15.99:6789/0 conn(0x7f84a815a800 legacy=0x7f84a815d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:43.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.911+0000 7f84a77fe640 1 -- 172.21.15.84:0/3886621266 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80b3ef0 con 0x7f84a80b24f0 2023-12-12T09:22:43.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.913+0000 7f84a77fe640 1 --2- 172.21.15.84:0/3886621266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b24f0 0x7f84a80b28d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f849800aa10 tx=0x7f849802ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac85bb1fcd6bf3c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:43.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.913+0000 7f84a6ffd640 1 -- 172.21.15.84:0/3886621266 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849802dc10 con 0x7f84a80b24f0 2023-12-12T09:22:43.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.913+0000 7f84a6ffd640 1 -- 172.21.15.84:0/3886621266 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849802dd70 con 0x7f84a80b24f0 2023-12-12T09:22:43.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.913+0000 7f84a6ffd640 1 -- 172.21.15.84:0/3886621266 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498035660 con 0x7f84a80b24f0 2023-12-12T09:22:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.914+0000 7f84ae153640 1 -- 172.21.15.84:0/3886621266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b24f0 msgr2=0x7f84a80b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.914+0000 7f84ae153640 1 --2- 172.21.15.84:0/3886621266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b24f0 0x7f84a80b28d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f849800aa10 tx=0x7f849802ce60 comp rx=0 tx=0).stop 2023-12-12T09:22:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.914+0000 7f84ae153640 1 -- 172.21.15.84:0/3886621266 shutdown_connections 2023-12-12T09:22:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.914+0000 7f84ae153640 1 --2- 172.21.15.84:0/3886621266 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a80b30b0 0x7f84a815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.914+0000 7f84ae153640 1 --2- 172.21.15.84:0/3886621266 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b24f0 0x7f84a80b28d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:43.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.914+0000 7f84ae153640 1 -- 172.21.15.84:0/3886621266 >> 172.21.15.84:0/3886621266 conn(0x7f84a806c3d0 msgr2=0x7f84a806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.914+0000 7f84ae153640 1 -- 172.21.15.84:0/3886621266 shutdown_connections 2023-12-12T09:22:43.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.914+0000 7f84ae153640 1 -- 172.21.15.84:0/3886621266 wait complete. 2023-12-12T09:22:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.916+0000 7f84ae153640 1 Processor -- start 2023-12-12T09:22:43.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.916+0000 7f84ae153640 1 -- start start 2023-12-12T09:22:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84ae153640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84a80b24f0 0x7f84a8148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84ae153640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b30b0 0x7f84a81567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:43.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84ae153640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a815a800 0x7f84a814c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84ae153640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8150a40 con 0x7f84a80b24f0 2023-12-12T09:22:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84ae153640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a81503f0 con 0x7f84a80b30b0 2023-12-12T09:22:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84ae153640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a8154f00 con 0x7f84a815a800 2023-12-12T09:22:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84a77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84a80b24f0 0x7f84a8148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84a77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84a80b24f0 0x7f84a8148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37544/0 (socket says 172.21.15.84:37544) 2023-12-12T09:22:43.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.917+0000 7f84a77fe640 1 -- 172.21.15.84:0/1983365771 learned_addr learned my addr 172.21.15.84:0/1983365771 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:43.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a77fe640 1 -- 172.21.15.84:0/1983365771 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a815a800 msgr2=0x7f84a814c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:43.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a77fe640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a815a800 0x7f84a814c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:43.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a77fe640 1 -- 172.21.15.84:0/1983365771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b30b0 msgr2=0x7f84a81567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:43.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f849effd640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b30b0 0x7f84a81567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:43.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a77fe640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b30b0 0x7f84a81567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:43.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a77fe640 1 -- 172.21.15.84:0/1983365771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849800a670 con 0x7f84a80b24f0 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f849effd640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b30b0 0x7f84a81567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a77fe640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84a80b24f0 0x7f84a8148360 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f849800a1c0 tx=0x7f84980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a4ff9640 1 -- 172.21.15.84:0/1983365771 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849803f600 con 0x7f84a80b24f0 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a4ff9640 1 -- 172.21.15.84:0/1983365771 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849803f780 con 0x7f84a80b24f0 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84a4ff9640 1 -- 172.21.15.84:0/1983365771 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849803fb30 con 0x7f84a80b24f0 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.918+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a8150660 con 0x7f84a80b24f0 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.919+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a81551e0 con 0x7f84a80b24f0 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.920+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a8150b80 con 0x7f84a80b24f0 2023-12-12T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.920+0000 7f84a4ff9640 1 -- 172.21.15.84:0/1983365771 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f849803fc90 con 0x7f84a80b24f0 2023-12-12T09:22:43.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.921+0000 7f84a4ff9640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f848806ae40 0x7f848806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:43.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.921+0000 7f84a4ff9640 1 -- 172.21.15.84:0/1983365771 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f84980ab830 con 0x7f84a80b24f0 2023-12-12T09:22:43.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.922+0000 7f849effd640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f848806ae40 0x7f848806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:43.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.922+0000 7f849effd640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f848806ae40 0x7f848806d300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ae750 tx=0x7f8490008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:43.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:43.926+0000 7f84a4ff9640 1 -- 172.21.15.84:0/1983365771 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8498076a90 con 0x7f84a80b24f0 2023-12-12T09:22:44.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:44.130+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f84a806e3e0 con 0x7f84a80b24f0 2023-12-12T09:22:45.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.228+0000 7f84a4ff9640 1 -- 172.21.15.84:0/1983365771 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7f849807a0b0 con 0x7f84a80b24f0 2023-12-12T09:22:45.229 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-12-12T09:22:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f848806ae40 msgr2=0x7f848806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f848806ae40 0x7f848806d300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f84a80ae750 tx=0x7f8490008040 comp rx=0 tx=0).stop 2023-12-12T09:22:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84a80b24f0 msgr2=0x7f84a8148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84a80b24f0 0x7f84a8148360 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f849800a1c0 tx=0x7f84980046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 shutdown_connections 2023-12-12T09:22:45.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f84a815a800 0x7f84a814c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84a80b30b0 0x7f84a81567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f848806ae40 0x7f848806d300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 --2- 172.21.15.84:0/1983365771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84a80b24f0 0x7f84a8148360 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.232+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 >> 172.21.15.84:0/1983365771 conn(0x7f84a806c3d0 msgr2=0x7f84a80af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:45.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.233+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 shutdown_connections 2023-12-12T09:22:45.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.233+0000 7f84ae153640 1 -- 172.21.15.84:0/1983365771 wait complete. 2023-12-12T09:22:45.256 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-12T09:22:45.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.467+0000 7f36006f3640 1 Processor -- start 2023-12-12T09:22:45.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.467+0000 7f36006f3640 1 -- start start 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.468+0000 7f36006f3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 0x7f35f80b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.468+0000 7f36006f3640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f35f80b30b0 0x7f35f815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.468+0000 7f36006f3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35f815a800 0x7f35f815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.468+0000 7f36006f3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f8153ff0 con 0x7f35f815a800 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.468+0000 7f36006f3640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f80b3ca0 con 0x7f35f80b30b0 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.468+0000 7f36006f3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80b2e10 con 0x7f35f80b24f0 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fec90640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35f815a800 0x7f35f815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fec90640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35f815a800 0x7f35f815d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37548/0 (socket says 172.21.15.84:37548) 2023-12-12T09:22:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fec90640 1 -- 172.21.15.84:0/3165224259 learned_addr learned my addr 172.21.15.84:0/3165224259 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fdc8e640 1 --2- 172.21.15.84:0/3165224259 >> v2:172.21.15.99:3300/0 conn(0x7f35f80b30b0 0x7f35f815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fe48f640 1 --2- 172.21.15.84:0/3165224259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 0x7f35f80b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fec90640 1 -- 172.21.15.84:0/3165224259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 msgr2=0x7f35f80b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fec90640 1 --2- 172.21.15.84:0/3165224259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 0x7f35f80b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fec90640 1 -- 172.21.15.84:0/3165224259 >> v2:172.21.15.99:3300/0 conn(0x7f35f80b30b0 msgr2=0x7f35f815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fec90640 1 --2- 172.21.15.84:0/3165224259 >> v2:172.21.15.99:3300/0 conn(0x7f35f80b30b0 0x7f35f815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.469+0000 7f35fec90640 1 -- 172.21.15.84:0/3165224259 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80b3ef0 con 0x7f35f815a800 2023-12-12T09:22:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.471+0000 7f35fec90640 1 --2- 172.21.15.84:0/3165224259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f815a800 0x7f35f815d0d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f35f806bd40 tx=0x7f35f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905f11e1e1a430f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.471+0000 7f35fd48d640 1 -- 172.21.15.84:0/3165224259 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f002ca70 con 0x7f35f815a800 2023-12-12T09:22:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.471+0000 7f35fd48d640 1 -- 172.21.15.84:0/3165224259 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f002cbd0 con 0x7f35f815a800 2023-12-12T09:22:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.471+0000 7f35fd48d640 1 -- 172.21.15.84:0/3165224259 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00343f0 con 0x7f35f815a800 2023-12-12T09:22:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 -- 172.21.15.84:0/3165224259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f815a800 msgr2=0x7f35f815d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 --2- 172.21.15.84:0/3165224259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f815a800 0x7f35f815d0d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f35f806bd40 tx=0x7f35f002bed0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 -- 172.21.15.84:0/3165224259 shutdown_connections 2023-12-12T09:22:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 --2- 172.21.15.84:0/3165224259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f815a800 0x7f35f815d0d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 --2- 172.21.15.84:0/3165224259 >> v2:172.21.15.99:3300/0 conn(0x7f35f80b30b0 0x7f35f815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 --2- 172.21.15.84:0/3165224259 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 0x7f35f80b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 -- 172.21.15.84:0/3165224259 >> 172.21.15.84:0/3165224259 conn(0x7f35f806c3d0 msgr2=0x7f35f806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 -- 172.21.15.84:0/3165224259 shutdown_connections 2023-12-12T09:22:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.472+0000 7f36006f3640 1 -- 172.21.15.84:0/3165224259 wait complete. 2023-12-12T09:22:45.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.474+0000 7f36006f3640 1 Processor -- start 2023-12-12T09:22:45.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.474+0000 7f36006f3640 1 -- start start 2023-12-12T09:22:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f36006f3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 0x7f35f8155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f36006f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f80b30b0 0x7f35f8152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f36006f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35f815a800 0x7f35f8156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f36006f3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81510a0 con 0x7f35f80b30b0 2023-12-12T09:22:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f36006f3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8152670 con 0x7f35f815a800 2023-12-12T09:22:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f36006f3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81528d0 con 0x7f35f80b24f0 2023-12-12T09:22:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f35fdc8e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f80b30b0 0x7f35f8152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f35fdc8e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f80b30b0 0x7f35f8152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37554/0 (socket says 172.21.15.84:37554) 2023-12-12T09:22:45.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.475+0000 7f35fdc8e640 1 -- 172.21.15.84:0/1614892773 learned_addr learned my addr 172.21.15.84:0/1614892773 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35fdc8e640 1 -- 172.21.15.84:0/1614892773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 msgr2=0x7f35f8155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35fe48f640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 0x7f35f8155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35fec90640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35f815a800 0x7f35f8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35fdc8e640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 0x7f35f8155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35fdc8e640 1 -- 172.21.15.84:0/1614892773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35f815a800 msgr2=0x7f35f8156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35fdc8e640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35f815a800 0x7f35f8156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35fdc8e640 1 -- 172.21.15.84:0/1614892773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009b30 con 0x7f35f80b30b0 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35fdc8e640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f80b30b0 0x7f35f8152130 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f35e800d7d0 tx=0x7f35e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35eeffd640 1 -- 172.21.15.84:0/1614892773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8018070 con 0x7f35f80b30b0 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35eeffd640 1 -- 172.21.15.84:0/1614892773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8004020 con 0x7f35f80b30b0 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f35eeffd640 1 -- 172.21.15.84:0/1614892773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80041b0 con 0x7f35f80b30b0 2023-12-12T09:22:45.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f8152bb0 con 0x7f35f80b30b0 2023-12-12T09:22:45.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.476+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f8150d30 con 0x7f35f80b30b0 2023-12-12T09:22:45.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.477+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f8151250 con 0x7f35f80b30b0 2023-12-12T09:22:45.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.478+0000 7f35eeffd640 1 -- 172.21.15.84:0/1614892773 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35e8004310 con 0x7f35f80b30b0 2023-12-12T09:22:45.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.479+0000 7f35eeffd640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f35dc06ae70 0x7f35dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.479+0000 7f35eeffd640 1 -- 172.21.15.84:0/1614892773 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f35e8089390 con 0x7f35f80b30b0 2023-12-12T09:22:45.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.480+0000 7f35fe48f640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f35dc06ae70 0x7f35dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.480+0000 7f35fe48f640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f35dc06ae70 0x7f35dc06d330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f35f4006fd0 tx=0x7f35f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:45.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.484+0000 7f35eeffd640 1 -- 172.21.15.84:0/1614892773 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35f8151250 con 0x7f35f80b30b0 2023-12-12T09:22:45.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.743+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f35f8155cb0 con 0x7f35f80b30b0 2023-12-12T09:22:45.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.744+0000 7f35eeffd640 1 -- 172.21.15.84:0/1614892773 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f35e8057fb0 con 0x7f35f80b30b0 2023-12-12T09:22:45.744 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:45.744 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBnJXhlazPlCRAA8h1rv4l+wATTogAYJaJACA==", 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-12-12T09:22:45.745 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBnJXhl2U3oLBAAamxW25qScCfsVFF8J5k66w==", 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBnJXhlyuNKGxAArml3MuY84tPlWVEkGXrQfA==", 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:22:45.746 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhlFkIjAhAArQOrgyVa4DoHVjka8fe9IQ==", 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.747 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBsJXhlGWtaKBAAcvay28WkisUnS9PkhhQAWQ==", 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBwJXhlzLyeBRAAF0OQ1/uxjMtcH7Dlq19+wQ==", 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:22:45.748 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBzJXhlDeDLDxAAs1H0Lw3yvvj26MgWz8tf+w==", 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQB2JXhlCGrHGxAAcT18fJklTVxEPj2Ax9bLkw==", 2023-12-12T09:22:45.749 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQB9JXhlvGCgFRAANKCYQxghEUOGixr7gZ3QBA==", 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCAJXhlAK3nLhAAvPsU0fD/waCxvw8zQ3L07w==", 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCDJXhlXIk1ORAApKc5rcRGatUeNq+RVIh6Ng==", 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:22:45.751 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQCHJXhlPw0zBxAAd3PQvyZAAGDlzbPKm/0zgA==", 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg==", 2023-12-12T09:22:45.752 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow r", 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rw pool=cephfs_data" 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhl/GmeJRAAUJlsvxorGdsBuqqHSU8LWw==", 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-12-12T09:22:45.753 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhlei68GhAAU3Wy1eq+3Pkruvpil5J1Zg==", 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBoJXhli8+AMRAAc4+osq4LmnMpuknxONr3YQ==", 2023-12-12T09:22:45.754 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBlJXhlYHMiORAAHWgXN5g13bYNUU0F8QGp3A==", 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.755 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBmJXhlWTtoOhAAHRRsQlAYQsSgQIzlShMGXw==", 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQBmJXhlNy8cLRAANZgrMuGBpqE0vziSKDEZZw==", 2023-12-12T09:22:45.756 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-12-12T09:22:45.757 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-12-12T09:22:45.757 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-12-12T09:22:45.757 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-12-12T09:22:45.757 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.757 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:45.757 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-12-12T09:22:45.757 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f35dc06ae70 msgr2=0x7f35dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f35dc06ae70 0x7f35dc06d330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f35f4006fd0 tx=0x7f35f4008040 comp rx=0 tx=0).stop 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f80b30b0 msgr2=0x7f35f8152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f80b30b0 0x7f35f8152130 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f35e800d7d0 tx=0x7f35e800dc90 comp rx=0 tx=0).stop 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 shutdown_connections 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35f815a800 0x7f35f8156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f35dc06ae70 0x7f35dc06d330 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f80b30b0 0x7f35f8152130 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 --2- 172.21.15.84:0/1614892773 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f35f80b24f0 0x7f35f8155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 >> 172.21.15.84:0/1614892773 conn(0x7f35f806c3d0 msgr2=0x7f35f8153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:45.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 shutdown_connections 2023-12-12T09:22:45.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.747+0000 7f36006f3640 1 -- 172.21.15.84:0/1614892773 wait complete. 2023-12-12T09:22:45.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.972+0000 7ffa18a2b640 1 Processor -- start 2023-12-12T09:22:45.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.972+0000 7ffa18a2b640 1 -- start start 2023-12-12T09:22:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa18a2b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa14071bb0 0x7ffa14071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa18a2b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa1413dae0 0x7ffa1413f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa18a2b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140724d0 con 0x7ffa140ce330 2023-12-12T09:22:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa18a2b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa14140270 con 0x7ffa14071bb0 2023-12-12T09:22:45.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa18a2b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140cd850 con 0x7ffa1413dae0 2023-12-12T09:22:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa1259c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa14071bb0 0x7ffa14071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa12d9d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa1413dae0 0x7ffa1413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa11d9b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffa140ce330 0x7ffa1413d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:47782/0 (socket says 172.21.15.84:47782) 2023-12-12T09:22:45.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.974+0000 7ffa11d9b640 1 -- 172.21.15.84:0/3321770875 learned_addr learned my addr 172.21.15.84:0/3321770875 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:45.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.975+0000 7ffa1259c640 1 -- 172.21.15.84:0/3321770875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa1413dae0 msgr2=0x7ffa1413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:45.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.975+0000 7ffa1259c640 1 --2- 172.21.15.84:0/3321770875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa1413dae0 0x7ffa1413f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.975+0000 7ffa1259c640 1 -- 172.21.15.84:0/3321770875 >> v1:172.21.15.99:6789/0 conn(0x7ffa140ce330 legacy=0x7ffa1413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.975+0000 7ffa1259c640 1 -- 172.21.15.84:0/3321770875 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa140cdb30 con 0x7ffa14071bb0 2023-12-12T09:22:45.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.975+0000 7ffa12d9d640 1 --2- 172.21.15.84:0/3321770875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa1413dae0 0x7ffa1413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:22:45.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.976+0000 7ffa1259c640 1 --2- 172.21.15.84:0/3321770875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14071bb0 0x7ffa14071f90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa040097a0 tx=0x7ffa0402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148c47883927ddb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:45.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.977+0000 7ffa1159a640 1 -- 172.21.15.84:0/3321770875 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0402d040 con 0x7ffa14071bb0 2023-12-12T09:22:45.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.977+0000 7ffa1159a640 1 -- 172.21.15.84:0/3321770875 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04031810 con 0x7ffa14071bb0 2023-12-12T09:22:45.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.977+0000 7ffa1159a640 1 -- 172.21.15.84:0/3321770875 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04031ba0 con 0x7ffa14071bb0 2023-12-12T09:22:45.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.978+0000 7ffa18a2b640 1 -- 172.21.15.84:0/3321770875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14071bb0 msgr2=0x7ffa14071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.978+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/3321770875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14071bb0 0x7ffa14071f90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa040097a0 tx=0x7ffa0402b8b0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.978+0000 7ffa18a2b640 1 -- 172.21.15.84:0/3321770875 shutdown_connections 2023-12-12T09:22:45.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.978+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/3321770875 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa1413dae0 0x7ffa1413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.978+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/3321770875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14071bb0 0x7ffa14071f90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.978+0000 7ffa18a2b640 1 -- 172.21.15.84:0/3321770875 >> 172.21.15.84:0/3321770875 conn(0x7ffa1406c3d0 msgr2=0x7ffa1406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:45.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.978+0000 7ffa18a2b640 1 -- 172.21.15.84:0/3321770875 shutdown_connections 2023-12-12T09:22:45.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.978+0000 7ffa18a2b640 1 -- 172.21.15.84:0/3321770875 wait complete. 2023-12-12T09:22:45.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.980+0000 7ffa18a2b640 1 Processor -- start 2023-12-12T09:22:45.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.980+0000 7ffa18a2b640 1 -- start start 2023-12-12T09:22:45.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa18a2b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa14071bb0 0x7ffa14153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa18a2b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa140ce330 0x7ffa14158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa18a2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14159300 0x7ffa14136260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa18a2b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14137550 con 0x7ffa140ce330 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa18a2b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14138290 con 0x7ffa14159300 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa18a2b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14159780 con 0x7ffa14071bb0 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa11d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa140ce330 0x7ffa14158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa11d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa140ce330 0x7ffa14158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36782/0 (socket says 172.21.15.84:36782) 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.981+0000 7ffa11d9b640 1 -- 172.21.15.84:0/2138113063 learned_addr learned my addr 172.21.15.84:0/2138113063 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa1259c640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa14071bb0 0x7ffa14153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa11d9b640 1 -- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa14071bb0 msgr2=0x7ffa14153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa11d9b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa14071bb0 0x7ffa14153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa12d9d640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14159300 0x7ffa14136260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa11d9b640 1 -- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14159300 msgr2=0x7ffa14136260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:45.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa11d9b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14159300 0x7ffa14136260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa11d9b640 1 -- 172.21.15.84:0/2138113063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009400 con 0x7ffa140ce330 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa1259c640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa14071bb0 0x7ffa14153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa11d9b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa140ce330 0x7ffa14158dc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800cb10 tx=0x7ffa0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa02ffd640 1 -- 172.21.15.84:0/2138113063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800ac70 con 0x7ffa140ce330 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa02ffd640 1 -- 172.21.15.84:0/2138113063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0800add0 con 0x7ffa140ce330 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa02ffd640 1 -- 172.21.15.84:0/2138113063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08012620 con 0x7ffa140ce330 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa04009400 con 0x7ffa140ce330 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.982+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa14137270 con 0x7ffa140ce330 2023-12-12T09:22:45.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.984+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa141383d0 con 0x7ffa140ce330 2023-12-12T09:22:45.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.985+0000 7ffa02ffd640 1 -- 172.21.15.84:0/2138113063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa08007070 con 0x7ffa140ce330 2023-12-12T09:22:45.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.985+0000 7ffa02ffd640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff9f406ae40 0x7ff9f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:45.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.986+0000 7ffa02ffd640 1 -- 172.21.15.84:0/2138113063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ffa08089310 con 0x7ffa140ce330 2023-12-12T09:22:45.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.986+0000 7ffa1259c640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff9f406ae40 0x7ff9f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:45.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.987+0000 7ffa1259c640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff9f406ae40 0x7ff9f406d300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffa04036000 tx=0x7ffa0403c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:45.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:45.990+0000 7ffa02ffd640 1 -- 172.21.15.84:0/2138113063 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa141383d0 con 0x7ffa140ce330 2023-12-12T09:22:46.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-12T09:22:46.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.183+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa141383d0 con 0x7ffa140ce330 2023-12-12T09:22:46.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.185+0000 7ffa02ffd640 1 -- 172.21.15.84:0/2138113063 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+12978 (secure 0 0 0) 0x7ffa141383d0 con 0x7ffa140ce330 2023-12-12T09:22:46.185 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:46.185 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":54,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:45.225445+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:46.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff9f406ae40 msgr2=0x7ff9f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff9f406ae40 0x7ff9f406d300 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffa04036000 tx=0x7ffa0403c040 comp rx=0 tx=0).stop 2023-12-12T09:22:46.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa140ce330 msgr2=0x7ffa14158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa140ce330 0x7ffa14158dc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800cb10 tx=0x7ffa0800a060 comp rx=0 tx=0).stop 2023-12-12T09:22:46.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 shutdown_connections 2023-12-12T09:22:46.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa14159300 0x7ffa14136260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff9f406ae40 0x7ff9f406d300 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa140ce330 0x7ffa14158dc0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 --2- 172.21.15.84:0/2138113063 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffa14071bb0 0x7ffa14153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 >> 172.21.15.84:0/2138113063 conn(0x7ffa1406c3d0 msgr2=0x7ffa140b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 shutdown_connections 2023-12-12T09:22:46.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.188+0000 7ffa18a2b640 1 -- 172.21.15.84:0/2138113063 wait complete. 2023-12-12T09:22:46.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:22:46.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:22:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.419+0000 7f11f0290640 1 Processor -- start 2023-12-12T09:22:46.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.420+0000 7f11f0290640 1 -- start start 2023-12-12T09:22:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11f0290640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f11e80b40d0 0x7f11e806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11f0290640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80ce6f0 0x7f11e80b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11f0290640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11e815be60 0x7f11e813e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11f0290640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e80ceb80 con 0x7f11e815be60 2023-12-12T09:22:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11f0290640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e80ce260 con 0x7f11e80b40d0 2023-12-12T09:22:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11f0290640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80b49f0 con 0x7f11e80ce6f0 2023-12-12T09:22:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11ee82d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11e815be60 0x7f11e813e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11ee82d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f11e815be60 0x7f11e813e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36798/0 (socket says 172.21.15.84:36798) 2023-12-12T09:22:46.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.421+0000 7f11ee82d640 1 -- 172.21.15.84:0/3863773354 learned_addr learned my addr 172.21.15.84:0/3863773354 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.422+0000 7f11ed82b640 1 --2- 172.21.15.84:0/3863773354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80ce6f0 0x7f11e80b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.422+0000 7f11ee02c640 1 --2- 172.21.15.84:0/3863773354 >> v2:172.21.15.99:3300/0 conn(0x7f11e80b40d0 0x7f11e806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.422+0000 7f11ee82d640 1 -- 172.21.15.84:0/3863773354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80ce6f0 msgr2=0x7f11e80b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.422+0000 7f11ee82d640 1 --2- 172.21.15.84:0/3863773354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80ce6f0 0x7f11e80b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.422+0000 7f11ee82d640 1 -- 172.21.15.84:0/3863773354 >> v2:172.21.15.99:3300/0 conn(0x7f11e80b40d0 msgr2=0x7f11e806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.422+0000 7f11ee82d640 1 --2- 172.21.15.84:0/3863773354 >> v2:172.21.15.99:3300/0 conn(0x7f11e80b40d0 0x7f11e806dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.422+0000 7f11ee82d640 1 -- 172.21.15.84:0/3863773354 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80cd930 con 0x7f11e815be60 2023-12-12T09:22:46.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.423+0000 7f11ee82d640 1 --2- 172.21.15.84:0/3863773354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e813e750 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f11e80b4d90 tx=0x7f11e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e742ec9618755b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:46.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.423+0000 7f11ed02a640 1 -- 172.21.15.84:0/3863773354 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e002ca70 con 0x7f11e815be60 2023-12-12T09:22:46.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11ed02a640 1 -- 172.21.15.84:0/3863773354 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e002cbd0 con 0x7f11e815be60 2023-12-12T09:22:46.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11ed02a640 1 -- 172.21.15.84:0/3863773354 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00343f0 con 0x7f11e815be60 2023-12-12T09:22:46.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 -- 172.21.15.84:0/3863773354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 msgr2=0x7f11e813e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 --2- 172.21.15.84:0/3863773354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e813e750 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f11e80b4d90 tx=0x7f11e002bed0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 -- 172.21.15.84:0/3863773354 shutdown_connections 2023-12-12T09:22:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 --2- 172.21.15.84:0/3863773354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e813e750 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 --2- 172.21.15.84:0/3863773354 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80ce6f0 0x7f11e80b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 --2- 172.21.15.84:0/3863773354 >> v2:172.21.15.99:3300/0 conn(0x7f11e80b40d0 0x7f11e806dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 -- 172.21.15.84:0/3863773354 >> 172.21.15.84:0/3863773354 conn(0x7f11e80b0ac0 msgr2=0x7f11e80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 -- 172.21.15.84:0/3863773354 shutdown_connections 2023-12-12T09:22:46.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.424+0000 7f11f0290640 1 -- 172.21.15.84:0/3863773354 wait complete. 2023-12-12T09:22:46.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.426+0000 7f11f0290640 1 Processor -- start 2023-12-12T09:22:46.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.426+0000 7f11f0290640 1 -- start start 2023-12-12T09:22:46.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11f0290640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80b40d0 0x7f11e80addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11f0290640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11e80ce6f0 0x7f11e81f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11f0290640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e81f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11f0290640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80ae310 con 0x7f11e815be60 2023-12-12T09:22:46.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11f0290640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80b3f50 con 0x7f11e80ce6f0 2023-12-12T09:22:46.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11f0290640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e81f2f10 con 0x7f11e80b40d0 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11ee82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e81f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11ee82d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e81f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36800/0 (socket says 172.21.15.84:36800) 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.427+0000 7f11ee82d640 1 -- 172.21.15.84:0/3087123700 learned_addr learned my addr 172.21.15.84:0/3087123700 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.428+0000 7f11ee82d640 1 -- 172.21.15.84:0/3087123700 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80b40d0 msgr2=0x7f11e80addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.428+0000 7f11ee82d640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80b40d0 0x7f11e80addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.428+0000 7f11ee82d640 1 -- 172.21.15.84:0/3087123700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11e80ce6f0 msgr2=0x7f11e81f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.428+0000 7f11ee82d640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11e80ce6f0 0x7f11e81f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.428+0000 7f11ee82d640 1 -- 172.21.15.84:0/3087123700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0009b30 con 0x7f11e815be60 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.428+0000 7f11ee82d640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e81f3910 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009f40 tx=0x7f11e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.428+0000 7f11deffd640 1 -- 172.21.15.84:0/3087123700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0009510 con 0x7f11e815be60 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.429+0000 7f11deffd640 1 -- 172.21.15.84:0/3087123700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e003e450 con 0x7f11e815be60 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.429+0000 7f11deffd640 1 -- 172.21.15.84:0/3087123700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e003e800 con 0x7f11e815be60 2023-12-12T09:22:46.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.429+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e81f7480 con 0x7f11e815be60 2023-12-12T09:22:46.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.429+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e80b3990 con 0x7f11e815be60 2023-12-12T09:22:46.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.430+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e80673c0 con 0x7f11e815be60 2023-12-12T09:22:46.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.431+0000 7f11deffd640 1 -- 172.21.15.84:0/3087123700 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11e003e960 con 0x7f11e815be60 2023-12-12T09:22:46.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.432+0000 7f11deffd640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f11cc06ae40 0x7f11cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.432+0000 7f11deffd640 1 -- 172.21.15.84:0/3087123700 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f11e00ac4e0 con 0x7f11e815be60 2023-12-12T09:22:46.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.432+0000 7f11ee02c640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f11cc06ae40 0x7f11cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.433+0000 7f11ee02c640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f11cc06ae40 0x7f11cc06d300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f11e400b7f0 tx=0x7f11e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:46.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.437+0000 7f11deffd640 1 -- 172.21.15.84:0/3087123700 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11e0077790 con 0x7f11e815be60 2023-12-12T09:22:46.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.625+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11e813dd00 con 0x7f11e815be60 2023-12-12T09:22:46.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.626+0000 7f11deffd640 1 -- 172.21.15.84:0/3087123700 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11e007adb0 con 0x7f11e815be60 2023-12-12T09:22:46.626 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:22:46.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f11cc06ae40 msgr2=0x7f11cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f11cc06ae40 0x7f11cc06d300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f11e400b7f0 tx=0x7f11e4008040 comp rx=0 tx=0).stop 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 msgr2=0x7f11e81f3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e81f3910 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009f40 tx=0x7f11e0004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 shutdown_connections 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f11cc06ae40 0x7f11cc06d300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11e815be60 0x7f11e81f3910 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11e80ce6f0 0x7f11e81f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 --2- 172.21.15.84:0/3087123700 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f11e80b40d0 0x7f11e80addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 >> 172.21.15.84:0/3087123700 conn(0x7f11e80b0ac0 msgr2=0x7f11e815d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 shutdown_connections 2023-12-12T09:22:46.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.629+0000 7f11f0290640 1 -- 172.21.15.84:0/3087123700 wait complete. 2023-12-12T09:22:46.649 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T09:22:46.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.854+0000 7fb1a91c5640 1 Processor -- start 2023-12-12T09:22:46.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.854+0000 7fb1a91c5640 1 -- start start 2023-12-12T09:22:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.856+0000 7fb1a91c5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1a40ce330 0x7fb1a413d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.856+0000 7fb1a91c5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a4140270 con 0x7fb1a40ce790 2023-12-12T09:22:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.856+0000 7fb1a91c5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a40cd850 con 0x7fb1a4071bb0 2023-12-12T09:22:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.856+0000 7fb1a91c5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40cdb30 con 0x7fb1a40ce330 2023-12-12T09:22:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.856+0000 7fb1a359e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb1a40ce790 0x7fb1a413f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55228/0 (socket says 172.21.15.84:55228) 2023-12-12T09:22:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.856+0000 7fb1a359e640 1 -- 172.21.15.84:0/1953698641 learned_addr learned my addr 172.21.15.84:0/1953698641 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb19bfff640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1a40ce330 0x7fb1a413d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017096708 0 0) 0x7fb1a4140270 con 0x7fb1a40ce790 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb190003520 con 0x7fb1a40ce790 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3705601761 0 0) 0x7fb190003520 con 0x7fb1a40ce790 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1a40ce330 msgr2=0x7fb1a413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1a40ce330 0x7fb1a413d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 >> v1:172.21.15.99:6789/0 conn(0x7fb1a4071bb0 legacy=0x7fb1a4071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40cde10 con 0x7fb1a40ce790 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fb19c0019f0 con 0x7fb1a40ce790 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 >> v1:172.21.15.84:6789/0 conn(0x7fb1a40ce790 legacy=0x7fb1a413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.857+0000 7fb1a259c640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1a40ce330 0x7fb1900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb1a259c640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb190003ee0 0x7fb1900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb1a259c640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb190004d00 0x7fb190005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40cdb30 con 0x7fb190003ee0 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000b9e0 con 0x7fb190004d00 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000bba0 con 0x7fb1a40ce330 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb19bfff640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb190003ee0 0x7fb1900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb1a2d9d640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1a40ce330 0x7fb1900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb1a359e640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb190004d00 0x7fb190005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb19bfff640 1 -- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1a40ce330 msgr2=0x7fb1900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb19bfff640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb1a40ce330 0x7fb1900039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb19bfff640 1 -- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb190004d00 msgr2=0x7fb190005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb19bfff640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb190004d00 0x7fb190005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb19bfff640 1 -- 172.21.15.84:0/1953698641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190003520 con 0x7fb190003ee0 2023-12-12T09:22:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.858+0000 7fb1a359e640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb190004d00 0x7fb190005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.859+0000 7fb19bfff640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb190003ee0 0x7fb1900047c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009ac0 tx=0x7fb1900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bfd920a39109c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c02c600 con 0x7fb190003ee0 2023-12-12T09:22:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c02c760 con 0x7fb190003ee0 2023-12-12T09:22:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a259c640 1 -- 172.21.15.84:0/1953698641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c02caf0 con 0x7fb190003ee0 2023-12-12T09:22:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a91c5640 1 -- 172.21.15.84:0/1953698641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb190003ee0 msgr2=0x7fb1900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a91c5640 1 --2- 172.21.15.84:0/1953698641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb190003ee0 0x7fb1900047c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009ac0 tx=0x7fb1900057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a359e640 1 -- 172.21.15.84:0/1953698641 reap_dead start 2023-12-12T09:22:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a91c5640 1 -- 172.21.15.84:0/1953698641 shutdown_connections 2023-12-12T09:22:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a91c5640 1 -- 172.21.15.84:0/1953698641 >> 172.21.15.84:0/1953698641 conn(0x7fb1a406c3d0 msgr2=0x7fb1a406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a91c5640 1 -- 172.21.15.84:0/1953698641 shutdown_connections 2023-12-12T09:22:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.860+0000 7fb1a91c5640 1 -- 172.21.15.84:0/1953698641 wait complete. 2023-12-12T09:22:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.862+0000 7fb1a91c5640 1 Processor -- start 2023-12-12T09:22:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.862+0000 7fb1a91c5640 1 -- start start 2023-12-12T09:22:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.863+0000 7fb1a91c5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb190003ee0 0x7fb1a413d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.863+0000 7fb1a91c5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a40adbf0 0x7fb1a413e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.863+0000 7fb1a91c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1a413ee20 0x7fb1a41f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.863+0000 7fb1a91c5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a413e4c0 con 0x7fb1a40adbf0 2023-12-12T09:22:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.863+0000 7fb1a91c5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a413f2a0 con 0x7fb1a413ee20 2023-12-12T09:22:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.863+0000 7fb1a91c5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a413d840 con 0x7fb190003ee0 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a40adbf0 0x7fb1a413e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a40adbf0 0x7fb1a413e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36818/0 (socket says 172.21.15.84:36818) 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 -- 172.21.15.84:0/3802600234 learned_addr learned my addr 172.21.15.84:0/3802600234 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb1a2d9d640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb190003ee0 0x7fb1a413d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 -- 172.21.15.84:0/3802600234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb190003ee0 msgr2=0x7fb1a413d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb190003ee0 0x7fb1a413d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb1a359e640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1a413ee20 0x7fb1a41f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 -- 172.21.15.84:0/3802600234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1a413ee20 msgr2=0x7fb1a41f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1a413ee20 0x7fb1a41f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 -- 172.21.15.84:0/3802600234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a413db20 con 0x7fb1a40adbf0 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.864+0000 7fb19bfff640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a40adbf0 0x7fb1a413e8e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb18c02c1a0 tx=0x7fb18c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.865+0000 7fb19b7fe640 1 -- 172.21.15.84:0/3802600234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c003810 con 0x7fb1a40adbf0 2023-12-12T09:22:46.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.865+0000 7fb19b7fe640 1 -- 172.21.15.84:0/3802600234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c003970 con 0x7fb1a40adbf0 2023-12-12T09:22:46.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.865+0000 7fb19b7fe640 1 -- 172.21.15.84:0/3802600234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c003ce0 con 0x7fb1a40adbf0 2023-12-12T09:22:46.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.865+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a413de00 con 0x7fb1a40adbf0 2023-12-12T09:22:46.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.865+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a40ae070 con 0x7fb1a40adbf0 2023-12-12T09:22:46.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.866+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a40673c0 con 0x7fb1a40adbf0 2023-12-12T09:22:46.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.867+0000 7fb19b7fe640 1 -- 172.21.15.84:0/3802600234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb18c034440 con 0x7fb1a40adbf0 2023-12-12T09:22:46.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.868+0000 7fb19b7fe640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb18406ae40 0x7fb18406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:46.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.869+0000 7fb19b7fe640 1 -- 172.21.15.84:0/3802600234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb18c0ab3a0 con 0x7fb1a40adbf0 2023-12-12T09:22:46.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.869+0000 7fb1a2d9d640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb18406ae40 0x7fb18406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:46.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.869+0000 7fb1a2d9d640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb18406ae40 0x7fb18406d300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb194001720 tx=0x7fb194007b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:46.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:46.873+0000 7fb19b7fe640 1 -- 172.21.15.84:0/3802600234 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb18c076770 con 0x7fb1a40adbf0 2023-12-12T09:22:47.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.056+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1a40ae710 con 0x7fb1a40adbf0 2023-12-12T09:22:47.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.057+0000 7fb19b7fe640 1 -- 172.21.15.84:0/3802600234 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb18c0a9e60 con 0x7fb1a40adbf0 2023-12-12T09:22:47.057 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:47.057 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-12-12T09:22:47.058 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-12-12T09:22:47.058 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-12-12T09:22:47.058 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-12-12T09:22:47.058 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:22:47.058 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb18406ae40 msgr2=0x7fb18406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb18406ae40 0x7fb18406d300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb194001720 tx=0x7fb194007b70 comp rx=0 tx=0).stop 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a40adbf0 msgr2=0x7fb1a413e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a40adbf0 0x7fb1a413e8e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb18c02c1a0 tx=0x7fb18c004730 comp rx=0 tx=0).stop 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 shutdown_connections 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1a413ee20 0x7fb1a41f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb18406ae40 0x7fb18406d300 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb1a40adbf0 0x7fb1a413e8e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 --2- 172.21.15.84:0/3802600234 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb190003ee0 0x7fb1a413d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.059+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 >> 172.21.15.84:0/3802600234 conn(0x7fb1a406c3d0 msgr2=0x7fb1a4139400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.060+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 shutdown_connections 2023-12-12T09:22:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.060+0000 7fb1a91c5640 1 -- 172.21.15.84:0/3802600234 wait complete. 2023-12-12T09:22:47.076 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T09:22:47.077 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T09:22:47.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.292+0000 7fc6edb6e640 1 Processor -- start 2023-12-12T09:22:47.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.292+0000 7fc6edb6e640 1 -- start start 2023-12-12T09:22:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.294+0000 7fc6edb6e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc6e806c060 0x7fc6e8071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.294+0000 7fc6edb6e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e8070cb0 con 0x7fc6e806c440 2023-12-12T09:22:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.294+0000 7fc6edb6e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e8070f50 con 0x7fc6e80abd50 2023-12-12T09:22:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.294+0000 7fc6edb6e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e806d8c0 con 0x7fc6e806c060 2023-12-12T09:22:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.294+0000 7fc6e7fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc6e806c440 0x7fc6e806c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55240/0 (socket says 172.21.15.84:55240) 2023-12-12T09:22:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.294+0000 7fc6e7fff640 1 -- 172.21.15.84:0/3867016137 learned_addr learned my addr 172.21.15.84:0/3867016137 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:47.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.294+0000 7fc6e77fe640 1 --2- 172.21.15.84:0/3867016137 >> v2:172.21.15.99:3300/0 conn(0x7fc6e806c060 0x7fc6e8071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:47.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.294+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395467747 0 0) 0x7fc6e8070cb0 con 0x7fc6e806c440 2023-12-12T09:22:47.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d4003520 con 0x7fc6e806c440 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 436040755 0 0) 0x7fc6d4003520 con 0x7fc6e806c440 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 >> v2:172.21.15.99:3300/0 conn(0x7fc6e806c060 msgr2=0x7fc6e8071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 --2- 172.21.15.84:0/3867016137 >> v2:172.21.15.99:3300/0 conn(0x7fc6e806c060 0x7fc6e8071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 >> v1:172.21.15.99:6789/0 conn(0x7fc6e80abd50 legacy=0x7fc6e80ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80711f0 con 0x7fc6e806c440 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fc6e00019f0 con 0x7fc6e806c440 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 >> v1:172.21.15.84:6789/0 conn(0x7fc6e806c440 legacy=0x7fc6e806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6d4003aa0 0x7fc6d4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6d40047c0 0x7fc6d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40052a0 0x7fc6d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e806d8c0 con 0x7fc6d40047c0 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d400c1f0 con 0x7fc6d4003aa0 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.295+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d400c3b0 con 0x7fc6d40052a0 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6dffff640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6d40047c0 0x7fc6d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6e77fe640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6d4003aa0 0x7fc6d4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6e7fff640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40052a0 0x7fc6d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6dffff640 1 -- 172.21.15.84:0/3867016137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40052a0 msgr2=0x7fc6d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6dffff640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40052a0 0x7fc6d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6dffff640 1 -- 172.21.15.84:0/3867016137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6d4003aa0 msgr2=0x7fc6d4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6dffff640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6d4003aa0 0x7fc6d4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6dffff640 1 -- 172.21.15.84:0/3867016137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d4003520 con 0x7fc6d40047c0 2023-12-12T09:22:47.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.296+0000 7fc6e7fff640 1 -- 172.21.15.84:0/3867016137 reap_dead start 2023-12-12T09:22:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.297+0000 7fc6dffff640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6d40047c0 0x7fc6d4004c40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0001720 tx=0x7fc6d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eb03a080ce0062 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.297+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00052d0 con 0x7fc6d40047c0 2023-12-12T09:22:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d002e050 con 0x7fc6d40047c0 2023-12-12T09:22:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6e6ffd640 1 -- 172.21.15.84:0/3867016137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0003830 con 0x7fc6d40047c0 2023-12-12T09:22:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6edb6e640 1 -- 172.21.15.84:0/3867016137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6d40047c0 msgr2=0x7fc6d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:47.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6edb6e640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6d40047c0 0x7fc6d4004c40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0001720 tx=0x7fc6d40057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6edb6e640 1 -- 172.21.15.84:0/3867016137 shutdown_connections 2023-12-12T09:22:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6edb6e640 1 --2- 172.21.15.84:0/3867016137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6d40047c0 0x7fc6d4004c40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6edb6e640 1 -- 172.21.15.84:0/3867016137 >> 172.21.15.84:0/3867016137 conn(0x7fc6e80b0970 msgr2=0x7fc6e80b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6edb6e640 1 -- 172.21.15.84:0/3867016137 shutdown_connections 2023-12-12T09:22:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.298+0000 7fc6edb6e640 1 -- 172.21.15.84:0/3867016137 wait complete. 2023-12-12T09:22:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.300+0000 7fc6edb6e640 1 Processor -- start 2023-12-12T09:22:47.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.300+0000 7fc6edb6e640 1 -- start start 2023-12-12T09:22:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.301+0000 7fc6edb6e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40047c0 0x7fc6e815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.301+0000 7fc6edb6e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6e80ccb40 0x7fc6e80ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:47.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.301+0000 7fc6edb6e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80c97f0 0x7fc6e81462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.301+0000 7fc6edb6e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80cd0e0 con 0x7fc6e80c97f0 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.301+0000 7fc6edb6e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80cd3c0 con 0x7fc6e80ccb40 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.301+0000 7fc6edb6e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e80cd6a0 con 0x7fc6d40047c0 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80c97f0 0x7fc6e81462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80c97f0 0x7fc6e81462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36832/0 (socket says 172.21.15.84:36832) 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 -- 172.21.15.84:0/1760118849 learned_addr learned my addr 172.21.15.84:0/1760118849 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e77fe640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40047c0 0x7fc6e815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6dffff640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6e80ccb40 0x7fc6e80ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 -- 172.21.15.84:0/1760118849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40047c0 msgr2=0x7fc6e815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40047c0 0x7fc6e815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 -- 172.21.15.84:0/1760118849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6e80ccb40 msgr2=0x7fc6e80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6e80ccb40 0x7fc6e80ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 -- 172.21.15.84:0/1760118849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80cd980 con 0x7fc6e80c97f0 2023-12-12T09:22:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.302+0000 7fc6e7fff640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80c97f0 0x7fc6e81462c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80adf20 tx=0x7fc6e000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.303+0000 7fc6e4ff9640 1 -- 172.21.15.84:0/1760118849 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000eb90 con 0x7fc6e80c97f0 2023-12-12T09:22:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.303+0000 7fc6e4ff9640 1 -- 172.21.15.84:0/1760118849 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000ed10 con 0x7fc6e80c97f0 2023-12-12T09:22:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.303+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e80cdc60 con 0x7fc6e80c97f0 2023-12-12T09:22:47.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.303+0000 7fc6e4ff9640 1 -- 172.21.15.84:0/1760118849 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0013660 con 0x7fc6e80c97f0 2023-12-12T09:22:47.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.303+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e80ce6c0 con 0x7fc6e80c97f0 2023-12-12T09:22:47.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.304+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8067f60 con 0x7fc6e80c97f0 2023-12-12T09:22:47.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.305+0000 7fc6e4ff9640 1 -- 172.21.15.84:0/1760118849 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6e00137c0 con 0x7fc6e80c97f0 2023-12-12T09:22:47.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.306+0000 7fc6e4ff9640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc6c806ae40 0x7fc6c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:47.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.306+0000 7fc6e4ff9640 1 -- 172.21.15.84:0/1760118849 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc6e00898a0 con 0x7fc6e80c97f0 2023-12-12T09:22:47.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.306+0000 7fc6e77fe640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc6c806ae40 0x7fc6c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:47.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.307+0000 7fc6e77fe640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc6c806ae40 0x7fc6c806d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009a10 tx=0x7fc6d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:47.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.310+0000 7fc6e4ff9640 1 -- 172.21.15.84:0/1760118849 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6e0054ac0 con 0x7fc6e80c97f0 2023-12-12T09:22:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:47.495+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc6e80cde50 con 0x7fc6e80c97f0 2023-12-12T09:22:48.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.269+0000 7fc6e4ff9640 1 -- 172.21.15.84:0/1760118849 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v55) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc6e00580e0 con 0x7fc6e80c97f0 2023-12-12T09:22:48.270 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-12-12T09:22:48.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc6c806ae40 msgr2=0x7fc6c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:48.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc6c806ae40 0x7fc6c806d300 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009a10 tx=0x7fc6d8008040 comp rx=0 tx=0).stop 2023-12-12T09:22:48.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80c97f0 msgr2=0x7fc6e81462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:48.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80c97f0 0x7fc6e81462c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80adf20 tx=0x7fc6e000e530 comp rx=0 tx=0).stop 2023-12-12T09:22:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 shutdown_connections 2023-12-12T09:22:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc6c806ae40 0x7fc6c806d300 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc6e80c97f0 0x7fc6e81462c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6e80ccb40 0x7fc6e80ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 --2- 172.21.15.84:0/1760118849 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc6d40047c0 0x7fc6e815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.273+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 >> 172.21.15.84:0/1760118849 conn(0x7fc6e80b0970 msgr2=0x7fc6e8099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.274+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 shutdown_connections 2023-12-12T09:22:48.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.274+0000 7fc6edb6e640 1 -- 172.21.15.84:0/1760118849 wait complete. 2023-12-12T09:22:48.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T09:22:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.502+0000 7f29b0ebb640 1 Processor -- start 2023-12-12T09:22:48.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.502+0000 7f29b0ebb640 1 -- start start 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29b0ebb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac143860 0x7f29ac0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29b0ebb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29ac0b4170 0x7f29ac06d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29b0ebb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac071c00 con 0x7f29ac06d970 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29b0ebb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac06de00 con 0x7f29ac0b4170 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29b0ebb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac143c40 con 0x7f29ac143860 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29a9d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29ac0b4170 0x7f29ac06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29a9d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f29ac0b4170 0x7f29ac06d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36842/0 (socket says 172.21.15.84:36842) 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29a9d9b640 1 -- 172.21.15.84:0/2692904338 learned_addr learned my addr 172.21.15.84:0/2692904338 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.504+0000 7f29aad9d640 1 --1- 172.21.15.84:0/2692904338 >> v1:172.21.15.84:6789/0 conn(0x7f29ac06d970 0x7f29ac15a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55256/0 (socket says 172.21.15.84:55256) 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.505+0000 7f29aa59c640 1 --2- 172.21.15.84:0/2692904338 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac143860 0x7f29ac0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:48.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.505+0000 7f29a9d9b640 1 -- 172.21.15.84:0/2692904338 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac143860 msgr2=0x7f29ac0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.505+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/2692904338 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac143860 0x7f29ac0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.505+0000 7f29a9d9b640 1 -- 172.21.15.84:0/2692904338 >> v1:172.21.15.84:6789/0 conn(0x7f29ac06d970 legacy=0x7f29ac15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.505+0000 7f29a9d9b640 1 -- 172.21.15.84:0/2692904338 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0b4780 con 0x7f29ac0b4170 2023-12-12T09:22:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.506+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/2692904338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0b4170 0x7f29ac06d430 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009870 tx=0x7f29a002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32526076b32d3cab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:48.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.506+0000 7f29a959a640 1 -- 172.21.15.84:0/2692904338 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00317c0 con 0x7f29ac0b4170 2023-12-12T09:22:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.506+0000 7f29a959a640 1 -- 172.21.15.84:0/2692904338 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a0031920 con 0x7f29ac0b4170 2023-12-12T09:22:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.506+0000 7f29a959a640 1 -- 172.21.15.84:0/2692904338 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0031cb0 con 0x7f29ac0b4170 2023-12-12T09:22:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.507+0000 7f29b0ebb640 1 -- 172.21.15.84:0/2692904338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0b4170 msgr2=0x7f29ac06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:48.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.507+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/2692904338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0b4170 0x7f29ac06d430 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009870 tx=0x7f29a002b860 comp rx=0 tx=0).stop 2023-12-12T09:22:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.507+0000 7f29b0ebb640 1 -- 172.21.15.84:0/2692904338 shutdown_connections 2023-12-12T09:22:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.507+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/2692904338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac0b4170 0x7f29ac06d430 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.507+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/2692904338 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac143860 0x7f29ac0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.507+0000 7f29b0ebb640 1 -- 172.21.15.84:0/2692904338 >> 172.21.15.84:0/2692904338 conn(0x7f29ac0b0ac0 msgr2=0x7f29ac0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.507+0000 7f29b0ebb640 1 -- 172.21.15.84:0/2692904338 shutdown_connections 2023-12-12T09:22:48.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.507+0000 7f29b0ebb640 1 -- 172.21.15.84:0/2692904338 wait complete. 2023-12-12T09:22:48.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.509+0000 7f29b0ebb640 1 Processor -- start 2023-12-12T09:22:48.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.509+0000 7f29b0ebb640 1 -- start start 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29b0ebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06d970 0x7f29ac139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29b0ebb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac0b4170 0x7f29ac0ad650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29b0ebb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac143860 0x7f29ac159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29b0ebb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0adb90 con 0x7f29ac143860 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29b0ebb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac1398a0 con 0x7f29ac06d970 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29b0ebb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac139b80 con 0x7f29ac0b4170 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29aad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac143860 0x7f29ac159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29aad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac143860 0x7f29ac159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36844/0 (socket says 172.21.15.84:36844) 2023-12-12T09:22:48.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.510+0000 7f29aad9d640 1 -- 172.21.15.84:0/1858018982 learned_addr learned my addr 172.21.15.84:0/1858018982 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29aa59c640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06d970 0x7f29ac139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac0b4170 0x7f29ac0ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29aad9d640 1 -- 172.21.15.84:0/1858018982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac0b4170 msgr2=0x7f29ac0ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29aad9d640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac0b4170 0x7f29ac0ad650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29aad9d640 1 -- 172.21.15.84:0/1858018982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06d970 msgr2=0x7f29ac139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29aad9d640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06d970 0x7f29ac139290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:48.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29aad9d640 1 -- 172.21.15.84:0/1858018982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00094d0 con 0x7f29ac143860 2023-12-12T09:22:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29aad9d640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac143860 0x7f29ac159fa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f29a400c730 tx=0x7f29a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f299affd640 1 -- 172.21.15.84:0/1858018982 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400ce40 con 0x7f29ac143860 2023-12-12T09:22:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f299affd640 1 -- 172.21.15.84:0/1858018982 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a400a640 con 0x7f29ac143860 2023-12-12T09:22:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f299affd640 1 -- 172.21.15.84:0/1858018982 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400a9f0 con 0x7f29ac143860 2023-12-12T09:22:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.511+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac139e60 con 0x7f29ac143860 2023-12-12T09:22:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.512+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac13a420 con 0x7f29ac143860 2023-12-12T09:22:48.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.512+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac13a610 con 0x7f29ac143860 2023-12-12T09:22:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.514+0000 7f299affd640 1 -- 172.21.15.84:0/1858018982 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29a400ab50 con 0x7f29ac143860 2023-12-12T09:22:48.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.515+0000 7f299affd640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f298c06ae40 0x7f298c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:48.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.515+0000 7f299affd640 1 -- 172.21.15.84:0/1858018982 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f29a4089350 con 0x7f29ac143860 2023-12-12T09:22:48.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.515+0000 7f29aa59c640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f298c06ae40 0x7f298c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:48.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.515+0000 7f29aa59c640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f298c06ae40 0x7f298c06d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f299c006fd0 tx=0x7f299c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:48.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.518+0000 7f299affd640 1 -- 172.21.15.84:0/1858018982 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f29a4054630 con 0x7f29ac143860 2023-12-12T09:22:48.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:48.694+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f29ac0673c0 con 0x7f29ac143860 2023-12-12T09:22:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.276+0000 7f299affd640 1 -- 172.21.15.84:0/1858018982 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v56) v1 ==== 170+0+0 (secure 0 0 0) 0x7f29a4057c50 con 0x7f29ac143860 2023-12-12T09:22:49.277 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-12-12T09:22:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.281+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f298c06ae40 msgr2=0x7f298c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.281+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f298c06ae40 0x7f298c06d300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f299c006fd0 tx=0x7f299c008040 comp rx=0 tx=0).stop 2023-12-12T09:22:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.281+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac143860 msgr2=0x7f29ac159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.281+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac143860 0x7f29ac159fa0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f29a400c730 tx=0x7f29a400cbf0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.282+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 shutdown_connections 2023-12-12T09:22:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.282+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f298c06ae40 0x7f298c06d300 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f299c006fd0 tx=0x7f299c008040 comp rx=0 tx=0).stop 2023-12-12T09:22:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.282+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac143860 0x7f29ac159fa0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.282+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f29ac0b4170 0x7f29ac0ad650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.282+0000 7f29b0ebb640 1 --2- 172.21.15.84:0/1858018982 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29ac06d970 0x7f29ac139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.282+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 >> 172.21.15.84:0/1858018982 conn(0x7f29ac0b0ac0 msgr2=0x7f29ac15b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:49.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.282+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 shutdown_connections 2023-12-12T09:22:49.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.282+0000 7f29b0ebb640 1 -- 172.21.15.84:0/1858018982 wait complete. 2023-12-12T09:22:49.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T09:22:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.502+0000 7f73e0568640 1 Processor -- start 2023-12-12T09:22:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.502+0000 7f73e0568640 1 -- start start 2023-12-12T09:22:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.503+0000 7f73e0568640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f73d806d430 0x7f73d806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.503+0000 7f73e0568640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73d80b1dc0 0x7f73d80b2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.503+0000 7f73e0568640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d8071c00 con 0x7f73d8143860 2023-12-12T09:22:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.503+0000 7f73e0568640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d806ddb0 con 0x7f73d80b1dc0 2023-12-12T09:22:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.503+0000 7f73e0568640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d8143c40 con 0x7f73d806d430 2023-12-12T09:22:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73deb05640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f73d80b1dc0 0x7f73d80b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73de304640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f73d8143860 0x7f73d80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55266/0 (socket says 172.21.15.84:55266) 2023-12-12T09:22:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73de304640 1 -- 172.21.15.84:0/1379654926 learned_addr learned my addr 172.21.15.84:0/1379654926 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73ddb03640 1 --2- 172.21.15.84:0/1379654926 >> v2:172.21.15.99:3300/0 conn(0x7f73d806d430 0x7f73d806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73deb05640 1 -- 172.21.15.84:0/1379654926 >> v2:172.21.15.99:3300/0 conn(0x7f73d806d430 msgr2=0x7f73d806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73deb05640 1 --2- 172.21.15.84:0/1379654926 >> v2:172.21.15.99:3300/0 conn(0x7f73d806d430 0x7f73d806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73deb05640 1 -- 172.21.15.84:0/1379654926 >> v1:172.21.15.84:6789/0 conn(0x7f73d8143860 legacy=0x7f73d80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73deb05640 1 -- 172.21.15.84:0/1379654926 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80b4780 con 0x7f73d80b1dc0 2023-12-12T09:22:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.504+0000 7f73dd302640 1 -- 172.21.15.84:0/1379654926 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740347339 0 0) 0x7f73d8071c00 con 0x7f73d8143860 2023-12-12T09:22:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.506+0000 7f73deb05640 1 --2- 172.21.15.84:0/1379654926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80b2210 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f73d80cb710 tx=0x7f73d002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f751cbe358fe2a16 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.506+0000 7f73dd302640 1 -- 172.21.15.84:0/1379654926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0031710 con 0x7f73d80b1dc0 2023-12-12T09:22:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.506+0000 7f73dd302640 1 -- 172.21.15.84:0/1379654926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d002f050 con 0x7f73d80b1dc0 2023-12-12T09:22:49.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.506+0000 7f73dd302640 1 -- 172.21.15.84:0/1379654926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d0031a90 con 0x7f73d80b1dc0 2023-12-12T09:22:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.506+0000 7f73e0568640 1 -- 172.21.15.84:0/1379654926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 msgr2=0x7f73d80b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.507+0000 7f73e0568640 1 --2- 172.21.15.84:0/1379654926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80b2210 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f73d80cb710 tx=0x7f73d002b7b0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.507+0000 7f73e0568640 1 -- 172.21.15.84:0/1379654926 shutdown_connections 2023-12-12T09:22:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.507+0000 7f73e0568640 1 --2- 172.21.15.84:0/1379654926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80b2210 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.507+0000 7f73e0568640 1 --2- 172.21.15.84:0/1379654926 >> v2:172.21.15.99:3300/0 conn(0x7f73d806d430 0x7f73d806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.507+0000 7f73e0568640 1 -- 172.21.15.84:0/1379654926 >> 172.21.15.84:0/1379654926 conn(0x7f73d80b0ac0 msgr2=0x7f73d80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.507+0000 7f73e0568640 1 -- 172.21.15.84:0/1379654926 shutdown_connections 2023-12-12T09:22:49.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.507+0000 7f73e0568640 1 -- 172.21.15.84:0/1379654926 wait complete. 2023-12-12T09:22:49.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.509+0000 7f73e0568640 1 Processor -- start 2023-12-12T09:22:49.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.509+0000 7f73e0568640 1 -- start start 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73e0568640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73d806d430 0x7f73d81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73e0568640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73e0568640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f73d8143860 0x7f73d80c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73e0568640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80cd8b0 con 0x7f73d80b1dc0 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73e0568640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d8159e20 con 0x7f73d806d430 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73e0568640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80cc9d0 con 0x7f73d8143860 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73ddb03640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73ddb03640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36866/0 (socket says 172.21.15.84:36866) 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73ddb03640 1 -- 172.21.15.84:0/643644272 learned_addr learned my addr 172.21.15.84:0/643644272 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73de304640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73d806d430 0x7f73d81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.510+0000 7f73deb05640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f73d8143860 0x7f73d80c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73ddb03640 1 -- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f73d8143860 msgr2=0x7f73d80c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73ddb03640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f73d8143860 0x7f73d80c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73ddb03640 1 -- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73d806d430 msgr2=0x7f73d81598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73ddb03640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73d806d430 0x7f73d81598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73ddb03640 1 -- 172.21.15.84:0/643644272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0009400 con 0x7f73d80b1dc0 2023-12-12T09:22:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73deb05640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f73d8143860 0x7f73d80c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73ddb03640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80cc490 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f73c400d5f0 tx=0x7f73c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73d6ffd640 1 -- 172.21.15.84:0/643644272 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40125f0 con 0x7f73d80b1dc0 2023-12-12T09:22:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73d6ffd640 1 -- 172.21.15.84:0/643644272 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c4012750 con 0x7f73d80b1dc0 2023-12-12T09:22:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73d6ffd640 1 -- 172.21.15.84:0/643644272 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4012b00 con 0x7f73d80b1dc0 2023-12-12T09:22:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d80ccca0 con 0x7f73d80b1dc0 2023-12-12T09:22:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.511+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d80cd260 con 0x7f73d80b1dc0 2023-12-12T09:22:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.512+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d80ae870 con 0x7f73d80b1dc0 2023-12-12T09:22:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.513+0000 7f73d6ffd640 1 -- 172.21.15.84:0/643644272 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73c4012c60 con 0x7f73d80b1dc0 2023-12-12T09:22:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.514+0000 7f73d6ffd640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f73bc06ae40 0x7f73bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.514+0000 7f73d6ffd640 1 -- 172.21.15.84:0/643644272 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f73c4089c20 con 0x7f73d80b1dc0 2023-12-12T09:22:49.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.515+0000 7f73de304640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f73bc06ae40 0x7f73bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:49.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.515+0000 7f73de304640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f73bc06ae40 0x7f73bc06d300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0012e0 tx=0x7f73cc007ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:49.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.519+0000 7f73d6ffd640 1 -- 172.21.15.84:0/643644272 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f73c4054b50 con 0x7f73d80b1dc0 2023-12-12T09:22:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:49.738+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f73d80673c0 con 0x7f73d80b1dc0 2023-12-12T09:22:50.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.324+0000 7f73d6ffd640 1 -- 172.21.15.84:0/643644272 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v23) v1 ==== 172+0+0 (secure 0 0 0) 0x7f73c4058170 con 0x7f73d80b1dc0 2023-12-12T09:22:50.327 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 8 and data pool 9 2023-12-12T09:22:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.335+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f73bc06ae40 msgr2=0x7f73bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.335+0000 7f73e0568640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f73bc06ae40 0x7f73bc06d300 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0012e0 tx=0x7f73cc007ed0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.335+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 msgr2=0x7f73d80cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.335+0000 7f73e0568640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80cc490 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f73c400d5f0 tx=0x7f73c400dab0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.336+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 shutdown_connections 2023-12-12T09:22:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.336+0000 7f73e0568640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f73d8143860 0x7f73d80c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.336+0000 7f73e0568640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f73bc06ae40 0x7f73bc06d300 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.336+0000 7f73e0568640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73d80b1dc0 0x7f73d80cc490 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.336+0000 7f73e0568640 1 --2- 172.21.15.84:0/643644272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73d806d430 0x7f73d81598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.336+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 >> 172.21.15.84:0/643644272 conn(0x7f73d80b0ac0 msgr2=0x7f73d815ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:50.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.336+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 shutdown_connections 2023-12-12T09:22:50.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.336+0000 7f73e0568640 1 -- 172.21.15.84:0/643644272 wait complete. 2023-12-12T09:22:50.372 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:50.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.547+0000 7f754e548640 1 Processor -- start 2023-12-12T09:22:50.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.547+0000 7f754e548640 1 -- start start 2023-12-12T09:22:50.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.548+0000 7f754e548640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f754813dae0 0x7f754813f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.548+0000 7f754e548640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7548140270 con 0x7f75480ce330 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.548+0000 7f754e548640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75480cd850 con 0x7f7548071bb0 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.548+0000 7f754e548640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75480cdb30 con 0x7f754813dae0 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.548+0000 7f753ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f75480ce330 0x7f754813d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55272/0 (socket says 172.21.15.84:55272) 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.548+0000 7f753ffff640 1 -- 172.21.15.84:0/1920049654 learned_addr learned my addr 172.21.15.84:0/1920049654 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f754cae5640 1 --2- 172.21.15.84:0/1920049654 >> v2:172.21.15.99:3300/0 conn(0x7f754813dae0 0x7f754813f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013782124 0 0) 0x7f7548140270 con 0x7f75480ce330 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7534003520 con 0x7f75480ce330 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1505318846 0 0) 0x7f7534003520 con 0x7f75480ce330 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 >> v2:172.21.15.99:3300/0 conn(0x7f754813dae0 msgr2=0x7f754813f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 --2- 172.21.15.84:0/1920049654 >> v2:172.21.15.99:3300/0 conn(0x7f754813dae0 0x7f754813f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 >> v1:172.21.15.99:6789/0 conn(0x7f7548071bb0 legacy=0x7f7548071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480cde10 con 0x7f75480ce330 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f7530001670 con 0x7f75480ce330 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 >> v1:172.21.15.84:6789/0 conn(0x7f75480ce330 legacy=0x7f754813d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f75340039c0 0x7f7534003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7534004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.549+0000 7f75477fe640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7534005180 0x7f753400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75480cdb30 con 0x7f75340047c0 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753400c080 con 0x7f7534005180 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753400c240 con 0x7f75340039c0 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f753ffff640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7534004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f754cae5640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7534005180 0x7f753400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f753ffff640 1 -- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f75340039c0 msgr2=0x7f7534003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f7547fff640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f75340039c0 0x7f7534003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f753ffff640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f75340039c0 0x7f7534003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f753ffff640 1 -- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7534005180 msgr2=0x7f753400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f753ffff640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7534005180 0x7f753400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f753ffff640 1 -- 172.21.15.84:0/1920049654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534003520 con 0x7f75340047c0 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f754cae5640 1 -- 172.21.15.84:0/1920049654 reap_dead start 2023-12-12T09:22:50.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.550+0000 7f7547fff640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f75340039c0 0x7f7534003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.551+0000 7f753ffff640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7534004c40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7530007fa0 tx=0x7f75340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7446f9d3ee5d72cc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.551+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530005ad0 con 0x7f75340047c0 2023-12-12T09:22:50.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.551+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530005c50 con 0x7f75340047c0 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.551+0000 7f75477fe640 1 -- 172.21.15.84:0/1920049654 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7530007070 con 0x7f75340047c0 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.552+0000 7f754e548640 1 -- 172.21.15.84:0/1920049654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 msgr2=0x7f7534004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.552+0000 7f754e548640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7534004c40 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f7530007fa0 tx=0x7f75340057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.552+0000 7f754e548640 1 -- 172.21.15.84:0/1920049654 shutdown_connections 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.552+0000 7f754e548640 1 --2- 172.21.15.84:0/1920049654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7534004c40 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.552+0000 7f754e548640 1 -- 172.21.15.84:0/1920049654 >> 172.21.15.84:0/1920049654 conn(0x7f754806c3d0 msgr2=0x7f754806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.552+0000 7f754e548640 1 -- 172.21.15.84:0/1920049654 shutdown_connections 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.552+0000 7f754e548640 1 -- 172.21.15.84:0/1920049654 wait complete. 2023-12-12T09:22:50.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.554+0000 7f754e548640 1 Processor -- start 2023-12-12T09:22:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.554+0000 7f754e548640 1 -- start start 2023-12-12T09:22:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f754e548640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7548169000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f754e548640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f754813c250 0x7f7548152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f754e548640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7548136990 0x7f7548136e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f754e548640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754813b160 con 0x7f75340047c0 2023-12-12T09:22:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f754e548640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7548169540 con 0x7f754813c250 2023-12-12T09:22:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f754e548640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754813a010 con 0x7f7548136990 2023-12-12T09:22:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f7547fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7548169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f7547fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7548169000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36890/0 (socket says 172.21.15.84:36890) 2023-12-12T09:22:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.555+0000 7f7547fff640 1 -- 172.21.15.84:0/4096325362 learned_addr learned my addr 172.21.15.84:0/4096325362 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f7547fff640 1 -- 172.21.15.84:0/4096325362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7548136990 msgr2=0x7f7548136e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f7547fff640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7548136990 0x7f7548136e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f7547fff640 1 -- 172.21.15.84:0/4096325362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f754813c250 msgr2=0x7f7548152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f753ffff640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f754813c250 0x7f7548152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f7547fff640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f754813c250 0x7f7548152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f7547fff640 1 -- 172.21.15.84:0/4096325362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754813c730 con 0x7f75340047c0 2023-12-12T09:22:50.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f7547fff640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7548169000 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f753800d380 tx=0x7f753800d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f75457fa640 1 -- 172.21.15.84:0/4096325362 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800b070 con 0x7f75340047c0 2023-12-12T09:22:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f75457fa640 1 -- 172.21.15.84:0/4096325362 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75380054e0 con 0x7f75340047c0 2023-12-12T09:22:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754813ca10 con 0x7f75340047c0 2023-12-12T09:22:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f75457fa640 1 -- 172.21.15.84:0/4096325362 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538003830 con 0x7f75340047c0 2023-12-12T09:22:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.556+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7548139ca0 con 0x7f75340047c0 2023-12-12T09:22:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.557+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75480673c0 con 0x7f75340047c0 2023-12-12T09:22:50.558 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.558+0000 7f75457fa640 1 -- 172.21.15.84:0/4096325362 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7538003990 con 0x7f75340047c0 2023-12-12T09:22:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.559+0000 7f75457fa640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f752806ae40 0x7f752806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.559 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.559+0000 7f75457fa640 1 -- 172.21.15.84:0/4096325362 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7538088ee0 con 0x7f75340047c0 2023-12-12T09:22:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.559+0000 7f753ffff640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f752806ae40 0x7f752806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.560+0000 7f753ffff640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f752806ae40 0x7f752806d300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7530034000 tx=0x7f7530007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:50.564 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.564+0000 7f75457fa640 1 -- 172.21.15.84:0/4096325362 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7538053f00 con 0x7f75340047c0 2023-12-12T09:22:50.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.752+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7548139e30 con 0x7f75340047c0 2023-12-12T09:22:50.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.755+0000 7f75457fa640 1 -- 172.21.15.84:0/4096325362 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16699 (secure 0 0 0) 0x7f7538018070 con 0x7f75340047c0 2023-12-12T09:22:50.756 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:50.756 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":57,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:49.740363+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.757+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f752806ae40 msgr2=0x7f752806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.757+0000 7f754e548640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f752806ae40 0x7f752806d300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7530034000 tx=0x7f7530007000 comp rx=0 tx=0).stop 2023-12-12T09:22:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.757+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 msgr2=0x7f7548169000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.757+0000 7f754e548640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7548169000 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f753800d380 tx=0x7f753800d840 comp rx=0 tx=0).stop 2023-12-12T09:22:50.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.758+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 shutdown_connections 2023-12-12T09:22:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.758+0000 7f754e548640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7548136990 0x7f7548136e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.758+0000 7f754e548640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f754813c250 0x7f7548152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.758+0000 7f754e548640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f752806ae40 0x7f752806d300 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.758+0000 7f754e548640 1 --2- 172.21.15.84:0/4096325362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75340047c0 0x7f7548169000 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.758+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 >> 172.21.15.84:0/4096325362 conn(0x7f754806c3d0 msgr2=0x7f75480afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.758+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 shutdown_connections 2023-12-12T09:22:50.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.758+0000 7f754e548640 1 -- 172.21.15.84:0/4096325362 wait complete. 2023-12-12T09:22:50.777 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.971+0000 7feb4d09b640 1 Processor -- start 2023-12-12T09:22:50.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.971+0000 7feb4d09b640 1 -- start start 2023-12-12T09:22:50.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.972+0000 7feb4d09b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feb480d16f0 0x7feb480d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.972+0000 7feb4d09b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb480b04b0 0x7feb480b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.972+0000 7feb4d09b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb480afd40 con 0x7feb4815d490 2023-12-12T09:22:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.972+0000 7feb4d09b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb480b0090 con 0x7feb480b04b0 2023-12-12T09:22:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.972+0000 7feb4d09b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb480d20c0 con 0x7feb480d16f0 2023-12-12T09:22:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.972+0000 7feb4759e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb480b04b0 0x7feb480b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.972+0000 7feb46d9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7feb4815d490 0x7feb480d3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55280/0 (socket says 172.21.15.84:55280) 2023-12-12T09:22:50.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.973+0000 7feb46d9d640 1 -- 172.21.15.84:0/116350112 learned_addr learned my addr 172.21.15.84:0/116350112 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:50.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.973+0000 7feb3ffff640 1 --2- 172.21.15.84:0/116350112 >> v2:172.21.15.99:3300/0 conn(0x7feb480d16f0 0x7feb480d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.973+0000 7feb4759e640 1 -- 172.21.15.84:0/116350112 >> v2:172.21.15.99:3300/0 conn(0x7feb480d16f0 msgr2=0x7feb480d1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.973+0000 7feb4759e640 1 --2- 172.21.15.84:0/116350112 >> v2:172.21.15.99:3300/0 conn(0x7feb480d16f0 0x7feb480d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.973+0000 7feb4759e640 1 -- 172.21.15.84:0/116350112 >> v1:172.21.15.84:6789/0 conn(0x7feb4815d490 legacy=0x7feb480d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.973+0000 7feb4759e640 1 -- 172.21.15.84:0/116350112 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb480ce860 con 0x7feb480b04b0 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.973+0000 7feb4659c640 1 -- 172.21.15.84:0/116350112 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396872856 0 0) 0x7feb480afd40 con 0x7feb4815d490 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.974+0000 7feb4759e640 1 --2- 172.21.15.84:0/116350112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480b04b0 0x7feb480b08e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7feb4808c580 tx=0x7feb4002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8329179bf1ea4f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.974+0000 7feb4659c640 1 -- 172.21.15.84:0/116350112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4002cbf0 con 0x7feb480b04b0 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.974+0000 7feb4659c640 1 -- 172.21.15.84:0/116350112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4002cd50 con 0x7feb480b04b0 2023-12-12T09:22:50.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.974+0000 7feb4659c640 1 -- 172.21.15.84:0/116350112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40034660 con 0x7feb480b04b0 2023-12-12T09:22:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.975+0000 7feb4d09b640 1 -- 172.21.15.84:0/116350112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480b04b0 msgr2=0x7feb480b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.975+0000 7feb4d09b640 1 --2- 172.21.15.84:0/116350112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480b04b0 0x7feb480b08e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7feb4808c580 tx=0x7feb4002be40 comp rx=0 tx=0).stop 2023-12-12T09:22:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.975+0000 7feb4d09b640 1 -- 172.21.15.84:0/116350112 shutdown_connections 2023-12-12T09:22:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.975+0000 7feb4d09b640 1 --2- 172.21.15.84:0/116350112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480b04b0 0x7feb480b08e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.975+0000 7feb4d09b640 1 --2- 172.21.15.84:0/116350112 >> v2:172.21.15.99:3300/0 conn(0x7feb480d16f0 0x7feb480d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.975+0000 7feb4d09b640 1 -- 172.21.15.84:0/116350112 >> 172.21.15.84:0/116350112 conn(0x7feb4809c450 msgr2=0x7feb480d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.975+0000 7feb4d09b640 1 -- 172.21.15.84:0/116350112 shutdown_connections 2023-12-12T09:22:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.975+0000 7feb4d09b640 1 -- 172.21.15.84:0/116350112 wait complete. 2023-12-12T09:22:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.977+0000 7feb4d09b640 1 Processor -- start 2023-12-12T09:22:50.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.977+0000 7feb4d09b640 1 -- start start 2023-12-12T09:22:50.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb4d09b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb480b04b0 0x7feb4815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb4d09b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480d16f0 0x7feb4815fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb4d09b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb4815d490 0x7feb480b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb4d09b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb481f08a0 con 0x7feb480d16f0 2023-12-12T09:22:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb4d09b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb481f2e50 con 0x7feb480b04b0 2023-12-12T09:22:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb4d09b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb481f30d0 con 0x7feb4815d490 2023-12-12T09:22:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb3ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480d16f0 0x7feb4815fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb3ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480d16f0 0x7feb4815fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36906/0 (socket says 172.21.15.84:36906) 2023-12-12T09:22:50.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb3ffff640 1 -- 172.21.15.84:0/1689252793 learned_addr learned my addr 172.21.15.84:0/1689252793 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:50.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb3ffff640 1 -- 172.21.15.84:0/1689252793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb4815d490 msgr2=0x7feb480b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb3ffff640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb4815d490 0x7feb480b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb3ffff640 1 -- 172.21.15.84:0/1689252793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb480b04b0 msgr2=0x7feb4815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:50.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb3ffff640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb480b04b0 0x7feb4815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:50.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.978+0000 7feb3ffff640 1 -- 172.21.15.84:0/1689252793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40009a70 con 0x7feb480d16f0 2023-12-12T09:22:50.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.979+0000 7feb3ffff640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480d16f0 0x7feb4815fe10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c7f0 tx=0x7feb3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:50.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.979+0000 7feb3f7fe640 1 -- 172.21.15.84:0/1689252793 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30004220 con 0x7feb480d16f0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.979+0000 7feb3f7fe640 1 -- 172.21.15.84:0/1689252793 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb300043a0 con 0x7feb480d16f0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.979+0000 7feb3f7fe640 1 -- 172.21.15.84:0/1689252793 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30007860 con 0x7feb480d16f0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.979+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb481f33b0 con 0x7feb480d16f0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.979+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb481f3970 con 0x7feb480d16f0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.980+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb48072b80 con 0x7feb480d16f0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.981+0000 7feb3f7fe640 1 -- 172.21.15.84:0/1689252793 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb30007bd0 con 0x7feb480d16f0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.982+0000 7feb3f7fe640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb2806ae40 0x7feb2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.982+0000 7feb3f7fe640 1 -- 172.21.15.84:0/1689252793 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feb30089780 con 0x7feb480d16f0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.982+0000 7feb46d9d640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb2806ae40 0x7feb2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:50.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.983+0000 7feb46d9d640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb2806ae40 0x7feb2806d300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feb38007fd0 tx=0x7feb38007960 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:50.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:50.986+0000 7feb3f7fe640 1 -- 172.21.15.84:0/1689252793 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb300546f0 con 0x7feb480d16f0 2023-12-12T09:22:51.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.166+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb480673c0 con 0x7feb480d16f0 2023-12-12T09:22:51.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.168+0000 7feb3f7fe640 1 -- 172.21.15.84:0/1689252793 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16699 (secure 0 0 0) 0x7feb30057d10 con 0x7feb480d16f0 2023-12-12T09:22:51.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:51.169 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":57,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:49.740363+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:51.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.170+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb2806ae40 msgr2=0x7feb2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:51.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.170+0000 7feb4d09b640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb2806ae40 0x7feb2806d300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feb38007fd0 tx=0x7feb38007960 comp rx=0 tx=0).stop 2023-12-12T09:22:51.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.170+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480d16f0 msgr2=0x7feb4815fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.170+0000 7feb4d09b640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480d16f0 0x7feb4815fe10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7feb3000c7f0 tx=0x7feb3000ccb0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.171+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 shutdown_connections 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.171+0000 7feb4d09b640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7feb4815d490 0x7feb480b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.171+0000 7feb4d09b640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7feb2806ae40 0x7feb2806d300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.171+0000 7feb4d09b640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb480d16f0 0x7feb4815fe10 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.171+0000 7feb4d09b640 1 --2- 172.21.15.84:0/1689252793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feb480b04b0 0x7feb4815f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.171+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 >> 172.21.15.84:0/1689252793 conn(0x7feb4809c450 msgr2=0x7feb4806caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.171+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 shutdown_connections 2023-12-12T09:22:51.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.171+0000 7feb4d09b640 1 -- 172.21.15.84:0/1689252793 wait complete. 2023-12-12T09:22:51.188 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T09:22:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.401+0000 7f9265abb640 1 Processor -- start 2023-12-12T09:22:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.402+0000 7f9265abb640 1 -- start start 2023-12-12T09:22:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.403+0000 7f9265abb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92601609f0 0x7f92600d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.403+0000 7f9265abb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92600d0180 0x7f92600b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.403+0000 7f9265abb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600d3dc0 con 0x7f92600b2610 2023-12-12T09:22:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.403+0000 7f9265abb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92600b2ad0 con 0x7f92601609f0 2023-12-12T09:22:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.403+0000 7f9265abb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b2db0 con 0x7f92600d0180 2023-12-12T09:22:51.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.403+0000 7f925f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92601609f0 0x7f92600d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:51.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.403+0000 7f925f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f92601609f0 0x7f92600d3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36912/0 (socket says 172.21.15.84:36912) 2023-12-12T09:22:51.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.403+0000 7f925f7fe640 1 -- 172.21.15.84:0/2184479040 learned_addr learned my addr 172.21.15.84:0/2184479040 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:51.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.404+0000 7f925f7fe640 1 -- 172.21.15.84:0/2184479040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92600d0180 msgr2=0x7f92600b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:51.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.404+0000 7f925f7fe640 1 --2- 172.21.15.84:0/2184479040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92600d0180 0x7f92600b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.404+0000 7f925f7fe640 1 -- 172.21.15.84:0/2184479040 >> v1:172.21.15.99:6789/0 conn(0x7f92600b2610 legacy=0x7f92600cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:51.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.404+0000 7f925f7fe640 1 -- 172.21.15.84:0/2184479040 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600b3090 con 0x7f92601609f0 2023-12-12T09:22:51.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.405+0000 7f925f7fe640 1 --2- 172.21.15.84:0/2184479040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92601609f0 0x7f92600d3770 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9250009e50 tx=0x7f925002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216b99ffb8e8e7ef server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:51.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.405+0000 7f925e7fc640 1 -- 172.21.15.84:0/2184479040 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925002ca70 con 0x7f92601609f0 2023-12-12T09:22:51.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.405+0000 7f925e7fc640 1 -- 172.21.15.84:0/2184479040 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925002cbd0 con 0x7f92601609f0 2023-12-12T09:22:51.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.405+0000 7f925e7fc640 1 -- 172.21.15.84:0/2184479040 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500343f0 con 0x7f92601609f0 2023-12-12T09:22:51.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.405+0000 7f9265abb640 1 -- 172.21.15.84:0/2184479040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92601609f0 msgr2=0x7f92600d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:51.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.405+0000 7f9265abb640 1 --2- 172.21.15.84:0/2184479040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92601609f0 0x7f92600d3770 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9250009e50 tx=0x7f925002bed0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.406+0000 7f9265abb640 1 -- 172.21.15.84:0/2184479040 shutdown_connections 2023-12-12T09:22:51.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.406+0000 7f9265abb640 1 --2- 172.21.15.84:0/2184479040 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92600d0180 0x7f92600b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.406+0000 7f9265abb640 1 --2- 172.21.15.84:0/2184479040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92601609f0 0x7f92600d3770 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.406+0000 7f9265abb640 1 -- 172.21.15.84:0/2184479040 >> 172.21.15.84:0/2184479040 conn(0x7f926009c3d0 msgr2=0x7f92600d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.406+0000 7f9265abb640 1 -- 172.21.15.84:0/2184479040 shutdown_connections 2023-12-12T09:22:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.406+0000 7f9265abb640 1 -- 172.21.15.84:0/2184479040 wait complete. 2023-12-12T09:22:51.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.407+0000 7f9265abb640 1 Processor -- start 2023-12-12T09:22:51.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.408+0000 7f9265abb640 1 -- start start 2023-12-12T09:22:51.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.408+0000 7f9265abb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92600b2610 0x7f9260147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.408+0000 7f9265abb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92600d0180 0x7f926015e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f9265abb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92601609f0 0x7f926015e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f9265abb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b8a30 con 0x7f92600b2610 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f9265abb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b8750 con 0x7f92600d0180 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f9265abb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600ccf10 con 0x7f92601609f0 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92600b2610 0x7f9260147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92600b2610 0x7f9260147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36926/0 (socket says 172.21.15.84:36926) 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925f7fe640 1 -- 172.21.15.84:0/2821503492 learned_addr learned my addr 172.21.15.84:0/2821503492 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925effd640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92600d0180 0x7f926015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925f7fe640 1 -- 172.21.15.84:0/2821503492 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92601609f0 msgr2=0x7f926015e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925f7fe640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92601609f0 0x7f926015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925f7fe640 1 -- 172.21.15.84:0/2821503492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92600d0180 msgr2=0x7f926015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:51.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925f7fe640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92600d0180 0x7f926015e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:51.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.409+0000 7f925f7fe640 1 -- 172.21.15.84:0/2821503492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250009b30 con 0x7f92600b2610 2023-12-12T09:22:51.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.410+0000 7f925f7fe640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92600b2610 0x7f9260147610 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9250009e50 tx=0x7f9250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:51.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.410+0000 7f9257fff640 1 -- 172.21.15.84:0/2821503492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925003e450 con 0x7f92600b2610 2023-12-12T09:22:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.410+0000 7f9257fff640 1 -- 172.21.15.84:0/2821503492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925003e5b0 con 0x7f92600b2610 2023-12-12T09:22:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.410+0000 7f9257fff640 1 -- 172.21.15.84:0/2821503492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925003e960 con 0x7f92600b2610 2023-12-12T09:22:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.410+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92600ccc30 con 0x7f92600b2610 2023-12-12T09:22:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.410+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9260156820 con 0x7f92600b2610 2023-12-12T09:22:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.411+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92601569e0 con 0x7f92600b2610 2023-12-12T09:22:51.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.412+0000 7f9257fff640 1 -- 172.21.15.84:0/2821503492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f925003eac0 con 0x7f92600b2610 2023-12-12T09:22:51.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.413+0000 7f9257fff640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f924006ae40 0x7f924006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:51.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.414+0000 7f9257fff640 1 -- 172.21.15.84:0/2821503492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f92500ac750 con 0x7f92600b2610 2023-12-12T09:22:51.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.414+0000 7f925effd640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f924006ae40 0x7f924006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:51.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.414+0000 7f925effd640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f924006ae40 0x7f924006d300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f926015afc0 tx=0x7f9248009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:51.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.418+0000 7f9257fff640 1 -- 172.21.15.84:0/2821503492 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9250077590 con 0x7f92600b2610 2023-12-12T09:22:51.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:51.643+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f92600673c0 con 0x7f92600b2610 2023-12-12T09:22:52.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.335+0000 7f9257fff640 1 -- 172.21.15.84:0/2821503492 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7f925007abb0 con 0x7f92600b2610 2023-12-12T09:22:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.338+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f924006ae40 msgr2=0x7f924006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.338+0000 7f9265abb640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f924006ae40 0x7f924006d300 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f926015afc0 tx=0x7f9248009040 comp rx=0 tx=0).stop 2023-12-12T09:22:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.338+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92600b2610 msgr2=0x7f9260147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.338+0000 7f9265abb640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92600b2610 0x7f9260147610 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9250009e50 tx=0x7f9250004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.339+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 shutdown_connections 2023-12-12T09:22:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.339+0000 7f9265abb640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f92601609f0 0x7f926015e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.339+0000 7f9265abb640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92600d0180 0x7f926015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:52.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.339+0000 7f9265abb640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f924006ae40 0x7f924006d300 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.339+0000 7f9265abb640 1 --2- 172.21.15.84:0/2821503492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92600b2610 0x7f9260147610 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.339+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 >> 172.21.15.84:0/2821503492 conn(0x7f926009c3d0 msgr2=0x7f926006bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.339+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 shutdown_connections 2023-12-12T09:22:52.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.339+0000 7f9265abb640 1 -- 172.21.15.84:0/2821503492 wait complete. 2023-12-12T09:22:52.360 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T09:22:52.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T09:22:52.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.575+0000 7fe14ae4b640 1 Processor -- start 2023-12-12T09:22:52.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.575+0000 7fe14ae4b640 1 -- start start 2023-12-12T09:22:52.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.577+0000 7fe14ae4b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe1441412c0 0x7fe14415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:52.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.577+0000 7fe14ae4b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440cdb80 con 0x7fe14413de10 2023-12-12T09:22:52.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.577+0000 7fe14ae4b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440cde60 con 0x7fe14415f000 2023-12-12T09:22:52.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.577+0000 7fe14ae4b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14415f4b0 con 0x7fe1441412c0 2023-12-12T09:22:52.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.577+0000 7fe149e49640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe14413de10 0x7fe1440cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55290/0 (socket says 172.21.15.84:55290) 2023-12-12T09:22:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.577+0000 7fe149e49640 1 -- 172.21.15.84:0/16764856 learned_addr learned my addr 172.21.15.84:0/16764856 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.577+0000 7fe149648640 1 --2- 172.21.15.84:0/16764856 >> v2:172.21.15.84:3300/0 conn(0x7fe1441412c0 0x7fe14415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.577+0000 7fe148e47640 1 -- 172.21.15.84:0/16764856 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380333265 0 0) 0x7fe1440cdb80 con 0x7fe14413de10 2023-12-12T09:22:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.578+0000 7fe148e47640 1 -- 172.21.15.84:0/16764856 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe130003520 con 0x7fe14413de10 2023-12-12T09:22:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.578+0000 7fe149648640 1 -- 172.21.15.84:0/16764856 >> v1:172.21.15.99:6789/0 conn(0x7fe14415f000 legacy=0x7fe144070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.578+0000 7fe149648640 1 -- 172.21.15.84:0/16764856 >> v1:172.21.15.84:6789/0 conn(0x7fe14413de10 legacy=0x7fe1440cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.578+0000 7fe149648640 1 -- 172.21.15.84:0/16764856 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1440ce140 con 0x7fe1441412c0 2023-12-12T09:22:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.579+0000 7fe149648640 1 --2- 172.21.15.84:0/16764856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1441412c0 0x7fe14415eac0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe1340097a0 tx=0x7fe13402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5be0b24c8a56c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.579+0000 7fe148e47640 1 -- 172.21.15.84:0/16764856 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134031830 con 0x7fe1441412c0 2023-12-12T09:22:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.579+0000 7fe148e47640 1 -- 172.21.15.84:0/16764856 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134031990 con 0x7fe1441412c0 2023-12-12T09:22:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.579+0000 7fe148e47640 1 -- 172.21.15.84:0/16764856 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134031d20 con 0x7fe1441412c0 2023-12-12T09:22:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.580+0000 7fe14ae4b640 1 -- 172.21.15.84:0/16764856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1441412c0 msgr2=0x7fe14415eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.580+0000 7fe14ae4b640 1 --2- 172.21.15.84:0/16764856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1441412c0 0x7fe14415eac0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe1340097a0 tx=0x7fe13402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:22:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.580+0000 7fe14ae4b640 1 -- 172.21.15.84:0/16764856 shutdown_connections 2023-12-12T09:22:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.580+0000 7fe14ae4b640 1 --2- 172.21.15.84:0/16764856 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1441412c0 0x7fe14415eac0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.580+0000 7fe14ae4b640 1 -- 172.21.15.84:0/16764856 >> 172.21.15.84:0/16764856 conn(0x7fe1440b0780 msgr2=0x7fe1440b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.580+0000 7fe14ae4b640 1 -- 172.21.15.84:0/16764856 shutdown_connections 2023-12-12T09:22:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.580+0000 7fe14ae4b640 1 -- 172.21.15.84:0/16764856 wait complete. 2023-12-12T09:22:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.581+0000 7fe14ae4b640 1 Processor -- start 2023-12-12T09:22:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.582+0000 7fe14ae4b640 1 -- start start 2023-12-12T09:22:52.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe14ae4b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14413de10 0x7fe144151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe14ae4b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14415f000 0x7fe14406d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe14ae4b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1440b38c0 0x7fe14406db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe14ae4b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144151760 con 0x7fe14415f000 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe14ae4b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440b3430 con 0x7fe14413de10 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe14ae4b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440b2820 con 0x7fe1440b38c0 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149648640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14415f000 0x7fe14406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149648640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14415f000 0x7fe14406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36936/0 (socket says 172.21.15.84:36936) 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149648640 1 -- 172.21.15.84:0/3953428983 learned_addr learned my addr 172.21.15.84:0/3953428983 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149e49640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14413de10 0x7fe144151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149648640 1 -- 172.21.15.84:0/3953428983 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1440b38c0 msgr2=0x7fe14406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149648640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1440b38c0 0x7fe14406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149648640 1 -- 172.21.15.84:0/3953428983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14413de10 msgr2=0x7fe144151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149648640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14413de10 0x7fe144151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.583+0000 7fe149648640 1 -- 172.21.15.84:0/3953428983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe134009400 con 0x7fe14415f000 2023-12-12T09:22:52.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.584+0000 7fe149648640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14415f000 0x7fe14406d620 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe13402bee0 tx=0x7fe1340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:52.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.584+0000 7fe13a7fc640 1 -- 172.21.15.84:0/3953428983 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13403a6f0 con 0x7fe14415f000 2023-12-12T09:22:52.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.584+0000 7fe13a7fc640 1 -- 172.21.15.84:0/3953428983 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13403a870 con 0x7fe14415f000 2023-12-12T09:22:52.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.584+0000 7fe13a7fc640 1 -- 172.21.15.84:0/3953428983 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13403ac20 con 0x7fe14415f000 2023-12-12T09:22:52.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.584+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1440b2b00 con 0x7fe14415f000 2023-12-12T09:22:52.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.584+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1440b30c0 con 0x7fe14415f000 2023-12-12T09:22:52.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.585+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1440b35a0 con 0x7fe14415f000 2023-12-12T09:22:52.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.586+0000 7fe13a7fc640 1 -- 172.21.15.84:0/3953428983 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe13404c3b0 con 0x7fe14415f000 2023-12-12T09:22:52.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.587+0000 7fe13a7fc640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe12806ae70 0x7fe12806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:52.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.587+0000 7fe13a7fc640 1 -- 172.21.15.84:0/3953428983 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe1340ab4c0 con 0x7fe14415f000 2023-12-12T09:22:52.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.587+0000 7fe149e49640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe12806ae70 0x7fe12806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:52.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.588+0000 7fe149e49640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe12806ae70 0x7fe12806d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe1400011e0 tx=0x7fe140009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:52.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.592+0000 7fe13a7fc640 1 -- 172.21.15.84:0/3953428983 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe134076390 con 0x7fe14415f000 2023-12-12T09:22:52.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:52.821+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe1440b3250 con 0x7fe14415f000 2023-12-12T09:22:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.345+0000 7fe13a7fc640 1 -- 172.21.15.84:0/3953428983 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe1340799b0 con 0x7fe14415f000 2023-12-12T09:22:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.348+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe12806ae70 msgr2=0x7fe12806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.348+0000 7fe14ae4b640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe12806ae70 0x7fe12806d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe1400011e0 tx=0x7fe140009040 comp rx=0 tx=0).stop 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14415f000 msgr2=0x7fe14406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14415f000 0x7fe14406d620 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe13402bee0 tx=0x7fe1340046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 shutdown_connections 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe1440b38c0 0x7fe14406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe12806ae70 0x7fe12806d330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe14415f000 0x7fe14406d620 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 --2- 172.21.15.84:0/3953428983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14413de10 0x7fe144151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 >> 172.21.15.84:0/3953428983 conn(0x7fe1440b0780 msgr2=0x7fe14415a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 shutdown_connections 2023-12-12T09:22:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.349+0000 7fe14ae4b640 1 -- 172.21.15.84:0/3953428983 wait complete. 2023-12-12T09:22:53.370 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T09:22:53.371 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:22:53.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.579+0000 7f82872e5640 1 Processor -- start 2023-12-12T09:22:53.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.580+0000 7f82872e5640 1 -- start start 2023-12-12T09:22:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.581+0000 7f82872e5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f828013dae0 0x7f828013f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.581+0000 7f82872e5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8280140270 con 0x7f82800ce330 2023-12-12T09:22:53.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.581+0000 7f82872e5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800cd850 con 0x7f8280071bb0 2023-12-12T09:22:53.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.581+0000 7f82872e5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800cdb30 con 0x7f828013dae0 2023-12-12T09:22:53.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8284880640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f82800ce330 0x7f828013d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:55298/0 (socket says 172.21.15.84:55298) 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8284880640 1 -- 172.21.15.84:0/1139351387 learned_addr learned my addr 172.21.15.84:0/1139351387 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8285882640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f828013dae0 0x7f828013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958984983 0 0) 0x7f8280140270 con 0x7f82800ce330 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f826c003520 con 0x7f82800ce330 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1270400926 0 0) 0x7f826c003520 con 0x7f82800ce330 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f828013dae0 msgr2=0x7f828013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8277fff640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f828013dae0 0x7f828013f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 >> v1:172.21.15.99:6789/0 conn(0x7f8280071bb0 legacy=0x7f8280071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.582+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800cde10 con 0x7f82800ce330 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f8270001670 con 0x7f82800ce330 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 >> v1:172.21.15.84:6789/0 conn(0x7f82800ce330 legacy=0x7f828013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8277fff640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f826c0039a0 0x7f826c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8277fff640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f826c0047c0 0x7f826c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:53.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8277fff640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f826c005180 0x7f826c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800cdb30 con 0x7f826c0047c0 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c00bec0 con 0x7f826c0039a0 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c00c000 con 0x7f826c005180 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8284880640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f826c0047c0 0x7f826c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8285081640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f826c0039a0 0x7f826c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8284880640 1 -- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f826c005180 msgr2=0x7f826c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8284880640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f826c005180 0x7f826c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8284880640 1 -- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f826c0039a0 msgr2=0x7f826c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8284880640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f826c0039a0 0x7f826c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.583+0000 7f8284880640 1 -- 172.21.15.84:0/1139351387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c003520 con 0x7f826c0047c0 2023-12-12T09:22:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.584+0000 7f8284880640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f826c0047c0 0x7f826c004c40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f827000c240 tx=0x7f826c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c5aaee3b9ee13c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270005ad0 con 0x7f826c0047c0 2023-12-12T09:22:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270005c50 con 0x7f826c0047c0 2023-12-12T09:22:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f8277fff640 1 -- 172.21.15.84:0/1139351387 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827002c8a0 con 0x7f826c0047c0 2023-12-12T09:22:53.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f82872e5640 1 -- 172.21.15.84:0/1139351387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f826c0047c0 msgr2=0x7f826c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f82872e5640 1 --2- 172.21.15.84:0/1139351387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f826c0047c0 0x7f826c004c40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f827000c240 tx=0x7f826c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f8285882640 1 -- 172.21.15.84:0/1139351387 reap_dead start 2023-12-12T09:22:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f82872e5640 1 -- 172.21.15.84:0/1139351387 shutdown_connections 2023-12-12T09:22:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f82872e5640 1 -- 172.21.15.84:0/1139351387 >> 172.21.15.84:0/1139351387 conn(0x7f828006c3d0 msgr2=0x7f828006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f82872e5640 1 -- 172.21.15.84:0/1139351387 shutdown_connections 2023-12-12T09:22:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.585+0000 7f82872e5640 1 -- 172.21.15.84:0/1139351387 wait complete. 2023-12-12T09:22:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.587+0000 7f82872e5640 1 Processor -- start 2023-12-12T09:22:53.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.587+0000 7f82872e5640 1 -- start start 2023-12-12T09:22:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.588+0000 7f82872e5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f826c0047c0 0x7f82801528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:53.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.588+0000 7f82872e5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828013b150 0x7f82800a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.588+0000 7f82872e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82800a89c0 0x7f82800ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.588+0000 7f82872e5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800a8e40 con 0x7f828013b150 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.588+0000 7f82872e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280152450 con 0x7f82800a89c0 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.588+0000 7f82872e5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280151e20 con 0x7f826c0047c0 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8284880640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828013b150 0x7f82800a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8284880640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828013b150 0x7f82800a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36950/0 (socket says 172.21.15.84:36950) 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8284880640 1 -- 172.21.15.84:0/143978245 learned_addr learned my addr 172.21.15.84:0/143978245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8285081640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f826c0047c0 0x7f82801528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8285882640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82800a89c0 0x7f82800ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8284880640 1 -- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f826c0047c0 msgr2=0x7f82801528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8284880640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f826c0047c0 0x7f82801528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8284880640 1 -- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82800a89c0 msgr2=0x7f82800ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8284880640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82800a89c0 0x7f82800ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8284880640 1 -- 172.21.15.84:0/143978245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280153ff0 con 0x7f828013b150 2023-12-12T09:22:53.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.589+0000 7f8285882640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82800a89c0 0x7f82800ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:53.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.590+0000 7f8284880640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828013b150 0x7f82800a8480 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8270001930 tx=0x7f8270001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:53.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.590+0000 7f8275ffb640 1 -- 172.21.15.84:0/143978245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270039070 con 0x7f828013b150 2023-12-12T09:22:53.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.590+0000 7f8275ffb640 1 -- 172.21.15.84:0/143978245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827002ccb0 con 0x7f828013b150 2023-12-12T09:22:53.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.590+0000 7f8275ffb640 1 -- 172.21.15.84:0/143978245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827003c040 con 0x7f828013b150 2023-12-12T09:22:53.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.590+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82801542d0 con 0x7f828013b150 2023-12-12T09:22:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.590+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82801520e0 con 0x7f828013b150 2023-12-12T09:22:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.591+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82800673c0 con 0x7f828013b150 2023-12-12T09:22:53.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.592+0000 7f8275ffb640 1 -- 172.21.15.84:0/143978245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8270032070 con 0x7f828013b150 2023-12-12T09:22:53.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.593+0000 7f8275ffb640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f826406ae50 0x7f826406d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:53.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.594+0000 7f8275ffb640 1 -- 172.21.15.84:0/143978245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f82700aac40 con 0x7f828013b150 2023-12-12T09:22:53.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.594+0000 7f8285081640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f826406ae50 0x7f826406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:53.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.594+0000 7f8285081640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f826406ae50 0x7f826406d310 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f827c005490 tx=0x7f827c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:53.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.598+0000 7f8275ffb640 1 -- 172.21.15.84:0/143978245 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8270075cb0 con 0x7f828013b150 2023-12-12T09:22:53.672 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-12-12T09:22:53.671+0000 7f876d8bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:22:53.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.823+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82800ae710 con 0x7f828013b150 2023-12-12T09:22:53.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.825+0000 7f8275ffb640 1 -- 172.21.15.84:0/143978245 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f82700792d0 con 0x7f828013b150 2023-12-12T09:22:53.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:53.825 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1966836821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1966836821},{"type":"v1","addr":"172.21.15.99:6835","nonce":1966836821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/4165741100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":4165741100},{"type":"v1","addr":"172.21.15.99:6833","nonce":4165741100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3716664132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3716664132},{"type":"v1","addr":"172.21.15.84:6836","nonce":3716664132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:22:49.741201+0000","modified":"2023-12-12T09:22:52.822545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6237},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6237":{"gid":6237,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/3202590301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3202590301},{"type":"v1","addr":"172.21.15.84:6837","nonce":3202590301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:22:53.826 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f826406ae50 msgr2=0x7f826406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f826406ae50 0x7f826406d310 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f827c005490 tx=0x7f827c009040 comp rx=0 tx=0).stop 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828013b150 msgr2=0x7f82800a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828013b150 0x7f82800a8480 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8270001930 tx=0x7f8270001a00 comp rx=0 tx=0).stop 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 shutdown_connections 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82800a89c0 0x7f82800ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f826406ae50 0x7f826406d310 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f828013b150 0x7f82800a8480 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 --2- 172.21.15.84:0/143978245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f826c0047c0 0x7f82801528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.827+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 >> 172.21.15.84:0/143978245 conn(0x7f828006c3d0 msgr2=0x7f828013d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.828+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 shutdown_connections 2023-12-12T09:22:53.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:53.828+0000 7f82872e5640 1 -- 172.21.15.84:0/143978245 wait complete. 2023-12-12T09:22:53.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:22:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.051+0000 7fa8dc973640 1 Processor -- start 2023-12-12T09:22:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.052+0000 7fa8dc973640 1 -- start start 2023-12-12T09:22:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.053+0000 7fa8dc973640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8d80ce330 0x7fa8d813d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.053+0000 7fa8dc973640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa8d80ce7c0 0x7fa8d813d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.053+0000 7fa8dc973640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d8140270 con 0x7fa8d8071bb0 2023-12-12T09:22:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.053+0000 7fa8dc973640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d80cd850 con 0x7fa8d80ce330 2023-12-12T09:22:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.053+0000 7fa8dc973640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d80cdb30 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.053+0000 7fa8cffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8d80ce330 0x7fa8d813d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.053+0000 7fa8cffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa8d80ce330 0x7fa8d813d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36956/0 (socket says 172.21.15.84:36956) 2023-12-12T09:22:54.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.053+0000 7fa8cffff640 1 -- 172.21.15.84:0/2903042971 learned_addr learned my addr 172.21.15.84:0/2903042971 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:54.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.054+0000 7fa8d6d9d640 1 --2- 172.21.15.84:0/2903042971 >> v2:172.21.15.99:3300/0 conn(0x7fa8d80ce7c0 0x7fa8d813d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.054+0000 7fa8cffff640 1 -- 172.21.15.84:0/2903042971 >> v2:172.21.15.99:3300/0 conn(0x7fa8d80ce7c0 msgr2=0x7fa8d813d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:54.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.054+0000 7fa8cffff640 1 --2- 172.21.15.84:0/2903042971 >> v2:172.21.15.99:3300/0 conn(0x7fa8d80ce7c0 0x7fa8d813d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.054+0000 7fa8cffff640 1 -- 172.21.15.84:0/2903042971 >> v1:172.21.15.99:6789/0 conn(0x7fa8d8071bb0 legacy=0x7fa8d8071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:54.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.054+0000 7fa8cffff640 1 -- 172.21.15.84:0/2903042971 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d80cde10 con 0x7fa8d80ce330 2023-12-12T09:22:54.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.054+0000 7fa8d6d9d640 1 --2- 172.21.15.84:0/2903042971 >> v2:172.21.15.99:3300/0 conn(0x7fa8d80ce7c0 0x7fa8d813d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:22:54.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.055+0000 7fa8cffff640 1 --2- 172.21.15.84:0/2903042971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce330 0x7fa8d813d3d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009870 tx=0x7fa8c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2445b7ca293426e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8d5d9b640 1 -- 172.21.15.84:0/2903042971 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0031870 con 0x7fa8d80ce330 2023-12-12T09:22:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8d5d9b640 1 -- 172.21.15.84:0/2903042971 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c00319d0 con 0x7fa8d80ce330 2023-12-12T09:22:54.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8d5d9b640 1 -- 172.21.15.84:0/2903042971 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0031d60 con 0x7fa8d80ce330 2023-12-12T09:22:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8dc973640 1 -- 172.21.15.84:0/2903042971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce330 msgr2=0x7fa8d813d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2903042971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce330 0x7fa8d813d3d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009870 tx=0x7fa8c002b910 comp rx=0 tx=0).stop 2023-12-12T09:22:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8dc973640 1 -- 172.21.15.84:0/2903042971 shutdown_connections 2023-12-12T09:22:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2903042971 >> v2:172.21.15.99:3300/0 conn(0x7fa8d80ce7c0 0x7fa8d813d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2903042971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce330 0x7fa8d813d3d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8dc973640 1 -- 172.21.15.84:0/2903042971 >> 172.21.15.84:0/2903042971 conn(0x7fa8d806c3d0 msgr2=0x7fa8d806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.056+0000 7fa8dc973640 1 -- 172.21.15.84:0/2903042971 shutdown_connections 2023-12-12T09:22:54.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.057+0000 7fa8dc973640 1 -- 172.21.15.84:0/2903042971 wait complete. 2023-12-12T09:22:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.058+0000 7fa8dc973640 1 Processor -- start 2023-12-12T09:22:54.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.058+0000 7fa8dc973640 1 -- start start 2023-12-12T09:22:54.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.059+0000 7fa8dc973640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d8071bb0 0x7fa8d8153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.059+0000 7fa8dc973640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8d80ce330 0x7fa8d8137c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.059+0000 7fa8dc973640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce7c0 0x7fa8d8138180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.059+0000 7fa8dc973640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8151520 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.059+0000 7fa8dc973640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8133ef0 con 0x7fa8d8071bb0 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.059+0000 7fa8dc973640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d813ed80 con 0x7fa8d80ce330 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce7c0 0x7fa8d8138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce7c0 0x7fa8d8138180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36964/0 (socket says 172.21.15.84:36964) 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 -- 172.21.15.84:0/2910440013 learned_addr learned my addr 172.21.15.84:0/2910440013 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 -- 172.21.15.84:0/2910440013 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8d80ce330 msgr2=0x7fa8d8137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8d80ce330 0x7fa8d8137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 -- 172.21.15.84:0/2910440013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d8071bb0 msgr2=0x7fa8d8153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d8071bb0 0x7fa8d8153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 -- 172.21.15.84:0/2910440013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00094d0 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8d6d9d640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce7c0 0x7fa8d8138180 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0007e20 tx=0x7fa8d000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.060+0000 7fa8ceffd640 1 -- 172.21.15.84:0/2910440013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0003b90 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.061+0000 7fa8ceffd640 1 -- 172.21.15.84:0/2910440013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d000f040 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.061+0000 7fa8ceffd640 1 -- 172.21.15.84:0/2910440013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d000de80 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.061+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d80af310 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.061+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d80af8d0 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.062+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d80673c0 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.063+0000 7fa8ceffd640 1 -- 172.21.15.84:0/2910440013 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8d0004030 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.064+0000 7fa8ceffd640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa8b806ae70 0x7fa8b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.064+0000 7fa8ceffd640 1 -- 172.21.15.84:0/2910440013 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa8d0089ab0 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.064+0000 7fa8d659c640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa8b806ae70 0x7fa8b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.065+0000 7fa8d659c640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa8b806ae70 0x7fa8b806d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8003cc0 tx=0x7fa8c80079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.068+0000 7fa8ceffd640 1 -- 172.21.15.84:0/2910440013 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8d0054980 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.261+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8d80ae710 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.264+0000 7fa8ceffd640 1 -- 172.21.15.84:0/2910440013 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7fa8d001a090 con 0x7fa8d80ce7c0 2023-12-12T09:22:54.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:54.264 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:22:54.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.266+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa8b806ae70 msgr2=0x7fa8b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.266+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa8b806ae70 0x7fa8b806d330 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8003cc0 tx=0x7fa8c80079b0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.266+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce7c0 msgr2=0x7fa8d8138180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.266+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce7c0 0x7fa8d8138180 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0007e20 tx=0x7fa8d000d4a0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.267+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 shutdown_connections 2023-12-12T09:22:54.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.267+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa8b806ae70 0x7fa8b806d330 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.267+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d80ce7c0 0x7fa8d8138180 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.267+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa8d80ce330 0x7fa8d8137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.267+0000 7fa8dc973640 1 --2- 172.21.15.84:0/2910440013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8d8071bb0 0x7fa8d8153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.267+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 >> 172.21.15.84:0/2910440013 conn(0x7fa8d806c3d0 msgr2=0x7fa8d813d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:54.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.267+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 shutdown_connections 2023-12-12T09:22:54.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.267+0000 7fa8dc973640 1 -- 172.21.15.84:0/2910440013 wait complete. 2023-12-12T09:22:54.286 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T09:22:54.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:22:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.499+0000 7f9607bec640 1 Processor -- start 2023-12-12T09:22:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.499+0000 7f9607bec640 1 -- start start 2023-12-12T09:22:54.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.501+0000 7f9607bec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9600142f40 0x7f960015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.501+0000 7f9607bec640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96000b4ba0 0x7f960015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.501+0000 7f9607bec640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000b3b60 con 0x7f960013ff90 2023-12-12T09:22:54.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.501+0000 7f9607bec640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960015e6d0 con 0x7f96000b4ba0 2023-12-12T09:22:54.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.501+0000 7f9607bec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960015e420 con 0x7f9600142f40 2023-12-12T09:22:54.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.501+0000 7f9606189640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96000b4ba0 0x7f960015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.501+0000 7f9606189640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96000b4ba0 0x7f960015dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36974/0 (socket says 172.21.15.84:36974) 2023-12-12T09:22:54.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.501+0000 7f9606189640 1 -- 172.21.15.84:0/1731597835 learned_addr learned my addr 172.21.15.84:0/1731597835 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:54.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.502+0000 7f9605187640 1 --2- 172.21.15.84:0/1731597835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9600142f40 0x7f960015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.502+0000 7f9606189640 1 -- 172.21.15.84:0/1731597835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9600142f40 msgr2=0x7f960015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:54.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.502+0000 7f9606189640 1 --2- 172.21.15.84:0/1731597835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9600142f40 0x7f960015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.502+0000 7f9606189640 1 -- 172.21.15.84:0/1731597835 >> v1:172.21.15.99:6789/0 conn(0x7f960013ff90 legacy=0x7f9600142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:54.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.502+0000 7f9606189640 1 -- 172.21.15.84:0/1731597835 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000b3de0 con 0x7f96000b4ba0 2023-12-12T09:22:54.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.502+0000 7f9605187640 1 --2- 172.21.15.84:0/1731597835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9600142f40 0x7f960015d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:54.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.503+0000 7f9606189640 1 --2- 172.21.15.84:0/1731597835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96000b4ba0 0x7f960015dee0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009870 tx=0x7f95f802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0c4bb1704d8b82 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.503+0000 7f9604986640 1 -- 172.21.15.84:0/1731597835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8031640 con 0x7f96000b4ba0 2023-12-12T09:22:54.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.503+0000 7f9604986640 1 -- 172.21.15.84:0/1731597835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f80317a0 con 0x7f96000b4ba0 2023-12-12T09:22:54.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.503+0000 7f9604986640 1 -- 172.21.15.84:0/1731597835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8031b30 con 0x7f96000b4ba0 2023-12-12T09:22:54.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.503+0000 7f9607bec640 1 -- 172.21.15.84:0/1731597835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96000b4ba0 msgr2=0x7f960015dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.503+0000 7f9607bec640 1 --2- 172.21.15.84:0/1731597835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96000b4ba0 0x7f960015dee0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009870 tx=0x7f95f802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.504+0000 7f9607bec640 1 -- 172.21.15.84:0/1731597835 shutdown_connections 2023-12-12T09:22:54.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.504+0000 7f9607bec640 1 --2- 172.21.15.84:0/1731597835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96000b4ba0 0x7f960015dee0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.504+0000 7f9607bec640 1 --2- 172.21.15.84:0/1731597835 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9600142f40 0x7f960015d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.504+0000 7f9607bec640 1 -- 172.21.15.84:0/1731597835 >> 172.21.15.84:0/1731597835 conn(0x7f960006c3d0 msgr2=0x7f960006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:54.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.504+0000 7f9607bec640 1 -- 172.21.15.84:0/1731597835 shutdown_connections 2023-12-12T09:22:54.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.504+0000 7f9607bec640 1 -- 172.21.15.84:0/1731597835 wait complete. 2023-12-12T09:22:54.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.505+0000 7f9607bec640 1 Processor -- start 2023-12-12T09:22:54.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.506+0000 7f9607bec640 1 -- start start 2023-12-12T09:22:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.506+0000 7f9607bec640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96000b4ba0 0x7f9600153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9607bec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f960013ff90 0x7f9600157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9607bec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9600142f40 0x7f96001416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9607bec640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9600153cc0 con 0x7f960013ff90 2023-12-12T09:22:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9607bec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96001587d0 con 0x7f9600142f40 2023-12-12T09:22:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9607bec640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9600158ab0 con 0x7f96000b4ba0 2023-12-12T09:22:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9605187640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f960013ff90 0x7f9600157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9605187640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f960013ff90 0x7f9600157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36978/0 (socket says 172.21.15.84:36978) 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9605187640 1 -- 172.21.15.84:0/752020845 learned_addr learned my addr 172.21.15.84:0/752020845 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9605187640 1 -- 172.21.15.84:0/752020845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96000b4ba0 msgr2=0x7f9600153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9606189640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9600142f40 0x7f96001416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9605187640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96000b4ba0 0x7f9600153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9605187640 1 -- 172.21.15.84:0/752020845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9600142f40 msgr2=0x7f96001416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9605187640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9600142f40 0x7f96001416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.507+0000 7f9605187640 1 -- 172.21.15.84:0/752020845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80094d0 con 0x7f960013ff90 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.508+0000 7f9605187640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f960013ff90 0x7f9600157d50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c7f0 tx=0x7f95f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.508+0000 7f95f67fc640 1 -- 172.21.15.84:0/752020845 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0007a30 con 0x7f960013ff90 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.508+0000 7f95f67fc640 1 -- 172.21.15.84:0/752020845 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0007b90 con 0x7f960013ff90 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.508+0000 7f95f67fc640 1 -- 172.21.15.84:0/752020845 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000ce40 con 0x7f960013ff90 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.508+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9600158d90 con 0x7f960013ff90 2023-12-12T09:22:54.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.508+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9600159350 con 0x7f960013ff90 2023-12-12T09:22:54.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.509+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9600159570 con 0x7f960013ff90 2023-12-12T09:22:54.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.510+0000 7f95f67fc640 1 -- 172.21.15.84:0/752020845 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95f00113f0 con 0x7f960013ff90 2023-12-12T09:22:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.511+0000 7f95f67fc640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95e406ae40 0x7f95e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.512+0000 7f95f67fc640 1 -- 172.21.15.84:0/752020845 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f95f0089950 con 0x7f960013ff90 2023-12-12T09:22:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.512+0000 7f9605988640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95e406ae40 0x7f95e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.512+0000 7f9605988640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95e406ae40 0x7f95e406d300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00abb0 tx=0x7f95fc009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.516+0000 7f95f67fc640 1 -- 172.21.15.84:0/752020845 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95f00548b0 con 0x7f960013ff90 2023-12-12T09:22:54.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.686+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96000b3140 con 0x7f95e406ae40 2023-12-12T09:22:54.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.697+0000 7f95f67fc640 1 -- 172.21.15.84:0/752020845 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281204 (secure 0 0 0) 0x7f96000b3140 con 0x7f95e406ae40 2023-12-12T09:22:54.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:54.703 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95e406ae40 msgr2=0x7f95e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95e406ae40 0x7f95e406d300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00abb0 tx=0x7f95fc009250 comp rx=0 tx=0).stop 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f960013ff90 msgr2=0x7f9600157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f960013ff90 0x7f9600157d50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c7f0 tx=0x7f95f000cbf0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 shutdown_connections 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9600142f40 0x7f96001416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f95e406ae40 0x7f95e406d300 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f960013ff90 0x7f9600157d50 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 --2- 172.21.15.84:0/752020845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96000b4ba0 0x7f9600153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 >> 172.21.15.84:0/752020845 conn(0x7f960006c3d0 msgr2=0x7f960015b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 shutdown_connections 2023-12-12T09:22:54.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.703+0000 7f9607bec640 1 -- 172.21.15.84:0/752020845 wait complete. 2023-12-12T09:22:54.723 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-12-12T09:22:53.139112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226692,"kb_used_data":6352,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748028,"statfs":{"total":773094113280,"available":772861980672,"internally_reserved":0,"allocated":6504448,"data_stored":3551338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.867715"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303909+0000","last_change":"2023-12-12T09:22:49.303909+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303909+0000","last_undegraded":"2023-12-12T09:22:49.303909+0000","last_fullsized":"2023-12-12T09:22:49.303909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298669+0000","last_change":"2023-12-12T09:22:49.298669+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298669+0000","last_undegraded":"2023-12-12T09:22:49.298669+0000","last_fullsized":"2023-12-12T09:22:49.298669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294890+0000","last_change":"2023-12-12T09:22:49.294890+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294890+0000","last_undegraded":"2023-12-12T09:22:49.294890+0000","last_fullsized":"2023-12-12T09:22:49.294890+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306459+0000","last_change":"2023-12-12T09:22:49.306459+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306459+0000","last_undegraded":"2023-12-12T09:22:49.306459+0000","last_fullsized":"2023-12-12T09:22:49.306459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.304656+0000","last_change":"2023-12-12T09:22:49.304656+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.304656+0000","last_undegraded":"2023-12-12T09:22:49.304656+0000","last_fullsized":"2023-12-12T09:22:49.304656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.301421+0000","last_change":"2023-12-12T09:22:49.301421+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.301421+0000","last_undegraded":"2023-12-12T09:22:49.301421+0000","last_fullsized":"2023-12-12T09:22:49.301421+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289806+0000","last_change":"2023-12-12T09:22:49.289806+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289806+0000","last_undegraded":"2023-12-12T09:22:49.289806+0000","last_fullsized":"2023-12-12T09:22:49.289806+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299472+0000","last_change":"2023-12-12T09:22:49.299472+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299472+0000","last_undegraded":"2023-12-12T09:22:49.299472+0000","last_fullsized":"2023-12-12T09:22:49.299472+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290154+0000","last_change":"2023-12-12T09:22:49.290154+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290154+0000","last_undegraded":"2023-12-12T09:22:49.290154+0000","last_fullsized":"2023-12-12T09:22:49.290154+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289963+0000","last_change":"2023-12-12T09:22:49.289963+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289963+0000","last_undegraded":"2023-12-12T09:22:49.289963+0000","last_fullsized":"2023-12-12T09:22:49.289963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289977+0000","last_change":"2023-12-12T09:22:49.289977+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289977+0000","last_undegraded":"2023-12-12T09:22:49.289977+0000","last_fullsized":"2023-12-12T09:22:49.289977+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305962+0000","last_change":"2023-12-12T09:22:49.305962+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305962+0000","last_undegraded":"2023-12-12T09:22:49.305962+0000","last_fullsized":"2023-12-12T09:22:49.305962+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305646+0000","last_change":"2023-12-12T09:22:49.305646+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305646+0000","last_undegraded":"2023-12-12T09:22:49.305646+0000","last_fullsized":"2023-12-12T09:22:49.305646+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291490+0000","last_change":"2023-12-12T09:22:49.291490+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291490+0000","last_undegraded":"2023-12-12T09:22:49.291490+0000","last_fullsized":"2023-12-12T09:22:49.291490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288629+0000","last_change":"2023-12-12T09:22:49.288629+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288629+0000","last_undegraded":"2023-12-12T09:22:49.288629+0000","last_fullsized":"2023-12-12T09:22:49.288629+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.301607+0000","last_change":"2023-12-12T09:22:49.301607+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.301607+0000","last_undegraded":"2023-12-12T09:22:49.301607+0000","last_fullsized":"2023-12-12T09:22:49.301607+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297986+0000","last_change":"2023-12-12T09:22:49.297986+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297986+0000","last_undegraded":"2023-12-12T09:22:49.297986+0000","last_fullsized":"2023-12-12T09:22:49.297986+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291848+0000","last_change":"2023-12-12T09:22:49.291848+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291848+0000","last_undegraded":"2023-12-12T09:22:49.291848+0000","last_fullsized":"2023-12-12T09:22:49.291848+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305479+0000","last_change":"2023-12-12T09:22:49.305479+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305479+0000","last_undegraded":"2023-12-12T09:22:49.305479+0000","last_fullsized":"2023-12-12T09:22:49.305479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298922+0000","last_change":"2023-12-12T09:22:49.298922+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298922+0000","last_undegraded":"2023-12-12T09:22:49.298922+0000","last_fullsized":"2023-12-12T09:22:49.298922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.292005+0000","last_change":"2023-12-12T09:22:49.292005+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.292005+0000","last_undegraded":"2023-12-12T09:22:49.292005+0000","last_fullsized":"2023-12-12T09:22:49.292005+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298407+0000","last_change":"2023-12-12T09:22:49.298407+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298407+0000","last_undegraded":"2023-12-12T09:22:49.298407+0000","last_fullsized":"2023-12-12T09:22:49.298407+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296981+0000","last_change":"2023-12-12T09:22:49.296981+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296981+0000","last_undegraded":"2023-12-12T09:22:49.296981+0000","last_fullsized":"2023-12-12T09:22:49.296981+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303738+0000","last_change":"2023-12-12T09:22:49.303738+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303738+0000","last_undegraded":"2023-12-12T09:22:49.303738+0000","last_fullsized":"2023-12-12T09:22:49.303738+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303408+0000","last_change":"2023-12-12T09:22:49.303408+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303408+0000","last_undegraded":"2023-12-12T09:22:49.303408+0000","last_fullsized":"2023-12-12T09:22:49.303408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306822+0000","last_change":"2023-12-12T09:22:49.306822+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306822+0000","last_undegraded":"2023-12-12T09:22:49.306822+0000","last_fullsized":"2023-12-12T09:22:49.306822+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299615+0000","last_change":"2023-12-12T09:22:49.299615+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299615+0000","last_undegraded":"2023-12-12T09:22:49.299615+0000","last_fullsized":"2023-12-12T09:22:49.299615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302418+0000","last_change":"2023-12-12T09:22:49.302418+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302418+0000","last_undegraded":"2023-12-12T09:22:49.302418+0000","last_fullsized":"2023-12-12T09:22:49.302418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297665+0000","last_change":"2023-12-12T09:22:49.297665+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297665+0000","last_undegraded":"2023-12-12T09:22:49.297665+0000","last_fullsized":"2023-12-12T09:22:49.297665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.287879+0000","last_change":"2023-12-12T09:22:49.287879+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.287879+0000","last_undegraded":"2023-12-12T09:22:49.287879+0000","last_fullsized":"2023-12-12T09:22:49.287879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302482+0000","last_change":"2023-12-12T09:22:49.302482+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302482+0000","last_undegraded":"2023-12-12T09:22:49.302482+0000","last_fullsized":"2023-12-12T09:22:49.302482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296959+0000","last_change":"2023-12-12T09:22:49.296959+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296959+0000","last_undegraded":"2023-12-12T09:22:49.296959+0000","last_fullsized":"2023-12-12T09:22:49.296959+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297969+0000","last_change":"2023-12-12T09:22:49.297969+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297969+0000","last_undegraded":"2023-12-12T09:22:49.297969+0000","last_fullsized":"2023-12-12T09:22:49.297969+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317154+0000","last_change":"2023-12-12T09:22:49.312219+0000","last_active":"2023-12-12T09:22:49.317154+0000","last_peered":"2023-12-12T09:22:49.317154+0000","last_clean":"2023-12-12T09:22:49.317154+0000","last_became_active":"2023-12-12T09:22:49.311828+0000","last_became_peered":"2023-12-12T09:22:49.311828+0000","last_unstale":"2023-12-12T09:22:49.317154+0000","last_undegraded":"2023-12-12T09:22:49.317154+0000","last_fullsized":"2023-12-12T09:22:49.317154+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:29:37.731161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290245+0000","last_change":"2023-12-12T09:22:49.290245+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290245+0000","last_undegraded":"2023-12-12T09:22:49.290245+0000","last_fullsized":"2023-12-12T09:22:49.290245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.315126+0000","last_change":"2023-12-12T09:22:49.306540+0000","last_active":"2023-12-12T09:22:49.315126+0000","last_peered":"2023-12-12T09:22:49.315126+0000","last_clean":"2023-12-12T09:22:49.315126+0000","last_became_active":"2023-12-12T09:22:49.306283+0000","last_became_peered":"2023-12-12T09:22:49.306283+0000","last_unstale":"2023-12-12T09:22:49.315126+0000","last_undegraded":"2023-12-12T09:22:49.315126+0000","last_fullsized":"2023-12-12T09:22:49.315126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:55:02.047149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294109+0000","last_change":"2023-12-12T09:22:49.294109+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294109+0000","last_undegraded":"2023-12-12T09:22:49.294109+0000","last_fullsized":"2023-12-12T09:22:49.294109+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.311411+0000","last_change":"2023-12-12T09:22:49.304758+0000","last_active":"2023-12-12T09:22:49.311411+0000","last_peered":"2023-12-12T09:22:49.311411+0000","last_clean":"2023-12-12T09:22:49.311411+0000","last_became_active":"2023-12-12T09:22:49.304487+0000","last_became_peered":"2023-12-12T09:22:49.304487+0000","last_unstale":"2023-12-12T09:22:49.311411+0000","last_undegraded":"2023-12-12T09:22:49.311411+0000","last_fullsized":"2023-12-12T09:22:49.311411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:10:19.181850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297024+0000","last_change":"2023-12-12T09:22:49.297024+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297024+0000","last_undegraded":"2023-12-12T09:22:49.297024+0000","last_fullsized":"2023-12-12T09:22:49.297024+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321010+0000","last_change":"2023-12-12T09:22:49.314610+0000","last_active":"2023-12-12T09:22:49.321010+0000","last_peered":"2023-12-12T09:22:49.321010+0000","last_clean":"2023-12-12T09:22:49.321010+0000","last_became_active":"2023-12-12T09:22:49.314219+0000","last_became_peered":"2023-12-12T09:22:49.314219+0000","last_unstale":"2023-12-12T09:22:49.321010+0000","last_undegraded":"2023-12-12T09:22:49.321010+0000","last_fullsized":"2023-12-12T09:22:49.321010+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:03:00.594237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295735+0000","last_change":"2023-12-12T09:22:49.295735+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295735+0000","last_undegraded":"2023-12-12T09:22:49.295735+0000","last_fullsized":"2023-12-12T09:22:49.295735+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314985+0000","last_change":"2023-12-12T09:22:49.310785+0000","last_active":"2023-12-12T09:22:49.314985+0000","last_peered":"2023-12-12T09:22:49.314985+0000","last_clean":"2023-12-12T09:22:49.314985+0000","last_became_active":"2023-12-12T09:22:49.310210+0000","last_became_peered":"2023-12-12T09:22:49.310210+0000","last_unstale":"2023-12-12T09:22:49.314985+0000","last_undegraded":"2023-12-12T09:22:49.314985+0000","last_fullsized":"2023-12-12T09:22:49.314985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:19:51.198011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296927+0000","last_change":"2023-12-12T09:22:49.296927+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296927+0000","last_undegraded":"2023-12-12T09:22:49.296927+0000","last_fullsized":"2023-12-12T09:22:49.296927+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317151+0000","last_change":"2023-12-12T09:22:49.313920+0000","last_active":"2023-12-12T09:22:49.317151+0000","last_peered":"2023-12-12T09:22:49.317151+0000","last_clean":"2023-12-12T09:22:49.317151+0000","last_became_active":"2023-12-12T09:22:49.313624+0000","last_became_peered":"2023-12-12T09:22:49.313624+0000","last_unstale":"2023-12-12T09:22:49.317151+0000","last_undegraded":"2023-12-12T09:22:49.317151+0000","last_fullsized":"2023-12-12T09:22:49.317151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:37.755816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302934+0000","last_change":"2023-12-12T09:22:49.302934+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302934+0000","last_undegraded":"2023-12-12T09:22:49.302934+0000","last_fullsized":"2023-12-12T09:22:49.302934+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320890+0000","last_change":"2023-12-12T09:22:49.312701+0000","last_active":"2023-12-12T09:22:49.320890+0000","last_peered":"2023-12-12T09:22:49.320890+0000","last_clean":"2023-12-12T09:22:49.320890+0000","last_became_active":"2023-12-12T09:22:49.312360+0000","last_became_peered":"2023-12-12T09:22:49.312360+0000","last_unstale":"2023-12-12T09:22:49.320890+0000","last_undegraded":"2023-12-12T09:22:49.320890+0000","last_fullsized":"2023-12-12T09:22:49.320890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296358+0000","last_change":"2023-12-12T09:22:49.296358+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296358+0000","last_undegraded":"2023-12-12T09:22:49.296358+0000","last_fullsized":"2023-12-12T09:22:49.296358+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.309557+0000","last_change":"2023-12-12T09:22:49.301866+0000","last_active":"2023-12-12T09:22:49.309557+0000","last_peered":"2023-12-12T09:22:49.309557+0000","last_clean":"2023-12-12T09:22:49.309557+0000","last_became_active":"2023-12-12T09:22:49.301545+0000","last_became_peered":"2023-12-12T09:22:49.301545+0000","last_unstale":"2023-12-12T09:22:49.309557+0000","last_undegraded":"2023-12-12T09:22:49.309557+0000","last_fullsized":"2023-12-12T09:22:49.309557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288573+0000","last_change":"2023-12-12T09:22:49.288573+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288573+0000","last_undegraded":"2023-12-12T09:22:49.288573+0000","last_fullsized":"2023-12-12T09:22:49.288573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319273+0000","last_change":"2023-12-12T09:22:49.317862+0000","last_active":"2023-12-12T09:22:49.319273+0000","last_peered":"2023-12-12T09:22:49.319273+0000","last_clean":"2023-12-12T09:22:49.319273+0000","last_became_active":"2023-12-12T09:22:49.317519+0000","last_became_peered":"2023-12-12T09:22:49.317519+0000","last_unstale":"2023-12-12T09:22:49.319273+0000","last_undegraded":"2023-12-12T09:22:49.319273+0000","last_fullsized":"2023-12-12T09:22:49.319273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295943+0000","last_change":"2023-12-12T09:22:49.295943+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295943+0000","last_undegraded":"2023-12-12T09:22:49.295943+0000","last_fullsized":"2023-12-12T09:22:49.295943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317133+0000","last_change":"2023-12-12T09:22:49.310163+0000","last_active":"2023-12-12T09:22:49.317133+0000","last_peered":"2023-12-12T09:22:49.317133+0000","last_clean":"2023-12-12T09:22:49.317133+0000","last_became_active":"2023-12-12T09:22:49.309844+0000","last_became_peered":"2023-12-12T09:22:49.309844+0000","last_unstale":"2023-12-12T09:22:49.317133+0000","last_undegraded":"2023-12-12T09:22:49.317133+0000","last_fullsized":"2023-12-12T09:22:49.317133+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:52.456770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291336+0000","last_change":"2023-12-12T09:22:49.291336+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291336+0000","last_undegraded":"2023-12-12T09:22:49.291336+0000","last_fullsized":"2023-12-12T09:22:49.291336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.316236+0000","last_change":"2023-12-12T09:22:49.312212+0000","last_active":"2023-12-12T09:22:49.316236+0000","last_peered":"2023-12-12T09:22:49.316236+0000","last_clean":"2023-12-12T09:22:49.316236+0000","last_became_active":"2023-12-12T09:22:49.311875+0000","last_became_peered":"2023-12-12T09:22:49.311875+0000","last_unstale":"2023-12-12T09:22:49.316236+0000","last_undegraded":"2023-12-12T09:22:49.316236+0000","last_fullsized":"2023-12-12T09:22:49.316236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294122+0000","last_change":"2023-12-12T09:22:49.294122+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294122+0000","last_undegraded":"2023-12-12T09:22:49.294122+0000","last_fullsized":"2023-12-12T09:22:49.294122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321523+0000","last_change":"2023-12-12T09:22:49.317782+0000","last_active":"2023-12-12T09:22:49.321523+0000","last_peered":"2023-12-12T09:22:49.321523+0000","last_clean":"2023-12-12T09:22:49.321523+0000","last_became_active":"2023-12-12T09:22:49.317482+0000","last_became_peered":"2023-12-12T09:22:49.317482+0000","last_unstale":"2023-12-12T09:22:49.321523+0000","last_undegraded":"2023-12-12T09:22:49.321523+0000","last_fullsized":"2023-12-12T09:22:49.321523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:43:40.240102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306769+0000","last_change":"2023-12-12T09:22:49.306769+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306769+0000","last_undegraded":"2023-12-12T09:22:49.306769+0000","last_fullsized":"2023-12-12T09:22:49.306769+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317195+0000","last_change":"2023-12-12T09:22:49.310312+0000","last_active":"2023-12-12T09:22:49.317195+0000","last_peered":"2023-12-12T09:22:49.317195+0000","last_clean":"2023-12-12T09:22:49.317195+0000","last_became_active":"2023-12-12T09:22:49.309975+0000","last_became_peered":"2023-12-12T09:22:49.309975+0000","last_unstale":"2023-12-12T09:22:49.317195+0000","last_undegraded":"2023-12-12T09:22:49.317195+0000","last_fullsized":"2023-12-12T09:22:49.317195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:44.355631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290680+0000","last_change":"2023-12-12T09:22:49.290680+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290680+0000","last_undegraded":"2023-12-12T09:22:49.290680+0000","last_fullsized":"2023-12-12T09:22:49.290680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319343+0000","last_change":"2023-12-12T09:22:49.317453+0000","last_active":"2023-12-12T09:22:49.319343+0000","last_peered":"2023-12-12T09:22:49.319343+0000","last_clean":"2023-12-12T09:22:49.319343+0000","last_became_active":"2023-12-12T09:22:49.317074+0000","last_became_peered":"2023-12-12T09:22:49.317074+0000","last_unstale":"2023-12-12T09:22:49.319343+0000","last_undegraded":"2023-12-12T09:22:49.319343+0000","last_fullsized":"2023-12-12T09:22:49.319343+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:10:30.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288497+0000","last_change":"2023-12-12T09:22:49.288497+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288497+0000","last_undegraded":"2023-12-12T09:22:49.288497+0000","last_fullsized":"2023-12-12T09:22:49.288497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320850+0000","last_change":"2023-12-12T09:22:49.312560+0000","last_active":"2023-12-12T09:22:49.320850+0000","last_peered":"2023-12-12T09:22:49.320850+0000","last_clean":"2023-12-12T09:22:49.320850+0000","last_became_active":"2023-12-12T09:22:49.312207+0000","last_became_peered":"2023-12-12T09:22:49.312207+0000","last_unstale":"2023-12-12T09:22:49.320850+0000","last_undegraded":"2023-12-12T09:22:49.320850+0000","last_fullsized":"2023-12-12T09:22:49.320850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:10:19.181850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.287797+0000","last_change":"2023-12-12T09:22:49.287797+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.287797+0000","last_undegraded":"2023-12-12T09:22:49.287797+0000","last_fullsized":"2023-12-12T09:22:49.287797+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.318667+0000","last_change":"2023-12-12T09:22:49.316431+0000","last_active":"2023-12-12T09:22:49.318667+0000","last_peered":"2023-12-12T09:22:49.318667+0000","last_clean":"2023-12-12T09:22:49.318667+0000","last_became_active":"2023-12-12T09:22:49.315687+0000","last_became_peered":"2023-12-12T09:22:49.315687+0000","last_unstale":"2023-12-12T09:22:49.318667+0000","last_undegraded":"2023-12-12T09:22:49.318667+0000","last_fullsized":"2023-12-12T09:22:49.318667+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:24.889220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290756+0000","last_change":"2023-12-12T09:22:49.290756+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290756+0000","last_undegraded":"2023-12-12T09:22:49.290756+0000","last_fullsized":"2023-12-12T09:22:49.290756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317252+0000","last_change":"2023-12-12T09:22:49.310717+0000","last_active":"2023-12-12T09:22:49.317252+0000","last_peered":"2023-12-12T09:22:49.317252+0000","last_clean":"2023-12-12T09:22:49.317252+0000","last_became_active":"2023-12-12T09:22:49.310424+0000","last_became_peered":"2023-12-12T09:22:49.310424+0000","last_unstale":"2023-12-12T09:22:49.317252+0000","last_undegraded":"2023-12-12T09:22:49.317252+0000","last_fullsized":"2023-12-12T09:22:49.317252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:04.604007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303028+0000","last_change":"2023-12-12T09:22:49.303028+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303028+0000","last_undegraded":"2023-12-12T09:22:49.303028+0000","last_fullsized":"2023-12-12T09:22:49.303028+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317050+0000","last_change":"2023-12-12T09:22:49.311109+0000","last_active":"2023-12-12T09:22:49.317050+0000","last_peered":"2023-12-12T09:22:49.317050+0000","last_clean":"2023-12-12T09:22:49.317050+0000","last_became_active":"2023-12-12T09:22:49.310693+0000","last_became_peered":"2023-12-12T09:22:49.310693+0000","last_unstale":"2023-12-12T09:22:49.317050+0000","last_undegraded":"2023-12-12T09:22:49.317050+0000","last_fullsized":"2023-12-12T09:22:49.317050+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:25:14.371805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295120+0000","last_change":"2023-12-12T09:22:49.295120+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295120+0000","last_undegraded":"2023-12-12T09:22:49.295120+0000","last_fullsized":"2023-12-12T09:22:49.295120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321054+0000","last_change":"2023-12-12T09:22:49.315722+0000","last_active":"2023-12-12T09:22:49.321054+0000","last_peered":"2023-12-12T09:22:49.321054+0000","last_clean":"2023-12-12T09:22:49.321054+0000","last_became_active":"2023-12-12T09:22:49.314425+0000","last_became_peered":"2023-12-12T09:22:49.314425+0000","last_unstale":"2023-12-12T09:22:49.321054+0000","last_undegraded":"2023-12-12T09:22:49.321054+0000","last_fullsized":"2023-12-12T09:22:49.321054+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:51.580255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.292875+0000","last_change":"2023-12-12T09:22:49.292875+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.292875+0000","last_undegraded":"2023-12-12T09:22:49.292875+0000","last_fullsized":"2023-12-12T09:22:49.292875+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.310573+0000","last_change":"2023-12-12T09:22:49.302394+0000","last_active":"2023-12-12T09:22:49.310573+0000","last_peered":"2023-12-12T09:22:49.310573+0000","last_clean":"2023-12-12T09:22:49.310573+0000","last_became_active":"2023-12-12T09:22:49.302117+0000","last_became_peered":"2023-12-12T09:22:49.302117+0000","last_unstale":"2023-12-12T09:22:49.310573+0000","last_undegraded":"2023-12-12T09:22:49.310573+0000","last_fullsized":"2023-12-12T09:22:49.310573+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:41.025867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.301414+0000","last_change":"2023-12-12T09:22:49.301414+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.301414+0000","last_undegraded":"2023-12-12T09:22:49.301414+0000","last_fullsized":"2023-12-12T09:22:49.301414+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.315008+0000","last_change":"2023-12-12T09:22:49.300566+0000","last_active":"2023-12-12T09:22:49.315008+0000","last_peered":"2023-12-12T09:22:49.315008+0000","last_clean":"2023-12-12T09:22:49.315008+0000","last_became_active":"2023-12-12T09:22:49.300278+0000","last_became_peered":"2023-12-12T09:22:49.300278+0000","last_unstale":"2023-12-12T09:22:49.315008+0000","last_undegraded":"2023-12-12T09:22:49.315008+0000","last_fullsized":"2023-12-12T09:22:49.315008+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:01:13.102148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295019+0000","last_change":"2023-12-12T09:22:49.295019+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295019+0000","last_undegraded":"2023-12-12T09:22:49.295019+0000","last_fullsized":"2023-12-12T09:22:49.295019+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314772+0000","last_change":"2023-12-12T09:22:49.309982+0000","last_active":"2023-12-12T09:22:49.314772+0000","last_peered":"2023-12-12T09:22:49.314772+0000","last_clean":"2023-12-12T09:22:49.314772+0000","last_became_active":"2023-12-12T09:22:49.309679+0000","last_became_peered":"2023-12-12T09:22:49.309679+0000","last_unstale":"2023-12-12T09:22:49.314772+0000","last_undegraded":"2023-12-12T09:22:49.314772+0000","last_fullsized":"2023-12-12T09:22:49.314772+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:55:48.543866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294500+0000","last_change":"2023-12-12T09:22:49.294500+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294500+0000","last_undegraded":"2023-12-12T09:22:49.294500+0000","last_fullsized":"2023-12-12T09:22:49.294500+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321506+0000","last_change":"2023-12-12T09:22:49.318054+0000","last_active":"2023-12-12T09:22:49.321506+0000","last_peered":"2023-12-12T09:22:49.321506+0000","last_clean":"2023-12-12T09:22:49.321506+0000","last_became_active":"2023-12-12T09:22:49.316900+0000","last_became_peered":"2023-12-12T09:22:49.316900+0000","last_unstale":"2023-12-12T09:22:49.321506+0000","last_undegraded":"2023-12-12T09:22:49.321506+0000","last_fullsized":"2023-12-12T09:22:49.321506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:45.654672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299222+0000","last_change":"2023-12-12T09:22:49.299222+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299222+0000","last_undegraded":"2023-12-12T09:22:49.299222+0000","last_fullsized":"2023-12-12T09:22:49.299222+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.307970+0000","last_change":"2023-12-12T09:22:49.299101+0000","last_active":"2023-12-12T09:22:49.307970+0000","last_peered":"2023-12-12T09:22:49.307970+0000","last_clean":"2023-12-12T09:22:49.307970+0000","last_became_active":"2023-12-12T09:22:49.298806+0000","last_became_peered":"2023-12-12T09:22:49.298806+0000","last_unstale":"2023-12-12T09:22:49.307970+0000","last_undegraded":"2023-12-12T09:22:49.307970+0000","last_fullsized":"2023-12-12T09:22:49.307970+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:55:52.971722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302603+0000","last_change":"2023-12-12T09:22:49.302603+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302603+0000","last_undegraded":"2023-12-12T09:22:49.302603+0000","last_fullsized":"2023-12-12T09:22:49.302603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317132+0000","last_change":"2023-12-12T09:22:49.313836+0000","last_active":"2023-12-12T09:22:49.317132+0000","last_peered":"2023-12-12T09:22:49.317132+0000","last_clean":"2023-12-12T09:22:49.317132+0000","last_became_active":"2023-12-12T09:22:49.313538+0000","last_became_peered":"2023-12-12T09:22:49.313538+0000","last_unstale":"2023-12-12T09:22:49.317132+0000","last_undegraded":"2023-12-12T09:22:49.317132+0000","last_fullsized":"2023-12-12T09:22:49.317132+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:45.654672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290188+0000","last_change":"2023-12-12T09:22:49.290188+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290188+0000","last_undegraded":"2023-12-12T09:22:49.290188+0000","last_fullsized":"2023-12-12T09:22:49.290188+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319314+0000","last_change":"2023-12-12T09:22:49.316665+0000","last_active":"2023-12-12T09:22:49.319314+0000","last_peered":"2023-12-12T09:22:49.319314+0000","last_clean":"2023-12-12T09:22:49.319314+0000","last_became_active":"2023-12-12T09:22:49.315307+0000","last_became_peered":"2023-12-12T09:22:49.315307+0000","last_unstale":"2023-12-12T09:22:49.319314+0000","last_undegraded":"2023-12-12T09:22:49.319314+0000","last_fullsized":"2023-12-12T09:22:49.319314+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:55:31.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294251+0000","last_change":"2023-12-12T09:22:49.294251+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294251+0000","last_undegraded":"2023-12-12T09:22:49.294251+0000","last_fullsized":"2023-12-12T09:22:49.294251+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320981+0000","last_change":"2023-12-12T09:22:49.313997+0000","last_active":"2023-12-12T09:22:49.320981+0000","last_peered":"2023-12-12T09:22:49.320981+0000","last_clean":"2023-12-12T09:22:49.320981+0000","last_became_active":"2023-12-12T09:22:49.313632+0000","last_became_peered":"2023-12-12T09:22:49.313632+0000","last_unstale":"2023-12-12T09:22:49.320981+0000","last_undegraded":"2023-12-12T09:22:49.320981+0000","last_fullsized":"2023-12-12T09:22:49.320981+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:37.755816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293291+0000","last_change":"2023-12-12T09:22:49.293291+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293291+0000","last_undegraded":"2023-12-12T09:22:49.293291+0000","last_fullsized":"2023-12-12T09:22:49.293291+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319473+0000","last_change":"2023-12-12T09:22:49.312354+0000","last_active":"2023-12-12T09:22:49.319473+0000","last_peered":"2023-12-12T09:22:49.319473+0000","last_clean":"2023-12-12T09:22:49.319473+0000","last_became_active":"2023-12-12T09:22:49.312037+0000","last_became_peered":"2023-12-12T09:22:49.312037+0000","last_unstale":"2023-12-12T09:22:49.319473+0000","last_undegraded":"2023-12-12T09:22:49.319473+0000","last_fullsized":"2023-12-12T09:22:49.319473+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:57:05.839285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289547+0000","last_change":"2023-12-12T09:22:49.289547+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289547+0000","last_undegraded":"2023-12-12T09:22:49.289547+0000","last_fullsized":"2023-12-12T09:22:49.289547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317783+0000","last_change":"2023-12-12T09:22:49.313350+0000","last_active":"2023-12-12T09:22:49.317783+0000","last_peered":"2023-12-12T09:22:49.317783+0000","last_clean":"2023-12-12T09:22:49.317783+0000","last_became_active":"2023-12-12T09:22:49.313073+0000","last_became_peered":"2023-12-12T09:22:49.313073+0000","last_unstale":"2023-12-12T09:22:49.317783+0000","last_undegraded":"2023-12-12T09:22:49.317783+0000","last_fullsized":"2023-12-12T09:22:49.317783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290799+0000","last_change":"2023-12-12T09:22:49.290799+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290799+0000","last_undegraded":"2023-12-12T09:22:49.290799+0000","last_fullsized":"2023-12-12T09:22:49.290799+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.307069+0000","last_change":"2023-12-12T09:22:49.297287+0000","last_active":"2023-12-12T09:22:49.307069+0000","last_peered":"2023-12-12T09:22:49.307069+0000","last_clean":"2023-12-12T09:22:49.307069+0000","last_became_active":"2023-12-12T09:22:49.296996+0000","last_became_peered":"2023-12-12T09:22:49.296996+0000","last_unstale":"2023-12-12T09:22:49.307069+0000","last_undegraded":"2023-12-12T09:22:49.307069+0000","last_fullsized":"2023-12-12T09:22:49.307069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:24.889220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293277+0000","last_change":"2023-12-12T09:22:49.293277+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293277+0000","last_undegraded":"2023-12-12T09:22:49.293277+0000","last_fullsized":"2023-12-12T09:22:49.293277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317286+0000","last_change":"2023-12-12T09:22:49.312112+0000","last_active":"2023-12-12T09:22:49.317286+0000","last_peered":"2023-12-12T09:22:49.317286+0000","last_clean":"2023-12-12T09:22:49.317286+0000","last_became_active":"2023-12-12T09:22:49.311865+0000","last_became_peered":"2023-12-12T09:22:49.311865+0000","last_unstale":"2023-12-12T09:22:49.317286+0000","last_undegraded":"2023-12-12T09:22:49.317286+0000","last_fullsized":"2023-12-12T09:22:49.317286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:05:48.316229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293907+0000","last_change":"2023-12-12T09:22:49.293907+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293907+0000","last_undegraded":"2023-12-12T09:22:49.293907+0000","last_fullsized":"2023-12-12T09:22:49.293907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314948+0000","last_change":"2023-12-12T09:22:49.314029+0000","last_active":"2023-12-12T09:22:49.314948+0000","last_peered":"2023-12-12T09:22:49.314948+0000","last_clean":"2023-12-12T09:22:49.314948+0000","last_became_active":"2023-12-12T09:22:49.313717+0000","last_became_peered":"2023-12-12T09:22:49.313717+0000","last_unstale":"2023-12-12T09:22:49.314948+0000","last_undegraded":"2023-12-12T09:22:49.314948+0000","last_fullsized":"2023-12-12T09:22:49.314948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:12:35.791620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-12T09:22:48.289462+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:22:48.289462+0000","last_peered":"2023-12-12T09:22:48.289462+0000","last_clean":"2023-12-12T09:22:48.289462+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:22:48.289462+0000","last_undegraded":"2023-12-12T09:22:48.289462+0000","last_fullsized":"2023-12-12T09:22:48.289462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1261568,"data_stored":888340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.036,"15min":1.0229999999999999},"min":{"1min":0.60299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.52,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2490000000000001,"15min":1.2829999999999999},"min":{"1min":0.89400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5900000000000001,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.288}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.024,"15min":0.98099999999999998},"min":{"1min":0.754,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.526,"5min":1.827,"15min":1.827},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.786,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.1080000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.137,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5960000000000001,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.92700000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.746,"5min":1.887,"15min":1.887},"last":1.266},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2270000000000001,"15min":1.246},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.621,"5min":2.355,"15min":2.355},"last":1.357}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3580000000000001},"min":{"1min":0.90600000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.696,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.351},"min":{"1min":0.872,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8069999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.321}]},{"osd":5,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.387,"15min":1.407},"min":{"1min":1.0700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.724,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.47},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.98599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7769999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.073}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.425,"15min":1.415},"min":{"1min":1.034,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9610000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.169},{"interface":"front","average":{"1min":1.577,"5min":1.472,"15min":1.4690000000000001},"min":{"1min":1.202,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8700000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.224}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.97399999999999998,"15min":0.94599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5029999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.429}]},{"osd":1,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.84099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.466},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.722,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.212}]},{"osd":2,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.196,"15min":1.1819999999999999},"min":{"1min":0.87,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.248},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.80000000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.635,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3480000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.198},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.679,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.282},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.363},"min":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1719999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.365,"15min":1.361},"min":{"1min":1.042,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8919999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.056},{"interface":"front","average":{"1min":1.288,"5min":1.268,"15min":1.2569999999999999},"min":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.925,"5min":1.996,"15min":1.996},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":1.087,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4430000000000001,"15min":1.4299999999999999},"min":{"1min":1.1970000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.5269999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.369,"15min":1.355},"min":{"1min":1.171,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.679,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.123},{"interface":"front","average":{"1min":1.504,"5min":1.4910000000000001,"15min":1.484},"min":{"1min":1.0920000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.837,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.494}]}]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.998,"15min":1.016},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.331,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.872},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.113,"15min":1.141},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5980000000000001,"5min":1.909,"15min":1.909},"last":1.2909999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.232},"min":{"1min":0.81799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.373,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7949999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7909999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.7589999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1830000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5960000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.335,"15min":1.3680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6950000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.633}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.284,"15min":1.266},"min":{"1min":1.0569999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9970000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.234},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4750000000000001,"15min":1.49},"min":{"1min":0.98499999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.79300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7669999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.46,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1680000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.569,"15min":1.581},"min":{"1min":1.1080000000000001,"5min":0.627,"15min":0.627},"max":{"1min":2.238,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0369999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.331,"15min":2.331},"last":1.696}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.151,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.538,"5min":1.633,"15min":1.633},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.119,"15min":1.123},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.669,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.68100000000000005}]},{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.194,"15min":1.1799999999999999},"min":{"1min":0.71999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.806,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.573},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.538,"5min":2.117,"15min":2.117},"last":1.3859999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.502,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.286}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.339,"15min":1.353},"min":{"1min":0.995,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7589999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.772},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7070000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":0.745}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.885,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.456},"min":{"1min":1.0149999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7230000000000001,"5min":3.343,"15min":3.343},"last":1.631}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.45,"15min":1.4930000000000001},"min":{"1min":1.0680000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.845,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.71},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5529999999999999,"15min":1.583},"min":{"1min":1.012,"5min":0.755,"15min":0.755},"max":{"1min":1.7629999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.5589999999999999,"15min":1.581},"min":{"1min":1.0529999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8029999999999999,"5min":3.085,"15min":3.085},"last":1.839},{"interface":"front","average":{"1min":1.429,"5min":1.5980000000000001,"15min":1.6519999999999999},"min":{"1min":1.1910000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.964,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.8180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88200000000000001,"15min":0.91300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4990000000000001,"5min":1.718,"15min":1.718},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.548,"5min":1.71,"15min":1.71},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":1.4419999999999999,"5min":1.575,"15min":1.575},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.071,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5609999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.482,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.222,"15min":1.24},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.956,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.0429999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3080000000000001},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.999},{"interface":"front","average":{"1min":1.274,"5min":1.29,"15min":1.284},"min":{"1min":0.871,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.623,"5min":1.73,"15min":1.73},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3069999999999999,"15min":1.3260000000000001},"min":{"1min":0.78400000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6639999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.429,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.81799999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0259999999999998,"5min":2.198,"15min":2.198},"last":1.1020000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3859999999999999,"15min":1.4019999999999999},"min":{"1min":0.93200000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6759999999999999,"5min":1.847,"15min":1.847},"last":0.753},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3740000000000001,"15min":1.3979999999999999},"min":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.768,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.94599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":0.52400000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.147}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.099}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.1619999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0800000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.504,"5min":1.613,"15min":1.613},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.048,"15min":1.05},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5369999999999999,"5min":2.903,"15min":2.903},"last":1.625}]},{"osd":3,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.998,"15min":1.002},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.341,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.90900000000000003,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4750000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.149,"15min":1.133},"min":{"1min":0.84899999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.167,"15min":1.165},"min":{"1min":0.67000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7430000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6379999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3109999999999999,"15min":1.3280000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6240000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.276}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3080000000000001,"15min":1.288},"min":{"1min":0.879,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0659999999999998,"5min":2.867,"15min":2.867},"last":1.712},{"interface":"front","average":{"1min":1.341,"5min":1.357,"15min":1.3640000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.835,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.681}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4119999999999999,"15min":1.4279999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7230000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.355,"15min":1.337},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1240000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.7669999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28240,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343600,"statfs":{"total":96636764160,"available":96607846400,"internally_reserved":0,"allocated":1249280,"data_stored":881753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.439,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.135,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.363,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.022}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.014,"15min":1.071},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.018,"15min":1.0429999999999999},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.371}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":1.6299999999999999,"5min":2.464,"15min":2.464},"last":0.97099999999999997}]},{"osd":4,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.232},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.621,"5min":2.343,"15min":2.343},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.22,"5min":1.341,"15min":1.375},"min":{"1min":0.82899999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.5629999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.1419999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3049999999999999,"15min":1.333},"min":{"1min":0.878,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.774,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.179},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7030000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.202}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4550000000000001,"15min":1.5029999999999999},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4970000000000001,"5min":2.573,"15min":2.573},"last":1.286},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3500000000000001,"15min":1.381},"min":{"1min":0.91600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.254}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4039999999999999,"15min":1.4319999999999999},"min":{"1min":0.90800000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.698,"5min":1.968,"15min":1.968},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.353,"15min":1.383},"min":{"1min":0.80100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7969999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:22:54.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:22:54.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.976+0000 7f60ee090640 1 Processor -- start 2023-12-12T09:22:54.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.976+0000 7f60ee090640 1 -- start start 2023-12-12T09:22:54.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60ee090640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f60e80b3090 0x7f60e815a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60ee090640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60e80713b0 0x7f60e8071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60ee090640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e8071d40 con 0x7f60e8143a90 2023-12-12T09:22:54.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60ee090640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e815ad50 con 0x7f60e80713b0 2023-12-12T09:22:54.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60ee090640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e8143e70 con 0x7f60e80b3090 2023-12-12T09:22:54.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60e7fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60e80713b0 0x7f60e8071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60e7fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f60e80713b0 0x7f60e8071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36982/0 (socket says 172.21.15.84:36982) 2023-12-12T09:22:54.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60e7fff640 1 -- 172.21.15.84:0/1598281779 learned_addr learned my addr 172.21.15.84:0/1598281779 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:54.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60deffd640 1 --2- 172.21.15.84:0/1598281779 >> v2:172.21.15.99:3300/0 conn(0x7f60e80b3090 0x7f60e815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60e7fff640 1 -- 172.21.15.84:0/1598281779 >> v2:172.21.15.99:3300/0 conn(0x7f60e80b3090 msgr2=0x7f60e815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:54.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60e7fff640 1 --2- 172.21.15.84:0/1598281779 >> v2:172.21.15.99:3300/0 conn(0x7f60e80b3090 0x7f60e815a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60e7fff640 1 -- 172.21.15.84:0/1598281779 >> v1:172.21.15.99:6789/0 conn(0x7f60e8143a90 legacy=0x7f60e80722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:54.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.978+0000 7f60e7fff640 1 -- 172.21.15.84:0/1598281779 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80b3670 con 0x7f60e80713b0 2023-12-12T09:22:54.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.980+0000 7f60e7fff640 1 --2- 172.21.15.84:0/1598281779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80713b0 0x7f60e8071800 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f60e80cc490 tx=0x7f60e002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1b4e7c0f0ee3c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.980+0000 7f60e6ffd640 1 -- 172.21.15.84:0/1598281779 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0031750 con 0x7f60e80713b0 2023-12-12T09:22:54.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.980+0000 7f60e6ffd640 1 -- 172.21.15.84:0/1598281779 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e00318b0 con 0x7f60e80713b0 2023-12-12T09:22:54.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.980+0000 7f60e6ffd640 1 -- 172.21.15.84:0/1598281779 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0031c40 con 0x7f60e80713b0 2023-12-12T09:22:54.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.980+0000 7f60ee090640 1 -- 172.21.15.84:0/1598281779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80713b0 msgr2=0x7f60e8071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.980+0000 7f60ee090640 1 --2- 172.21.15.84:0/1598281779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80713b0 0x7f60e8071800 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f60e80cc490 tx=0x7f60e002b7f0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.981+0000 7f60ee090640 1 -- 172.21.15.84:0/1598281779 shutdown_connections 2023-12-12T09:22:54.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.981+0000 7f60ee090640 1 --2- 172.21.15.84:0/1598281779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80713b0 0x7f60e8071800 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.981+0000 7f60ee090640 1 --2- 172.21.15.84:0/1598281779 >> v2:172.21.15.99:3300/0 conn(0x7f60e80b3090 0x7f60e815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.981+0000 7f60ee090640 1 -- 172.21.15.84:0/1598281779 >> 172.21.15.84:0/1598281779 conn(0x7f60e80b1d90 msgr2=0x7f60e80b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:54.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.981+0000 7f60ee090640 1 -- 172.21.15.84:0/1598281779 shutdown_connections 2023-12-12T09:22:54.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.981+0000 7f60ee090640 1 -- 172.21.15.84:0/1598281779 wait complete. 2023-12-12T09:22:54.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.983+0000 7f60ee090640 1 Processor -- start 2023-12-12T09:22:54.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.983+0000 7f60ee090640 1 -- start start 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.984+0000 7f60ee090640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e80713b0 0x7f60e80a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.984+0000 7f60ee090640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80b3090 0x7f60e815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.984+0000 7f60ee090640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e8143a90 0x7f60e80a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.984+0000 7f60ee090640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80a9560 con 0x7f60e80b3090 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.984+0000 7f60ee090640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80a9770 con 0x7f60e8143a90 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.984+0000 7f60ee090640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80a9a50 con 0x7f60e80713b0 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80b3090 0x7f60e815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80b3090 0x7f60e815ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36988/0 (socket says 172.21.15.84:36988) 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 -- 172.21.15.84:0/2246512633 learned_addr learned my addr 172.21.15.84:0/2246512633 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60e7fff640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e8143a90 0x7f60e80a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 -- 172.21.15.84:0/2246512633 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e80713b0 msgr2=0x7f60e80a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e80713b0 0x7f60e80a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 -- 172.21.15.84:0/2246512633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e8143a90 msgr2=0x7f60e80a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e8143a90 0x7f60e80a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 -- 172.21.15.84:0/2246512633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00094d0 con 0x7f60e80b3090 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60deffd640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80b3090 0x7f60e815ca80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c7f0 tx=0x7f60d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.985+0000 7f60e4ff9640 1 -- 172.21.15.84:0/2246512633 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0004220 con 0x7f60e80b3090 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.986+0000 7f60e4ff9640 1 -- 172.21.15.84:0/2246512633 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d00043a0 con 0x7f60e80b3090 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.986+0000 7f60e4ff9640 1 -- 172.21.15.84:0/2246512633 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d0007860 con 0x7f60e80b3090 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.986+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e815bfa0 con 0x7f60e80b3090 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.986+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e815c560 con 0x7f60e80b3090 2023-12-12T09:22:54.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.987+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8071800 con 0x7f60e80b3090 2023-12-12T09:22:54.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.988+0000 7f60e4ff9640 1 -- 172.21.15.84:0/2246512633 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60d0007bd0 con 0x7f60e80b3090 2023-12-12T09:22:54.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.989+0000 7f60e4ff9640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f60c806ae40 0x7f60c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:54.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.989+0000 7f60e4ff9640 1 -- 172.21.15.84:0/2246512633 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f60d0089820 con 0x7f60e80b3090 2023-12-12T09:22:54.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.989+0000 7f60e77fe640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f60c806ae40 0x7f60c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:54.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.990+0000 7f60e77fe640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f60c806ae40 0x7f60c806d300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f60d8001c60 tx=0x7f60d8007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:54.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:54.993+0000 7f60e4ff9640 1 -- 172.21.15.84:0/2246512633 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60d00546f0 con 0x7f60e80b3090 2023-12-12T09:22:55.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.178+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60e815d3c0 con 0x7f60c806ae40 2023-12-12T09:22:55.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.200+0000 7f60e4ff9640 1 -- 172.21.15.84:0/2246512633 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282077 (secure 0 0 0) 0x7f60e815d3c0 con 0x7f60c806ae40 2023-12-12T09:22:55.205 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:55.206 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f60c806ae40 msgr2=0x7f60c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f60c806ae40 0x7f60c806d300 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f60d8001c60 tx=0x7f60d8007d10 comp rx=0 tx=0).stop 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80b3090 msgr2=0x7f60e815ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80b3090 0x7f60e815ca80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f60d000c7f0 tx=0x7f60d000ccb0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 shutdown_connections 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60e8143a90 0x7f60e80a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f60c806ae40 0x7f60c806d300 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60e80b3090 0x7f60e815ca80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.206+0000 7f60ee090640 1 --2- 172.21.15.84:0/2246512633 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f60e80713b0 0x7f60e80a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.207+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 >> 172.21.15.84:0/2246512633 conn(0x7f60e80b1d90 msgr2=0x7f60e81428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.207+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 shutdown_connections 2023-12-12T09:22:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.207+0000 7f60ee090640 1 -- 172.21.15.84:0/2246512633 wait complete. 2023-12-12T09:22:55.227 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-12-12T09:22:55.139781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226744,"kb_used_data":6404,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747976,"statfs":{"total":773094113280,"available":772861927424,"internally_reserved":0,"allocated":6557696,"data_stored":3573834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001832"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303909+0000","last_change":"2023-12-12T09:22:49.303909+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303909+0000","last_undegraded":"2023-12-12T09:22:49.303909+0000","last_fullsized":"2023-12-12T09:22:49.303909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298669+0000","last_change":"2023-12-12T09:22:49.298669+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298669+0000","last_undegraded":"2023-12-12T09:22:49.298669+0000","last_fullsized":"2023-12-12T09:22:49.298669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294890+0000","last_change":"2023-12-12T09:22:49.294890+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294890+0000","last_undegraded":"2023-12-12T09:22:49.294890+0000","last_fullsized":"2023-12-12T09:22:49.294890+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306459+0000","last_change":"2023-12-12T09:22:49.306459+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306459+0000","last_undegraded":"2023-12-12T09:22:49.306459+0000","last_fullsized":"2023-12-12T09:22:49.306459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.304656+0000","last_change":"2023-12-12T09:22:49.304656+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.304656+0000","last_undegraded":"2023-12-12T09:22:49.304656+0000","last_fullsized":"2023-12-12T09:22:49.304656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038137+0000","last_change":"2023-12-12T09:22:50.348775+0000","last_active":"2023-12-12T09:22:52.038137+0000","last_peered":"2023-12-12T09:22:52.038137+0000","last_clean":"2023-12-12T09:22:52.038137+0000","last_became_active":"2023-12-12T09:22:50.348511+0000","last_became_peered":"2023-12-12T09:22:50.348511+0000","last_unstale":"2023-12-12T09:22:52.038137+0000","last_undegraded":"2023-12-12T09:22:52.038137+0000","last_fullsized":"2023-12-12T09:22:52.038137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:17:28.250406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289806+0000","last_change":"2023-12-12T09:22:49.289806+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289806+0000","last_undegraded":"2023-12-12T09:22:49.289806+0000","last_fullsized":"2023-12-12T09:22:49.289806+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299472+0000","last_change":"2023-12-12T09:22:49.299472+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299472+0000","last_undegraded":"2023-12-12T09:22:49.299472+0000","last_fullsized":"2023-12-12T09:22:49.299472+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290154+0000","last_change":"2023-12-12T09:22:49.290154+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290154+0000","last_undegraded":"2023-12-12T09:22:49.290154+0000","last_fullsized":"2023-12-12T09:22:49.290154+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289963+0000","last_change":"2023-12-12T09:22:49.289963+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289963+0000","last_undegraded":"2023-12-12T09:22:49.289963+0000","last_fullsized":"2023-12-12T09:22:49.289963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289977+0000","last_change":"2023-12-12T09:22:49.289977+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289977+0000","last_undegraded":"2023-12-12T09:22:49.289977+0000","last_fullsized":"2023-12-12T09:22:49.289977+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305962+0000","last_change":"2023-12-12T09:22:49.305962+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305962+0000","last_undegraded":"2023-12-12T09:22:49.305962+0000","last_fullsized":"2023-12-12T09:22:49.305962+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305646+0000","last_change":"2023-12-12T09:22:49.305646+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305646+0000","last_undegraded":"2023-12-12T09:22:49.305646+0000","last_fullsized":"2023-12-12T09:22:49.305646+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291490+0000","last_change":"2023-12-12T09:22:49.291490+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291490+0000","last_undegraded":"2023-12-12T09:22:49.291490+0000","last_fullsized":"2023-12-12T09:22:49.291490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288629+0000","last_change":"2023-12-12T09:22:49.288629+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288629+0000","last_undegraded":"2023-12-12T09:22:49.288629+0000","last_fullsized":"2023-12-12T09:22:49.288629+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036983+0000","last_change":"2023-12-12T09:22:50.341029+0000","last_active":"2023-12-12T09:22:52.036983+0000","last_peered":"2023-12-12T09:22:52.036983+0000","last_clean":"2023-12-12T09:22:52.036983+0000","last_became_active":"2023-12-12T09:22:50.340754+0000","last_became_peered":"2023-12-12T09:22:50.340754+0000","last_unstale":"2023-12-12T09:22:52.036983+0000","last_undegraded":"2023-12-12T09:22:52.036983+0000","last_fullsized":"2023-12-12T09:22:52.036983+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:23:41.648515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297986+0000","last_change":"2023-12-12T09:22:49.297986+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297986+0000","last_undegraded":"2023-12-12T09:22:49.297986+0000","last_fullsized":"2023-12-12T09:22:49.297986+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291848+0000","last_change":"2023-12-12T09:22:49.291848+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291848+0000","last_undegraded":"2023-12-12T09:22:49.291848+0000","last_fullsized":"2023-12-12T09:22:49.291848+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305479+0000","last_change":"2023-12-12T09:22:49.305479+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305479+0000","last_undegraded":"2023-12-12T09:22:49.305479+0000","last_fullsized":"2023-12-12T09:22:49.305479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298922+0000","last_change":"2023-12-12T09:22:49.298922+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298922+0000","last_undegraded":"2023-12-12T09:22:49.298922+0000","last_fullsized":"2023-12-12T09:22:49.298922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.292005+0000","last_change":"2023-12-12T09:22:49.292005+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.292005+0000","last_undegraded":"2023-12-12T09:22:49.292005+0000","last_fullsized":"2023-12-12T09:22:49.292005+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298407+0000","last_change":"2023-12-12T09:22:49.298407+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298407+0000","last_undegraded":"2023-12-12T09:22:49.298407+0000","last_fullsized":"2023-12-12T09:22:49.298407+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296981+0000","last_change":"2023-12-12T09:22:49.296981+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296981+0000","last_undegraded":"2023-12-12T09:22:49.296981+0000","last_fullsized":"2023-12-12T09:22:49.296981+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303738+0000","last_change":"2023-12-12T09:22:49.303738+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303738+0000","last_undegraded":"2023-12-12T09:22:49.303738+0000","last_fullsized":"2023-12-12T09:22:49.303738+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303408+0000","last_change":"2023-12-12T09:22:49.303408+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303408+0000","last_undegraded":"2023-12-12T09:22:49.303408+0000","last_fullsized":"2023-12-12T09:22:49.303408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306822+0000","last_change":"2023-12-12T09:22:49.306822+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306822+0000","last_undegraded":"2023-12-12T09:22:49.306822+0000","last_fullsized":"2023-12-12T09:22:49.306822+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039030+0000","last_change":"2023-12-12T09:22:50.343639+0000","last_active":"2023-12-12T09:22:52.039030+0000","last_peered":"2023-12-12T09:22:52.039030+0000","last_clean":"2023-12-12T09:22:52.039030+0000","last_became_active":"2023-12-12T09:22:50.343313+0000","last_became_peered":"2023-12-12T09:22:50.343313+0000","last_unstale":"2023-12-12T09:22:52.039030+0000","last_undegraded":"2023-12-12T09:22:52.039030+0000","last_fullsized":"2023-12-12T09:22:52.039030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:13.749849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302418+0000","last_change":"2023-12-12T09:22:49.302418+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302418+0000","last_undegraded":"2023-12-12T09:22:49.302418+0000","last_fullsized":"2023-12-12T09:22:49.302418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297665+0000","last_change":"2023-12-12T09:22:49.297665+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297665+0000","last_undegraded":"2023-12-12T09:22:49.297665+0000","last_fullsized":"2023-12-12T09:22:49.297665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.287879+0000","last_change":"2023-12-12T09:22:49.287879+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.287879+0000","last_undegraded":"2023-12-12T09:22:49.287879+0000","last_fullsized":"2023-12-12T09:22:49.287879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302482+0000","last_change":"2023-12-12T09:22:49.302482+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302482+0000","last_undegraded":"2023-12-12T09:22:49.302482+0000","last_fullsized":"2023-12-12T09:22:49.302482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037351+0000","last_change":"2023-12-12T09:22:50.351200+0000","last_active":"2023-12-12T09:22:52.037351+0000","last_peered":"2023-12-12T09:22:52.037351+0000","last_clean":"2023-12-12T09:22:52.037351+0000","last_became_active":"2023-12-12T09:22:50.350947+0000","last_became_peered":"2023-12-12T09:22:50.350947+0000","last_unstale":"2023-12-12T09:22:52.037351+0000","last_undegraded":"2023-12-12T09:22:52.037351+0000","last_fullsized":"2023-12-12T09:22:52.037351+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:11:21.528607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039271+0000","last_change":"2023-12-12T09:22:50.329672+0000","last_active":"2023-12-12T09:22:52.039271+0000","last_peered":"2023-12-12T09:22:52.039271+0000","last_clean":"2023-12-12T09:22:52.039271+0000","last_became_active":"2023-12-12T09:22:50.329338+0000","last_became_peered":"2023-12-12T09:22:50.329338+0000","last_unstale":"2023-12-12T09:22:52.039271+0000","last_undegraded":"2023-12-12T09:22:52.039271+0000","last_fullsized":"2023-12-12T09:22:52.039271+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:13.948023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.367755+0000","last_change":"2023-12-12T09:22:49.312219+0000","last_active":"2023-12-12T09:22:50.367755+0000","last_peered":"2023-12-12T09:22:50.367755+0000","last_clean":"2023-12-12T09:22:50.367755+0000","last_became_active":"2023-12-12T09:22:49.311828+0000","last_became_peered":"2023-12-12T09:22:49.311828+0000","last_unstale":"2023-12-12T09:22:50.367755+0000","last_undegraded":"2023-12-12T09:22:50.367755+0000","last_fullsized":"2023-12-12T09:22:50.367755+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:56:27.499035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290245+0000","last_change":"2023-12-12T09:22:49.290245+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290245+0000","last_undegraded":"2023-12-12T09:22:49.290245+0000","last_fullsized":"2023-12-12T09:22:49.290245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.315126+0000","last_change":"2023-12-12T09:22:49.306540+0000","last_active":"2023-12-12T09:22:49.315126+0000","last_peered":"2023-12-12T09:22:49.315126+0000","last_clean":"2023-12-12T09:22:49.315126+0000","last_became_active":"2023-12-12T09:22:49.306283+0000","last_became_peered":"2023-12-12T09:22:49.306283+0000","last_unstale":"2023-12-12T09:22:49.315126+0000","last_undegraded":"2023-12-12T09:22:49.315126+0000","last_fullsized":"2023-12-12T09:22:49.315126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:55:02.047149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038897+0000","last_change":"2023-12-12T09:22:50.338596+0000","last_active":"2023-12-12T09:22:52.038897+0000","last_peered":"2023-12-12T09:22:52.038897+0000","last_clean":"2023-12-12T09:22:52.038897+0000","last_became_active":"2023-12-12T09:22:50.338299+0000","last_became_peered":"2023-12-12T09:22:50.338299+0000","last_unstale":"2023-12-12T09:22:52.038897+0000","last_undegraded":"2023-12-12T09:22:52.038897+0000","last_fullsized":"2023-12-12T09:22:52.038897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:24.471730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.365300+0000","last_change":"2023-12-12T09:22:49.304758+0000","last_active":"2023-12-12T09:22:50.365300+0000","last_peered":"2023-12-12T09:22:50.365300+0000","last_clean":"2023-12-12T09:22:50.365300+0000","last_became_active":"2023-12-12T09:22:49.304487+0000","last_became_peered":"2023-12-12T09:22:49.304487+0000","last_unstale":"2023-12-12T09:22:50.365300+0000","last_undegraded":"2023-12-12T09:22:50.365300+0000","last_fullsized":"2023-12-12T09:22:50.365300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:53:35.402070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039094+0000","last_change":"2023-12-12T09:22:50.328018+0000","last_active":"2023-12-12T09:22:52.039094+0000","last_peered":"2023-12-12T09:22:52.039094+0000","last_clean":"2023-12-12T09:22:52.039094+0000","last_became_active":"2023-12-12T09:22:50.325156+0000","last_became_peered":"2023-12-12T09:22:50.325156+0000","last_unstale":"2023-12-12T09:22:52.039094+0000","last_undegraded":"2023-12-12T09:22:52.039094+0000","last_fullsized":"2023-12-12T09:22:52.039094+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:26.404747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321010+0000","last_change":"2023-12-12T09:22:49.314610+0000","last_active":"2023-12-12T09:22:49.321010+0000","last_peered":"2023-12-12T09:22:49.321010+0000","last_clean":"2023-12-12T09:22:49.321010+0000","last_became_active":"2023-12-12T09:22:49.314219+0000","last_became_peered":"2023-12-12T09:22:49.314219+0000","last_unstale":"2023-12-12T09:22:49.321010+0000","last_undegraded":"2023-12-12T09:22:49.321010+0000","last_fullsized":"2023-12-12T09:22:49.321010+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:03:00.594237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295735+0000","last_change":"2023-12-12T09:22:49.295735+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295735+0000","last_undegraded":"2023-12-12T09:22:49.295735+0000","last_fullsized":"2023-12-12T09:22:49.295735+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314985+0000","last_change":"2023-12-12T09:22:49.310785+0000","last_active":"2023-12-12T09:22:49.314985+0000","last_peered":"2023-12-12T09:22:49.314985+0000","last_clean":"2023-12-12T09:22:49.314985+0000","last_became_active":"2023-12-12T09:22:49.310210+0000","last_became_peered":"2023-12-12T09:22:49.310210+0000","last_unstale":"2023-12-12T09:22:49.314985+0000","last_undegraded":"2023-12-12T09:22:49.314985+0000","last_fullsized":"2023-12-12T09:22:49.314985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:19:51.198011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296927+0000","last_change":"2023-12-12T09:22:49.296927+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296927+0000","last_undegraded":"2023-12-12T09:22:49.296927+0000","last_fullsized":"2023-12-12T09:22:49.296927+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.362481+0000","last_change":"2023-12-12T09:22:49.313920+0000","last_active":"2023-12-12T09:22:50.362481+0000","last_peered":"2023-12-12T09:22:50.362481+0000","last_clean":"2023-12-12T09:22:50.362481+0000","last_became_active":"2023-12-12T09:22:49.313624+0000","last_became_peered":"2023-12-12T09:22:49.313624+0000","last_unstale":"2023-12-12T09:22:50.362481+0000","last_undegraded":"2023-12-12T09:22:50.362481+0000","last_fullsized":"2023-12-12T09:22:50.362481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:40.125862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302934+0000","last_change":"2023-12-12T09:22:49.302934+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302934+0000","last_undegraded":"2023-12-12T09:22:49.302934+0000","last_fullsized":"2023-12-12T09:22:49.302934+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320890+0000","last_change":"2023-12-12T09:22:49.312701+0000","last_active":"2023-12-12T09:22:49.320890+0000","last_peered":"2023-12-12T09:22:49.320890+0000","last_clean":"2023-12-12T09:22:49.320890+0000","last_became_active":"2023-12-12T09:22:49.312360+0000","last_became_peered":"2023-12-12T09:22:49.312360+0000","last_unstale":"2023-12-12T09:22:49.320890+0000","last_undegraded":"2023-12-12T09:22:49.320890+0000","last_fullsized":"2023-12-12T09:22:49.320890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296358+0000","last_change":"2023-12-12T09:22:49.296358+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296358+0000","last_undegraded":"2023-12-12T09:22:49.296358+0000","last_fullsized":"2023-12-12T09:22:49.296358+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.309557+0000","last_change":"2023-12-12T09:22:49.301866+0000","last_active":"2023-12-12T09:22:49.309557+0000","last_peered":"2023-12-12T09:22:49.309557+0000","last_clean":"2023-12-12T09:22:49.309557+0000","last_became_active":"2023-12-12T09:22:49.301545+0000","last_became_peered":"2023-12-12T09:22:49.301545+0000","last_unstale":"2023-12-12T09:22:49.309557+0000","last_undegraded":"2023-12-12T09:22:49.309557+0000","last_fullsized":"2023-12-12T09:22:49.309557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288573+0000","last_change":"2023-12-12T09:22:49.288573+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288573+0000","last_undegraded":"2023-12-12T09:22:49.288573+0000","last_fullsized":"2023-12-12T09:22:49.288573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319273+0000","last_change":"2023-12-12T09:22:49.317862+0000","last_active":"2023-12-12T09:22:49.319273+0000","last_peered":"2023-12-12T09:22:49.319273+0000","last_clean":"2023-12-12T09:22:49.319273+0000","last_became_active":"2023-12-12T09:22:49.317519+0000","last_became_peered":"2023-12-12T09:22:49.317519+0000","last_unstale":"2023-12-12T09:22:49.319273+0000","last_undegraded":"2023-12-12T09:22:49.319273+0000","last_fullsized":"2023-12-12T09:22:49.319273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295943+0000","last_change":"2023-12-12T09:22:49.295943+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295943+0000","last_undegraded":"2023-12-12T09:22:49.295943+0000","last_fullsized":"2023-12-12T09:22:49.295943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317133+0000","last_change":"2023-12-12T09:22:49.310163+0000","last_active":"2023-12-12T09:22:49.317133+0000","last_peered":"2023-12-12T09:22:49.317133+0000","last_clean":"2023-12-12T09:22:49.317133+0000","last_became_active":"2023-12-12T09:22:49.309844+0000","last_became_peered":"2023-12-12T09:22:49.309844+0000","last_unstale":"2023-12-12T09:22:49.317133+0000","last_undegraded":"2023-12-12T09:22:49.317133+0000","last_fullsized":"2023-12-12T09:22:49.317133+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:52.456770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291336+0000","last_change":"2023-12-12T09:22:49.291336+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291336+0000","last_undegraded":"2023-12-12T09:22:49.291336+0000","last_fullsized":"2023-12-12T09:22:49.291336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.316236+0000","last_change":"2023-12-12T09:22:49.312212+0000","last_active":"2023-12-12T09:22:49.316236+0000","last_peered":"2023-12-12T09:22:49.316236+0000","last_clean":"2023-12-12T09:22:49.316236+0000","last_became_active":"2023-12-12T09:22:49.311875+0000","last_became_peered":"2023-12-12T09:22:49.311875+0000","last_unstale":"2023-12-12T09:22:49.316236+0000","last_undegraded":"2023-12-12T09:22:49.316236+0000","last_fullsized":"2023-12-12T09:22:49.316236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294122+0000","last_change":"2023-12-12T09:22:49.294122+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294122+0000","last_undegraded":"2023-12-12T09:22:49.294122+0000","last_fullsized":"2023-12-12T09:22:49.294122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321523+0000","last_change":"2023-12-12T09:22:49.317782+0000","last_active":"2023-12-12T09:22:49.321523+0000","last_peered":"2023-12-12T09:22:49.321523+0000","last_clean":"2023-12-12T09:22:49.321523+0000","last_became_active":"2023-12-12T09:22:49.317482+0000","last_became_peered":"2023-12-12T09:22:49.317482+0000","last_unstale":"2023-12-12T09:22:49.321523+0000","last_undegraded":"2023-12-12T09:22:49.321523+0000","last_fullsized":"2023-12-12T09:22:49.321523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:43:40.240102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306769+0000","last_change":"2023-12-12T09:22:49.306769+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306769+0000","last_undegraded":"2023-12-12T09:22:49.306769+0000","last_fullsized":"2023-12-12T09:22:49.306769+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317195+0000","last_change":"2023-12-12T09:22:49.310312+0000","last_active":"2023-12-12T09:22:49.317195+0000","last_peered":"2023-12-12T09:22:49.317195+0000","last_clean":"2023-12-12T09:22:49.317195+0000","last_became_active":"2023-12-12T09:22:49.309975+0000","last_became_peered":"2023-12-12T09:22:49.309975+0000","last_unstale":"2023-12-12T09:22:49.317195+0000","last_undegraded":"2023-12-12T09:22:49.317195+0000","last_fullsized":"2023-12-12T09:22:49.317195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:44.355631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290680+0000","last_change":"2023-12-12T09:22:49.290680+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290680+0000","last_undegraded":"2023-12-12T09:22:49.290680+0000","last_fullsized":"2023-12-12T09:22:49.290680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319343+0000","last_change":"2023-12-12T09:22:49.317453+0000","last_active":"2023-12-12T09:22:49.319343+0000","last_peered":"2023-12-12T09:22:49.319343+0000","last_clean":"2023-12-12T09:22:49.319343+0000","last_became_active":"2023-12-12T09:22:49.317074+0000","last_became_peered":"2023-12-12T09:22:49.317074+0000","last_unstale":"2023-12-12T09:22:49.319343+0000","last_undegraded":"2023-12-12T09:22:49.319343+0000","last_fullsized":"2023-12-12T09:22:49.319343+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:10:30.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288497+0000","last_change":"2023-12-12T09:22:49.288497+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288497+0000","last_undegraded":"2023-12-12T09:22:49.288497+0000","last_fullsized":"2023-12-12T09:22:49.288497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320850+0000","last_change":"2023-12-12T09:22:49.312560+0000","last_active":"2023-12-12T09:22:49.320850+0000","last_peered":"2023-12-12T09:22:49.320850+0000","last_clean":"2023-12-12T09:22:49.320850+0000","last_became_active":"2023-12-12T09:22:49.312207+0000","last_became_peered":"2023-12-12T09:22:49.312207+0000","last_unstale":"2023-12-12T09:22:49.320850+0000","last_undegraded":"2023-12-12T09:22:49.320850+0000","last_fullsized":"2023-12-12T09:22:49.320850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:10:19.181850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.287797+0000","last_change":"2023-12-12T09:22:49.287797+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.287797+0000","last_undegraded":"2023-12-12T09:22:49.287797+0000","last_fullsized":"2023-12-12T09:22:49.287797+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.318667+0000","last_change":"2023-12-12T09:22:49.316431+0000","last_active":"2023-12-12T09:22:49.318667+0000","last_peered":"2023-12-12T09:22:49.318667+0000","last_clean":"2023-12-12T09:22:49.318667+0000","last_became_active":"2023-12-12T09:22:49.315687+0000","last_became_peered":"2023-12-12T09:22:49.315687+0000","last_unstale":"2023-12-12T09:22:49.318667+0000","last_undegraded":"2023-12-12T09:22:49.318667+0000","last_fullsized":"2023-12-12T09:22:49.318667+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:24.889220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290756+0000","last_change":"2023-12-12T09:22:49.290756+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290756+0000","last_undegraded":"2023-12-12T09:22:49.290756+0000","last_fullsized":"2023-12-12T09:22:49.290756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317252+0000","last_change":"2023-12-12T09:22:49.310717+0000","last_active":"2023-12-12T09:22:49.317252+0000","last_peered":"2023-12-12T09:22:49.317252+0000","last_clean":"2023-12-12T09:22:49.317252+0000","last_became_active":"2023-12-12T09:22:49.310424+0000","last_became_peered":"2023-12-12T09:22:49.310424+0000","last_unstale":"2023-12-12T09:22:49.317252+0000","last_undegraded":"2023-12-12T09:22:49.317252+0000","last_fullsized":"2023-12-12T09:22:49.317252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:04.604007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303028+0000","last_change":"2023-12-12T09:22:49.303028+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303028+0000","last_undegraded":"2023-12-12T09:22:49.303028+0000","last_fullsized":"2023-12-12T09:22:49.303028+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.365452+0000","last_change":"2023-12-12T09:22:49.311109+0000","last_active":"2023-12-12T09:22:50.365452+0000","last_peered":"2023-12-12T09:22:50.365452+0000","last_clean":"2023-12-12T09:22:50.365452+0000","last_became_active":"2023-12-12T09:22:49.310693+0000","last_became_peered":"2023-12-12T09:22:49.310693+0000","last_unstale":"2023-12-12T09:22:50.365452+0000","last_undegraded":"2023-12-12T09:22:50.365452+0000","last_fullsized":"2023-12-12T09:22:50.365452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:16.173389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295120+0000","last_change":"2023-12-12T09:22:49.295120+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295120+0000","last_undegraded":"2023-12-12T09:22:49.295120+0000","last_fullsized":"2023-12-12T09:22:49.295120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321054+0000","last_change":"2023-12-12T09:22:49.315722+0000","last_active":"2023-12-12T09:22:49.321054+0000","last_peered":"2023-12-12T09:22:49.321054+0000","last_clean":"2023-12-12T09:22:49.321054+0000","last_became_active":"2023-12-12T09:22:49.314425+0000","last_became_peered":"2023-12-12T09:22:49.314425+0000","last_unstale":"2023-12-12T09:22:49.321054+0000","last_undegraded":"2023-12-12T09:22:49.321054+0000","last_fullsized":"2023-12-12T09:22:49.321054+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:51.580255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.292875+0000","last_change":"2023-12-12T09:22:49.292875+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.292875+0000","last_undegraded":"2023-12-12T09:22:49.292875+0000","last_fullsized":"2023-12-12T09:22:49.292875+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.310526+0000","last_change":"2023-12-12T09:22:49.302394+0000","last_active":"2023-12-12T09:22:50.310526+0000","last_peered":"2023-12-12T09:22:50.310526+0000","last_clean":"2023-12-12T09:22:50.310526+0000","last_became_active":"2023-12-12T09:22:49.302117+0000","last_became_peered":"2023-12-12T09:22:49.302117+0000","last_unstale":"2023-12-12T09:22:50.310526+0000","last_undegraded":"2023-12-12T09:22:50.310526+0000","last_fullsized":"2023-12-12T09:22:50.310526+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.301414+0000","last_change":"2023-12-12T09:22:49.301414+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.301414+0000","last_undegraded":"2023-12-12T09:22:49.301414+0000","last_fullsized":"2023-12-12T09:22:49.301414+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.315008+0000","last_change":"2023-12-12T09:22:49.300566+0000","last_active":"2023-12-12T09:22:49.315008+0000","last_peered":"2023-12-12T09:22:49.315008+0000","last_clean":"2023-12-12T09:22:49.315008+0000","last_became_active":"2023-12-12T09:22:49.300278+0000","last_became_peered":"2023-12-12T09:22:49.300278+0000","last_unstale":"2023-12-12T09:22:49.315008+0000","last_undegraded":"2023-12-12T09:22:49.315008+0000","last_fullsized":"2023-12-12T09:22:49.315008+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:01:13.102148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038857+0000","last_change":"2023-12-12T09:22:50.349493+0000","last_active":"2023-12-12T09:22:52.038857+0000","last_peered":"2023-12-12T09:22:52.038857+0000","last_clean":"2023-12-12T09:22:52.038857+0000","last_became_active":"2023-12-12T09:22:50.347205+0000","last_became_peered":"2023-12-12T09:22:50.347205+0000","last_unstale":"2023-12-12T09:22:52.038857+0000","last_undegraded":"2023-12-12T09:22:52.038857+0000","last_fullsized":"2023-12-12T09:22:52.038857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:44:33.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314772+0000","last_change":"2023-12-12T09:22:49.309982+0000","last_active":"2023-12-12T09:22:49.314772+0000","last_peered":"2023-12-12T09:22:49.314772+0000","last_clean":"2023-12-12T09:22:49.314772+0000","last_became_active":"2023-12-12T09:22:49.309679+0000","last_became_peered":"2023-12-12T09:22:49.309679+0000","last_unstale":"2023-12-12T09:22:49.314772+0000","last_undegraded":"2023-12-12T09:22:49.314772+0000","last_fullsized":"2023-12-12T09:22:49.314772+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:55:48.543866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036737+0000","last_change":"2023-12-12T09:22:50.335580+0000","last_active":"2023-12-12T09:22:52.036737+0000","last_peered":"2023-12-12T09:22:52.036737+0000","last_clean":"2023-12-12T09:22:52.036737+0000","last_became_active":"2023-12-12T09:22:50.335285+0000","last_became_peered":"2023-12-12T09:22:50.335285+0000","last_unstale":"2023-12-12T09:22:52.036737+0000","last_undegraded":"2023-12-12T09:22:52.036737+0000","last_fullsized":"2023-12-12T09:22:52.036737+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:27:54.001510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321506+0000","last_change":"2023-12-12T09:22:49.318054+0000","last_active":"2023-12-12T09:22:49.321506+0000","last_peered":"2023-12-12T09:22:49.321506+0000","last_clean":"2023-12-12T09:22:49.321506+0000","last_became_active":"2023-12-12T09:22:49.316900+0000","last_became_peered":"2023-12-12T09:22:49.316900+0000","last_unstale":"2023-12-12T09:22:49.321506+0000","last_undegraded":"2023-12-12T09:22:49.321506+0000","last_fullsized":"2023-12-12T09:22:49.321506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:45.654672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299222+0000","last_change":"2023-12-12T09:22:49.299222+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299222+0000","last_undegraded":"2023-12-12T09:22:49.299222+0000","last_fullsized":"2023-12-12T09:22:49.299222+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.307970+0000","last_change":"2023-12-12T09:22:49.299101+0000","last_active":"2023-12-12T09:22:49.307970+0000","last_peered":"2023-12-12T09:22:49.307970+0000","last_clean":"2023-12-12T09:22:49.307970+0000","last_became_active":"2023-12-12T09:22:49.298806+0000","last_became_peered":"2023-12-12T09:22:49.298806+0000","last_unstale":"2023-12-12T09:22:49.307970+0000","last_undegraded":"2023-12-12T09:22:49.307970+0000","last_fullsized":"2023-12-12T09:22:49.307970+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:55:52.971722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302603+0000","last_change":"2023-12-12T09:22:49.302603+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302603+0000","last_undegraded":"2023-12-12T09:22:49.302603+0000","last_fullsized":"2023-12-12T09:22:49.302603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039456+0000","last_change":"2023-12-12T09:22:49.313836+0000","last_active":"2023-12-12T09:22:52.039456+0000","last_peered":"2023-12-12T09:22:52.039456+0000","last_clean":"2023-12-12T09:22:52.039456+0000","last_became_active":"2023-12-12T09:22:49.313538+0000","last_became_peered":"2023-12-12T09:22:49.313538+0000","last_unstale":"2023-12-12T09:22:52.039456+0000","last_undegraded":"2023-12-12T09:22:52.039456+0000","last_fullsized":"2023-12-12T09:22:52.039456+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:56:02.548586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290188+0000","last_change":"2023-12-12T09:22:49.290188+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290188+0000","last_undegraded":"2023-12-12T09:22:49.290188+0000","last_fullsized":"2023-12-12T09:22:49.290188+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319314+0000","last_change":"2023-12-12T09:22:49.316665+0000","last_active":"2023-12-12T09:22:49.319314+0000","last_peered":"2023-12-12T09:22:49.319314+0000","last_clean":"2023-12-12T09:22:49.319314+0000","last_became_active":"2023-12-12T09:22:49.315307+0000","last_became_peered":"2023-12-12T09:22:49.315307+0000","last_unstale":"2023-12-12T09:22:49.319314+0000","last_undegraded":"2023-12-12T09:22:49.319314+0000","last_fullsized":"2023-12-12T09:22:49.319314+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:55:31.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039416+0000","last_change":"2023-12-12T09:22:50.329797+0000","last_active":"2023-12-12T09:22:52.039416+0000","last_peered":"2023-12-12T09:22:52.039416+0000","last_clean":"2023-12-12T09:22:52.039416+0000","last_became_active":"2023-12-12T09:22:50.328986+0000","last_became_peered":"2023-12-12T09:22:50.328986+0000","last_unstale":"2023-12-12T09:22:52.039416+0000","last_undegraded":"2023-12-12T09:22:52.039416+0000","last_fullsized":"2023-12-12T09:22:52.039416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:39.866786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320981+0000","last_change":"2023-12-12T09:22:49.313997+0000","last_active":"2023-12-12T09:22:49.320981+0000","last_peered":"2023-12-12T09:22:49.320981+0000","last_clean":"2023-12-12T09:22:49.320981+0000","last_became_active":"2023-12-12T09:22:49.313632+0000","last_became_peered":"2023-12-12T09:22:49.313632+0000","last_unstale":"2023-12-12T09:22:49.320981+0000","last_undegraded":"2023-12-12T09:22:49.320981+0000","last_fullsized":"2023-12-12T09:22:49.320981+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:37.755816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293291+0000","last_change":"2023-12-12T09:22:49.293291+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293291+0000","last_undegraded":"2023-12-12T09:22:49.293291+0000","last_fullsized":"2023-12-12T09:22:49.293291+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319473+0000","last_change":"2023-12-12T09:22:49.312354+0000","last_active":"2023-12-12T09:22:49.319473+0000","last_peered":"2023-12-12T09:22:49.319473+0000","last_clean":"2023-12-12T09:22:49.319473+0000","last_became_active":"2023-12-12T09:22:49.312037+0000","last_became_peered":"2023-12-12T09:22:49.312037+0000","last_unstale":"2023-12-12T09:22:49.319473+0000","last_undegraded":"2023-12-12T09:22:49.319473+0000","last_fullsized":"2023-12-12T09:22:49.319473+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:57:05.839285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289547+0000","last_change":"2023-12-12T09:22:49.289547+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289547+0000","last_undegraded":"2023-12-12T09:22:49.289547+0000","last_fullsized":"2023-12-12T09:22:49.289547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317783+0000","last_change":"2023-12-12T09:22:49.313350+0000","last_active":"2023-12-12T09:22:49.317783+0000","last_peered":"2023-12-12T09:22:49.317783+0000","last_clean":"2023-12-12T09:22:49.317783+0000","last_became_active":"2023-12-12T09:22:49.313073+0000","last_became_peered":"2023-12-12T09:22:49.313073+0000","last_unstale":"2023-12-12T09:22:49.317783+0000","last_undegraded":"2023-12-12T09:22:49.317783+0000","last_fullsized":"2023-12-12T09:22:49.317783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290799+0000","last_change":"2023-12-12T09:22:49.290799+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290799+0000","last_undegraded":"2023-12-12T09:22:49.290799+0000","last_fullsized":"2023-12-12T09:22:49.290799+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.307069+0000","last_change":"2023-12-12T09:22:49.297287+0000","last_active":"2023-12-12T09:22:49.307069+0000","last_peered":"2023-12-12T09:22:49.307069+0000","last_clean":"2023-12-12T09:22:49.307069+0000","last_became_active":"2023-12-12T09:22:49.296996+0000","last_became_peered":"2023-12-12T09:22:49.296996+0000","last_unstale":"2023-12-12T09:22:49.307069+0000","last_undegraded":"2023-12-12T09:22:49.307069+0000","last_fullsized":"2023-12-12T09:22:49.307069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:24.889220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293277+0000","last_change":"2023-12-12T09:22:49.293277+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293277+0000","last_undegraded":"2023-12-12T09:22:49.293277+0000","last_fullsized":"2023-12-12T09:22:49.293277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317286+0000","last_change":"2023-12-12T09:22:49.312112+0000","last_active":"2023-12-12T09:22:49.317286+0000","last_peered":"2023-12-12T09:22:49.317286+0000","last_clean":"2023-12-12T09:22:49.317286+0000","last_became_active":"2023-12-12T09:22:49.311865+0000","last_became_peered":"2023-12-12T09:22:49.311865+0000","last_unstale":"2023-12-12T09:22:49.317286+0000","last_undegraded":"2023-12-12T09:22:49.317286+0000","last_fullsized":"2023-12-12T09:22:49.317286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:05:48.316229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293907+0000","last_change":"2023-12-12T09:22:49.293907+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293907+0000","last_undegraded":"2023-12-12T09:22:49.293907+0000","last_fullsized":"2023-12-12T09:22:49.293907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314948+0000","last_change":"2023-12-12T09:22:49.314029+0000","last_active":"2023-12-12T09:22:49.314948+0000","last_peered":"2023-12-12T09:22:49.314948+0000","last_clean":"2023-12-12T09:22:49.314948+0000","last_became_active":"2023-12-12T09:22:49.313717+0000","last_became_peered":"2023-12-12T09:22:49.313717+0000","last_unstale":"2023-12-12T09:22:49.314948+0000","last_undegraded":"2023-12-12T09:22:49.314948+0000","last_fullsized":"2023-12-12T09:22:49.314948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:12:35.791620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-12T09:22:48.289462+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:22:48.289462+0000","last_peered":"2023-12-12T09:22:48.289462+0000","last_clean":"2023-12-12T09:22:48.289462+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:22:48.289462+0000","last_undegraded":"2023-12-12T09:22:48.289462+0000","last_fullsized":"2023-12-12T09:22:48.289462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1261568,"data_stored":888340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.036,"15min":1.0229999999999999},"min":{"1min":0.60299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.52,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2490000000000001,"15min":1.2829999999999999},"min":{"1min":0.89400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5900000000000001,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.288}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.024,"15min":0.98099999999999998},"min":{"1min":0.754,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.526,"5min":1.827,"15min":1.827},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.786,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.1080000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.137,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5960000000000001,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.92700000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.746,"5min":1.887,"15min":1.887},"last":1.266},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2270000000000001,"15min":1.246},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.621,"5min":2.355,"15min":2.355},"last":1.357}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3580000000000001},"min":{"1min":0.90600000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.696,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.351},"min":{"1min":0.872,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8069999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.321}]},{"osd":5,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.387,"15min":1.407},"min":{"1min":1.0700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.724,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.47},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.98599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7769999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.073}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.425,"15min":1.415},"min":{"1min":1.034,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9610000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.169},{"interface":"front","average":{"1min":1.577,"5min":1.472,"15min":1.4690000000000001},"min":{"1min":1.202,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8700000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.224}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.97399999999999998,"15min":0.94599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5029999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.429}]},{"osd":1,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.84099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.466},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.722,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.212}]},{"osd":2,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.196,"15min":1.1819999999999999},"min":{"1min":0.87,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.248},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.80000000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.635,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3480000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.198},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.679,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.282},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.363},"min":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1719999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.365,"15min":1.361},"min":{"1min":1.042,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8919999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.056},{"interface":"front","average":{"1min":1.288,"5min":1.268,"15min":1.2569999999999999},"min":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.925,"5min":1.996,"15min":1.996},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":1.087,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4430000000000001,"15min":1.4299999999999999},"min":{"1min":1.1970000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.5269999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.369,"15min":1.355},"min":{"1min":1.171,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.679,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.123},{"interface":"front","average":{"1min":1.504,"5min":1.4910000000000001,"15min":1.484},"min":{"1min":1.0920000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.837,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.494}]}]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.998,"15min":1.016},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.331,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.872},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.113,"15min":1.141},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5980000000000001,"5min":1.909,"15min":1.909},"last":1.2909999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.232},"min":{"1min":0.81799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.373,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7949999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7909999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.7589999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1830000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5960000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.335,"15min":1.3680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6950000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.633}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.284,"15min":1.266},"min":{"1min":1.0569999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9970000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.234},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4750000000000001,"15min":1.49},"min":{"1min":0.98499999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.79300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7669999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.46,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1680000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.569,"15min":1.581},"min":{"1min":1.1080000000000001,"5min":0.627,"15min":0.627},"max":{"1min":2.238,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0369999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.331,"15min":2.331},"last":1.696}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.151,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.538,"5min":1.633,"15min":1.633},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.119,"15min":1.123},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.669,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.68100000000000005}]},{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.194,"15min":1.1799999999999999},"min":{"1min":0.71999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.806,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.573},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.538,"5min":2.117,"15min":2.117},"last":1.3859999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.502,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.286}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.339,"15min":1.353},"min":{"1min":0.995,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7589999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.772},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7070000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":0.745}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.885,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.456},"min":{"1min":1.0149999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7230000000000001,"5min":3.343,"15min":3.343},"last":1.631}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.45,"15min":1.4930000000000001},"min":{"1min":1.0680000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.845,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.71},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5529999999999999,"15min":1.583},"min":{"1min":1.012,"5min":0.755,"15min":0.755},"max":{"1min":1.7629999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.5589999999999999,"15min":1.581},"min":{"1min":1.0529999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8029999999999999,"5min":3.085,"15min":3.085},"last":1.839},{"interface":"front","average":{"1min":1.429,"5min":1.5980000000000001,"15min":1.6519999999999999},"min":{"1min":1.1910000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.964,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.8180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88200000000000001,"15min":0.91300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4990000000000001,"5min":1.718,"15min":1.718},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.548,"5min":1.71,"15min":1.71},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":1.4419999999999999,"5min":1.575,"15min":1.575},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.071,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5609999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.482,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.222,"15min":1.24},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.956,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.0429999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3080000000000001},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.999},{"interface":"front","average":{"1min":1.274,"5min":1.29,"15min":1.284},"min":{"1min":0.871,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.623,"5min":1.73,"15min":1.73},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3069999999999999,"15min":1.3260000000000001},"min":{"1min":0.78400000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6639999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.429,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.81799999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0259999999999998,"5min":2.198,"15min":2.198},"last":1.1020000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3859999999999999,"15min":1.4019999999999999},"min":{"1min":0.93200000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6759999999999999,"5min":1.847,"15min":1.847},"last":0.753},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3740000000000001,"15min":1.3979999999999999},"min":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.768,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.94599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":0.52400000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.147}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.099}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.1619999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0800000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.504,"5min":1.613,"15min":1.613},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.048,"15min":1.05},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5369999999999999,"5min":2.903,"15min":2.903},"last":1.625}]},{"osd":3,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.998,"15min":1.002},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.341,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.90900000000000003,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4750000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.149,"15min":1.133},"min":{"1min":0.84899999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.167,"15min":1.165},"min":{"1min":0.67000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7430000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6379999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3109999999999999,"15min":1.3280000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6240000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.276}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3080000000000001,"15min":1.288},"min":{"1min":0.879,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0659999999999998,"5min":2.867,"15min":2.867},"last":1.712},{"interface":"front","average":{"1min":1.341,"5min":1.357,"15min":1.3640000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.835,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.681}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4119999999999999,"15min":1.4279999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7230000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.355,"15min":1.337},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1240000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.7669999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1302528,"data_stored":904249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.439,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.135,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.363,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1519999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.014,"15min":1.071},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.018,"15min":1.0429999999999999},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.294},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":1.6299999999999999,"5min":2.464,"15min":2.464},"last":0.68100000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.232},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.621,"5min":2.343,"15min":2.343},"last":1.431},{"interface":"front","average":{"1min":1.22,"5min":1.341,"15min":1.375},"min":{"1min":0.82899999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.5629999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.879}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3049999999999999,"15min":1.333},"min":{"1min":0.878,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.774,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7030000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4550000000000001,"15min":1.5029999999999999},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4970000000000001,"5min":2.573,"15min":2.573},"last":1.331},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3500000000000001,"15min":1.381},"min":{"1min":0.91600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.2549999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4039999999999999,"15min":1.4319999999999999},"min":{"1min":0.90800000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.698,"5min":1.968,"15min":1.968},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.353,"15min":1.383},"min":{"1min":0.80100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7969999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:22:55.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:22:55.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.486+0000 7fa165b61640 1 Processor -- start 2023-12-12T09:22:55.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.487+0000 7fa165b61640 1 -- start start 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.488+0000 7fa165b61640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa160071bb0 0x7fa160071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.488+0000 7fa165b61640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa16013dae0 0x7fa16013f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.488+0000 7fa165b61640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600724d0 con 0x7fa1600ce330 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.488+0000 7fa165b61640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa160140270 con 0x7fa160071bb0 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.488+0000 7fa165b61640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600cd850 con 0x7fa16013dae0 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.488+0000 7fa15f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa160071bb0 0x7fa160071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.489+0000 7fa15f7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa160071bb0 0x7fa160071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36990/0 (socket says 172.21.15.84:36990) 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.489+0000 7fa15f7fe640 1 -- 172.21.15.84:0/381696223 learned_addr learned my addr 172.21.15.84:0/381696223 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:55.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.489+0000 7fa15f7fe640 1 -- 172.21.15.84:0/381696223 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa16013dae0 msgr2=0x7fa16013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.489+0000 7fa15f7fe640 1 --2- 172.21.15.84:0/381696223 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa16013dae0 0x7fa16013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.489+0000 7fa15f7fe640 1 -- 172.21.15.84:0/381696223 >> v1:172.21.15.99:6789/0 conn(0x7fa1600ce330 legacy=0x7fa16013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.489+0000 7fa15f7fe640 1 -- 172.21.15.84:0/381696223 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600cdb30 con 0x7fa160071bb0 2023-12-12T09:22:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.490+0000 7fa15f7fe640 1 --2- 172.21.15.84:0/381696223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160071f90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa150009870 tx=0x7fa15002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ae566fd0a0b3a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.490+0000 7fa15effd640 1 -- 172.21.15.84:0/381696223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150031640 con 0x7fa160071bb0 2023-12-12T09:22:55.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.490+0000 7fa15effd640 1 -- 172.21.15.84:0/381696223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1500317a0 con 0x7fa160071bb0 2023-12-12T09:22:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.490+0000 7fa15effd640 1 -- 172.21.15.84:0/381696223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150031b30 con 0x7fa160071bb0 2023-12-12T09:22:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.491+0000 7fa165b61640 1 -- 172.21.15.84:0/381696223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 msgr2=0x7fa160071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.491+0000 7fa165b61640 1 --2- 172.21.15.84:0/381696223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160071f90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa150009870 tx=0x7fa15002b8f0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.491+0000 7fa165b61640 1 -- 172.21.15.84:0/381696223 shutdown_connections 2023-12-12T09:22:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.491+0000 7fa165b61640 1 --2- 172.21.15.84:0/381696223 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa16013dae0 0x7fa16013f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.491+0000 7fa165b61640 1 --2- 172.21.15.84:0/381696223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160071f90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.491+0000 7fa165b61640 1 -- 172.21.15.84:0/381696223 >> 172.21.15.84:0/381696223 conn(0x7fa16006c3d0 msgr2=0x7fa16006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.491+0000 7fa165b61640 1 -- 172.21.15.84:0/381696223 shutdown_connections 2023-12-12T09:22:55.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.491+0000 7fa165b61640 1 -- 172.21.15.84:0/381696223 wait complete. 2023-12-12T09:22:55.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.493+0000 7fa165b61640 1 Processor -- start 2023-12-12T09:22:55.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.493+0000 7fa165b61640 1 -- start start 2023-12-12T09:22:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa165b61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160135ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa165b61640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1600ce330 0x7fa1601465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa165b61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1601e0220 0x7fa1601e06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa165b61640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601e1c60 con 0x7fa160071bb0 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa165b61640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601e0fe0 con 0x7fa1601e0220 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa165b61640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601e12c0 con 0x7fa1600ce330 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160135ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160135ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37002/0 (socket says 172.21.15.84:37002) 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15f7fe640 1 -- 172.21.15.84:0/1728588908 learned_addr learned my addr 172.21.15.84:0/1728588908 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa157fff640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1600ce330 0x7fa1601465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15f7fe640 1 -- 172.21.15.84:0/1728588908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1600ce330 msgr2=0x7fa1601465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15f7fe640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1600ce330 0x7fa1601465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15f7fe640 1 -- 172.21.15.84:0/1728588908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1601e0220 msgr2=0x7fa1601e06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15ffff640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1601e0220 0x7fa1601e06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15f7fe640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1601e0220 0x7fa1601e06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.495+0000 7fa15f7fe640 1 -- 172.21.15.84:0/1728588908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500094d0 con 0x7fa160071bb0 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.496+0000 7fa15f7fe640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160135ef0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa1500090b0 tx=0x7fa1500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.496+0000 7fa15cff9640 1 -- 172.21.15.84:0/1728588908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15003ac60 con 0x7fa160071bb0 2023-12-12T09:22:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.496+0000 7fa15cff9640 1 -- 172.21.15.84:0/1728588908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15003adc0 con 0x7fa160071bb0 2023-12-12T09:22:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.496+0000 7fa15cff9640 1 -- 172.21.15.84:0/1728588908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150044630 con 0x7fa160071bb0 2023-12-12T09:22:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.496+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1601e15a0 con 0x7fa160071bb0 2023-12-12T09:22:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.496+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa160146b30 con 0x7fa160071bb0 2023-12-12T09:22:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.497+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1601e1da0 con 0x7fa160071bb0 2023-12-12T09:22:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.498+0000 7fa15cff9640 1 -- 172.21.15.84:0/1728588908 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa15002f050 con 0x7fa160071bb0 2023-12-12T09:22:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.499+0000 7fa15cff9640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa14006ae40 0x7fa14006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.499+0000 7fa15cff9640 1 -- 172.21.15.84:0/1728588908 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa1500ab6f0 con 0x7fa160071bb0 2023-12-12T09:22:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.499+0000 7fa157fff640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa14006ae40 0x7fa14006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.500+0000 7fa157fff640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa14006ae40 0x7fa14006d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa1601539e0 tx=0x7fa148009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:55.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.503+0000 7fa15cff9640 1 -- 172.21.15.84:0/1728588908 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1601e1da0 con 0x7fa160071bb0 2023-12-12T09:22:55.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.688+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1600cd4d0 con 0x7fa14006ae40 2023-12-12T09:22:55.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.709+0000 7fa15cff9640 1 -- 172.21.15.84:0/1728588908 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282077 (secure 0 0 0) 0x7fa1480050d0 con 0x7fa14006ae40 2023-12-12T09:22:55.715 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:55.716 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:22:55.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa14006ae40 msgr2=0x7fa14006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa14006ae40 0x7fa14006d300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa1601539e0 tx=0x7fa148009040 comp rx=0 tx=0).stop 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 msgr2=0x7fa160135ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160135ef0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa1500090b0 tx=0x7fa1500046c0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 shutdown_connections 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1601e0220 0x7fa1601e06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa1600ce330 0x7fa1601465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa14006ae40 0x7fa14006d300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 --2- 172.21.15.84:0/1728588908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa160071bb0 0x7fa160135ef0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 >> 172.21.15.84:0/1728588908 conn(0x7fa16006c3d0 msgr2=0x7fa160070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 shutdown_connections 2023-12-12T09:22:55.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.715+0000 7fa165b61640 1 -- 172.21.15.84:0/1728588908 wait complete. 2023-12-12T09:22:55.737 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-12-12T09:22:55.139781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226744,"kb_used_data":6404,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747976,"statfs":{"total":773094113280,"available":772861927424,"internally_reserved":0,"allocated":6557696,"data_stored":3573834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001832"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303909+0000","last_change":"2023-12-12T09:22:49.303909+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303909+0000","last_undegraded":"2023-12-12T09:22:49.303909+0000","last_fullsized":"2023-12-12T09:22:49.303909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298669+0000","last_change":"2023-12-12T09:22:49.298669+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298669+0000","last_undegraded":"2023-12-12T09:22:49.298669+0000","last_fullsized":"2023-12-12T09:22:49.298669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294890+0000","last_change":"2023-12-12T09:22:49.294890+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294890+0000","last_undegraded":"2023-12-12T09:22:49.294890+0000","last_fullsized":"2023-12-12T09:22:49.294890+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306459+0000","last_change":"2023-12-12T09:22:49.306459+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306459+0000","last_undegraded":"2023-12-12T09:22:49.306459+0000","last_fullsized":"2023-12-12T09:22:49.306459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.304656+0000","last_change":"2023-12-12T09:22:49.304656+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.304656+0000","last_undegraded":"2023-12-12T09:22:49.304656+0000","last_fullsized":"2023-12-12T09:22:49.304656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038137+0000","last_change":"2023-12-12T09:22:50.348775+0000","last_active":"2023-12-12T09:22:52.038137+0000","last_peered":"2023-12-12T09:22:52.038137+0000","last_clean":"2023-12-12T09:22:52.038137+0000","last_became_active":"2023-12-12T09:22:50.348511+0000","last_became_peered":"2023-12-12T09:22:50.348511+0000","last_unstale":"2023-12-12T09:22:52.038137+0000","last_undegraded":"2023-12-12T09:22:52.038137+0000","last_fullsized":"2023-12-12T09:22:52.038137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:17:28.250406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289806+0000","last_change":"2023-12-12T09:22:49.289806+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289806+0000","last_undegraded":"2023-12-12T09:22:49.289806+0000","last_fullsized":"2023-12-12T09:22:49.289806+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299472+0000","last_change":"2023-12-12T09:22:49.299472+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299472+0000","last_undegraded":"2023-12-12T09:22:49.299472+0000","last_fullsized":"2023-12-12T09:22:49.299472+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290154+0000","last_change":"2023-12-12T09:22:49.290154+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290154+0000","last_undegraded":"2023-12-12T09:22:49.290154+0000","last_fullsized":"2023-12-12T09:22:49.290154+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289963+0000","last_change":"2023-12-12T09:22:49.289963+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289963+0000","last_undegraded":"2023-12-12T09:22:49.289963+0000","last_fullsized":"2023-12-12T09:22:49.289963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289977+0000","last_change":"2023-12-12T09:22:49.289977+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289977+0000","last_undegraded":"2023-12-12T09:22:49.289977+0000","last_fullsized":"2023-12-12T09:22:49.289977+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305962+0000","last_change":"2023-12-12T09:22:49.305962+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305962+0000","last_undegraded":"2023-12-12T09:22:49.305962+0000","last_fullsized":"2023-12-12T09:22:49.305962+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305646+0000","last_change":"2023-12-12T09:22:49.305646+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305646+0000","last_undegraded":"2023-12-12T09:22:49.305646+0000","last_fullsized":"2023-12-12T09:22:49.305646+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291490+0000","last_change":"2023-12-12T09:22:49.291490+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291490+0000","last_undegraded":"2023-12-12T09:22:49.291490+0000","last_fullsized":"2023-12-12T09:22:49.291490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288629+0000","last_change":"2023-12-12T09:22:49.288629+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288629+0000","last_undegraded":"2023-12-12T09:22:49.288629+0000","last_fullsized":"2023-12-12T09:22:49.288629+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036983+0000","last_change":"2023-12-12T09:22:50.341029+0000","last_active":"2023-12-12T09:22:52.036983+0000","last_peered":"2023-12-12T09:22:52.036983+0000","last_clean":"2023-12-12T09:22:52.036983+0000","last_became_active":"2023-12-12T09:22:50.340754+0000","last_became_peered":"2023-12-12T09:22:50.340754+0000","last_unstale":"2023-12-12T09:22:52.036983+0000","last_undegraded":"2023-12-12T09:22:52.036983+0000","last_fullsized":"2023-12-12T09:22:52.036983+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:23:41.648515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297986+0000","last_change":"2023-12-12T09:22:49.297986+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297986+0000","last_undegraded":"2023-12-12T09:22:49.297986+0000","last_fullsized":"2023-12-12T09:22:49.297986+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291848+0000","last_change":"2023-12-12T09:22:49.291848+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291848+0000","last_undegraded":"2023-12-12T09:22:49.291848+0000","last_fullsized":"2023-12-12T09:22:49.291848+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305479+0000","last_change":"2023-12-12T09:22:49.305479+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305479+0000","last_undegraded":"2023-12-12T09:22:49.305479+0000","last_fullsized":"2023-12-12T09:22:49.305479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298922+0000","last_change":"2023-12-12T09:22:49.298922+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298922+0000","last_undegraded":"2023-12-12T09:22:49.298922+0000","last_fullsized":"2023-12-12T09:22:49.298922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.292005+0000","last_change":"2023-12-12T09:22:49.292005+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.292005+0000","last_undegraded":"2023-12-12T09:22:49.292005+0000","last_fullsized":"2023-12-12T09:22:49.292005+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298407+0000","last_change":"2023-12-12T09:22:49.298407+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298407+0000","last_undegraded":"2023-12-12T09:22:49.298407+0000","last_fullsized":"2023-12-12T09:22:49.298407+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296981+0000","last_change":"2023-12-12T09:22:49.296981+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296981+0000","last_undegraded":"2023-12-12T09:22:49.296981+0000","last_fullsized":"2023-12-12T09:22:49.296981+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303738+0000","last_change":"2023-12-12T09:22:49.303738+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303738+0000","last_undegraded":"2023-12-12T09:22:49.303738+0000","last_fullsized":"2023-12-12T09:22:49.303738+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303408+0000","last_change":"2023-12-12T09:22:49.303408+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303408+0000","last_undegraded":"2023-12-12T09:22:49.303408+0000","last_fullsized":"2023-12-12T09:22:49.303408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306822+0000","last_change":"2023-12-12T09:22:49.306822+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306822+0000","last_undegraded":"2023-12-12T09:22:49.306822+0000","last_fullsized":"2023-12-12T09:22:49.306822+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039030+0000","last_change":"2023-12-12T09:22:50.343639+0000","last_active":"2023-12-12T09:22:52.039030+0000","last_peered":"2023-12-12T09:22:52.039030+0000","last_clean":"2023-12-12T09:22:52.039030+0000","last_became_active":"2023-12-12T09:22:50.343313+0000","last_became_peered":"2023-12-12T09:22:50.343313+0000","last_unstale":"2023-12-12T09:22:52.039030+0000","last_undegraded":"2023-12-12T09:22:52.039030+0000","last_fullsized":"2023-12-12T09:22:52.039030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:13.749849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302418+0000","last_change":"2023-12-12T09:22:49.302418+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302418+0000","last_undegraded":"2023-12-12T09:22:49.302418+0000","last_fullsized":"2023-12-12T09:22:49.302418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297665+0000","last_change":"2023-12-12T09:22:49.297665+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297665+0000","last_undegraded":"2023-12-12T09:22:49.297665+0000","last_fullsized":"2023-12-12T09:22:49.297665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.287879+0000","last_change":"2023-12-12T09:22:49.287879+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.287879+0000","last_undegraded":"2023-12-12T09:22:49.287879+0000","last_fullsized":"2023-12-12T09:22:49.287879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302482+0000","last_change":"2023-12-12T09:22:49.302482+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302482+0000","last_undegraded":"2023-12-12T09:22:49.302482+0000","last_fullsized":"2023-12-12T09:22:49.302482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037351+0000","last_change":"2023-12-12T09:22:50.351200+0000","last_active":"2023-12-12T09:22:52.037351+0000","last_peered":"2023-12-12T09:22:52.037351+0000","last_clean":"2023-12-12T09:22:52.037351+0000","last_became_active":"2023-12-12T09:22:50.350947+0000","last_became_peered":"2023-12-12T09:22:50.350947+0000","last_unstale":"2023-12-12T09:22:52.037351+0000","last_undegraded":"2023-12-12T09:22:52.037351+0000","last_fullsized":"2023-12-12T09:22:52.037351+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:11:21.528607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039271+0000","last_change":"2023-12-12T09:22:50.329672+0000","last_active":"2023-12-12T09:22:52.039271+0000","last_peered":"2023-12-12T09:22:52.039271+0000","last_clean":"2023-12-12T09:22:52.039271+0000","last_became_active":"2023-12-12T09:22:50.329338+0000","last_became_peered":"2023-12-12T09:22:50.329338+0000","last_unstale":"2023-12-12T09:22:52.039271+0000","last_undegraded":"2023-12-12T09:22:52.039271+0000","last_fullsized":"2023-12-12T09:22:52.039271+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:13.948023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.367755+0000","last_change":"2023-12-12T09:22:49.312219+0000","last_active":"2023-12-12T09:22:50.367755+0000","last_peered":"2023-12-12T09:22:50.367755+0000","last_clean":"2023-12-12T09:22:50.367755+0000","last_became_active":"2023-12-12T09:22:49.311828+0000","last_became_peered":"2023-12-12T09:22:49.311828+0000","last_unstale":"2023-12-12T09:22:50.367755+0000","last_undegraded":"2023-12-12T09:22:50.367755+0000","last_fullsized":"2023-12-12T09:22:50.367755+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:56:27.499035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290245+0000","last_change":"2023-12-12T09:22:49.290245+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290245+0000","last_undegraded":"2023-12-12T09:22:49.290245+0000","last_fullsized":"2023-12-12T09:22:49.290245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.315126+0000","last_change":"2023-12-12T09:22:49.306540+0000","last_active":"2023-12-12T09:22:49.315126+0000","last_peered":"2023-12-12T09:22:49.315126+0000","last_clean":"2023-12-12T09:22:49.315126+0000","last_became_active":"2023-12-12T09:22:49.306283+0000","last_became_peered":"2023-12-12T09:22:49.306283+0000","last_unstale":"2023-12-12T09:22:49.315126+0000","last_undegraded":"2023-12-12T09:22:49.315126+0000","last_fullsized":"2023-12-12T09:22:49.315126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:55:02.047149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038897+0000","last_change":"2023-12-12T09:22:50.338596+0000","last_active":"2023-12-12T09:22:52.038897+0000","last_peered":"2023-12-12T09:22:52.038897+0000","last_clean":"2023-12-12T09:22:52.038897+0000","last_became_active":"2023-12-12T09:22:50.338299+0000","last_became_peered":"2023-12-12T09:22:50.338299+0000","last_unstale":"2023-12-12T09:22:52.038897+0000","last_undegraded":"2023-12-12T09:22:52.038897+0000","last_fullsized":"2023-12-12T09:22:52.038897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:24.471730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.365300+0000","last_change":"2023-12-12T09:22:49.304758+0000","last_active":"2023-12-12T09:22:50.365300+0000","last_peered":"2023-12-12T09:22:50.365300+0000","last_clean":"2023-12-12T09:22:50.365300+0000","last_became_active":"2023-12-12T09:22:49.304487+0000","last_became_peered":"2023-12-12T09:22:49.304487+0000","last_unstale":"2023-12-12T09:22:50.365300+0000","last_undegraded":"2023-12-12T09:22:50.365300+0000","last_fullsized":"2023-12-12T09:22:50.365300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:53:35.402070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039094+0000","last_change":"2023-12-12T09:22:50.328018+0000","last_active":"2023-12-12T09:22:52.039094+0000","last_peered":"2023-12-12T09:22:52.039094+0000","last_clean":"2023-12-12T09:22:52.039094+0000","last_became_active":"2023-12-12T09:22:50.325156+0000","last_became_peered":"2023-12-12T09:22:50.325156+0000","last_unstale":"2023-12-12T09:22:52.039094+0000","last_undegraded":"2023-12-12T09:22:52.039094+0000","last_fullsized":"2023-12-12T09:22:52.039094+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:26.404747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321010+0000","last_change":"2023-12-12T09:22:49.314610+0000","last_active":"2023-12-12T09:22:49.321010+0000","last_peered":"2023-12-12T09:22:49.321010+0000","last_clean":"2023-12-12T09:22:49.321010+0000","last_became_active":"2023-12-12T09:22:49.314219+0000","last_became_peered":"2023-12-12T09:22:49.314219+0000","last_unstale":"2023-12-12T09:22:49.321010+0000","last_undegraded":"2023-12-12T09:22:49.321010+0000","last_fullsized":"2023-12-12T09:22:49.321010+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:03:00.594237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295735+0000","last_change":"2023-12-12T09:22:49.295735+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295735+0000","last_undegraded":"2023-12-12T09:22:49.295735+0000","last_fullsized":"2023-12-12T09:22:49.295735+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314985+0000","last_change":"2023-12-12T09:22:49.310785+0000","last_active":"2023-12-12T09:22:49.314985+0000","last_peered":"2023-12-12T09:22:49.314985+0000","last_clean":"2023-12-12T09:22:49.314985+0000","last_became_active":"2023-12-12T09:22:49.310210+0000","last_became_peered":"2023-12-12T09:22:49.310210+0000","last_unstale":"2023-12-12T09:22:49.314985+0000","last_undegraded":"2023-12-12T09:22:49.314985+0000","last_fullsized":"2023-12-12T09:22:49.314985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:19:51.198011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296927+0000","last_change":"2023-12-12T09:22:49.296927+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296927+0000","last_undegraded":"2023-12-12T09:22:49.296927+0000","last_fullsized":"2023-12-12T09:22:49.296927+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.362481+0000","last_change":"2023-12-12T09:22:49.313920+0000","last_active":"2023-12-12T09:22:50.362481+0000","last_peered":"2023-12-12T09:22:50.362481+0000","last_clean":"2023-12-12T09:22:50.362481+0000","last_became_active":"2023-12-12T09:22:49.313624+0000","last_became_peered":"2023-12-12T09:22:49.313624+0000","last_unstale":"2023-12-12T09:22:50.362481+0000","last_undegraded":"2023-12-12T09:22:50.362481+0000","last_fullsized":"2023-12-12T09:22:50.362481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:40.125862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302934+0000","last_change":"2023-12-12T09:22:49.302934+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302934+0000","last_undegraded":"2023-12-12T09:22:49.302934+0000","last_fullsized":"2023-12-12T09:22:49.302934+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320890+0000","last_change":"2023-12-12T09:22:49.312701+0000","last_active":"2023-12-12T09:22:49.320890+0000","last_peered":"2023-12-12T09:22:49.320890+0000","last_clean":"2023-12-12T09:22:49.320890+0000","last_became_active":"2023-12-12T09:22:49.312360+0000","last_became_peered":"2023-12-12T09:22:49.312360+0000","last_unstale":"2023-12-12T09:22:49.320890+0000","last_undegraded":"2023-12-12T09:22:49.320890+0000","last_fullsized":"2023-12-12T09:22:49.320890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296358+0000","last_change":"2023-12-12T09:22:49.296358+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296358+0000","last_undegraded":"2023-12-12T09:22:49.296358+0000","last_fullsized":"2023-12-12T09:22:49.296358+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.309557+0000","last_change":"2023-12-12T09:22:49.301866+0000","last_active":"2023-12-12T09:22:49.309557+0000","last_peered":"2023-12-12T09:22:49.309557+0000","last_clean":"2023-12-12T09:22:49.309557+0000","last_became_active":"2023-12-12T09:22:49.301545+0000","last_became_peered":"2023-12-12T09:22:49.301545+0000","last_unstale":"2023-12-12T09:22:49.309557+0000","last_undegraded":"2023-12-12T09:22:49.309557+0000","last_fullsized":"2023-12-12T09:22:49.309557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288573+0000","last_change":"2023-12-12T09:22:49.288573+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288573+0000","last_undegraded":"2023-12-12T09:22:49.288573+0000","last_fullsized":"2023-12-12T09:22:49.288573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319273+0000","last_change":"2023-12-12T09:22:49.317862+0000","last_active":"2023-12-12T09:22:49.319273+0000","last_peered":"2023-12-12T09:22:49.319273+0000","last_clean":"2023-12-12T09:22:49.319273+0000","last_became_active":"2023-12-12T09:22:49.317519+0000","last_became_peered":"2023-12-12T09:22:49.317519+0000","last_unstale":"2023-12-12T09:22:49.319273+0000","last_undegraded":"2023-12-12T09:22:49.319273+0000","last_fullsized":"2023-12-12T09:22:49.319273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295943+0000","last_change":"2023-12-12T09:22:49.295943+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295943+0000","last_undegraded":"2023-12-12T09:22:49.295943+0000","last_fullsized":"2023-12-12T09:22:49.295943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317133+0000","last_change":"2023-12-12T09:22:49.310163+0000","last_active":"2023-12-12T09:22:49.317133+0000","last_peered":"2023-12-12T09:22:49.317133+0000","last_clean":"2023-12-12T09:22:49.317133+0000","last_became_active":"2023-12-12T09:22:49.309844+0000","last_became_peered":"2023-12-12T09:22:49.309844+0000","last_unstale":"2023-12-12T09:22:49.317133+0000","last_undegraded":"2023-12-12T09:22:49.317133+0000","last_fullsized":"2023-12-12T09:22:49.317133+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:52.456770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291336+0000","last_change":"2023-12-12T09:22:49.291336+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291336+0000","last_undegraded":"2023-12-12T09:22:49.291336+0000","last_fullsized":"2023-12-12T09:22:49.291336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.316236+0000","last_change":"2023-12-12T09:22:49.312212+0000","last_active":"2023-12-12T09:22:49.316236+0000","last_peered":"2023-12-12T09:22:49.316236+0000","last_clean":"2023-12-12T09:22:49.316236+0000","last_became_active":"2023-12-12T09:22:49.311875+0000","last_became_peered":"2023-12-12T09:22:49.311875+0000","last_unstale":"2023-12-12T09:22:49.316236+0000","last_undegraded":"2023-12-12T09:22:49.316236+0000","last_fullsized":"2023-12-12T09:22:49.316236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294122+0000","last_change":"2023-12-12T09:22:49.294122+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294122+0000","last_undegraded":"2023-12-12T09:22:49.294122+0000","last_fullsized":"2023-12-12T09:22:49.294122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321523+0000","last_change":"2023-12-12T09:22:49.317782+0000","last_active":"2023-12-12T09:22:49.321523+0000","last_peered":"2023-12-12T09:22:49.321523+0000","last_clean":"2023-12-12T09:22:49.321523+0000","last_became_active":"2023-12-12T09:22:49.317482+0000","last_became_peered":"2023-12-12T09:22:49.317482+0000","last_unstale":"2023-12-12T09:22:49.321523+0000","last_undegraded":"2023-12-12T09:22:49.321523+0000","last_fullsized":"2023-12-12T09:22:49.321523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:43:40.240102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306769+0000","last_change":"2023-12-12T09:22:49.306769+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306769+0000","last_undegraded":"2023-12-12T09:22:49.306769+0000","last_fullsized":"2023-12-12T09:22:49.306769+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317195+0000","last_change":"2023-12-12T09:22:49.310312+0000","last_active":"2023-12-12T09:22:49.317195+0000","last_peered":"2023-12-12T09:22:49.317195+0000","last_clean":"2023-12-12T09:22:49.317195+0000","last_became_active":"2023-12-12T09:22:49.309975+0000","last_became_peered":"2023-12-12T09:22:49.309975+0000","last_unstale":"2023-12-12T09:22:49.317195+0000","last_undegraded":"2023-12-12T09:22:49.317195+0000","last_fullsized":"2023-12-12T09:22:49.317195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:44.355631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290680+0000","last_change":"2023-12-12T09:22:49.290680+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290680+0000","last_undegraded":"2023-12-12T09:22:49.290680+0000","last_fullsized":"2023-12-12T09:22:49.290680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319343+0000","last_change":"2023-12-12T09:22:49.317453+0000","last_active":"2023-12-12T09:22:49.319343+0000","last_peered":"2023-12-12T09:22:49.319343+0000","last_clean":"2023-12-12T09:22:49.319343+0000","last_became_active":"2023-12-12T09:22:49.317074+0000","last_became_peered":"2023-12-12T09:22:49.317074+0000","last_unstale":"2023-12-12T09:22:49.319343+0000","last_undegraded":"2023-12-12T09:22:49.319343+0000","last_fullsized":"2023-12-12T09:22:49.319343+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:10:30.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288497+0000","last_change":"2023-12-12T09:22:49.288497+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288497+0000","last_undegraded":"2023-12-12T09:22:49.288497+0000","last_fullsized":"2023-12-12T09:22:49.288497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320850+0000","last_change":"2023-12-12T09:22:49.312560+0000","last_active":"2023-12-12T09:22:49.320850+0000","last_peered":"2023-12-12T09:22:49.320850+0000","last_clean":"2023-12-12T09:22:49.320850+0000","last_became_active":"2023-12-12T09:22:49.312207+0000","last_became_peered":"2023-12-12T09:22:49.312207+0000","last_unstale":"2023-12-12T09:22:49.320850+0000","last_undegraded":"2023-12-12T09:22:49.320850+0000","last_fullsized":"2023-12-12T09:22:49.320850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:10:19.181850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.287797+0000","last_change":"2023-12-12T09:22:49.287797+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.287797+0000","last_undegraded":"2023-12-12T09:22:49.287797+0000","last_fullsized":"2023-12-12T09:22:49.287797+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.318667+0000","last_change":"2023-12-12T09:22:49.316431+0000","last_active":"2023-12-12T09:22:49.318667+0000","last_peered":"2023-12-12T09:22:49.318667+0000","last_clean":"2023-12-12T09:22:49.318667+0000","last_became_active":"2023-12-12T09:22:49.315687+0000","last_became_peered":"2023-12-12T09:22:49.315687+0000","last_unstale":"2023-12-12T09:22:49.318667+0000","last_undegraded":"2023-12-12T09:22:49.318667+0000","last_fullsized":"2023-12-12T09:22:49.318667+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:24.889220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290756+0000","last_change":"2023-12-12T09:22:49.290756+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290756+0000","last_undegraded":"2023-12-12T09:22:49.290756+0000","last_fullsized":"2023-12-12T09:22:49.290756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317252+0000","last_change":"2023-12-12T09:22:49.310717+0000","last_active":"2023-12-12T09:22:49.317252+0000","last_peered":"2023-12-12T09:22:49.317252+0000","last_clean":"2023-12-12T09:22:49.317252+0000","last_became_active":"2023-12-12T09:22:49.310424+0000","last_became_peered":"2023-12-12T09:22:49.310424+0000","last_unstale":"2023-12-12T09:22:49.317252+0000","last_undegraded":"2023-12-12T09:22:49.317252+0000","last_fullsized":"2023-12-12T09:22:49.317252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:04.604007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303028+0000","last_change":"2023-12-12T09:22:49.303028+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303028+0000","last_undegraded":"2023-12-12T09:22:49.303028+0000","last_fullsized":"2023-12-12T09:22:49.303028+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.365452+0000","last_change":"2023-12-12T09:22:49.311109+0000","last_active":"2023-12-12T09:22:50.365452+0000","last_peered":"2023-12-12T09:22:50.365452+0000","last_clean":"2023-12-12T09:22:50.365452+0000","last_became_active":"2023-12-12T09:22:49.310693+0000","last_became_peered":"2023-12-12T09:22:49.310693+0000","last_unstale":"2023-12-12T09:22:50.365452+0000","last_undegraded":"2023-12-12T09:22:50.365452+0000","last_fullsized":"2023-12-12T09:22:50.365452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:16.173389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295120+0000","last_change":"2023-12-12T09:22:49.295120+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295120+0000","last_undegraded":"2023-12-12T09:22:49.295120+0000","last_fullsized":"2023-12-12T09:22:49.295120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321054+0000","last_change":"2023-12-12T09:22:49.315722+0000","last_active":"2023-12-12T09:22:49.321054+0000","last_peered":"2023-12-12T09:22:49.321054+0000","last_clean":"2023-12-12T09:22:49.321054+0000","last_became_active":"2023-12-12T09:22:49.314425+0000","last_became_peered":"2023-12-12T09:22:49.314425+0000","last_unstale":"2023-12-12T09:22:49.321054+0000","last_undegraded":"2023-12-12T09:22:49.321054+0000","last_fullsized":"2023-12-12T09:22:49.321054+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:51.580255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.292875+0000","last_change":"2023-12-12T09:22:49.292875+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.292875+0000","last_undegraded":"2023-12-12T09:22:49.292875+0000","last_fullsized":"2023-12-12T09:22:49.292875+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.310526+0000","last_change":"2023-12-12T09:22:49.302394+0000","last_active":"2023-12-12T09:22:50.310526+0000","last_peered":"2023-12-12T09:22:50.310526+0000","last_clean":"2023-12-12T09:22:50.310526+0000","last_became_active":"2023-12-12T09:22:49.302117+0000","last_became_peered":"2023-12-12T09:22:49.302117+0000","last_unstale":"2023-12-12T09:22:50.310526+0000","last_undegraded":"2023-12-12T09:22:50.310526+0000","last_fullsized":"2023-12-12T09:22:50.310526+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.301414+0000","last_change":"2023-12-12T09:22:49.301414+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.301414+0000","last_undegraded":"2023-12-12T09:22:49.301414+0000","last_fullsized":"2023-12-12T09:22:49.301414+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.315008+0000","last_change":"2023-12-12T09:22:49.300566+0000","last_active":"2023-12-12T09:22:49.315008+0000","last_peered":"2023-12-12T09:22:49.315008+0000","last_clean":"2023-12-12T09:22:49.315008+0000","last_became_active":"2023-12-12T09:22:49.300278+0000","last_became_peered":"2023-12-12T09:22:49.300278+0000","last_unstale":"2023-12-12T09:22:49.315008+0000","last_undegraded":"2023-12-12T09:22:49.315008+0000","last_fullsized":"2023-12-12T09:22:49.315008+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:01:13.102148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038857+0000","last_change":"2023-12-12T09:22:50.349493+0000","last_active":"2023-12-12T09:22:52.038857+0000","last_peered":"2023-12-12T09:22:52.038857+0000","last_clean":"2023-12-12T09:22:52.038857+0000","last_became_active":"2023-12-12T09:22:50.347205+0000","last_became_peered":"2023-12-12T09:22:50.347205+0000","last_unstale":"2023-12-12T09:22:52.038857+0000","last_undegraded":"2023-12-12T09:22:52.038857+0000","last_fullsized":"2023-12-12T09:22:52.038857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:44:33.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314772+0000","last_change":"2023-12-12T09:22:49.309982+0000","last_active":"2023-12-12T09:22:49.314772+0000","last_peered":"2023-12-12T09:22:49.314772+0000","last_clean":"2023-12-12T09:22:49.314772+0000","last_became_active":"2023-12-12T09:22:49.309679+0000","last_became_peered":"2023-12-12T09:22:49.309679+0000","last_unstale":"2023-12-12T09:22:49.314772+0000","last_undegraded":"2023-12-12T09:22:49.314772+0000","last_fullsized":"2023-12-12T09:22:49.314772+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:55:48.543866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036737+0000","last_change":"2023-12-12T09:22:50.335580+0000","last_active":"2023-12-12T09:22:52.036737+0000","last_peered":"2023-12-12T09:22:52.036737+0000","last_clean":"2023-12-12T09:22:52.036737+0000","last_became_active":"2023-12-12T09:22:50.335285+0000","last_became_peered":"2023-12-12T09:22:50.335285+0000","last_unstale":"2023-12-12T09:22:52.036737+0000","last_undegraded":"2023-12-12T09:22:52.036737+0000","last_fullsized":"2023-12-12T09:22:52.036737+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:27:54.001510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321506+0000","last_change":"2023-12-12T09:22:49.318054+0000","last_active":"2023-12-12T09:22:49.321506+0000","last_peered":"2023-12-12T09:22:49.321506+0000","last_clean":"2023-12-12T09:22:49.321506+0000","last_became_active":"2023-12-12T09:22:49.316900+0000","last_became_peered":"2023-12-12T09:22:49.316900+0000","last_unstale":"2023-12-12T09:22:49.321506+0000","last_undegraded":"2023-12-12T09:22:49.321506+0000","last_fullsized":"2023-12-12T09:22:49.321506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:45.654672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299222+0000","last_change":"2023-12-12T09:22:49.299222+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299222+0000","last_undegraded":"2023-12-12T09:22:49.299222+0000","last_fullsized":"2023-12-12T09:22:49.299222+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.307970+0000","last_change":"2023-12-12T09:22:49.299101+0000","last_active":"2023-12-12T09:22:49.307970+0000","last_peered":"2023-12-12T09:22:49.307970+0000","last_clean":"2023-12-12T09:22:49.307970+0000","last_became_active":"2023-12-12T09:22:49.298806+0000","last_became_peered":"2023-12-12T09:22:49.298806+0000","last_unstale":"2023-12-12T09:22:49.307970+0000","last_undegraded":"2023-12-12T09:22:49.307970+0000","last_fullsized":"2023-12-12T09:22:49.307970+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:55:52.971722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302603+0000","last_change":"2023-12-12T09:22:49.302603+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302603+0000","last_undegraded":"2023-12-12T09:22:49.302603+0000","last_fullsized":"2023-12-12T09:22:49.302603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039456+0000","last_change":"2023-12-12T09:22:49.313836+0000","last_active":"2023-12-12T09:22:52.039456+0000","last_peered":"2023-12-12T09:22:52.039456+0000","last_clean":"2023-12-12T09:22:52.039456+0000","last_became_active":"2023-12-12T09:22:49.313538+0000","last_became_peered":"2023-12-12T09:22:49.313538+0000","last_unstale":"2023-12-12T09:22:52.039456+0000","last_undegraded":"2023-12-12T09:22:52.039456+0000","last_fullsized":"2023-12-12T09:22:52.039456+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:56:02.548586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290188+0000","last_change":"2023-12-12T09:22:49.290188+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290188+0000","last_undegraded":"2023-12-12T09:22:49.290188+0000","last_fullsized":"2023-12-12T09:22:49.290188+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319314+0000","last_change":"2023-12-12T09:22:49.316665+0000","last_active":"2023-12-12T09:22:49.319314+0000","last_peered":"2023-12-12T09:22:49.319314+0000","last_clean":"2023-12-12T09:22:49.319314+0000","last_became_active":"2023-12-12T09:22:49.315307+0000","last_became_peered":"2023-12-12T09:22:49.315307+0000","last_unstale":"2023-12-12T09:22:49.319314+0000","last_undegraded":"2023-12-12T09:22:49.319314+0000","last_fullsized":"2023-12-12T09:22:49.319314+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:55:31.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039416+0000","last_change":"2023-12-12T09:22:50.329797+0000","last_active":"2023-12-12T09:22:52.039416+0000","last_peered":"2023-12-12T09:22:52.039416+0000","last_clean":"2023-12-12T09:22:52.039416+0000","last_became_active":"2023-12-12T09:22:50.328986+0000","last_became_peered":"2023-12-12T09:22:50.328986+0000","last_unstale":"2023-12-12T09:22:52.039416+0000","last_undegraded":"2023-12-12T09:22:52.039416+0000","last_fullsized":"2023-12-12T09:22:52.039416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:39.866786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320981+0000","last_change":"2023-12-12T09:22:49.313997+0000","last_active":"2023-12-12T09:22:49.320981+0000","last_peered":"2023-12-12T09:22:49.320981+0000","last_clean":"2023-12-12T09:22:49.320981+0000","last_became_active":"2023-12-12T09:22:49.313632+0000","last_became_peered":"2023-12-12T09:22:49.313632+0000","last_unstale":"2023-12-12T09:22:49.320981+0000","last_undegraded":"2023-12-12T09:22:49.320981+0000","last_fullsized":"2023-12-12T09:22:49.320981+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:37.755816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293291+0000","last_change":"2023-12-12T09:22:49.293291+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293291+0000","last_undegraded":"2023-12-12T09:22:49.293291+0000","last_fullsized":"2023-12-12T09:22:49.293291+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319473+0000","last_change":"2023-12-12T09:22:49.312354+0000","last_active":"2023-12-12T09:22:49.319473+0000","last_peered":"2023-12-12T09:22:49.319473+0000","last_clean":"2023-12-12T09:22:49.319473+0000","last_became_active":"2023-12-12T09:22:49.312037+0000","last_became_peered":"2023-12-12T09:22:49.312037+0000","last_unstale":"2023-12-12T09:22:49.319473+0000","last_undegraded":"2023-12-12T09:22:49.319473+0000","last_fullsized":"2023-12-12T09:22:49.319473+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:57:05.839285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289547+0000","last_change":"2023-12-12T09:22:49.289547+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289547+0000","last_undegraded":"2023-12-12T09:22:49.289547+0000","last_fullsized":"2023-12-12T09:22:49.289547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317783+0000","last_change":"2023-12-12T09:22:49.313350+0000","last_active":"2023-12-12T09:22:49.317783+0000","last_peered":"2023-12-12T09:22:49.317783+0000","last_clean":"2023-12-12T09:22:49.317783+0000","last_became_active":"2023-12-12T09:22:49.313073+0000","last_became_peered":"2023-12-12T09:22:49.313073+0000","last_unstale":"2023-12-12T09:22:49.317783+0000","last_undegraded":"2023-12-12T09:22:49.317783+0000","last_fullsized":"2023-12-12T09:22:49.317783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290799+0000","last_change":"2023-12-12T09:22:49.290799+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290799+0000","last_undegraded":"2023-12-12T09:22:49.290799+0000","last_fullsized":"2023-12-12T09:22:49.290799+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.307069+0000","last_change":"2023-12-12T09:22:49.297287+0000","last_active":"2023-12-12T09:22:49.307069+0000","last_peered":"2023-12-12T09:22:49.307069+0000","last_clean":"2023-12-12T09:22:49.307069+0000","last_became_active":"2023-12-12T09:22:49.296996+0000","last_became_peered":"2023-12-12T09:22:49.296996+0000","last_unstale":"2023-12-12T09:22:49.307069+0000","last_undegraded":"2023-12-12T09:22:49.307069+0000","last_fullsized":"2023-12-12T09:22:49.307069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:24.889220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293277+0000","last_change":"2023-12-12T09:22:49.293277+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293277+0000","last_undegraded":"2023-12-12T09:22:49.293277+0000","last_fullsized":"2023-12-12T09:22:49.293277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317286+0000","last_change":"2023-12-12T09:22:49.312112+0000","last_active":"2023-12-12T09:22:49.317286+0000","last_peered":"2023-12-12T09:22:49.317286+0000","last_clean":"2023-12-12T09:22:49.317286+0000","last_became_active":"2023-12-12T09:22:49.311865+0000","last_became_peered":"2023-12-12T09:22:49.311865+0000","last_unstale":"2023-12-12T09:22:49.317286+0000","last_undegraded":"2023-12-12T09:22:49.317286+0000","last_fullsized":"2023-12-12T09:22:49.317286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:05:48.316229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293907+0000","last_change":"2023-12-12T09:22:49.293907+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293907+0000","last_undegraded":"2023-12-12T09:22:49.293907+0000","last_fullsized":"2023-12-12T09:22:49.293907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314948+0000","last_change":"2023-12-12T09:22:49.314029+0000","last_active":"2023-12-12T09:22:49.314948+0000","last_peered":"2023-12-12T09:22:49.314948+0000","last_clean":"2023-12-12T09:22:49.314948+0000","last_became_active":"2023-12-12T09:22:49.313717+0000","last_became_peered":"2023-12-12T09:22:49.313717+0000","last_unstale":"2023-12-12T09:22:49.314948+0000","last_undegraded":"2023-12-12T09:22:49.314948+0000","last_fullsized":"2023-12-12T09:22:49.314948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:12:35.791620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-12T09:22:48.289462+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:22:48.289462+0000","last_peered":"2023-12-12T09:22:48.289462+0000","last_clean":"2023-12-12T09:22:48.289462+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:22:48.289462+0000","last_undegraded":"2023-12-12T09:22:48.289462+0000","last_fullsized":"2023-12-12T09:22:48.289462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1261568,"data_stored":888340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.036,"15min":1.0229999999999999},"min":{"1min":0.60299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.52,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2490000000000001,"15min":1.2829999999999999},"min":{"1min":0.89400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5900000000000001,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.288}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.024,"15min":0.98099999999999998},"min":{"1min":0.754,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.526,"5min":1.827,"15min":1.827},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.786,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.1080000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.137,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5960000000000001,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.92700000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.746,"5min":1.887,"15min":1.887},"last":1.266},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2270000000000001,"15min":1.246},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.621,"5min":2.355,"15min":2.355},"last":1.357}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3580000000000001},"min":{"1min":0.90600000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.696,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.351},"min":{"1min":0.872,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8069999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.321}]},{"osd":5,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.387,"15min":1.407},"min":{"1min":1.0700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.724,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.47},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.98599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7769999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.073}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.425,"15min":1.415},"min":{"1min":1.034,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9610000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.169},{"interface":"front","average":{"1min":1.577,"5min":1.472,"15min":1.4690000000000001},"min":{"1min":1.202,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8700000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.224}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.97399999999999998,"15min":0.94599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5029999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.429}]},{"osd":1,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.84099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.466},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.722,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.212}]},{"osd":2,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.196,"15min":1.1819999999999999},"min":{"1min":0.87,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.248},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.80000000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.635,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3480000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.198},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.679,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.282},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.363},"min":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1719999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.365,"15min":1.361},"min":{"1min":1.042,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8919999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.056},{"interface":"front","average":{"1min":1.288,"5min":1.268,"15min":1.2569999999999999},"min":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.925,"5min":1.996,"15min":1.996},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":1.087,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4430000000000001,"15min":1.4299999999999999},"min":{"1min":1.1970000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.5269999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.369,"15min":1.355},"min":{"1min":1.171,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.679,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.123},{"interface":"front","average":{"1min":1.504,"5min":1.4910000000000001,"15min":1.484},"min":{"1min":1.0920000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.837,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.494}]}]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.998,"15min":1.016},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.331,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.872},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.113,"15min":1.141},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5980000000000001,"5min":1.909,"15min":1.909},"last":1.2909999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.232},"min":{"1min":0.81799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.373,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7949999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7909999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.7589999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1830000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5960000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.335,"15min":1.3680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6950000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.633}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.284,"15min":1.266},"min":{"1min":1.0569999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9970000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.234},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4750000000000001,"15min":1.49},"min":{"1min":0.98499999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.79300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7669999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.46,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1680000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.569,"15min":1.581},"min":{"1min":1.1080000000000001,"5min":0.627,"15min":0.627},"max":{"1min":2.238,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0369999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.331,"15min":2.331},"last":1.696}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.151,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.538,"5min":1.633,"15min":1.633},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.119,"15min":1.123},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.669,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.68100000000000005}]},{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.194,"15min":1.1799999999999999},"min":{"1min":0.71999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.806,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.573},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.538,"5min":2.117,"15min":2.117},"last":1.3859999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.502,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.286}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.339,"15min":1.353},"min":{"1min":0.995,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7589999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.772},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7070000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":0.745}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.885,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.456},"min":{"1min":1.0149999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7230000000000001,"5min":3.343,"15min":3.343},"last":1.631}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.45,"15min":1.4930000000000001},"min":{"1min":1.0680000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.845,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.71},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5529999999999999,"15min":1.583},"min":{"1min":1.012,"5min":0.755,"15min":0.755},"max":{"1min":1.7629999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.5589999999999999,"15min":1.581},"min":{"1min":1.0529999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8029999999999999,"5min":3.085,"15min":3.085},"last":1.839},{"interface":"front","average":{"1min":1.429,"5min":1.5980000000000001,"15min":1.6519999999999999},"min":{"1min":1.1910000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.964,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.8180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88200000000000001,"15min":0.91300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4990000000000001,"5min":1.718,"15min":1.718},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.548,"5min":1.71,"15min":1.71},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":1.4419999999999999,"5min":1.575,"15min":1.575},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.071,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5609999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.482,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.222,"15min":1.24},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.956,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.0429999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3080000000000001},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.999},{"interface":"front","average":{"1min":1.274,"5min":1.29,"15min":1.284},"min":{"1min":0.871,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.623,"5min":1.73,"15min":1.73},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3069999999999999,"15min":1.3260000000000001},"min":{"1min":0.78400000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6639999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.429,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.81799999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0259999999999998,"5min":2.198,"15min":2.198},"last":1.1020000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3859999999999999,"15min":1.4019999999999999},"min":{"1min":0.93200000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6759999999999999,"5min":1.847,"15min":1.847},"last":0.753},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3740000000000001,"15min":1.3979999999999999},"min":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.768,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.94599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":0.52400000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.147}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.099}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.1619999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0800000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.504,"5min":1.613,"15min":1.613},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.048,"15min":1.05},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5369999999999999,"5min":2.903,"15min":2.903},"last":1.625}]},{"osd":3,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.998,"15min":1.002},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.341,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.90900000000000003,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4750000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.149,"15min":1.133},"min":{"1min":0.84899999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.167,"15min":1.165},"min":{"1min":0.67000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7430000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6379999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3109999999999999,"15min":1.3280000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6240000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.276}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3080000000000001,"15min":1.288},"min":{"1min":0.879,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0659999999999998,"5min":2.867,"15min":2.867},"last":1.712},{"interface":"front","average":{"1min":1.341,"5min":1.357,"15min":1.3640000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.835,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.681}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4119999999999999,"15min":1.4279999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7230000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.355,"15min":1.337},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1240000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.7669999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1302528,"data_stored":904249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.439,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.135,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.363,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1519999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.014,"15min":1.071},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.018,"15min":1.0429999999999999},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.294},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":1.6299999999999999,"5min":2.464,"15min":2.464},"last":0.68100000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.232},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.621,"5min":2.343,"15min":2.343},"last":1.431},{"interface":"front","average":{"1min":1.22,"5min":1.341,"15min":1.375},"min":{"1min":0.82899999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.5629999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.879}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3049999999999999,"15min":1.333},"min":{"1min":0.878,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.774,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7030000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4550000000000001,"15min":1.5029999999999999},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4970000000000001,"5min":2.573,"15min":2.573},"last":1.331},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3500000000000001,"15min":1.381},"min":{"1min":0.91600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.2549999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4039999999999999,"15min":1.4319999999999999},"min":{"1min":0.90800000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.698,"5min":1.968,"15min":1.968},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.353,"15min":1.383},"min":{"1min":0.80100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7969999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:22:55.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-12-12T09:22:55.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.303909+0000', 'last_change': '2023-12-12T09:22:49.303909+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.303909+0000', 'last_undegraded': '2023-12-12T09:22:49.303909+0000', 'last_fullsized': '2023-12-12T09:22:49.303909+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:22:55.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-12-12T09:22:55.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.298669+0000', 'last_change': '2023-12-12T09:22:49.298669+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.298669+0000', 'last_undegraded': '2023-12-12T09:22:49.298669+0000', 'last_fullsized': '2023-12-12T09:22:49.298669+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-12-12T09:22:55.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.294890+0000', 'last_change': '2023-12-12T09:22:49.294890+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.294890+0000', 'last_undegraded': '2023-12-12T09:22:49.294890+0000', 'last_fullsized': '2023-12-12T09:22:49.294890+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.306459+0000', 'last_change': '2023-12-12T09:22:49.306459+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.306459+0000', 'last_undegraded': '2023-12-12T09:22:49.306459+0000', 'last_fullsized': '2023-12-12T09:22:49.306459+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.304656+0000', 'last_change': '2023-12-12T09:22:49.304656+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.304656+0000', 'last_undegraded': '2023-12-12T09:22:49.304656+0000', 'last_fullsized': '2023-12-12T09:22:49.304656+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.289806+0000', 'last_change': '2023-12-12T09:22:49.289806+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.289806+0000', 'last_undegraded': '2023-12-12T09:22:49.289806+0000', 'last_fullsized': '2023-12-12T09:22:49.289806+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.299472+0000', 'last_change': '2023-12-12T09:22:49.299472+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.299472+0000', 'last_undegraded': '2023-12-12T09:22:49.299472+0000', 'last_fullsized': '2023-12-12T09:22:49.299472+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.290154+0000', 'last_change': '2023-12-12T09:22:49.290154+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.290154+0000', 'last_undegraded': '2023-12-12T09:22:49.290154+0000', 'last_fullsized': '2023-12-12T09:22:49.290154+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-12-12T09:22:55.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.289963+0000', 'last_change': '2023-12-12T09:22:49.289963+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.289963+0000', 'last_undegraded': '2023-12-12T09:22:49.289963+0000', 'last_fullsized': '2023-12-12T09:22:49.289963+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.289977+0000', 'last_change': '2023-12-12T09:22:49.289977+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.289977+0000', 'last_undegraded': '2023-12-12T09:22:49.289977+0000', 'last_fullsized': '2023-12-12T09:22:49.289977+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.305962+0000', 'last_change': '2023-12-12T09:22:49.305962+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.305962+0000', 'last_undegraded': '2023-12-12T09:22:49.305962+0000', 'last_fullsized': '2023-12-12T09:22:49.305962+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.305646+0000', 'last_change': '2023-12-12T09:22:49.305646+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.305646+0000', 'last_undegraded': '2023-12-12T09:22:49.305646+0000', 'last_fullsized': '2023-12-12T09:22:49.305646+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.291490+0000', 'last_change': '2023-12-12T09:22:49.291490+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.291490+0000', 'last_undegraded': '2023-12-12T09:22:49.291490+0000', 'last_fullsized': '2023-12-12T09:22:49.291490+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.288629+0000', 'last_change': '2023-12-12T09:22:49.288629+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.288629+0000', 'last_undegraded': '2023-12-12T09:22:49.288629+0000', 'last_fullsized': '2023-12-12T09:22:49.288629+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.297986+0000', 'last_change': '2023-12-12T09:22:49.297986+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.297986+0000', 'last_undegraded': '2023-12-12T09:22:49.297986+0000', 'last_fullsized': '2023-12-12T09:22:49.297986+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.291848+0000', 'last_change': '2023-12-12T09:22:49.291848+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.291848+0000', 'last_undegraded': '2023-12-12T09:22:49.291848+0000', 'last_fullsized': '2023-12-12T09:22:49.291848+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.305479+0000', 'last_change': '2023-12-12T09:22:49.305479+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.305479+0000', 'last_undegraded': '2023-12-12T09:22:49.305479+0000', 'last_fullsized': '2023-12-12T09:22:49.305479+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.298922+0000', 'last_change': '2023-12-12T09:22:49.298922+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.298922+0000', 'last_undegraded': '2023-12-12T09:22:49.298922+0000', 'last_fullsized': '2023-12-12T09:22:49.298922+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.292005+0000', 'last_change': '2023-12-12T09:22:49.292005+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.292005+0000', 'last_undegraded': '2023-12-12T09:22:49.292005+0000', 'last_fullsized': '2023-12-12T09:22:49.292005+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.298407+0000', 'last_change': '2023-12-12T09:22:49.298407+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.298407+0000', 'last_undegraded': '2023-12-12T09:22:49.298407+0000', 'last_fullsized': '2023-12-12T09:22:49.298407+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.296981+0000', 'last_change': '2023-12-12T09:22:49.296981+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.296981+0000', 'last_undegraded': '2023-12-12T09:22:49.296981+0000', 'last_fullsized': '2023-12-12T09:22:49.296981+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.303738+0000', 'last_change': '2023-12-12T09:22:49.303738+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.303738+0000', 'last_undegraded': '2023-12-12T09:22:49.303738+0000', 'last_fullsized': '2023-12-12T09:22:49.303738+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.303408+0000', 'last_change': '2023-12-12T09:22:49.303408+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.303408+0000', 'last_undegraded': '2023-12-12T09:22:49.303408+0000', 'last_fullsized': '2023-12-12T09:22:49.303408+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.306822+0000', 'last_change': '2023-12-12T09:22:49.306822+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.306822+0000', 'last_undegraded': '2023-12-12T09:22:49.306822+0000', 'last_fullsized': '2023-12-12T09:22:49.306822+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.302418+0000', 'last_change': '2023-12-12T09:22:49.302418+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.302418+0000', 'last_undegraded': '2023-12-12T09:22:49.302418+0000', 'last_fullsized': '2023-12-12T09:22:49.302418+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.297665+0000', 'last_change': '2023-12-12T09:22:49.297665+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.297665+0000', 'last_undegraded': '2023-12-12T09:22:49.297665+0000', 'last_fullsized': '2023-12-12T09:22:49.297665+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.287879+0000', 'last_change': '2023-12-12T09:22:49.287879+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.287879+0000', 'last_undegraded': '2023-12-12T09:22:49.287879+0000', 'last_fullsized': '2023-12-12T09:22:49.287879+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.302482+0000', 'last_change': '2023-12-12T09:22:49.302482+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.302482+0000', 'last_undegraded': '2023-12-12T09:22:49.302482+0000', 'last_fullsized': '2023-12-12T09:22:49.302482+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.290245+0000', 'last_change': '2023-12-12T09:22:49.290245+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.290245+0000', 'last_undegraded': '2023-12-12T09:22:49.290245+0000', 'last_fullsized': '2023-12-12T09:22:49.290245+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.295735+0000', 'last_change': '2023-12-12T09:22:49.295735+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.295735+0000', 'last_undegraded': '2023-12-12T09:22:49.295735+0000', 'last_fullsized': '2023-12-12T09:22:49.295735+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.296927+0000', 'last_change': '2023-12-12T09:22:49.296927+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.296927+0000', 'last_undegraded': '2023-12-12T09:22:49.296927+0000', 'last_fullsized': '2023-12-12T09:22:49.296927+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.302934+0000', 'last_change': '2023-12-12T09:22:49.302934+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.302934+0000', 'last_undegraded': '2023-12-12T09:22:49.302934+0000', 'last_fullsized': '2023-12-12T09:22:49.302934+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.296358+0000', 'last_change': '2023-12-12T09:22:49.296358+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.296358+0000', 'last_undegraded': '2023-12-12T09:22:49.296358+0000', 'last_fullsized': '2023-12-12T09:22:49.296358+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-12-12T09:22:55.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.288573+0000', 'last_change': '2023-12-12T09:22:49.288573+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.288573+0000', 'last_undegraded': '2023-12-12T09:22:49.288573+0000', 'last_fullsized': '2023-12-12T09:22:49.288573+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.295943+0000', 'last_change': '2023-12-12T09:22:49.295943+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.295943+0000', 'last_undegraded': '2023-12-12T09:22:49.295943+0000', 'last_fullsized': '2023-12-12T09:22:49.295943+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.291336+0000', 'last_change': '2023-12-12T09:22:49.291336+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.291336+0000', 'last_undegraded': '2023-12-12T09:22:49.291336+0000', 'last_fullsized': '2023-12-12T09:22:49.291336+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.294122+0000', 'last_change': '2023-12-12T09:22:49.294122+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.294122+0000', 'last_undegraded': '2023-12-12T09:22:49.294122+0000', 'last_fullsized': '2023-12-12T09:22:49.294122+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.306769+0000', 'last_change': '2023-12-12T09:22:49.306769+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.306769+0000', 'last_undegraded': '2023-12-12T09:22:49.306769+0000', 'last_fullsized': '2023-12-12T09:22:49.306769+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.290680+0000', 'last_change': '2023-12-12T09:22:49.290680+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.290680+0000', 'last_undegraded': '2023-12-12T09:22:49.290680+0000', 'last_fullsized': '2023-12-12T09:22:49.290680+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-12-12T09:22:55.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.288497+0000', 'last_change': '2023-12-12T09:22:49.288497+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.288497+0000', 'last_undegraded': '2023-12-12T09:22:49.288497+0000', 'last_fullsized': '2023-12-12T09:22:49.288497+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.287797+0000', 'last_change': '2023-12-12T09:22:49.287797+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.287797+0000', 'last_undegraded': '2023-12-12T09:22:49.287797+0000', 'last_fullsized': '2023-12-12T09:22:49.287797+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.290756+0000', 'last_change': '2023-12-12T09:22:49.290756+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.290756+0000', 'last_undegraded': '2023-12-12T09:22:49.290756+0000', 'last_fullsized': '2023-12-12T09:22:49.290756+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.303028+0000', 'last_change': '2023-12-12T09:22:49.303028+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.303028+0000', 'last_undegraded': '2023-12-12T09:22:49.303028+0000', 'last_fullsized': '2023-12-12T09:22:49.303028+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.295120+0000', 'last_change': '2023-12-12T09:22:49.295120+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.295120+0000', 'last_undegraded': '2023-12-12T09:22:49.295120+0000', 'last_fullsized': '2023-12-12T09:22:49.295120+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.292875+0000', 'last_change': '2023-12-12T09:22:49.292875+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.292875+0000', 'last_undegraded': '2023-12-12T09:22:49.292875+0000', 'last_fullsized': '2023-12-12T09:22:49.292875+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-12-12T09:22:55.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.301414+0000', 'last_change': '2023-12-12T09:22:49.301414+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.301414+0000', 'last_undegraded': '2023-12-12T09:22:49.301414+0000', 'last_fullsized': '2023-12-12T09:22:49.301414+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.299222+0000', 'last_change': '2023-12-12T09:22:49.299222+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.299222+0000', 'last_undegraded': '2023-12-12T09:22:49.299222+0000', 'last_fullsized': '2023-12-12T09:22:49.299222+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.302603+0000', 'last_change': '2023-12-12T09:22:49.302603+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.302603+0000', 'last_undegraded': '2023-12-12T09:22:49.302603+0000', 'last_fullsized': '2023-12-12T09:22:49.302603+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.290188+0000', 'last_change': '2023-12-12T09:22:49.290188+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.290188+0000', 'last_undegraded': '2023-12-12T09:22:49.290188+0000', 'last_fullsized': '2023-12-12T09:22:49.290188+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.293291+0000', 'last_change': '2023-12-12T09:22:49.293291+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.293291+0000', 'last_undegraded': '2023-12-12T09:22:49.293291+0000', 'last_fullsized': '2023-12-12T09:22:49.293291+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.289547+0000', 'last_change': '2023-12-12T09:22:49.289547+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.289547+0000', 'last_undegraded': '2023-12-12T09:22:49.289547+0000', 'last_fullsized': '2023-12-12T09:22:49.289547+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-12-12T09:22:55.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.290799+0000', 'last_change': '2023-12-12T09:22:49.290799+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.290799+0000', 'last_undegraded': '2023-12-12T09:22:49.290799+0000', 'last_fullsized': '2023-12-12T09:22:49.290799+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-12T09:22:55.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-12-12T09:22:55.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.293277+0000', 'last_change': '2023-12-12T09:22:49.293277+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.293277+0000', 'last_undegraded': '2023-12-12T09:22:49.293277+0000', 'last_fullsized': '2023-12-12T09:22:49.293277+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-12-12T09:22:55.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2023-12-12T09:22:49.293907+0000', 'last_change': '2023-12-12T09:22:49.293907+0000', 'last_active': '2023-12-12T09:22:49.269891+0000', 'last_peered': '2023-12-12T09:22:49.269891+0000', 'last_clean': '2023-12-12T09:22:49.269891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-12T09:22:49.293907+0000', 'last_undegraded': '2023-12-12T09:22:49.293907+0000', 'last_fullsized': '2023-12-12T09:22:49.293907+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'last_clean_scrub_stamp': '2023-12-12T09:22:49.269891+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-12T09:22:55.751 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-12T09:22:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.991+0000 7faf61d9e640 1 Processor -- start 2023-12-12T09:22:55.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.991+0000 7faf61d9e640 1 -- start start 2023-12-12T09:22:55.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.992+0000 7faf61d9e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faf5c15f1d0 0x7faf5c0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.992+0000 7faf61d9e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c0cd920 0x7faf5c0706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.992+0000 7faf61d9e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c070240 con 0x7faf5c13dd70 2023-12-12T09:22:55.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.992+0000 7faf61d9e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0ce140 con 0x7faf5c15f1d0 2023-12-12T09:22:55.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.992+0000 7faf61d9e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0ce420 con 0x7faf5c0cd920 2023-12-12T09:22:55.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.992+0000 7faf60d9c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faf5c13dd70 0x7faf5c15eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51376/0 (socket says 172.21.15.84:51376) 2023-12-12T09:22:55.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.992+0000 7faf60d9c640 1 -- 172.21.15.84:0/2974649014 learned_addr learned my addr 172.21.15.84:0/2974649014 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf6159d640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c0cd920 0x7faf5c0706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5bfff640 1 --2- 172.21.15.84:0/2974649014 >> v2:172.21.15.99:3300/0 conn(0x7faf5c15f1d0 0x7faf5c0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797657117 0 0) 0x7faf5c070240 con 0x7faf5c13dd70 2023-12-12T09:22:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c003520 con 0x7faf5c13dd70 2023-12-12T09:22:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1627533970 0 0) 0x7faf4c003520 con 0x7faf5c13dd70 2023-12-12T09:22:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c0cd920 msgr2=0x7faf5c0706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c0cd920 0x7faf5c0706d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 >> v2:172.21.15.99:3300/0 conn(0x7faf5c15f1d0 msgr2=0x7faf5c0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 --2- 172.21.15.84:0/2974649014 >> v2:172.21.15.99:3300/0 conn(0x7faf5c15f1d0 0x7faf5c0cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0ce700 con 0x7faf5c13dd70 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7faf50001670 con 0x7faf5c13dd70 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 >> v1:172.21.15.84:6789/0 conn(0x7faf5c13dd70 legacy=0x7faf5c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c0cd920 0x7faf4c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.993+0000 7faf5b7fe640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c003ef0 0x7faf4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf5b7fe640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf4c004d00 0x7faf4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0ce140 con 0x7faf4c004d00 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0ce420 con 0x7faf4c003ef0 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c00b980 con 0x7faf5c0cd920 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf6159d640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf4c004d00 0x7faf4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf60d9c640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c0cd920 0x7faf4c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf5bfff640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c003ef0 0x7faf4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf6159d640 1 -- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c0cd920 msgr2=0x7faf4c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf6159d640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c0cd920 0x7faf4c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf6159d640 1 -- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c003ef0 msgr2=0x7faf4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf6159d640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c003ef0 0x7faf4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf6159d640 1 -- 172.21.15.84:0/2974649014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c003520 con 0x7faf4c004d00 2023-12-12T09:22:55.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.994+0000 7faf5bfff640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c003ef0 0x7faf4c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.995+0000 7faf6159d640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf4c004d00 0x7faf4c005180 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faf54009fc0 tx=0x7faf4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3947d2de4fe8549 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5402cc00 con 0x7faf4c004d00 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5400f040 con 0x7faf4c004d00 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf5b7fe640 1 -- 172.21.15.84:0/2974649014 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54034440 con 0x7faf4c004d00 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf61d9e640 1 -- 172.21.15.84:0/2974649014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf4c004d00 msgr2=0x7faf4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf61d9e640 1 --2- 172.21.15.84:0/2974649014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf4c004d00 0x7faf4c005180 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faf54009fc0 tx=0x7faf4c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf6159d640 1 -- 172.21.15.84:0/2974649014 reap_dead start 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf61d9e640 1 -- 172.21.15.84:0/2974649014 shutdown_connections 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf61d9e640 1 -- 172.21.15.84:0/2974649014 >> 172.21.15.84:0/2974649014 conn(0x7faf5c0b0780 msgr2=0x7faf5c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:55.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf61d9e640 1 -- 172.21.15.84:0/2974649014 shutdown_connections 2023-12-12T09:22:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.996+0000 7faf61d9e640 1 -- 172.21.15.84:0/2974649014 wait complete. 2023-12-12T09:22:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.998+0000 7faf61d9e640 1 Processor -- start 2023-12-12T09:22:56.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.998+0000 7faf61d9e640 1 -- start start 2023-12-12T09:22:56.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.999+0000 7faf61d9e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c004d00 0x7faf5c143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.999+0000 7faf61d9e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c15c700 0x7faf5c15d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.999+0000 7faf61d9e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5c15d8d0 0x7faf5c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.999+0000 7faf61d9e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c1430f0 con 0x7faf5c15d8d0 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.999+0000 7faf61d9e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c142790 con 0x7faf4c004d00 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:55.999+0000 7faf61d9e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c142a30 con 0x7faf5c15c700 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5c15d8d0 0x7faf5c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5c15d8d0 0x7faf5c1596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51682/0 (socket says 172.21.15.84:51682) 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 -- 172.21.15.84:0/1183097602 learned_addr learned my addr 172.21.15.84:0/1183097602 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 -- 172.21.15.84:0/1183097602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c15c700 msgr2=0x7faf5c15d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c15c700 0x7faf5c15d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 -- 172.21.15.84:0/1183097602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c004d00 msgr2=0x7faf5c143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c004d00 0x7faf5c143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 -- 172.21.15.84:0/1183097602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c142d10 con 0x7faf5c15d8d0 2023-12-12T09:22:56.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.000+0000 7faf6159d640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5c15d8d0 0x7faf5c1596b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7faf54037040 tx=0x7faf54009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:56.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.001+0000 7faf597fa640 1 -- 172.21.15.84:0/1183097602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5402cea0 con 0x7faf5c15d8d0 2023-12-12T09:22:56.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.001+0000 7faf597fa640 1 -- 172.21.15.84:0/1183097602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf54034ad0 con 0x7faf5c15d8d0 2023-12-12T09:22:56.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.001+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c15cb80 con 0x7faf5c15d8d0 2023-12-12T09:22:56.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.001+0000 7faf597fa640 1 -- 172.21.15.84:0/1183097602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54034e40 con 0x7faf5c15d8d0 2023-12-12T09:22:56.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.001+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c15dde0 con 0x7faf5c15d8d0 2023-12-12T09:22:56.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.002+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c0673c0 con 0x7faf5c15d8d0 2023-12-12T09:22:56.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.003+0000 7faf597fa640 1 -- 172.21.15.84:0/1183097602 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf54047460 con 0x7faf5c15d8d0 2023-12-12T09:22:56.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.004+0000 7faf597fa640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf4006ae40 0x7faf4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.004+0000 7faf597fa640 1 -- 172.21.15.84:0/1183097602 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faf540ab5b0 con 0x7faf5c15d8d0 2023-12-12T09:22:56.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.004+0000 7faf60d9c640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf4006ae40 0x7faf4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:56.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.005+0000 7faf60d9c640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf4006ae40 0x7faf4006d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faf500059b0 tx=0x7faf50001dd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:56.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.008+0000 7faf597fa640 1 -- 172.21.15.84:0/1183097602 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf54076510 con 0x7faf5c15d8d0 2023-12-12T09:22:56.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.268+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7faf5c071f80 con 0x7faf5c15d8d0 2023-12-12T09:22:56.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.269+0000 7faf597fa640 1 -- 172.21.15.84:0/1183097602 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1097 (secure 0 0 0) 0x7faf54079b30 con 0x7faf5c15d8d0 2023-12-12T09:22:56.270 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:56.270 INFO:teuthology.orchestra.run.smithi084.stdout:{"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":214,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1702372774,"num_in_osds":8,"osd_in_since":1702372765,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":54},{"state_name":"active+clean","count":43}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590950,"bytes_used":232185856,"bytes_avail":772861927424,"bytes_total":773094113280,"inactive_pgs_ratio":0.55670100450515747,"write_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":6237}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-12-12T09:22:29.132198+0000","services":{}},"progress_events":{}} 2023-12-12T09:22:56.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf4006ae40 msgr2=0x7faf4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf4006ae40 0x7faf4006d300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faf500059b0 tx=0x7faf50001dd0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5c15d8d0 msgr2=0x7faf5c1596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5c15d8d0 0x7faf5c1596b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7faf54037040 tx=0x7faf54009750 comp rx=0 tx=0).stop 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 shutdown_connections 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7faf4006ae40 0x7faf4006d300 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf5c15d8d0 0x7faf5c1596b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7faf5c15c700 0x7faf5c15d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 --2- 172.21.15.84:0/1183097602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf4c004d00 0x7faf5c143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 >> 172.21.15.84:0/1183097602 conn(0x7faf5c0b0780 msgr2=0x7faf5c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 shutdown_connections 2023-12-12T09:22:56.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.272+0000 7faf61d9e640 1 -- 172.21.15.84:0/1183097602 wait complete. 2023-12-12T09:22:56.290 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-12T09:22:56.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:22:56.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.503+0000 7f4337fff640 1 Processor -- start 2023-12-12T09:22:56.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.503+0000 7f4337fff640 1 -- start start 2023-12-12T09:22:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.505+0000 7f4337fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433806df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.505+0000 7f4337fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4338070f10 0x7f43380b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.505+0000 7f4337fff640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43381619e0 con 0x7f433814af30 2023-12-12T09:22:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.505+0000 7f4337fff640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433814b310 con 0x7f4338070f10 2023-12-12T09:22:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.505+0000 7f4337fff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4338070290 con 0x7f433806c480 2023-12-12T09:22:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.506+0000 7f43377fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4338070f10 0x7f43380b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.506+0000 7f43377fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4338070f10 0x7f43380b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:47150/0 (socket says 172.21.15.84:47150) 2023-12-12T09:22:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.506+0000 7f43377fe640 1 -- 172.21.15.84:0/30161094 learned_addr learned my addr 172.21.15.84:0/30161094 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:56.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.506+0000 7f43367fc640 1 --2- 172.21.15.84:0/30161094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433806df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.507+0000 7f43367fc640 1 -- 172.21.15.84:0/30161094 >> v2:172.21.15.99:3300/0 conn(0x7f4338070f10 msgr2=0x7f43380b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.507+0000 7f43367fc640 1 --2- 172.21.15.84:0/30161094 >> v2:172.21.15.99:3300/0 conn(0x7f4338070f10 0x7f43380b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.507+0000 7f43367fc640 1 -- 172.21.15.84:0/30161094 >> v1:172.21.15.99:6789/0 conn(0x7f433814af30 legacy=0x7f433806bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.507+0000 7f43367fc640 1 -- 172.21.15.84:0/30161094 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380713c0 con 0x7f433806c480 2023-12-12T09:22:56.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.507+0000 7f43377fe640 1 --2- 172.21.15.84:0/30161094 >> v2:172.21.15.99:3300/0 conn(0x7f4338070f10 0x7f43380b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:22:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.508+0000 7f43367fc640 1 --2- 172.21.15.84:0/30161094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433806df20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4320009d90 tx=0x7f432002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38fd9332bba06380 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:56.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.508+0000 7f4335ffb640 1 -- 172.21.15.84:0/30161094 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432002cc50 con 0x7f433806c480 2023-12-12T09:22:56.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.508+0000 7f4335ffb640 1 -- 172.21.15.84:0/30161094 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432002cdb0 con 0x7f433806c480 2023-12-12T09:22:56.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.508+0000 7f4335ffb640 1 -- 172.21.15.84:0/30161094 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320034660 con 0x7f433806c480 2023-12-12T09:22:56.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.509+0000 7f4337fff640 1 -- 172.21.15.84:0/30161094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 msgr2=0x7f433806df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.509+0000 7f4337fff640 1 --2- 172.21.15.84:0/30161094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433806df20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4320009d90 tx=0x7f432002bea0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.509+0000 7f4337fff640 1 -- 172.21.15.84:0/30161094 shutdown_connections 2023-12-12T09:22:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.509+0000 7f4337fff640 1 --2- 172.21.15.84:0/30161094 >> v2:172.21.15.99:3300/0 conn(0x7f4338070f10 0x7f43380b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.509+0000 7f4337fff640 1 --2- 172.21.15.84:0/30161094 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433806df20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.509+0000 7f4337fff640 1 -- 172.21.15.84:0/30161094 >> 172.21.15.84:0/30161094 conn(0x7f43380b07f0 msgr2=0x7f43380b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.509+0000 7f4337fff640 1 -- 172.21.15.84:0/30161094 shutdown_connections 2023-12-12T09:22:56.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.509+0000 7f4337fff640 1 -- 172.21.15.84:0/30161094 wait complete. 2023-12-12T09:22:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.511+0000 7f4337fff640 1 Processor -- start 2023-12-12T09:22:56.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.512+0000 7f4337fff640 1 -- start start 2023-12-12T09:22:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f4337fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f4337fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4338070f10 0x7f433815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f4337fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f433814af30 0x7f433815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f4337fff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433813eeb0 con 0x7f4338070f10 2023-12-12T09:22:56.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f4337fff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433813f430 con 0x7f433814af30 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f4337fff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4338164530 con 0x7f433806c480 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f43367fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4338070f10 0x7f433815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f43367fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4338070f10 0x7f433815ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51684/0 (socket says 172.21.15.84:51684) 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.513+0000 7f43367fc640 1 -- 172.21.15.84:0/2993633793 learned_addr learned my addr 172.21.15.84:0/2993633793 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f4336ffd640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f43377fe640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f433814af30 0x7f433815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f43367fc640 1 -- 172.21.15.84:0/2993633793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 msgr2=0x7f433815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f43367fc640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f43367fc640 1 -- 172.21.15.84:0/2993633793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f433814af30 msgr2=0x7f433815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f43367fc640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f433814af30 0x7f433815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f43367fc640 1 -- 172.21.15.84:0/2993633793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300094d0 con 0x7f4338070f10 2023-12-12T09:22:56.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f43367fc640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4338070f10 0x7f433815ccc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4320009eb0 tx=0x7f4320004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f432f7fe640 1 -- 172.21.15.84:0/2993633793 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432003e610 con 0x7f4338070f10 2023-12-12T09:22:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f432f7fe640 1 -- 172.21.15.84:0/2993633793 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432003e770 con 0x7f4338070f10 2023-12-12T09:22:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f432f7fe640 1 -- 172.21.15.84:0/2993633793 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432003eae0 con 0x7f4338070f10 2023-12-12T09:22:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.514+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4320009a70 con 0x7f4338070f10 2023-12-12T09:22:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.515+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433813f0c0 con 0x7f4338070f10 2023-12-12T09:22:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.516+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4338072090 con 0x7f4338070f10 2023-12-12T09:22:56.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.517+0000 7f432f7fe640 1 -- 172.21.15.84:0/2993633793 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f432003b050 con 0x7f4338070f10 2023-12-12T09:22:56.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.517+0000 7f432f7fe640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f431806ae70 0x7f431806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:56.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.517+0000 7f432f7fe640 1 -- 172.21.15.84:0/2993633793 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f43200ac040 con 0x7f4338070f10 2023-12-12T09:22:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.518+0000 7f4336ffd640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f431806ae70 0x7f431806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:56.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.518+0000 7f4336ffd640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f431806ae70 0x7f431806d330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4328007fd0 tx=0x7f4328009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:56.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.522+0000 7f432f7fe640 1 -- 172.21.15.84:0/2993633793 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4320076fb0 con 0x7f4338070f10 2023-12-12T09:22:56.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.707+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43380b1af0 con 0x7f431806ae70 2023-12-12T09:22:56.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.723+0000 7f432f7fe640 1 -- 172.21.15.84:0/2993633793 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282077 (secure 0 0 0) 0x7f43280050d0 con 0x7f431806ae70 2023-12-12T09:22:56.728 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:22:56.729 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:22:56.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f431806ae70 msgr2=0x7f431806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f431806ae70 0x7f431806d330 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4328007fd0 tx=0x7f4328009040 comp rx=0 tx=0).stop 2023-12-12T09:22:56.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4338070f10 msgr2=0x7f433815ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:56.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4338070f10 0x7f433815ccc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4320009eb0 tx=0x7f4320004a40 comp rx=0 tx=0).stop 2023-12-12T09:22:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 shutdown_connections 2023-12-12T09:22:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f433814af30 0x7f433815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f431806ae70 0x7f431806d330 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4338070f10 0x7f433815ccc0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 --2- 172.21.15.84:0/2993633793 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f433806c480 0x7f433815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 >> 172.21.15.84:0/2993633793 conn(0x7f43380b07f0 msgr2=0x7f43380b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 shutdown_connections 2023-12-12T09:22:56.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:56.729+0000 7f4337fff640 1 -- 172.21.15.84:0/2993633793 wait complete. 2023-12-12T09:22:56.751 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-12-12T09:22:55.139781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":170,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226744,"kb_used_data":6404,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747976,"statfs":{"total":773094113280,"available":772861927424,"internally_reserved":0,"allocated":6557696,"data_stored":3573834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001832"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303909+0000","last_change":"2023-12-12T09:22:49.303909+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303909+0000","last_undegraded":"2023-12-12T09:22:49.303909+0000","last_fullsized":"2023-12-12T09:22:49.303909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298669+0000","last_change":"2023-12-12T09:22:49.298669+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298669+0000","last_undegraded":"2023-12-12T09:22:49.298669+0000","last_fullsized":"2023-12-12T09:22:49.298669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294890+0000","last_change":"2023-12-12T09:22:49.294890+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294890+0000","last_undegraded":"2023-12-12T09:22:49.294890+0000","last_fullsized":"2023-12-12T09:22:49.294890+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306459+0000","last_change":"2023-12-12T09:22:49.306459+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306459+0000","last_undegraded":"2023-12-12T09:22:49.306459+0000","last_fullsized":"2023-12-12T09:22:49.306459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.304656+0000","last_change":"2023-12-12T09:22:49.304656+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.304656+0000","last_undegraded":"2023-12-12T09:22:49.304656+0000","last_fullsized":"2023-12-12T09:22:49.304656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038137+0000","last_change":"2023-12-12T09:22:50.348775+0000","last_active":"2023-12-12T09:22:52.038137+0000","last_peered":"2023-12-12T09:22:52.038137+0000","last_clean":"2023-12-12T09:22:52.038137+0000","last_became_active":"2023-12-12T09:22:50.348511+0000","last_became_peered":"2023-12-12T09:22:50.348511+0000","last_unstale":"2023-12-12T09:22:52.038137+0000","last_undegraded":"2023-12-12T09:22:52.038137+0000","last_fullsized":"2023-12-12T09:22:52.038137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:17:28.250406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289806+0000","last_change":"2023-12-12T09:22:49.289806+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289806+0000","last_undegraded":"2023-12-12T09:22:49.289806+0000","last_fullsized":"2023-12-12T09:22:49.289806+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299472+0000","last_change":"2023-12-12T09:22:49.299472+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299472+0000","last_undegraded":"2023-12-12T09:22:49.299472+0000","last_fullsized":"2023-12-12T09:22:49.299472+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290154+0000","last_change":"2023-12-12T09:22:49.290154+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290154+0000","last_undegraded":"2023-12-12T09:22:49.290154+0000","last_fullsized":"2023-12-12T09:22:49.290154+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289963+0000","last_change":"2023-12-12T09:22:49.289963+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289963+0000","last_undegraded":"2023-12-12T09:22:49.289963+0000","last_fullsized":"2023-12-12T09:22:49.289963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289977+0000","last_change":"2023-12-12T09:22:49.289977+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289977+0000","last_undegraded":"2023-12-12T09:22:49.289977+0000","last_fullsized":"2023-12-12T09:22:49.289977+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305962+0000","last_change":"2023-12-12T09:22:49.305962+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305962+0000","last_undegraded":"2023-12-12T09:22:49.305962+0000","last_fullsized":"2023-12-12T09:22:49.305962+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305646+0000","last_change":"2023-12-12T09:22:49.305646+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305646+0000","last_undegraded":"2023-12-12T09:22:49.305646+0000","last_fullsized":"2023-12-12T09:22:49.305646+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291490+0000","last_change":"2023-12-12T09:22:49.291490+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291490+0000","last_undegraded":"2023-12-12T09:22:49.291490+0000","last_fullsized":"2023-12-12T09:22:49.291490+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288629+0000","last_change":"2023-12-12T09:22:49.288629+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288629+0000","last_undegraded":"2023-12-12T09:22:49.288629+0000","last_fullsized":"2023-12-12T09:22:49.288629+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036983+0000","last_change":"2023-12-12T09:22:50.341029+0000","last_active":"2023-12-12T09:22:52.036983+0000","last_peered":"2023-12-12T09:22:52.036983+0000","last_clean":"2023-12-12T09:22:52.036983+0000","last_became_active":"2023-12-12T09:22:50.340754+0000","last_became_peered":"2023-12-12T09:22:50.340754+0000","last_unstale":"2023-12-12T09:22:52.036983+0000","last_undegraded":"2023-12-12T09:22:52.036983+0000","last_fullsized":"2023-12-12T09:22:52.036983+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:23:41.648515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297986+0000","last_change":"2023-12-12T09:22:49.297986+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297986+0000","last_undegraded":"2023-12-12T09:22:49.297986+0000","last_fullsized":"2023-12-12T09:22:49.297986+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291848+0000","last_change":"2023-12-12T09:22:49.291848+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291848+0000","last_undegraded":"2023-12-12T09:22:49.291848+0000","last_fullsized":"2023-12-12T09:22:49.291848+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.305479+0000","last_change":"2023-12-12T09:22:49.305479+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.305479+0000","last_undegraded":"2023-12-12T09:22:49.305479+0000","last_fullsized":"2023-12-12T09:22:49.305479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298922+0000","last_change":"2023-12-12T09:22:49.298922+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298922+0000","last_undegraded":"2023-12-12T09:22:49.298922+0000","last_fullsized":"2023-12-12T09:22:49.298922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.292005+0000","last_change":"2023-12-12T09:22:49.292005+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.292005+0000","last_undegraded":"2023-12-12T09:22:49.292005+0000","last_fullsized":"2023-12-12T09:22:49.292005+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.298407+0000","last_change":"2023-12-12T09:22:49.298407+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.298407+0000","last_undegraded":"2023-12-12T09:22:49.298407+0000","last_fullsized":"2023-12-12T09:22:49.298407+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296981+0000","last_change":"2023-12-12T09:22:49.296981+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296981+0000","last_undegraded":"2023-12-12T09:22:49.296981+0000","last_fullsized":"2023-12-12T09:22:49.296981+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303738+0000","last_change":"2023-12-12T09:22:49.303738+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303738+0000","last_undegraded":"2023-12-12T09:22:49.303738+0000","last_fullsized":"2023-12-12T09:22:49.303738+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303408+0000","last_change":"2023-12-12T09:22:49.303408+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303408+0000","last_undegraded":"2023-12-12T09:22:49.303408+0000","last_fullsized":"2023-12-12T09:22:49.303408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306822+0000","last_change":"2023-12-12T09:22:49.306822+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306822+0000","last_undegraded":"2023-12-12T09:22:49.306822+0000","last_fullsized":"2023-12-12T09:22:49.306822+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039030+0000","last_change":"2023-12-12T09:22:50.343639+0000","last_active":"2023-12-12T09:22:52.039030+0000","last_peered":"2023-12-12T09:22:52.039030+0000","last_clean":"2023-12-12T09:22:52.039030+0000","last_became_active":"2023-12-12T09:22:50.343313+0000","last_became_peered":"2023-12-12T09:22:50.343313+0000","last_unstale":"2023-12-12T09:22:52.039030+0000","last_undegraded":"2023-12-12T09:22:52.039030+0000","last_fullsized":"2023-12-12T09:22:52.039030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:13.749849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302418+0000","last_change":"2023-12-12T09:22:49.302418+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302418+0000","last_undegraded":"2023-12-12T09:22:49.302418+0000","last_fullsized":"2023-12-12T09:22:49.302418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.297665+0000","last_change":"2023-12-12T09:22:49.297665+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.297665+0000","last_undegraded":"2023-12-12T09:22:49.297665+0000","last_fullsized":"2023-12-12T09:22:49.297665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.287879+0000","last_change":"2023-12-12T09:22:49.287879+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.287879+0000","last_undegraded":"2023-12-12T09:22:49.287879+0000","last_fullsized":"2023-12-12T09:22:49.287879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302482+0000","last_change":"2023-12-12T09:22:49.302482+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302482+0000","last_undegraded":"2023-12-12T09:22:49.302482+0000","last_fullsized":"2023-12-12T09:22:49.302482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037351+0000","last_change":"2023-12-12T09:22:50.351200+0000","last_active":"2023-12-12T09:22:52.037351+0000","last_peered":"2023-12-12T09:22:52.037351+0000","last_clean":"2023-12-12T09:22:52.037351+0000","last_became_active":"2023-12-12T09:22:50.350947+0000","last_became_peered":"2023-12-12T09:22:50.350947+0000","last_unstale":"2023-12-12T09:22:52.037351+0000","last_undegraded":"2023-12-12T09:22:52.037351+0000","last_fullsized":"2023-12-12T09:22:52.037351+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:11:21.528607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039271+0000","last_change":"2023-12-12T09:22:50.329672+0000","last_active":"2023-12-12T09:22:52.039271+0000","last_peered":"2023-12-12T09:22:52.039271+0000","last_clean":"2023-12-12T09:22:52.039271+0000","last_became_active":"2023-12-12T09:22:50.329338+0000","last_became_peered":"2023-12-12T09:22:50.329338+0000","last_unstale":"2023-12-12T09:22:52.039271+0000","last_undegraded":"2023-12-12T09:22:52.039271+0000","last_fullsized":"2023-12-12T09:22:52.039271+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:13.948023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.367755+0000","last_change":"2023-12-12T09:22:49.312219+0000","last_active":"2023-12-12T09:22:50.367755+0000","last_peered":"2023-12-12T09:22:50.367755+0000","last_clean":"2023-12-12T09:22:50.367755+0000","last_became_active":"2023-12-12T09:22:49.311828+0000","last_became_peered":"2023-12-12T09:22:49.311828+0000","last_unstale":"2023-12-12T09:22:50.367755+0000","last_undegraded":"2023-12-12T09:22:50.367755+0000","last_fullsized":"2023-12-12T09:22:50.367755+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:56:27.499035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290245+0000","last_change":"2023-12-12T09:22:49.290245+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290245+0000","last_undegraded":"2023-12-12T09:22:49.290245+0000","last_fullsized":"2023-12-12T09:22:49.290245+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.315126+0000","last_change":"2023-12-12T09:22:49.306540+0000","last_active":"2023-12-12T09:22:49.315126+0000","last_peered":"2023-12-12T09:22:49.315126+0000","last_clean":"2023-12-12T09:22:49.315126+0000","last_became_active":"2023-12-12T09:22:49.306283+0000","last_became_peered":"2023-12-12T09:22:49.306283+0000","last_unstale":"2023-12-12T09:22:49.315126+0000","last_undegraded":"2023-12-12T09:22:49.315126+0000","last_fullsized":"2023-12-12T09:22:49.315126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:55:02.047149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038897+0000","last_change":"2023-12-12T09:22:50.338596+0000","last_active":"2023-12-12T09:22:52.038897+0000","last_peered":"2023-12-12T09:22:52.038897+0000","last_clean":"2023-12-12T09:22:52.038897+0000","last_became_active":"2023-12-12T09:22:50.338299+0000","last_became_peered":"2023-12-12T09:22:50.338299+0000","last_unstale":"2023-12-12T09:22:52.038897+0000","last_undegraded":"2023-12-12T09:22:52.038897+0000","last_fullsized":"2023-12-12T09:22:52.038897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:24.471730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.365300+0000","last_change":"2023-12-12T09:22:49.304758+0000","last_active":"2023-12-12T09:22:50.365300+0000","last_peered":"2023-12-12T09:22:50.365300+0000","last_clean":"2023-12-12T09:22:50.365300+0000","last_became_active":"2023-12-12T09:22:49.304487+0000","last_became_peered":"2023-12-12T09:22:49.304487+0000","last_unstale":"2023-12-12T09:22:50.365300+0000","last_undegraded":"2023-12-12T09:22:50.365300+0000","last_fullsized":"2023-12-12T09:22:50.365300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:53:35.402070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039094+0000","last_change":"2023-12-12T09:22:50.328018+0000","last_active":"2023-12-12T09:22:52.039094+0000","last_peered":"2023-12-12T09:22:52.039094+0000","last_clean":"2023-12-12T09:22:52.039094+0000","last_became_active":"2023-12-12T09:22:50.325156+0000","last_became_peered":"2023-12-12T09:22:50.325156+0000","last_unstale":"2023-12-12T09:22:52.039094+0000","last_undegraded":"2023-12-12T09:22:52.039094+0000","last_fullsized":"2023-12-12T09:22:52.039094+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:26.404747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321010+0000","last_change":"2023-12-12T09:22:49.314610+0000","last_active":"2023-12-12T09:22:49.321010+0000","last_peered":"2023-12-12T09:22:49.321010+0000","last_clean":"2023-12-12T09:22:49.321010+0000","last_became_active":"2023-12-12T09:22:49.314219+0000","last_became_peered":"2023-12-12T09:22:49.314219+0000","last_unstale":"2023-12-12T09:22:49.321010+0000","last_undegraded":"2023-12-12T09:22:49.321010+0000","last_fullsized":"2023-12-12T09:22:49.321010+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:03:00.594237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295735+0000","last_change":"2023-12-12T09:22:49.295735+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295735+0000","last_undegraded":"2023-12-12T09:22:49.295735+0000","last_fullsized":"2023-12-12T09:22:49.295735+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314985+0000","last_change":"2023-12-12T09:22:49.310785+0000","last_active":"2023-12-12T09:22:49.314985+0000","last_peered":"2023-12-12T09:22:49.314985+0000","last_clean":"2023-12-12T09:22:49.314985+0000","last_became_active":"2023-12-12T09:22:49.310210+0000","last_became_peered":"2023-12-12T09:22:49.310210+0000","last_unstale":"2023-12-12T09:22:49.314985+0000","last_undegraded":"2023-12-12T09:22:49.314985+0000","last_fullsized":"2023-12-12T09:22:49.314985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:19:51.198011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296927+0000","last_change":"2023-12-12T09:22:49.296927+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296927+0000","last_undegraded":"2023-12-12T09:22:49.296927+0000","last_fullsized":"2023-12-12T09:22:49.296927+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.362481+0000","last_change":"2023-12-12T09:22:49.313920+0000","last_active":"2023-12-12T09:22:50.362481+0000","last_peered":"2023-12-12T09:22:50.362481+0000","last_clean":"2023-12-12T09:22:50.362481+0000","last_became_active":"2023-12-12T09:22:49.313624+0000","last_became_peered":"2023-12-12T09:22:49.313624+0000","last_unstale":"2023-12-12T09:22:50.362481+0000","last_undegraded":"2023-12-12T09:22:50.362481+0000","last_fullsized":"2023-12-12T09:22:50.362481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:40.125862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302934+0000","last_change":"2023-12-12T09:22:49.302934+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302934+0000","last_undegraded":"2023-12-12T09:22:49.302934+0000","last_fullsized":"2023-12-12T09:22:49.302934+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320890+0000","last_change":"2023-12-12T09:22:49.312701+0000","last_active":"2023-12-12T09:22:49.320890+0000","last_peered":"2023-12-12T09:22:49.320890+0000","last_clean":"2023-12-12T09:22:49.320890+0000","last_became_active":"2023-12-12T09:22:49.312360+0000","last_became_peered":"2023-12-12T09:22:49.312360+0000","last_unstale":"2023-12-12T09:22:49.320890+0000","last_undegraded":"2023-12-12T09:22:49.320890+0000","last_fullsized":"2023-12-12T09:22:49.320890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.296358+0000","last_change":"2023-12-12T09:22:49.296358+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.296358+0000","last_undegraded":"2023-12-12T09:22:49.296358+0000","last_fullsized":"2023-12-12T09:22:49.296358+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.309557+0000","last_change":"2023-12-12T09:22:49.301866+0000","last_active":"2023-12-12T09:22:49.309557+0000","last_peered":"2023-12-12T09:22:49.309557+0000","last_clean":"2023-12-12T09:22:49.309557+0000","last_became_active":"2023-12-12T09:22:49.301545+0000","last_became_peered":"2023-12-12T09:22:49.301545+0000","last_unstale":"2023-12-12T09:22:49.309557+0000","last_undegraded":"2023-12-12T09:22:49.309557+0000","last_fullsized":"2023-12-12T09:22:49.309557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288573+0000","last_change":"2023-12-12T09:22:49.288573+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288573+0000","last_undegraded":"2023-12-12T09:22:49.288573+0000","last_fullsized":"2023-12-12T09:22:49.288573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319273+0000","last_change":"2023-12-12T09:22:49.317862+0000","last_active":"2023-12-12T09:22:49.319273+0000","last_peered":"2023-12-12T09:22:49.319273+0000","last_clean":"2023-12-12T09:22:49.319273+0000","last_became_active":"2023-12-12T09:22:49.317519+0000","last_became_peered":"2023-12-12T09:22:49.317519+0000","last_unstale":"2023-12-12T09:22:49.319273+0000","last_undegraded":"2023-12-12T09:22:49.319273+0000","last_fullsized":"2023-12-12T09:22:49.319273+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295943+0000","last_change":"2023-12-12T09:22:49.295943+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295943+0000","last_undegraded":"2023-12-12T09:22:49.295943+0000","last_fullsized":"2023-12-12T09:22:49.295943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317133+0000","last_change":"2023-12-12T09:22:49.310163+0000","last_active":"2023-12-12T09:22:49.317133+0000","last_peered":"2023-12-12T09:22:49.317133+0000","last_clean":"2023-12-12T09:22:49.317133+0000","last_became_active":"2023-12-12T09:22:49.309844+0000","last_became_peered":"2023-12-12T09:22:49.309844+0000","last_unstale":"2023-12-12T09:22:49.317133+0000","last_undegraded":"2023-12-12T09:22:49.317133+0000","last_fullsized":"2023-12-12T09:22:49.317133+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:52.456770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.291336+0000","last_change":"2023-12-12T09:22:49.291336+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.291336+0000","last_undegraded":"2023-12-12T09:22:49.291336+0000","last_fullsized":"2023-12-12T09:22:49.291336+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.316236+0000","last_change":"2023-12-12T09:22:49.312212+0000","last_active":"2023-12-12T09:22:49.316236+0000","last_peered":"2023-12-12T09:22:49.316236+0000","last_clean":"2023-12-12T09:22:49.316236+0000","last_became_active":"2023-12-12T09:22:49.311875+0000","last_became_peered":"2023-12-12T09:22:49.311875+0000","last_unstale":"2023-12-12T09:22:49.316236+0000","last_undegraded":"2023-12-12T09:22:49.316236+0000","last_fullsized":"2023-12-12T09:22:49.316236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.294122+0000","last_change":"2023-12-12T09:22:49.294122+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.294122+0000","last_undegraded":"2023-12-12T09:22:49.294122+0000","last_fullsized":"2023-12-12T09:22:49.294122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321523+0000","last_change":"2023-12-12T09:22:49.317782+0000","last_active":"2023-12-12T09:22:49.321523+0000","last_peered":"2023-12-12T09:22:49.321523+0000","last_clean":"2023-12-12T09:22:49.321523+0000","last_became_active":"2023-12-12T09:22:49.317482+0000","last_became_peered":"2023-12-12T09:22:49.317482+0000","last_unstale":"2023-12-12T09:22:49.321523+0000","last_undegraded":"2023-12-12T09:22:49.321523+0000","last_fullsized":"2023-12-12T09:22:49.321523+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:43:40.240102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.306769+0000","last_change":"2023-12-12T09:22:49.306769+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.306769+0000","last_undegraded":"2023-12-12T09:22:49.306769+0000","last_fullsized":"2023-12-12T09:22:49.306769+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317195+0000","last_change":"2023-12-12T09:22:49.310312+0000","last_active":"2023-12-12T09:22:49.317195+0000","last_peered":"2023-12-12T09:22:49.317195+0000","last_clean":"2023-12-12T09:22:49.317195+0000","last_became_active":"2023-12-12T09:22:49.309975+0000","last_became_peered":"2023-12-12T09:22:49.309975+0000","last_unstale":"2023-12-12T09:22:49.317195+0000","last_undegraded":"2023-12-12T09:22:49.317195+0000","last_fullsized":"2023-12-12T09:22:49.317195+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:35:44.355631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290680+0000","last_change":"2023-12-12T09:22:49.290680+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290680+0000","last_undegraded":"2023-12-12T09:22:49.290680+0000","last_fullsized":"2023-12-12T09:22:49.290680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319343+0000","last_change":"2023-12-12T09:22:49.317453+0000","last_active":"2023-12-12T09:22:49.319343+0000","last_peered":"2023-12-12T09:22:49.319343+0000","last_clean":"2023-12-12T09:22:49.319343+0000","last_became_active":"2023-12-12T09:22:49.317074+0000","last_became_peered":"2023-12-12T09:22:49.317074+0000","last_unstale":"2023-12-12T09:22:49.319343+0000","last_undegraded":"2023-12-12T09:22:49.319343+0000","last_fullsized":"2023-12-12T09:22:49.319343+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:10:30.091533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.288497+0000","last_change":"2023-12-12T09:22:49.288497+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.288497+0000","last_undegraded":"2023-12-12T09:22:49.288497+0000","last_fullsized":"2023-12-12T09:22:49.288497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320850+0000","last_change":"2023-12-12T09:22:49.312560+0000","last_active":"2023-12-12T09:22:49.320850+0000","last_peered":"2023-12-12T09:22:49.320850+0000","last_clean":"2023-12-12T09:22:49.320850+0000","last_became_active":"2023-12-12T09:22:49.312207+0000","last_became_peered":"2023-12-12T09:22:49.312207+0000","last_unstale":"2023-12-12T09:22:49.320850+0000","last_undegraded":"2023-12-12T09:22:49.320850+0000","last_fullsized":"2023-12-12T09:22:49.320850+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:10:19.181850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.287797+0000","last_change":"2023-12-12T09:22:49.287797+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.287797+0000","last_undegraded":"2023-12-12T09:22:49.287797+0000","last_fullsized":"2023-12-12T09:22:49.287797+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.318667+0000","last_change":"2023-12-12T09:22:49.316431+0000","last_active":"2023-12-12T09:22:49.318667+0000","last_peered":"2023-12-12T09:22:49.318667+0000","last_clean":"2023-12-12T09:22:49.318667+0000","last_became_active":"2023-12-12T09:22:49.315687+0000","last_became_peered":"2023-12-12T09:22:49.315687+0000","last_unstale":"2023-12-12T09:22:49.318667+0000","last_undegraded":"2023-12-12T09:22:49.318667+0000","last_fullsized":"2023-12-12T09:22:49.318667+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:24.889220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290756+0000","last_change":"2023-12-12T09:22:49.290756+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290756+0000","last_undegraded":"2023-12-12T09:22:49.290756+0000","last_fullsized":"2023-12-12T09:22:49.290756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317252+0000","last_change":"2023-12-12T09:22:49.310717+0000","last_active":"2023-12-12T09:22:49.317252+0000","last_peered":"2023-12-12T09:22:49.317252+0000","last_clean":"2023-12-12T09:22:49.317252+0000","last_became_active":"2023-12-12T09:22:49.310424+0000","last_became_peered":"2023-12-12T09:22:49.310424+0000","last_unstale":"2023-12-12T09:22:49.317252+0000","last_undegraded":"2023-12-12T09:22:49.317252+0000","last_fullsized":"2023-12-12T09:22:49.317252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:48:04.604007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.303028+0000","last_change":"2023-12-12T09:22:49.303028+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.303028+0000","last_undegraded":"2023-12-12T09:22:49.303028+0000","last_fullsized":"2023-12-12T09:22:49.303028+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.365452+0000","last_change":"2023-12-12T09:22:49.311109+0000","last_active":"2023-12-12T09:22:50.365452+0000","last_peered":"2023-12-12T09:22:50.365452+0000","last_clean":"2023-12-12T09:22:50.365452+0000","last_became_active":"2023-12-12T09:22:49.310693+0000","last_became_peered":"2023-12-12T09:22:49.310693+0000","last_unstale":"2023-12-12T09:22:50.365452+0000","last_undegraded":"2023-12-12T09:22:50.365452+0000","last_fullsized":"2023-12-12T09:22:50.365452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:16.173389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.295120+0000","last_change":"2023-12-12T09:22:49.295120+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.295120+0000","last_undegraded":"2023-12-12T09:22:49.295120+0000","last_fullsized":"2023-12-12T09:22:49.295120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321054+0000","last_change":"2023-12-12T09:22:49.315722+0000","last_active":"2023-12-12T09:22:49.321054+0000","last_peered":"2023-12-12T09:22:49.321054+0000","last_clean":"2023-12-12T09:22:49.321054+0000","last_became_active":"2023-12-12T09:22:49.314425+0000","last_became_peered":"2023-12-12T09:22:49.314425+0000","last_unstale":"2023-12-12T09:22:49.321054+0000","last_undegraded":"2023-12-12T09:22:49.321054+0000","last_fullsized":"2023-12-12T09:22:49.321054+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:51.580255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.292875+0000","last_change":"2023-12-12T09:22:49.292875+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.292875+0000","last_undegraded":"2023-12-12T09:22:49.292875+0000","last_fullsized":"2023-12-12T09:22:49.292875+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.310526+0000","last_change":"2023-12-12T09:22:49.302394+0000","last_active":"2023-12-12T09:22:50.310526+0000","last_peered":"2023-12-12T09:22:50.310526+0000","last_clean":"2023-12-12T09:22:50.310526+0000","last_became_active":"2023-12-12T09:22:49.302117+0000","last_became_peered":"2023-12-12T09:22:49.302117+0000","last_unstale":"2023-12-12T09:22:50.310526+0000","last_undegraded":"2023-12-12T09:22:50.310526+0000","last_fullsized":"2023-12-12T09:22:50.310526+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.301414+0000","last_change":"2023-12-12T09:22:49.301414+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.301414+0000","last_undegraded":"2023-12-12T09:22:49.301414+0000","last_fullsized":"2023-12-12T09:22:49.301414+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.315008+0000","last_change":"2023-12-12T09:22:49.300566+0000","last_active":"2023-12-12T09:22:49.315008+0000","last_peered":"2023-12-12T09:22:49.315008+0000","last_clean":"2023-12-12T09:22:49.315008+0000","last_became_active":"2023-12-12T09:22:49.300278+0000","last_became_peered":"2023-12-12T09:22:49.300278+0000","last_unstale":"2023-12-12T09:22:49.315008+0000","last_undegraded":"2023-12-12T09:22:49.315008+0000","last_fullsized":"2023-12-12T09:22:49.315008+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:01:13.102148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038857+0000","last_change":"2023-12-12T09:22:50.349493+0000","last_active":"2023-12-12T09:22:52.038857+0000","last_peered":"2023-12-12T09:22:52.038857+0000","last_clean":"2023-12-12T09:22:52.038857+0000","last_became_active":"2023-12-12T09:22:50.347205+0000","last_became_peered":"2023-12-12T09:22:50.347205+0000","last_unstale":"2023-12-12T09:22:52.038857+0000","last_undegraded":"2023-12-12T09:22:52.038857+0000","last_fullsized":"2023-12-12T09:22:52.038857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:44:33.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314772+0000","last_change":"2023-12-12T09:22:49.309982+0000","last_active":"2023-12-12T09:22:49.314772+0000","last_peered":"2023-12-12T09:22:49.314772+0000","last_clean":"2023-12-12T09:22:49.314772+0000","last_became_active":"2023-12-12T09:22:49.309679+0000","last_became_peered":"2023-12-12T09:22:49.309679+0000","last_unstale":"2023-12-12T09:22:49.314772+0000","last_undegraded":"2023-12-12T09:22:49.314772+0000","last_fullsized":"2023-12-12T09:22:49.314772+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:55:48.543866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036737+0000","last_change":"2023-12-12T09:22:50.335580+0000","last_active":"2023-12-12T09:22:52.036737+0000","last_peered":"2023-12-12T09:22:52.036737+0000","last_clean":"2023-12-12T09:22:52.036737+0000","last_became_active":"2023-12-12T09:22:50.335285+0000","last_became_peered":"2023-12-12T09:22:50.335285+0000","last_unstale":"2023-12-12T09:22:52.036737+0000","last_undegraded":"2023-12-12T09:22:52.036737+0000","last_fullsized":"2023-12-12T09:22:52.036737+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:27:54.001510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.321506+0000","last_change":"2023-12-12T09:22:49.318054+0000","last_active":"2023-12-12T09:22:49.321506+0000","last_peered":"2023-12-12T09:22:49.321506+0000","last_clean":"2023-12-12T09:22:49.321506+0000","last_became_active":"2023-12-12T09:22:49.316900+0000","last_became_peered":"2023-12-12T09:22:49.316900+0000","last_unstale":"2023-12-12T09:22:49.321506+0000","last_undegraded":"2023-12-12T09:22:49.321506+0000","last_fullsized":"2023-12-12T09:22:49.321506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:45.654672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.299222+0000","last_change":"2023-12-12T09:22:49.299222+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.299222+0000","last_undegraded":"2023-12-12T09:22:49.299222+0000","last_fullsized":"2023-12-12T09:22:49.299222+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.307970+0000","last_change":"2023-12-12T09:22:49.299101+0000","last_active":"2023-12-12T09:22:49.307970+0000","last_peered":"2023-12-12T09:22:49.307970+0000","last_clean":"2023-12-12T09:22:49.307970+0000","last_became_active":"2023-12-12T09:22:49.298806+0000","last_became_peered":"2023-12-12T09:22:49.298806+0000","last_unstale":"2023-12-12T09:22:49.307970+0000","last_undegraded":"2023-12-12T09:22:49.307970+0000","last_fullsized":"2023-12-12T09:22:49.307970+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:55:52.971722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.302603+0000","last_change":"2023-12-12T09:22:49.302603+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.302603+0000","last_undegraded":"2023-12-12T09:22:49.302603+0000","last_fullsized":"2023-12-12T09:22:49.302603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039456+0000","last_change":"2023-12-12T09:22:49.313836+0000","last_active":"2023-12-12T09:22:52.039456+0000","last_peered":"2023-12-12T09:22:52.039456+0000","last_clean":"2023-12-12T09:22:52.039456+0000","last_became_active":"2023-12-12T09:22:49.313538+0000","last_became_peered":"2023-12-12T09:22:49.313538+0000","last_unstale":"2023-12-12T09:22:52.039456+0000","last_undegraded":"2023-12-12T09:22:52.039456+0000","last_fullsized":"2023-12-12T09:22:52.039456+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:56:02.548586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290188+0000","last_change":"2023-12-12T09:22:49.290188+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290188+0000","last_undegraded":"2023-12-12T09:22:49.290188+0000","last_fullsized":"2023-12-12T09:22:49.290188+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319314+0000","last_change":"2023-12-12T09:22:49.316665+0000","last_active":"2023-12-12T09:22:49.319314+0000","last_peered":"2023-12-12T09:22:49.319314+0000","last_clean":"2023-12-12T09:22:49.319314+0000","last_became_active":"2023-12-12T09:22:49.315307+0000","last_became_peered":"2023-12-12T09:22:49.315307+0000","last_unstale":"2023-12-12T09:22:49.319314+0000","last_undegraded":"2023-12-12T09:22:49.319314+0000","last_fullsized":"2023-12-12T09:22:49.319314+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:55:31.202986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039416+0000","last_change":"2023-12-12T09:22:50.329797+0000","last_active":"2023-12-12T09:22:52.039416+0000","last_peered":"2023-12-12T09:22:52.039416+0000","last_clean":"2023-12-12T09:22:52.039416+0000","last_became_active":"2023-12-12T09:22:50.328986+0000","last_became_peered":"2023-12-12T09:22:50.328986+0000","last_unstale":"2023-12-12T09:22:52.039416+0000","last_undegraded":"2023-12-12T09:22:52.039416+0000","last_fullsized":"2023-12-12T09:22:52.039416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:39.866786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.320981+0000","last_change":"2023-12-12T09:22:49.313997+0000","last_active":"2023-12-12T09:22:49.320981+0000","last_peered":"2023-12-12T09:22:49.320981+0000","last_clean":"2023-12-12T09:22:49.320981+0000","last_became_active":"2023-12-12T09:22:49.313632+0000","last_became_peered":"2023-12-12T09:22:49.313632+0000","last_unstale":"2023-12-12T09:22:49.320981+0000","last_undegraded":"2023-12-12T09:22:49.320981+0000","last_fullsized":"2023-12-12T09:22:49.320981+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:37.755816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293291+0000","last_change":"2023-12-12T09:22:49.293291+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293291+0000","last_undegraded":"2023-12-12T09:22:49.293291+0000","last_fullsized":"2023-12-12T09:22:49.293291+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.319473+0000","last_change":"2023-12-12T09:22:49.312354+0000","last_active":"2023-12-12T09:22:49.319473+0000","last_peered":"2023-12-12T09:22:49.319473+0000","last_clean":"2023-12-12T09:22:49.319473+0000","last_became_active":"2023-12-12T09:22:49.312037+0000","last_became_peered":"2023-12-12T09:22:49.312037+0000","last_unstale":"2023-12-12T09:22:49.319473+0000","last_undegraded":"2023-12-12T09:22:49.319473+0000","last_fullsized":"2023-12-12T09:22:49.319473+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:57:05.839285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.289547+0000","last_change":"2023-12-12T09:22:49.289547+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.289547+0000","last_undegraded":"2023-12-12T09:22:49.289547+0000","last_fullsized":"2023-12-12T09:22:49.289547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317783+0000","last_change":"2023-12-12T09:22:49.313350+0000","last_active":"2023-12-12T09:22:49.317783+0000","last_peered":"2023-12-12T09:22:49.317783+0000","last_clean":"2023-12-12T09:22:49.317783+0000","last_became_active":"2023-12-12T09:22:49.313073+0000","last_became_peered":"2023-12-12T09:22:49.313073+0000","last_unstale":"2023-12-12T09:22:49.317783+0000","last_undegraded":"2023-12-12T09:22:49.317783+0000","last_fullsized":"2023-12-12T09:22:49.317783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.290799+0000","last_change":"2023-12-12T09:22:49.290799+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.290799+0000","last_undegraded":"2023-12-12T09:22:49.290799+0000","last_fullsized":"2023-12-12T09:22:49.290799+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.307069+0000","last_change":"2023-12-12T09:22:49.297287+0000","last_active":"2023-12-12T09:22:49.307069+0000","last_peered":"2023-12-12T09:22:49.307069+0000","last_clean":"2023-12-12T09:22:49.307069+0000","last_became_active":"2023-12-12T09:22:49.296996+0000","last_became_peered":"2023-12-12T09:22:49.296996+0000","last_unstale":"2023-12-12T09:22:49.307069+0000","last_undegraded":"2023-12-12T09:22:49.307069+0000","last_fullsized":"2023-12-12T09:22:49.307069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:24.889220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293277+0000","last_change":"2023-12-12T09:22:49.293277+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293277+0000","last_undegraded":"2023-12-12T09:22:49.293277+0000","last_fullsized":"2023-12-12T09:22:49.293277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.317286+0000","last_change":"2023-12-12T09:22:49.312112+0000","last_active":"2023-12-12T09:22:49.317286+0000","last_peered":"2023-12-12T09:22:49.317286+0000","last_clean":"2023-12-12T09:22:49.317286+0000","last_became_active":"2023-12-12T09:22:49.311865+0000","last_became_peered":"2023-12-12T09:22:49.311865+0000","last_unstale":"2023-12-12T09:22:49.317286+0000","last_undegraded":"2023-12-12T09:22:49.317286+0000","last_fullsized":"2023-12-12T09:22:49.317286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:05:48.316229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2023-12-12T09:22:49.293907+0000","last_change":"2023-12-12T09:22:49.293907+0000","last_active":"2023-12-12T09:22:49.269891+0000","last_peered":"2023-12-12T09:22:49.269891+0000","last_clean":"2023-12-12T09:22:49.269891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-12T09:22:49.293907+0000","last_undegraded":"2023-12-12T09:22:49.293907+0000","last_fullsized":"2023-12-12T09:22:49.293907+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-12-12T09:22:49.314948+0000","last_change":"2023-12-12T09:22:49.314029+0000","last_active":"2023-12-12T09:22:49.314948+0000","last_peered":"2023-12-12T09:22:49.314948+0000","last_clean":"2023-12-12T09:22:49.314948+0000","last_became_active":"2023-12-12T09:22:49.313717+0000","last_became_peered":"2023-12-12T09:22:49.313717+0000","last_unstale":"2023-12-12T09:22:49.314948+0000","last_undegraded":"2023-12-12T09:22:49.314948+0000","last_fullsized":"2023-12-12T09:22:49.314948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:12:35.791620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-12-12T09:22:48.289462+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:22:48.289462+0000","last_peered":"2023-12-12T09:22:48.289462+0000","last_clean":"2023-12-12T09:22:48.289462+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:22:48.289462+0000","last_undegraded":"2023-12-12T09:22:48.289462+0000","last_fullsized":"2023-12-12T09:22:48.289462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1261568,"data_stored":888340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.036,"15min":1.0229999999999999},"min":{"1min":0.60299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.52,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2490000000000001,"15min":1.2829999999999999},"min":{"1min":0.89400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5900000000000001,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.288}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.024,"15min":0.98099999999999998},"min":{"1min":0.754,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.526,"5min":1.827,"15min":1.827},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.786,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.1080000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.137,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5960000000000001,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.92700000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.746,"5min":1.887,"15min":1.887},"last":1.266},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2270000000000001,"15min":1.246},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.621,"5min":2.355,"15min":2.355},"last":1.357}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3580000000000001},"min":{"1min":0.90600000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.696,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.351},"min":{"1min":0.872,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8069999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.321}]},{"osd":5,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.387,"15min":1.407},"min":{"1min":1.0700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.724,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.47},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.98599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7769999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.073}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.425,"15min":1.415},"min":{"1min":1.034,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9610000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.169},{"interface":"front","average":{"1min":1.577,"5min":1.472,"15min":1.4690000000000001},"min":{"1min":1.202,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8700000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.224}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.97399999999999998,"15min":0.94599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5029999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.429}]},{"osd":1,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.84099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.466},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.722,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.212}]},{"osd":2,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.196,"15min":1.1819999999999999},"min":{"1min":0.87,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.248},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.80000000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.635,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3480000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.198},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.679,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.282},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.363},"min":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1719999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.365,"15min":1.361},"min":{"1min":1.042,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8919999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.056},{"interface":"front","average":{"1min":1.288,"5min":1.268,"15min":1.2569999999999999},"min":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.925,"5min":1.996,"15min":1.996},"last":0.78800000000000003}]},{"osd":5,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":1.087,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4430000000000001,"15min":1.4299999999999999},"min":{"1min":1.1970000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.5269999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.369,"15min":1.355},"min":{"1min":1.171,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.679,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.123},{"interface":"front","average":{"1min":1.504,"5min":1.4910000000000001,"15min":1.484},"min":{"1min":1.0920000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.837,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.494}]}]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.998,"15min":1.016},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.331,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.872},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.113,"15min":1.141},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5980000000000001,"5min":1.909,"15min":1.909},"last":1.2909999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.232},"min":{"1min":0.81799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.373,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7949999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7909999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.7589999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1830000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5960000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.335,"15min":1.3680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6950000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.633}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.284,"15min":1.266},"min":{"1min":1.0569999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9970000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.234},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4750000000000001,"15min":1.49},"min":{"1min":0.98499999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.3360000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.79300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7669999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.46,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1680000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.569,"15min":1.581},"min":{"1min":1.1080000000000001,"5min":0.627,"15min":0.627},"max":{"1min":2.238,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0369999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.331,"15min":2.331},"last":1.696}]}]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":291385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.151,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.538,"5min":1.633,"15min":1.633},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.119,"15min":1.123},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.669,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.68100000000000005}]},{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.194,"15min":1.1799999999999999},"min":{"1min":0.71999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.806,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.573},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.538,"5min":2.117,"15min":2.117},"last":1.3859999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.502,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.286}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.339,"15min":1.353},"min":{"1min":0.995,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7589999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.772},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7070000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":0.745}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.885,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.456},"min":{"1min":1.0149999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7230000000000001,"5min":3.343,"15min":3.343},"last":1.631}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.45,"15min":1.4930000000000001},"min":{"1min":1.0680000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.845,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.71},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5529999999999999,"15min":1.583},"min":{"1min":1.012,"5min":0.755,"15min":0.755},"max":{"1min":1.7629999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.5589999999999999,"15min":1.581},"min":{"1min":1.0529999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8029999999999999,"5min":3.085,"15min":3.085},"last":1.839},{"interface":"front","average":{"1min":1.429,"5min":1.5980000000000001,"15min":1.6519999999999999},"min":{"1min":1.1910000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.964,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.8180000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88200000000000001,"15min":0.91300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4990000000000001,"5min":1.718,"15min":1.718},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.548,"5min":1.71,"15min":1.71},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":1.4419999999999999,"5min":1.575,"15min":1.575},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.071,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5609999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.482,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.50700000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.222,"15min":1.24},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.956,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.0429999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3080000000000001},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.999},{"interface":"front","average":{"1min":1.274,"5min":1.29,"15min":1.284},"min":{"1min":0.871,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.623,"5min":1.73,"15min":1.73},"last":0.85699999999999998}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3069999999999999,"15min":1.3260000000000001},"min":{"1min":0.78400000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6639999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.429,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.81799999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0259999999999998,"5min":2.198,"15min":2.198},"last":1.1020000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3859999999999999,"15min":1.4019999999999999},"min":{"1min":0.93200000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6759999999999999,"5min":1.847,"15min":1.847},"last":0.753},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3740000000000001,"15min":1.3979999999999999},"min":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.768,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.94599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":0.52400000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.55400000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.147}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.099}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.1619999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":297972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0800000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.504,"5min":1.613,"15min":1.613},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.048,"15min":1.05},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5369999999999999,"5min":2.903,"15min":2.903},"last":1.625}]},{"osd":3,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.998,"15min":1.002},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.341,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.90900000000000003,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4750000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.5920000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.149,"15min":1.133},"min":{"1min":0.84899999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.167,"15min":1.165},"min":{"1min":0.67000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7430000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":0.91300000000000003}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6379999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3109999999999999,"15min":1.3280000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6240000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.276}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3080000000000001,"15min":1.288},"min":{"1min":0.879,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0659999999999998,"5min":2.867,"15min":2.867},"last":1.712},{"interface":"front","average":{"1min":1.341,"5min":1.357,"15min":1.3640000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.835,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.681}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4119999999999999,"15min":1.4279999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7230000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.355,"15min":1.337},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1240000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.7669999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1302528,"data_stored":904249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.439,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.135,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.363,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1519999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.014,"15min":1.071},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.018,"15min":1.0429999999999999},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.294},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":1.6299999999999999,"5min":2.464,"15min":2.464},"last":0.68100000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.232},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.621,"5min":2.343,"15min":2.343},"last":1.431},{"interface":"front","average":{"1min":1.22,"5min":1.341,"15min":1.375},"min":{"1min":0.82899999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.5629999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.879}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3049999999999999,"15min":1.333},"min":{"1min":0.878,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.774,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7030000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4550000000000001,"15min":1.5029999999999999},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4970000000000001,"5min":2.573,"15min":2.573},"last":1.331},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3500000000000001,"15min":1.381},"min":{"1min":0.91600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.2549999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4039999999999999,"15min":1.4319999999999999},"min":{"1min":0.90800000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.698,"5min":1.968,"15min":1.968},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.353,"15min":1.383},"min":{"1min":0.80100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7969999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:22:58.364 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:22:58.373 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:22:59.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:22:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.978+0000 7f0fa54a3640 1 Processor -- start 2023-12-12T09:22:59.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.978+0000 7f0fa54a3640 1 -- start start 2023-12-12T09:22:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.979+0000 7f0fa54a3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f0fa006de80 0x7f0fa015f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.979+0000 7f0fa54a3640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0fa00705b0 0x7f0fa00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.979+0000 7f0fa54a3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa0144b20 con 0x7f0fa0144740 2023-12-12T09:22:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.979+0000 7f0fa54a3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa006e310 con 0x7f0fa006de80 2023-12-12T09:22:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.979+0000 7f0fa54a3640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa006d670 con 0x7f0fa00705b0 2023-12-12T09:22:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0fa0144740 0x7f0fa015e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51390/0 (socket says 172.21.15.84:51390) 2023-12-12T09:22:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9ffff640 1 -- 172.21.15.84:0/675167609 learned_addr learned my addr 172.21.15.84:0/675167609 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:22:59.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/675167609 >> v2:172.21.15.84:3300/0 conn(0x7f0fa006de80 0x7f0fa015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0fa4ca2640 1 --2- 172.21.15.84:0/675167609 >> v2:172.21.15.99:3300/0 conn(0x7f0fa00705b0 0x7f0fa00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9effd640 1 -- 172.21.15.84:0/675167609 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455616767 0 0) 0x7f0fa0144b20 con 0x7f0fa0144740 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9effd640 1 -- 172.21.15.84:0/675167609 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f88003520 con 0x7f0fa0144740 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9f7fe640 1 -- 172.21.15.84:0/675167609 >> v2:172.21.15.99:3300/0 conn(0x7f0fa00705b0 msgr2=0x7f0fa00709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/675167609 >> v2:172.21.15.99:3300/0 conn(0x7f0fa00705b0 0x7f0fa00709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9f7fe640 1 -- 172.21.15.84:0/675167609 >> v1:172.21.15.84:6789/0 conn(0x7f0fa0144740 legacy=0x7f0fa015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.980+0000 7f0f9effd640 1 -- 172.21.15.84:0/675167609 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2682836492 0 0) 0x7f0f88003520 con 0x7f0fa0144740 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.981+0000 7f0f9f7fe640 1 -- 172.21.15.84:0/675167609 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa006cdd0 con 0x7f0fa006de80 2023-12-12T09:22:59.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.982+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/675167609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa006de80 0x7f0fa015f060 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0fa006ba20 tx=0x7f0f9402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe84273ab24a5f43 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:59.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.982+0000 7f0f9effd640 1 -- 172.21.15.84:0/675167609 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90001670 con 0x7f0fa006de80 2023-12-12T09:22:59.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.982+0000 7f0f9effd640 1 -- 172.21.15.84:0/675167609 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94033440 con 0x7f0fa006de80 2023-12-12T09:22:59.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.982+0000 7f0f9effd640 1 -- 172.21.15.84:0/675167609 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940337d0 con 0x7f0fa006de80 2023-12-12T09:22:59.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.982+0000 7f0fa54a3640 1 -- 172.21.15.84:0/675167609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa006de80 msgr2=0x7f0fa015f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:59.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.982+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/675167609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa006de80 0x7f0fa015f060 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0fa006ba20 tx=0x7f0f9402b7a0 comp rx=0 tx=0).stop 2023-12-12T09:22:59.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.983+0000 7f0fa54a3640 1 -- 172.21.15.84:0/675167609 shutdown_connections 2023-12-12T09:22:59.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.983+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/675167609 >> v2:172.21.15.99:3300/0 conn(0x7f0fa00705b0 0x7f0fa00709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:59.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.983+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/675167609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa006de80 0x7f0fa015f060 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:59.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.983+0000 7f0fa54a3640 1 -- 172.21.15.84:0/675167609 >> 172.21.15.84:0/675167609 conn(0x7f0fa00b07f0 msgr2=0x7f0fa00b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:22:59.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.983+0000 7f0fa54a3640 1 -- 172.21.15.84:0/675167609 shutdown_connections 2023-12-12T09:22:59.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.983+0000 7f0fa54a3640 1 -- 172.21.15.84:0/675167609 wait complete. 2023-12-12T09:22:59.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.984+0000 7f0fa54a3640 1 Processor -- start 2023-12-12T09:22:59.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.985+0000 7f0fa54a3640 1 -- start start 2023-12-12T09:22:59.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.985+0000 7f0fa54a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa006de80 0x7f0fa0158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:59.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa54a3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fa00705b0 0x7f0fa013f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:59.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa54a3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa0144740 0x7f0fa013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:59.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa54a3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa013a000 con 0x7f0fa0144740 2023-12-12T09:22:59.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa54a3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa015c2a0 con 0x7f0fa006de80 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa54a3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01f3f00 con 0x7f0fa00705b0 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa4ca2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa0144740 0x7f0fa013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa4ca2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa0144740 0x7f0fa013fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51694/0 (socket says 172.21.15.84:51694) 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa4ca2640 1 -- 172.21.15.84:0/430491630 learned_addr learned my addr 172.21.15.84:0/430491630 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa4ca2640 1 -- 172.21.15.84:0/430491630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fa00705b0 msgr2=0x7f0fa013f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa4ca2640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fa00705b0 0x7f0fa013f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa4ca2640 1 -- 172.21.15.84:0/430491630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa006de80 msgr2=0x7f0fa0158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa4ca2640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa006de80 0x7f0fa0158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.986+0000 7f0fa4ca2640 1 -- 172.21.15.84:0/430491630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f94009400 con 0x7f0fa0144740 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.987+0000 7f0fa4ca2640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa0144740 0x7f0fa013fd40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0f98007e40 tx=0x7f0f9800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.987+0000 7f0f9cff9640 1 -- 172.21.15.84:0/430491630 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98014620 con 0x7f0fa0144740 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.987+0000 7f0f9cff9640 1 -- 172.21.15.84:0/430491630 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9800ee90 con 0x7f0fa0144740 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.987+0000 7f0f9cff9640 1 -- 172.21.15.84:0/430491630 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f980149e0 con 0x7f0fa0144740 2023-12-12T09:22:59.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.987+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa01f3140 con 0x7f0fa0144740 2023-12-12T09:22:59.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.987+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa01f3700 con 0x7f0fa0144740 2023-12-12T09:22:59.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.988+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa00673c0 con 0x7f0fa0144740 2023-12-12T09:22:59.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.989+0000 7f0f9cff9640 1 -- 172.21.15.84:0/430491630 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f98014b40 con 0x7f0fa0144740 2023-12-12T09:22:59.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.990+0000 7f0f9cff9640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f8c06ae40 0x7f0f8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:22:59.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.990+0000 7f0f9cff9640 1 -- 172.21.15.84:0/430491630 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0f9808a180 con 0x7f0fa0144740 2023-12-12T09:22:59.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.990+0000 7f0f9ffff640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f8c06ae40 0x7f0f8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:22:59.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.991+0000 7f0f9ffff640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f8c06ae40 0x7f0f8c06d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0f90001eb0 tx=0x7f0f90001980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:22:59.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:22:59.995+0000 7f0f9cff9640 1 -- 172.21.15.84:0/430491630 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f980550e0 con 0x7f0fa0144740 2023-12-12T09:23:00.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.182+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fa0070090 con 0x7f0f8c06ae40 2023-12-12T09:23:00.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.205+0000 7f0f9cff9640 1 -- 172.21.15.84:0/430491630 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286521 (secure 0 0 0) 0x7f0f90001350 con 0x7f0f8c06ae40 2023-12-12T09:23:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:00.211 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.210+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f8c06ae40 msgr2=0x7f0f8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f8c06ae40 0x7f0f8c06d300 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0f90001eb0 tx=0x7f0f90001980 comp rx=0 tx=0).stop 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa0144740 msgr2=0x7f0fa013fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa0144740 0x7f0fa013fd40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0f98007e40 tx=0x7f0f9800e4b0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 shutdown_connections 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f0f8c06ae40 0x7f0f8c06d300 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa0144740 0x7f0fa013fd40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0fa00705b0 0x7f0fa013f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 --2- 172.21.15.84:0/430491630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa006de80 0x7f0fa0158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 >> 172.21.15.84:0/430491630 conn(0x7f0fa00b07f0 msgr2=0x7f0fa01420f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:00.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 shutdown_connections 2023-12-12T09:23:00.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.211+0000 7f0fa54a3640 1 -- 172.21.15.84:0/430491630 wait complete. 2023-12-12T09:23:00.232 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-12-12T09:22:59.141466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231116,"kb_used_data":6632,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743604,"statfs":{"total":773094113280,"available":772857450496,"internally_reserved":0,"allocated":6791168,"data_stored":3679052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.835676"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.604255+0000","last_change":"2023-12-12T09:22:50.352076+0000","last_active":"2023-12-12T09:22:51.604255+0000","last_peered":"2023-12-12T09:22:51.604255+0000","last_clean":"2023-12-12T09:22:51.604255+0000","last_became_active":"2023-12-12T09:22:50.351383+0000","last_became_peered":"2023-12-12T09:22:50.351383+0000","last_unstale":"2023-12-12T09:22:51.604255+0000","last_undegraded":"2023-12-12T09:22:51.604255+0000","last_fullsized":"2023-12-12T09:22:51.604255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:12:36.806643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037273+0000","last_change":"2023-12-12T09:22:50.347342+0000","last_active":"2023-12-12T09:22:52.037273+0000","last_peered":"2023-12-12T09:22:52.037273+0000","last_clean":"2023-12-12T09:22:52.037273+0000","last_became_active":"2023-12-12T09:22:50.347059+0000","last_became_peered":"2023-12-12T09:22:50.347059+0000","last_unstale":"2023-12-12T09:22:52.037273+0000","last_undegraded":"2023-12-12T09:22:52.037273+0000","last_fullsized":"2023-12-12T09:22:52.037273+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:15:29.616660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038638+0000","last_change":"2023-12-12T09:22:50.335879+0000","last_active":"2023-12-12T09:22:52.038638+0000","last_peered":"2023-12-12T09:22:52.038638+0000","last_clean":"2023-12-12T09:22:52.038638+0000","last_became_active":"2023-12-12T09:22:50.335605+0000","last_became_peered":"2023-12-12T09:22:50.335605+0000","last_unstale":"2023-12-12T09:22:52.038638+0000","last_undegraded":"2023-12-12T09:22:52.038638+0000","last_fullsized":"2023-12-12T09:22:52.038638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:43:45.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.340485+0000","last_change":"2023-12-12T09:22:50.342172+0000","last_active":"2023-12-12T09:22:51.340485+0000","last_peered":"2023-12-12T09:22:51.340485+0000","last_clean":"2023-12-12T09:22:51.340485+0000","last_became_active":"2023-12-12T09:22:50.341799+0000","last_became_peered":"2023-12-12T09:22:50.341799+0000","last_unstale":"2023-12-12T09:22:51.340485+0000","last_undegraded":"2023-12-12T09:22:51.340485+0000","last_fullsized":"2023-12-12T09:22:51.340485+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:50.117128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.603561+0000","last_change":"2023-12-12T09:22:50.343309+0000","last_active":"2023-12-12T09:22:51.603561+0000","last_peered":"2023-12-12T09:22:51.603561+0000","last_clean":"2023-12-12T09:22:51.603561+0000","last_became_active":"2023-12-12T09:22:50.340568+0000","last_became_peered":"2023-12-12T09:22:50.340568+0000","last_unstale":"2023-12-12T09:22:51.603561+0000","last_undegraded":"2023-12-12T09:22:51.603561+0000","last_fullsized":"2023-12-12T09:22:51.603561+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:06:27.759413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038137+0000","last_change":"2023-12-12T09:22:50.348775+0000","last_active":"2023-12-12T09:22:52.038137+0000","last_peered":"2023-12-12T09:22:52.038137+0000","last_clean":"2023-12-12T09:22:52.038137+0000","last_became_active":"2023-12-12T09:22:50.348511+0000","last_became_peered":"2023-12-12T09:22:50.348511+0000","last_unstale":"2023-12-12T09:22:52.038137+0000","last_undegraded":"2023-12-12T09:22:52.038137+0000","last_fullsized":"2023-12-12T09:22:52.038137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:17:28.250406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.340267+0000","last_change":"2023-12-12T09:22:50.324625+0000","last_active":"2023-12-12T09:22:51.340267+0000","last_peered":"2023-12-12T09:22:51.340267+0000","last_clean":"2023-12-12T09:22:51.340267+0000","last_became_active":"2023-12-12T09:22:50.324274+0000","last_became_peered":"2023-12-12T09:22:50.324274+0000","last_unstale":"2023-12-12T09:22:51.340267+0000","last_undegraded":"2023-12-12T09:22:51.340267+0000","last_fullsized":"2023-12-12T09:22:51.340267+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:41.140885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036569+0000","last_change":"2023-12-12T09:22:50.350293+0000","last_active":"2023-12-12T09:22:52.036569+0000","last_peered":"2023-12-12T09:22:52.036569+0000","last_clean":"2023-12-12T09:22:52.036569+0000","last_became_active":"2023-12-12T09:22:50.349974+0000","last_became_peered":"2023-12-12T09:22:50.349974+0000","last_unstale":"2023-12-12T09:22:52.036569+0000","last_undegraded":"2023-12-12T09:22:52.036569+0000","last_fullsized":"2023-12-12T09:22:52.036569+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:16:50.306502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.342663+0000","last_change":"2023-12-12T09:22:50.329194+0000","last_active":"2023-12-12T09:22:51.342663+0000","last_peered":"2023-12-12T09:22:51.342663+0000","last_clean":"2023-12-12T09:22:51.342663+0000","last_became_active":"2023-12-12T09:22:50.328878+0000","last_became_peered":"2023-12-12T09:22:50.328878+0000","last_unstale":"2023-12-12T09:22:51.342663+0000","last_undegraded":"2023-12-12T09:22:51.342663+0000","last_fullsized":"2023-12-12T09:22:51.342663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:07:47.309456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.335745+0000","last_change":"2023-12-12T09:22:50.347553+0000","last_active":"2023-12-12T09:22:51.335745+0000","last_peered":"2023-12-12T09:22:51.335745+0000","last_clean":"2023-12-12T09:22:51.335745+0000","last_became_active":"2023-12-12T09:22:50.346348+0000","last_became_peered":"2023-12-12T09:22:50.346348+0000","last_unstale":"2023-12-12T09:22:51.335745+0000","last_undegraded":"2023-12-12T09:22:51.335745+0000","last_fullsized":"2023-12-12T09:22:51.335745+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:56:28.514058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.335722+0000","last_change":"2023-12-12T09:22:50.355182+0000","last_active":"2023-12-12T09:22:51.335722+0000","last_peered":"2023-12-12T09:22:51.335722+0000","last_clean":"2023-12-12T09:22:51.335722+0000","last_became_active":"2023-12-12T09:22:50.353322+0000","last_became_peered":"2023-12-12T09:22:50.353322+0000","last_unstale":"2023-12-12T09:22:51.335722+0000","last_undegraded":"2023-12-12T09:22:51.335722+0000","last_fullsized":"2023-12-12T09:22:51.335722+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:01.269044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.340629+0000","last_change":"2023-12-12T09:22:50.332806+0000","last_active":"2023-12-12T09:22:51.340629+0000","last_peered":"2023-12-12T09:22:51.340629+0000","last_clean":"2023-12-12T09:22:51.340629+0000","last_became_active":"2023-12-12T09:22:50.332292+0000","last_became_peered":"2023-12-12T09:22:50.332292+0000","last_unstale":"2023-12-12T09:22:51.340629+0000","last_undegraded":"2023-12-12T09:22:51.340629+0000","last_fullsized":"2023-12-12T09:22:51.340629+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:27:54.001510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037310+0000","last_change":"2023-12-12T09:22:50.345680+0000","last_active":"2023-12-12T09:22:52.037310+0000","last_peered":"2023-12-12T09:22:52.037310+0000","last_clean":"2023-12-12T09:22:52.037310+0000","last_became_active":"2023-12-12T09:22:50.344854+0000","last_became_peered":"2023-12-12T09:22:50.344854+0000","last_unstale":"2023-12-12T09:22:52.037310+0000","last_undegraded":"2023-12-12T09:22:52.037310+0000","last_fullsized":"2023-12-12T09:22:52.037310+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:42.040890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.340148+0000","last_change":"2023-12-12T09:22:50.342895+0000","last_active":"2023-12-12T09:22:51.340148+0000","last_peered":"2023-12-12T09:22:51.340148+0000","last_clean":"2023-12-12T09:22:51.340148+0000","last_became_active":"2023-12-12T09:22:50.342311+0000","last_became_peered":"2023-12-12T09:22:50.342311+0000","last_unstale":"2023-12-12T09:22:51.340148+0000","last_undegraded":"2023-12-12T09:22:51.340148+0000","last_fullsized":"2023-12-12T09:22:51.340148+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:08.124163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.340780+0000","last_change":"2023-12-12T09:22:50.342523+0000","last_active":"2023-12-12T09:22:51.340780+0000","last_peered":"2023-12-12T09:22:51.340780+0000","last_clean":"2023-12-12T09:22:51.340780+0000","last_became_active":"2023-12-12T09:22:50.342229+0000","last_became_peered":"2023-12-12T09:22:50.342229+0000","last_unstale":"2023-12-12T09:22:51.340780+0000","last_undegraded":"2023-12-12T09:22:51.340780+0000","last_fullsized":"2023-12-12T09:22:51.340780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:24:08.819934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036983+0000","last_change":"2023-12-12T09:22:50.341029+0000","last_active":"2023-12-12T09:22:52.036983+0000","last_peered":"2023-12-12T09:22:52.036983+0000","last_clean":"2023-12-12T09:22:52.036983+0000","last_became_active":"2023-12-12T09:22:50.340754+0000","last_became_peered":"2023-12-12T09:22:50.340754+0000","last_unstale":"2023-12-12T09:22:52.036983+0000","last_undegraded":"2023-12-12T09:22:52.036983+0000","last_fullsized":"2023-12-12T09:22:52.036983+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:23:41.648515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037980+0000","last_change":"2023-12-12T09:22:50.349051+0000","last_active":"2023-12-12T09:22:52.037980+0000","last_peered":"2023-12-12T09:22:52.037980+0000","last_clean":"2023-12-12T09:22:52.037980+0000","last_became_active":"2023-12-12T09:22:50.348757+0000","last_became_peered":"2023-12-12T09:22:50.348757+0000","last_unstale":"2023-12-12T09:22:52.037980+0000","last_undegraded":"2023-12-12T09:22:52.037980+0000","last_fullsized":"2023-12-12T09:22:52.037980+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:54:21.999209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038517+0000","last_change":"2023-12-12T09:22:50.338407+0000","last_active":"2023-12-12T09:22:52.038517+0000","last_peered":"2023-12-12T09:22:52.038517+0000","last_clean":"2023-12-12T09:22:52.038517+0000","last_became_active":"2023-12-12T09:22:50.338152+0000","last_became_peered":"2023-12-12T09:22:50.338152+0000","last_unstale":"2023-12-12T09:22:52.038517+0000","last_undegraded":"2023-12-12T09:22:52.038517+0000","last_fullsized":"2023-12-12T09:22:52.038517+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:53.468995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.603827+0000","last_change":"2023-12-12T09:22:50.351372+0000","last_active":"2023-12-12T09:22:51.603827+0000","last_peered":"2023-12-12T09:22:51.603827+0000","last_clean":"2023-12-12T09:22:51.603827+0000","last_became_active":"2023-12-12T09:22:50.350301+0000","last_became_peered":"2023-12-12T09:22:50.350301+0000","last_unstale":"2023-12-12T09:22:51.603827+0000","last_undegraded":"2023-12-12T09:22:51.603827+0000","last_fullsized":"2023-12-12T09:22:51.603827+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:00:22.727411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037719+0000","last_change":"2023-12-12T09:22:50.352783+0000","last_active":"2023-12-12T09:22:52.037719+0000","last_peered":"2023-12-12T09:22:52.037719+0000","last_clean":"2023-12-12T09:22:52.037719+0000","last_became_active":"2023-12-12T09:22:50.349166+0000","last_became_peered":"2023-12-12T09:22:50.349166+0000","last_unstale":"2023-12-12T09:22:52.037719+0000","last_undegraded":"2023-12-12T09:22:52.037719+0000","last_fullsized":"2023-12-12T09:22:52.037719+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:58:29.678020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037137+0000","last_change":"2023-12-12T09:22:50.334908+0000","last_active":"2023-12-12T09:22:52.037137+0000","last_peered":"2023-12-12T09:22:52.037137+0000","last_clean":"2023-12-12T09:22:52.037137+0000","last_became_active":"2023-12-12T09:22:50.334429+0000","last_became_peered":"2023-12-12T09:22:50.334429+0000","last_unstale":"2023-12-12T09:22:52.037137+0000","last_undegraded":"2023-12-12T09:22:52.037137+0000","last_fullsized":"2023-12-12T09:22:52.037137+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:24:08.819934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037287+0000","last_change":"2023-12-12T09:22:50.356889+0000","last_active":"2023-12-12T09:22:52.037287+0000","last_peered":"2023-12-12T09:22:52.037287+0000","last_clean":"2023-12-12T09:22:52.037287+0000","last_became_active":"2023-12-12T09:22:50.355665+0000","last_became_peered":"2023-12-12T09:22:50.355665+0000","last_unstale":"2023-12-12T09:22:52.037287+0000","last_undegraded":"2023-12-12T09:22:52.037287+0000","last_fullsized":"2023-12-12T09:22:52.037287+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:39.029309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037984+0000","last_change":"2023-12-12T09:22:50.350049+0000","last_active":"2023-12-12T09:22:52.037984+0000","last_peered":"2023-12-12T09:22:52.037984+0000","last_clean":"2023-12-12T09:22:52.037984+0000","last_became_active":"2023-12-12T09:22:50.349781+0000","last_became_peered":"2023-12-12T09:22:50.349781+0000","last_unstale":"2023-12-12T09:22:52.037984+0000","last_undegraded":"2023-12-12T09:22:52.037984+0000","last_fullsized":"2023-12-12T09:22:52.037984+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:17.188413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036893+0000","last_change":"2023-12-12T09:22:50.342383+0000","last_active":"2023-12-12T09:22:52.036893+0000","last_peered":"2023-12-12T09:22:52.036893+0000","last_clean":"2023-12-12T09:22:52.036893+0000","last_became_active":"2023-12-12T09:22:50.341925+0000","last_became_peered":"2023-12-12T09:22:50.341925+0000","last_unstale":"2023-12-12T09:22:52.036893+0000","last_undegraded":"2023-12-12T09:22:52.036893+0000","last_fullsized":"2023-12-12T09:22:52.036893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:57:34.769334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.604241+0000","last_change":"2023-12-12T09:22:50.346546+0000","last_active":"2023-12-12T09:22:51.604241+0000","last_peered":"2023-12-12T09:22:51.604241+0000","last_clean":"2023-12-12T09:22:51.604241+0000","last_became_active":"2023-12-12T09:22:50.346018+0000","last_became_peered":"2023-12-12T09:22:50.346018+0000","last_unstale":"2023-12-12T09:22:51.604241+0000","last_undegraded":"2023-12-12T09:22:51.604241+0000","last_fullsized":"2023-12-12T09:22:51.604241+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:35:55.429451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.341378+0000","last_change":"2023-12-12T09:22:50.332216+0000","last_active":"2023-12-12T09:22:51.341378+0000","last_peered":"2023-12-12T09:22:51.341378+0000","last_clean":"2023-12-12T09:22:51.341378+0000","last_became_active":"2023-12-12T09:22:50.331946+0000","last_became_peered":"2023-12-12T09:22:50.331946+0000","last_unstale":"2023-12-12T09:22:51.341378+0000","last_undegraded":"2023-12-12T09:22:51.341378+0000","last_fullsized":"2023-12-12T09:22:51.341378+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:17:28.250406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039030+0000","last_change":"2023-12-12T09:22:50.343639+0000","last_active":"2023-12-12T09:22:52.039030+0000","last_peered":"2023-12-12T09:22:52.039030+0000","last_clean":"2023-12-12T09:22:52.039030+0000","last_became_active":"2023-12-12T09:22:50.343313+0000","last_became_peered":"2023-12-12T09:22:50.343313+0000","last_unstale":"2023-12-12T09:22:52.039030+0000","last_undegraded":"2023-12-12T09:22:52.039030+0000","last_fullsized":"2023-12-12T09:22:52.039030+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:13.749849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.603761+0000","last_change":"2023-12-12T09:22:50.334879+0000","last_active":"2023-12-12T09:22:51.603761+0000","last_peered":"2023-12-12T09:22:51.603761+0000","last_clean":"2023-12-12T09:22:51.603761+0000","last_became_active":"2023-12-12T09:22:50.334554+0000","last_became_peered":"2023-12-12T09:22:50.334554+0000","last_unstale":"2023-12-12T09:22:51.603761+0000","last_undegraded":"2023-12-12T09:22:51.603761+0000","last_fullsized":"2023-12-12T09:22:51.603761+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:41:10.606802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038288+0000","last_change":"2023-12-12T09:22:50.351320+0000","last_active":"2023-12-12T09:22:52.038288+0000","last_peered":"2023-12-12T09:22:52.038288+0000","last_clean":"2023-12-12T09:22:52.038288+0000","last_became_active":"2023-12-12T09:22:50.348396+0000","last_became_peered":"2023-12-12T09:22:50.348396+0000","last_unstale":"2023-12-12T09:22:52.038288+0000","last_undegraded":"2023-12-12T09:22:52.038288+0000","last_fullsized":"2023-12-12T09:22:52.038288+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:30:43.470302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037665+0000","last_change":"2023-12-12T09:22:50.337635+0000","last_active":"2023-12-12T09:22:52.037665+0000","last_peered":"2023-12-12T09:22:52.037665+0000","last_clean":"2023-12-12T09:22:52.037665+0000","last_became_active":"2023-12-12T09:22:50.336315+0000","last_became_peered":"2023-12-12T09:22:50.336315+0000","last_unstale":"2023-12-12T09:22:52.037665+0000","last_undegraded":"2023-12-12T09:22:52.037665+0000","last_fullsized":"2023-12-12T09:22:52.037665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:18:30.106110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.603307+0000","last_change":"2023-12-12T09:22:50.345716+0000","last_active":"2023-12-12T09:22:51.603307+0000","last_peered":"2023-12-12T09:22:51.603307+0000","last_clean":"2023-12-12T09:22:51.603307+0000","last_became_active":"2023-12-12T09:22:50.345437+0000","last_became_peered":"2023-12-12T09:22:50.345437+0000","last_unstale":"2023-12-12T09:22:51.603307+0000","last_undegraded":"2023-12-12T09:22:51.603307+0000","last_fullsized":"2023-12-12T09:22:51.603307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:33:38.235117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037351+0000","last_change":"2023-12-12T09:22:50.351200+0000","last_active":"2023-12-12T09:22:52.037351+0000","last_peered":"2023-12-12T09:22:52.037351+0000","last_clean":"2023-12-12T09:22:52.037351+0000","last_became_active":"2023-12-12T09:22:50.350947+0000","last_became_peered":"2023-12-12T09:22:50.350947+0000","last_unstale":"2023-12-12T09:22:52.037351+0000","last_undegraded":"2023-12-12T09:22:52.037351+0000","last_fullsized":"2023-12-12T09:22:52.037351+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:11:21.528607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039271+0000","last_change":"2023-12-12T09:22:50.329672+0000","last_active":"2023-12-12T09:22:52.039271+0000","last_peered":"2023-12-12T09:22:52.039271+0000","last_clean":"2023-12-12T09:22:52.039271+0000","last_became_active":"2023-12-12T09:22:50.329338+0000","last_became_peered":"2023-12-12T09:22:50.329338+0000","last_unstale":"2023-12-12T09:22:52.039271+0000","last_undegraded":"2023-12-12T09:22:52.039271+0000","last_fullsized":"2023-12-12T09:22:52.039271+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:13.948023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.367755+0000","last_change":"2023-12-12T09:22:49.312219+0000","last_active":"2023-12-12T09:22:50.367755+0000","last_peered":"2023-12-12T09:22:50.367755+0000","last_clean":"2023-12-12T09:22:50.367755+0000","last_became_active":"2023-12-12T09:22:49.311828+0000","last_became_peered":"2023-12-12T09:22:49.311828+0000","last_unstale":"2023-12-12T09:22:50.367755+0000","last_undegraded":"2023-12-12T09:22:50.367755+0000","last_fullsized":"2023-12-12T09:22:50.367755+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:56:27.499035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.335892+0000","last_change":"2023-12-12T09:22:50.340272+0000","last_active":"2023-12-12T09:22:51.335892+0000","last_peered":"2023-12-12T09:22:51.335892+0000","last_clean":"2023-12-12T09:22:51.335892+0000","last_became_active":"2023-12-12T09:22:50.339713+0000","last_became_peered":"2023-12-12T09:22:50.339713+0000","last_unstale":"2023-12-12T09:22:51.335892+0000","last_undegraded":"2023-12-12T09:22:51.335892+0000","last_fullsized":"2023-12-12T09:22:51.335892+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:08.124163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.370139+0000","last_change":"2023-12-12T09:22:49.306540+0000","last_active":"2023-12-12T09:22:50.370139+0000","last_peered":"2023-12-12T09:22:50.370139+0000","last_clean":"2023-12-12T09:22:50.370139+0000","last_became_active":"2023-12-12T09:22:49.306283+0000","last_became_peered":"2023-12-12T09:22:49.306283+0000","last_unstale":"2023-12-12T09:22:50.370139+0000","last_undegraded":"2023-12-12T09:22:50.370139+0000","last_fullsized":"2023-12-12T09:22:50.370139+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:03.231302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038897+0000","last_change":"2023-12-12T09:22:50.338596+0000","last_active":"2023-12-12T09:22:52.038897+0000","last_peered":"2023-12-12T09:22:52.038897+0000","last_clean":"2023-12-12T09:22:52.038897+0000","last_became_active":"2023-12-12T09:22:50.338299+0000","last_became_peered":"2023-12-12T09:22:50.338299+0000","last_unstale":"2023-12-12T09:22:52.038897+0000","last_undegraded":"2023-12-12T09:22:52.038897+0000","last_fullsized":"2023-12-12T09:22:52.038897+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:24.471730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.365300+0000","last_change":"2023-12-12T09:22:49.304758+0000","last_active":"2023-12-12T09:22:50.365300+0000","last_peered":"2023-12-12T09:22:50.365300+0000","last_clean":"2023-12-12T09:22:50.365300+0000","last_became_active":"2023-12-12T09:22:49.304487+0000","last_became_peered":"2023-12-12T09:22:49.304487+0000","last_unstale":"2023-12-12T09:22:50.365300+0000","last_undegraded":"2023-12-12T09:22:50.365300+0000","last_fullsized":"2023-12-12T09:22:50.365300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:53:35.402070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039094+0000","last_change":"2023-12-12T09:22:50.328018+0000","last_active":"2023-12-12T09:22:52.039094+0000","last_peered":"2023-12-12T09:22:52.039094+0000","last_clean":"2023-12-12T09:22:52.039094+0000","last_became_active":"2023-12-12T09:22:50.325156+0000","last_became_peered":"2023-12-12T09:22:50.325156+0000","last_unstale":"2023-12-12T09:22:52.039094+0000","last_undegraded":"2023-12-12T09:22:52.039094+0000","last_fullsized":"2023-12-12T09:22:52.039094+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:30:26.404747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.364071+0000","last_change":"2023-12-12T09:22:49.314610+0000","last_active":"2023-12-12T09:22:50.364071+0000","last_peered":"2023-12-12T09:22:50.364071+0000","last_clean":"2023-12-12T09:22:50.364071+0000","last_became_active":"2023-12-12T09:22:49.314219+0000","last_became_peered":"2023-12-12T09:22:49.314219+0000","last_unstale":"2023-12-12T09:22:50.364071+0000","last_undegraded":"2023-12-12T09:22:50.364071+0000","last_fullsized":"2023-12-12T09:22:50.364071+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:18:29.091087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037661+0000","last_change":"2023-12-12T09:22:50.350638+0000","last_active":"2023-12-12T09:22:52.037661+0000","last_peered":"2023-12-12T09:22:52.037661+0000","last_clean":"2023-12-12T09:22:52.037661+0000","last_became_active":"2023-12-12T09:22:50.350386+0000","last_became_peered":"2023-12-12T09:22:50.350386+0000","last_unstale":"2023-12-12T09:22:52.037661+0000","last_undegraded":"2023-12-12T09:22:52.037661+0000","last_fullsized":"2023-12-12T09:22:52.037661+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:25:39.331954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.360390+0000","last_change":"2023-12-12T09:22:49.310785+0000","last_active":"2023-12-12T09:22:50.360390+0000","last_peered":"2023-12-12T09:22:50.360390+0000","last_clean":"2023-12-12T09:22:50.360390+0000","last_became_active":"2023-12-12T09:22:49.310210+0000","last_became_peered":"2023-12-12T09:22:49.310210+0000","last_unstale":"2023-12-12T09:22:50.360390+0000","last_undegraded":"2023-12-12T09:22:50.360390+0000","last_fullsized":"2023-12-12T09:22:50.360390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037925+0000","last_change":"2023-12-12T09:22:50.345892+0000","last_active":"2023-12-12T09:22:52.037925+0000","last_peered":"2023-12-12T09:22:52.037925+0000","last_clean":"2023-12-12T09:22:52.037925+0000","last_became_active":"2023-12-12T09:22:50.345523+0000","last_became_peered":"2023-12-12T09:22:50.345523+0000","last_unstale":"2023-12-12T09:22:52.037925+0000","last_undegraded":"2023-12-12T09:22:52.037925+0000","last_fullsized":"2023-12-12T09:22:52.037925+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:35.130052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.362481+0000","last_change":"2023-12-12T09:22:49.313920+0000","last_active":"2023-12-12T09:22:50.362481+0000","last_peered":"2023-12-12T09:22:50.362481+0000","last_clean":"2023-12-12T09:22:50.362481+0000","last_became_active":"2023-12-12T09:22:49.313624+0000","last_became_peered":"2023-12-12T09:22:49.313624+0000","last_unstale":"2023-12-12T09:22:50.362481+0000","last_undegraded":"2023-12-12T09:22:50.362481+0000","last_fullsized":"2023-12-12T09:22:50.362481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:07:40.125862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037987+0000","last_change":"2023-12-12T09:22:50.340809+0000","last_active":"2023-12-12T09:22:52.037987+0000","last_peered":"2023-12-12T09:22:52.037987+0000","last_clean":"2023-12-12T09:22:52.037987+0000","last_became_active":"2023-12-12T09:22:50.340416+0000","last_became_peered":"2023-12-12T09:22:50.340416+0000","last_unstale":"2023-12-12T09:22:52.037987+0000","last_undegraded":"2023-12-12T09:22:52.037987+0000","last_fullsized":"2023-12-12T09:22:52.037987+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:29:38.746184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.318023+0000","last_change":"2023-12-12T09:22:49.312701+0000","last_active":"2023-12-12T09:22:50.318023+0000","last_peered":"2023-12-12T09:22:50.318023+0000","last_clean":"2023-12-12T09:22:50.318023+0000","last_became_active":"2023-12-12T09:22:49.312360+0000","last_became_peered":"2023-12-12T09:22:49.312360+0000","last_unstale":"2023-12-12T09:22:50.318023+0000","last_undegraded":"2023-12-12T09:22:50.318023+0000","last_fullsized":"2023-12-12T09:22:50.318023+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:57:03.999120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036922+0000","last_change":"2023-12-12T09:22:50.349035+0000","last_active":"2023-12-12T09:22:52.036922+0000","last_peered":"2023-12-12T09:22:52.036922+0000","last_clean":"2023-12-12T09:22:52.036922+0000","last_became_active":"2023-12-12T09:22:50.348718+0000","last_became_peered":"2023-12-12T09:22:50.348718+0000","last_unstale":"2023-12-12T09:22:52.036922+0000","last_undegraded":"2023-12-12T09:22:52.036922+0000","last_fullsized":"2023-12-12T09:22:52.036922+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:30:38.144611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.313415+0000","last_change":"2023-12-12T09:22:49.301866+0000","last_active":"2023-12-12T09:22:50.313415+0000","last_peered":"2023-12-12T09:22:50.313415+0000","last_clean":"2023-12-12T09:22:50.313415+0000","last_became_active":"2023-12-12T09:22:49.301545+0000","last_became_peered":"2023-12-12T09:22:49.301545+0000","last_unstale":"2023-12-12T09:22:50.313415+0000","last_undegraded":"2023-12-12T09:22:50.313415+0000","last_fullsized":"2023-12-12T09:22:50.313415+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:10:19.181850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.342644+0000","last_change":"2023-12-12T09:22:50.337698+0000","last_active":"2023-12-12T09:22:51.342644+0000","last_peered":"2023-12-12T09:22:51.342644+0000","last_clean":"2023-12-12T09:22:51.342644+0000","last_became_active":"2023-12-12T09:22:50.337328+0000","last_became_peered":"2023-12-12T09:22:50.337328+0000","last_unstale":"2023-12-12T09:22:51.342644+0000","last_undegraded":"2023-12-12T09:22:51.342644+0000","last_fullsized":"2023-12-12T09:22:51.342644+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:18:30.106110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.326079+0000","last_change":"2023-12-12T09:22:49.317862+0000","last_active":"2023-12-12T09:22:50.326079+0000","last_peered":"2023-12-12T09:22:50.326079+0000","last_clean":"2023-12-12T09:22:50.326079+0000","last_became_active":"2023-12-12T09:22:49.317519+0000","last_became_peered":"2023-12-12T09:22:49.317519+0000","last_unstale":"2023-12-12T09:22:50.326079+0000","last_undegraded":"2023-12-12T09:22:50.326079+0000","last_fullsized":"2023-12-12T09:22:50.326079+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038799+0000","last_change":"2023-12-12T09:22:50.339580+0000","last_active":"2023-12-12T09:22:52.038799+0000","last_peered":"2023-12-12T09:22:52.038799+0000","last_clean":"2023-12-12T09:22:52.038799+0000","last_became_active":"2023-12-12T09:22:50.339153+0000","last_became_peered":"2023-12-12T09:22:50.339153+0000","last_unstale":"2023-12-12T09:22:52.038799+0000","last_undegraded":"2023-12-12T09:22:52.038799+0000","last_fullsized":"2023-12-12T09:22:52.038799+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:57:05.014143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.339914+0000","last_change":"2023-12-12T09:22:49.310163+0000","last_active":"2023-12-12T09:22:50.339914+0000","last_peered":"2023-12-12T09:22:50.339914+0000","last_clean":"2023-12-12T09:22:50.339914+0000","last_became_active":"2023-12-12T09:22:49.309844+0000","last_became_peered":"2023-12-12T09:22:49.309844+0000","last_unstale":"2023-12-12T09:22:50.339914+0000","last_undegraded":"2023-12-12T09:22:50.339914+0000","last_fullsized":"2023-12-12T09:22:50.339914+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:37:24.103752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.335252+0000","last_change":"2023-12-12T09:22:50.348022+0000","last_active":"2023-12-12T09:22:51.335252+0000","last_peered":"2023-12-12T09:22:51.335252+0000","last_clean":"2023-12-12T09:22:51.335252+0000","last_became_active":"2023-12-12T09:22:50.345835+0000","last_became_peered":"2023-12-12T09:22:50.345835+0000","last_unstale":"2023-12-12T09:22:51.335252+0000","last_undegraded":"2023-12-12T09:22:51.335252+0000","last_fullsized":"2023-12-12T09:22:51.335252+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:03:01.609260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.369953+0000","last_change":"2023-12-12T09:22:49.312212+0000","last_active":"2023-12-12T09:22:50.369953+0000","last_peered":"2023-12-12T09:22:50.369953+0000","last_clean":"2023-12-12T09:22:50.369953+0000","last_became_active":"2023-12-12T09:22:49.311875+0000","last_became_peered":"2023-12-12T09:22:49.311875+0000","last_unstale":"2023-12-12T09:22:50.369953+0000","last_undegraded":"2023-12-12T09:22:50.369953+0000","last_fullsized":"2023-12-12T09:22:50.369953+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:07.109140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038638+0000","last_change":"2023-12-12T09:22:50.341648+0000","last_active":"2023-12-12T09:22:52.038638+0000","last_peered":"2023-12-12T09:22:52.038638+0000","last_clean":"2023-12-12T09:22:52.038638+0000","last_became_active":"2023-12-12T09:22:50.341230+0000","last_became_peered":"2023-12-12T09:22:50.341230+0000","last_unstale":"2023-12-12T09:22:52.038638+0000","last_undegraded":"2023-12-12T09:22:52.038638+0000","last_fullsized":"2023-12-12T09:22:52.038638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:53:36.417093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.370373+0000","last_change":"2023-12-12T09:22:49.317782+0000","last_active":"2023-12-12T09:22:50.370373+0000","last_peered":"2023-12-12T09:22:50.370373+0000","last_clean":"2023-12-12T09:22:50.370373+0000","last_became_active":"2023-12-12T09:22:49.317482+0000","last_became_peered":"2023-12-12T09:22:49.317482+0000","last_unstale":"2023-12-12T09:22:50.370373+0000","last_undegraded":"2023-12-12T09:22:50.370373+0000","last_fullsized":"2023-12-12T09:22:50.370373+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:03:00.594237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.342144+0000","last_change":"2023-12-12T09:22:50.342605+0000","last_active":"2023-12-12T09:22:51.342144+0000","last_peered":"2023-12-12T09:22:51.342144+0000","last_clean":"2023-12-12T09:22:51.342144+0000","last_became_active":"2023-12-12T09:22:50.342297+0000","last_became_peered":"2023-12-12T09:22:50.342297+0000","last_unstale":"2023-12-12T09:22:51.342144+0000","last_undegraded":"2023-12-12T09:22:51.342144+0000","last_fullsized":"2023-12-12T09:22:51.342144+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:08:24.471730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.367557+0000","last_change":"2023-12-12T09:22:49.310312+0000","last_active":"2023-12-12T09:22:50.367557+0000","last_peered":"2023-12-12T09:22:50.367557+0000","last_clean":"2023-12-12T09:22:50.367557+0000","last_became_active":"2023-12-12T09:22:49.309975+0000","last_became_peered":"2023-12-12T09:22:49.309975+0000","last_unstale":"2023-12-12T09:22:50.367557+0000","last_undegraded":"2023-12-12T09:22:50.367557+0000","last_fullsized":"2023-12-12T09:22:50.367557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:40:35.691688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037535+0000","last_change":"2023-12-12T09:22:50.344980+0000","last_active":"2023-12-12T09:22:52.037535+0000","last_peered":"2023-12-12T09:22:52.037535+0000","last_clean":"2023-12-12T09:22:52.037535+0000","last_became_active":"2023-12-12T09:22:50.344652+0000","last_became_peered":"2023-12-12T09:22:50.344652+0000","last_unstale":"2023-12-12T09:22:52.037535+0000","last_undegraded":"2023-12-12T09:22:52.037535+0000","last_fullsized":"2023-12-12T09:22:52.037535+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:15:55.851502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.327493+0000","last_change":"2023-12-12T09:22:49.317453+0000","last_active":"2023-12-12T09:22:50.327493+0000","last_peered":"2023-12-12T09:22:50.327493+0000","last_clean":"2023-12-12T09:22:50.327493+0000","last_became_active":"2023-12-12T09:22:49.317074+0000","last_became_peered":"2023-12-12T09:22:49.317074+0000","last_unstale":"2023-12-12T09:22:50.327493+0000","last_undegraded":"2023-12-12T09:22:50.327493+0000","last_fullsized":"2023-12-12T09:22:50.327493+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:17:19.666367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.341673+0000","last_change":"2023-12-12T09:22:50.331893+0000","last_active":"2023-12-12T09:22:51.341673+0000","last_peered":"2023-12-12T09:22:51.341673+0000","last_clean":"2023-12-12T09:22:51.341673+0000","last_became_active":"2023-12-12T09:22:50.329865+0000","last_became_peered":"2023-12-12T09:22:50.329865+0000","last_unstale":"2023-12-12T09:22:51.341673+0000","last_undegraded":"2023-12-12T09:22:51.341673+0000","last_fullsized":"2023-12-12T09:22:51.341673+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:15:55.851502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.317685+0000","last_change":"2023-12-12T09:22:49.312560+0000","last_active":"2023-12-12T09:22:50.317685+0000","last_peered":"2023-12-12T09:22:50.317685+0000","last_clean":"2023-12-12T09:22:50.317685+0000","last_became_active":"2023-12-12T09:22:49.312207+0000","last_became_peered":"2023-12-12T09:22:49.312207+0000","last_unstale":"2023-12-12T09:22:50.317685+0000","last_undegraded":"2023-12-12T09:22:50.317685+0000","last_fullsized":"2023-12-12T09:22:50.317685+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:43:44.385231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038108+0000","last_change":"2023-12-12T09:22:50.349902+0000","last_active":"2023-12-12T09:22:52.038108+0000","last_peered":"2023-12-12T09:22:52.038108+0000","last_clean":"2023-12-12T09:22:52.038108+0000","last_became_active":"2023-12-12T09:22:50.349627+0000","last_became_peered":"2023-12-12T09:22:50.349627+0000","last_unstale":"2023-12-12T09:22:52.038108+0000","last_undegraded":"2023-12-12T09:22:52.038108+0000","last_fullsized":"2023-12-12T09:22:52.038108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:56:03.563610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.370137+0000","last_change":"2023-12-12T09:22:49.316431+0000","last_active":"2023-12-12T09:22:50.370137+0000","last_peered":"2023-12-12T09:22:50.370137+0000","last_clean":"2023-12-12T09:22:50.370137+0000","last_became_active":"2023-12-12T09:22:49.315687+0000","last_became_peered":"2023-12-12T09:22:49.315687+0000","last_unstale":"2023-12-12T09:22:50.370137+0000","last_undegraded":"2023-12-12T09:22:50.370137+0000","last_fullsized":"2023-12-12T09:22:50.370137+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:43:40.240102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038634+0000","last_change":"2023-12-12T09:22:50.338213+0000","last_active":"2023-12-12T09:22:52.038634+0000","last_peered":"2023-12-12T09:22:52.038634+0000","last_clean":"2023-12-12T09:22:52.038634+0000","last_became_active":"2023-12-12T09:22:50.337947+0000","last_became_peered":"2023-12-12T09:22:50.337947+0000","last_unstale":"2023-12-12T09:22:52.038634+0000","last_undegraded":"2023-12-12T09:22:52.038634+0000","last_fullsized":"2023-12-12T09:22:52.038634+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:24:04.725145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.367476+0000","last_change":"2023-12-12T09:22:49.310717+0000","last_active":"2023-12-12T09:22:50.367476+0000","last_peered":"2023-12-12T09:22:50.367476+0000","last_clean":"2023-12-12T09:22:50.367476+0000","last_became_active":"2023-12-12T09:22:49.310424+0000","last_became_peered":"2023-12-12T09:22:49.310424+0000","last_unstale":"2023-12-12T09:22:50.367476+0000","last_undegraded":"2023-12-12T09:22:50.367476+0000","last_fullsized":"2023-12-12T09:22:50.367476+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:47:53.648351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.341351+0000","last_change":"2023-12-12T09:22:50.336798+0000","last_active":"2023-12-12T09:22:51.341351+0000","last_peered":"2023-12-12T09:22:51.341351+0000","last_clean":"2023-12-12T09:22:51.341351+0000","last_became_active":"2023-12-12T09:22:50.336282+0000","last_became_peered":"2023-12-12T09:22:50.336282+0000","last_unstale":"2023-12-12T09:22:51.341351+0000","last_undegraded":"2023-12-12T09:22:51.341351+0000","last_fullsized":"2023-12-12T09:22:51.341351+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:23:41.648515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.365452+0000","last_change":"2023-12-12T09:22:49.311109+0000","last_active":"2023-12-12T09:22:50.365452+0000","last_peered":"2023-12-12T09:22:50.365452+0000","last_clean":"2023-12-12T09:22:50.365452+0000","last_became_active":"2023-12-12T09:22:49.310693+0000","last_became_peered":"2023-12-12T09:22:49.310693+0000","last_unstale":"2023-12-12T09:22:50.365452+0000","last_undegraded":"2023-12-12T09:22:50.365452+0000","last_fullsized":"2023-12-12T09:22:50.365452+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:16.173389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037977+0000","last_change":"2023-12-12T09:22:50.352298+0000","last_active":"2023-12-12T09:22:52.037977+0000","last_peered":"2023-12-12T09:22:52.037977+0000","last_clean":"2023-12-12T09:22:52.037977+0000","last_became_active":"2023-12-12T09:22:50.347192+0000","last_became_peered":"2023-12-12T09:22:50.347192+0000","last_unstale":"2023-12-12T09:22:52.037977+0000","last_undegraded":"2023-12-12T09:22:52.037977+0000","last_fullsized":"2023-12-12T09:22:52.037977+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:15:57.151949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.364057+0000","last_change":"2023-12-12T09:22:49.315722+0000","last_active":"2023-12-12T09:22:50.364057+0000","last_peered":"2023-12-12T09:22:50.364057+0000","last_clean":"2023-12-12T09:22:50.364057+0000","last_became_active":"2023-12-12T09:22:49.314425+0000","last_became_peered":"2023-12-12T09:22:49.314425+0000","last_unstale":"2023-12-12T09:22:50.364057+0000","last_undegraded":"2023-12-12T09:22:50.364057+0000","last_fullsized":"2023-12-12T09:22:50.364057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:34:16.173389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039032+0000","last_change":"2023-12-12T09:22:50.341712+0000","last_active":"2023-12-12T09:22:52.039032+0000","last_peered":"2023-12-12T09:22:52.039032+0000","last_clean":"2023-12-12T09:22:52.039032+0000","last_became_active":"2023-12-12T09:22:50.341427+0000","last_became_peered":"2023-12-12T09:22:50.341427+0000","last_unstale":"2023-12-12T09:22:52.039032+0000","last_undegraded":"2023-12-12T09:22:52.039032+0000","last_fullsized":"2023-12-12T09:22:52.039032+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:16:50.117128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.310526+0000","last_change":"2023-12-12T09:22:49.302394+0000","last_active":"2023-12-12T09:22:50.310526+0000","last_peered":"2023-12-12T09:22:50.310526+0000","last_clean":"2023-12-12T09:22:50.310526+0000","last_became_active":"2023-12-12T09:22:49.302117+0000","last_became_peered":"2023-12-12T09:22:49.302117+0000","last_unstale":"2023-12-12T09:22:50.310526+0000","last_undegraded":"2023-12-12T09:22:50.310526+0000","last_fullsized":"2023-12-12T09:22:50.310526+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:04:00.254020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.342206+0000","last_change":"2023-12-12T09:22:50.338573+0000","last_active":"2023-12-12T09:22:51.342206+0000","last_peered":"2023-12-12T09:22:51.342206+0000","last_clean":"2023-12-12T09:22:51.342206+0000","last_became_active":"2023-12-12T09:22:50.338252+0000","last_became_peered":"2023-12-12T09:22:50.338252+0000","last_unstale":"2023-12-12T09:22:51.342206+0000","last_undegraded":"2023-12-12T09:22:51.342206+0000","last_fullsized":"2023-12-12T09:22:51.342206+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:52:13.749849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.370417+0000","last_change":"2023-12-12T09:22:49.300566+0000","last_active":"2023-12-12T09:22:50.370417+0000","last_peered":"2023-12-12T09:22:50.370417+0000","last_clean":"2023-12-12T09:22:50.370417+0000","last_became_active":"2023-12-12T09:22:49.300278+0000","last_became_peered":"2023-12-12T09:22:49.300278+0000","last_unstale":"2023-12-12T09:22:50.370417+0000","last_undegraded":"2023-12-12T09:22:50.370417+0000","last_fullsized":"2023-12-12T09:22:50.370417+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:32:26.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038857+0000","last_change":"2023-12-12T09:22:50.349493+0000","last_active":"2023-12-12T09:22:52.038857+0000","last_peered":"2023-12-12T09:22:52.038857+0000","last_clean":"2023-12-12T09:22:52.038857+0000","last_became_active":"2023-12-12T09:22:50.347205+0000","last_became_peered":"2023-12-12T09:22:50.347205+0000","last_unstale":"2023-12-12T09:22:52.038857+0000","last_undegraded":"2023-12-12T09:22:52.038857+0000","last_fullsized":"2023-12-12T09:22:52.038857+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:44:33.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.336036+0000","last_change":"2023-12-12T09:22:49.309982+0000","last_active":"2023-12-12T09:22:50.336036+0000","last_peered":"2023-12-12T09:22:50.336036+0000","last_clean":"2023-12-12T09:22:50.336036+0000","last_became_active":"2023-12-12T09:22:49.309679+0000","last_became_peered":"2023-12-12T09:22:49.309679+0000","last_unstale":"2023-12-12T09:22:50.336036+0000","last_undegraded":"2023-12-12T09:22:50.336036+0000","last_fullsized":"2023-12-12T09:22:50.336036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:10:19.181850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036737+0000","last_change":"2023-12-12T09:22:50.335580+0000","last_active":"2023-12-12T09:22:52.036737+0000","last_peered":"2023-12-12T09:22:52.036737+0000","last_clean":"2023-12-12T09:22:52.036737+0000","last_became_active":"2023-12-12T09:22:50.335285+0000","last_became_peered":"2023-12-12T09:22:50.335285+0000","last_unstale":"2023-12-12T09:22:52.036737+0000","last_undegraded":"2023-12-12T09:22:52.036737+0000","last_fullsized":"2023-12-12T09:22:52.036737+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:27:54.001510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.315722+0000","last_change":"2023-12-12T09:22:49.318054+0000","last_active":"2023-12-12T09:22:50.315722+0000","last_peered":"2023-12-12T09:22:50.315722+0000","last_clean":"2023-12-12T09:22:50.315722+0000","last_became_active":"2023-12-12T09:22:49.316900+0000","last_became_peered":"2023-12-12T09:22:49.316900+0000","last_unstale":"2023-12-12T09:22:50.315722+0000","last_undegraded":"2023-12-12T09:22:50.315722+0000","last_fullsized":"2023-12-12T09:22:50.315722+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:20:52.453972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.341377+0000","last_change":"2023-12-12T09:22:50.346319+0000","last_active":"2023-12-12T09:22:51.341377+0000","last_peered":"2023-12-12T09:22:51.341377+0000","last_clean":"2023-12-12T09:22:51.341377+0000","last_became_active":"2023-12-12T09:22:50.346034+0000","last_became_peered":"2023-12-12T09:22:50.346034+0000","last_unstale":"2023-12-12T09:22:51.341377+0000","last_undegraded":"2023-12-12T09:22:51.341377+0000","last_fullsized":"2023-12-12T09:22:51.341377+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:11:21.528607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.364868+0000","last_change":"2023-12-12T09:22:49.299101+0000","last_active":"2023-12-12T09:22:50.364868+0000","last_peered":"2023-12-12T09:22:50.364868+0000","last_clean":"2023-12-12T09:22:50.364868+0000","last_became_active":"2023-12-12T09:22:49.298806+0000","last_became_peered":"2023-12-12T09:22:49.298806+0000","last_unstale":"2023-12-12T09:22:50.364868+0000","last_undegraded":"2023-12-12T09:22:50.364868+0000","last_fullsized":"2023-12-12T09:22:50.364868+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:25:14.371805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.341527+0000","last_change":"2023-12-12T09:22:50.331388+0000","last_active":"2023-12-12T09:22:51.341527+0000","last_peered":"2023-12-12T09:22:51.341527+0000","last_clean":"2023-12-12T09:22:51.341527+0000","last_became_active":"2023-12-12T09:22:50.330945+0000","last_became_peered":"2023-12-12T09:22:50.330945+0000","last_unstale":"2023-12-12T09:22:51.341527+0000","last_undegraded":"2023-12-12T09:22:51.341527+0000","last_fullsized":"2023-12-12T09:22:51.341527+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T09:44:33.633728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039456+0000","last_change":"2023-12-12T09:22:49.313836+0000","last_active":"2023-12-12T09:22:52.039456+0000","last_peered":"2023-12-12T09:22:52.039456+0000","last_clean":"2023-12-12T09:22:52.039456+0000","last_became_active":"2023-12-12T09:22:49.313538+0000","last_became_peered":"2023-12-12T09:22:49.313538+0000","last_unstale":"2023-12-12T09:22:52.039456+0000","last_undegraded":"2023-12-12T09:22:52.039456+0000","last_fullsized":"2023-12-12T09:22:52.039456+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:56:02.548586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.335389+0000","last_change":"2023-12-12T09:22:50.346110+0000","last_active":"2023-12-12T09:22:51.335389+0000","last_peered":"2023-12-12T09:22:51.335389+0000","last_clean":"2023-12-12T09:22:51.335389+0000","last_became_active":"2023-12-12T09:22:50.344784+0000","last_became_peered":"2023-12-12T09:22:50.344784+0000","last_unstale":"2023-12-12T09:22:51.335389+0000","last_undegraded":"2023-12-12T09:22:51.335389+0000","last_fullsized":"2023-12-12T09:22:51.335389+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:52.595278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.334337+0000","last_change":"2023-12-12T09:22:49.316665+0000","last_active":"2023-12-12T09:22:50.334337+0000","last_peered":"2023-12-12T09:22:50.334337+0000","last_clean":"2023-12-12T09:22:50.334337+0000","last_became_active":"2023-12-12T09:22:49.315307+0000","last_became_peered":"2023-12-12T09:22:49.315307+0000","last_unstale":"2023-12-12T09:22:50.334337+0000","last_undegraded":"2023-12-12T09:22:50.334337+0000","last_fullsized":"2023-12-12T09:22:50.334337+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:19:51.198011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.039416+0000","last_change":"2023-12-12T09:22:50.329797+0000","last_active":"2023-12-12T09:22:52.039416+0000","last_peered":"2023-12-12T09:22:52.039416+0000","last_clean":"2023-12-12T09:22:52.039416+0000","last_became_active":"2023-12-12T09:22:50.328986+0000","last_became_peered":"2023-12-12T09:22:50.328986+0000","last_unstale":"2023-12-12T09:22:52.039416+0000","last_undegraded":"2023-12-12T09:22:52.039416+0000","last_fullsized":"2023-12-12T09:22:52.039416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:54:39.866786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.314175+0000","last_change":"2023-12-12T09:22:49.313997+0000","last_active":"2023-12-12T09:22:50.314175+0000","last_peered":"2023-12-12T09:22:50.314175+0000","last_clean":"2023-12-12T09:22:50.314175+0000","last_became_active":"2023-12-12T09:22:49.313632+0000","last_became_peered":"2023-12-12T09:22:49.313632+0000","last_unstale":"2023-12-12T09:22:50.314175+0000","last_undegraded":"2023-12-12T09:22:50.314175+0000","last_fullsized":"2023-12-12T09:22:50.314175+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:07:46.294433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037661+0000","last_change":"2023-12-12T09:22:50.350081+0000","last_active":"2023-12-12T09:22:52.037661+0000","last_peered":"2023-12-12T09:22:52.037661+0000","last_clean":"2023-12-12T09:22:52.037661+0000","last_became_active":"2023-12-12T09:22:50.349570+0000","last_became_peered":"2023-12-12T09:22:50.349570+0000","last_unstale":"2023-12-12T09:22:52.037661+0000","last_undegraded":"2023-12-12T09:22:52.037661+0000","last_fullsized":"2023-12-12T09:22:52.037661+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:57:00.723323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.330991+0000","last_change":"2023-12-12T09:22:49.312354+0000","last_active":"2023-12-12T09:22:50.330991+0000","last_peered":"2023-12-12T09:22:50.330991+0000","last_clean":"2023-12-12T09:22:50.330991+0000","last_became_active":"2023-12-12T09:22:49.312037+0000","last_became_peered":"2023-12-12T09:22:49.312037+0000","last_unstale":"2023-12-12T09:22:50.330991+0000","last_undegraded":"2023-12-12T09:22:50.330991+0000","last_fullsized":"2023-12-12T09:22:50.330991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:57:33.754311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037957+0000","last_change":"2023-12-12T09:22:50.347720+0000","last_active":"2023-12-12T09:22:52.037957+0000","last_peered":"2023-12-12T09:22:52.037957+0000","last_clean":"2023-12-12T09:22:52.037957+0000","last_became_active":"2023-12-12T09:22:50.347350+0000","last_became_peered":"2023-12-12T09:22:50.347350+0000","last_unstale":"2023-12-12T09:22:52.037957+0000","last_undegraded":"2023-12-12T09:22:52.037957+0000","last_fullsized":"2023-12-12T09:22:52.037957+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:07:47.309456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.316233+0000","last_change":"2023-12-12T09:22:49.313350+0000","last_active":"2023-12-12T09:22:50.316233+0000","last_peered":"2023-12-12T09:22:50.316233+0000","last_clean":"2023-12-12T09:22:50.316233+0000","last_became_active":"2023-12-12T09:22:49.313073+0000","last_became_peered":"2023-12-12T09:22:49.313073+0000","last_unstale":"2023-12-12T09:22:50.316233+0000","last_undegraded":"2023-12-12T09:22:50.316233+0000","last_fullsized":"2023-12-12T09:22:50.316233+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:08:51.580255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:51.335199+0000","last_change":"2023-12-12T09:22:50.348230+0000","last_active":"2023-12-12T09:22:51.335199+0000","last_peered":"2023-12-12T09:22:51.335199+0000","last_clean":"2023-12-12T09:22:51.335199+0000","last_became_active":"2023-12-12T09:22:50.347703+0000","last_became_peered":"2023-12-12T09:22:50.347703+0000","last_unstale":"2023-12-12T09:22:51.335199+0000","last_undegraded":"2023-12-12T09:22:51.335199+0000","last_fullsized":"2023-12-12T09:22:51.335199+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:42:38.770839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.331157+0000","last_change":"2023-12-12T09:22:49.297287+0000","last_active":"2023-12-12T09:22:50.331157+0000","last_peered":"2023-12-12T09:22:50.331157+0000","last_clean":"2023-12-12T09:22:50.331157+0000","last_became_active":"2023-12-12T09:22:49.296996+0000","last_became_peered":"2023-12-12T09:22:49.296996+0000","last_unstale":"2023-12-12T09:22:50.331157+0000","last_undegraded":"2023-12-12T09:22:50.331157+0000","last_fullsized":"2023-12-12T09:22:50.331157+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:08:41.025867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.037285+0000","last_change":"2023-12-12T09:22:50.347997+0000","last_active":"2023-12-12T09:22:52.037285+0000","last_peered":"2023-12-12T09:22:52.037285+0000","last_clean":"2023-12-12T09:22:52.037285+0000","last_became_active":"2023-12-12T09:22:50.346667+0000","last_became_peered":"2023-12-12T09:22:50.346667+0000","last_unstale":"2023-12-12T09:22:52.037285+0000","last_undegraded":"2023-12-12T09:22:52.037285+0000","last_fullsized":"2023-12-12T09:22:52.037285+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:50:40.802811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.330721+0000","last_change":"2023-12-12T09:22:49.312112+0000","last_active":"2023-12-12T09:22:50.330721+0000","last_peered":"2023-12-12T09:22:50.330721+0000","last_clean":"2023-12-12T09:22:50.330721+0000","last_became_active":"2023-12-12T09:22:49.311865+0000","last_became_peered":"2023-12-12T09:22:49.311865+0000","last_unstale":"2023-12-12T09:22:50.330721+0000","last_undegraded":"2023-12-12T09:22:50.330721+0000","last_fullsized":"2023-12-12T09:22:50.330721+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:19:09.034752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.036827+0000","last_change":"2023-12-12T09:22:50.344361+0000","last_active":"2023-12-12T09:22:52.036827+0000","last_peered":"2023-12-12T09:22:52.036827+0000","last_clean":"2023-12-12T09:22:52.036827+0000","last_became_active":"2023-12-12T09:22:50.344093+0000","last_became_peered":"2023-12-12T09:22:50.344093+0000","last_unstale":"2023-12-12T09:22:52.036827+0000","last_undegraded":"2023-12-12T09:22:52.036827+0000","last_fullsized":"2023-12-12T09:22:52.036827+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:49.269891+0000","last_clean_scrub_stamp":"2023-12-12T09:22:49.269891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:10:02.183754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.328345+0000","last_change":"2023-12-12T09:22:49.314029+0000","last_active":"2023-12-12T09:22:50.328345+0000","last_peered":"2023-12-12T09:22:50.328345+0000","last_clean":"2023-12-12T09:22:50.328345+0000","last_became_active":"2023-12-12T09:22:49.313717+0000","last_became_peered":"2023-12-12T09:22:49.313717+0000","last_unstale":"2023-12-12T09:22:50.328345+0000","last_undegraded":"2023-12-12T09:22:50.328345+0000","last_fullsized":"2023-12-12T09:22:50.328345+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:22:48.254868+0000","last_clean_scrub_stamp":"2023-12-12T09:22:48.254868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:12:22.503784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-12T09:22:50.322398+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:22:50.322398+0000","last_peered":"2023-12-12T09:22:50.322398+0000","last_clean":"2023-12-12T09:22:50.322398+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:22:50.322398+0000","last_undegraded":"2023-12-12T09:22:50.322398+0000","last_fullsized":"2023-12-12T09:22:50.322398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":902215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.036,"15min":1.0229999999999999},"min":{"1min":0.60299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.52,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.2490000000000001,"15min":1.2829999999999999},"min":{"1min":0.89400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5900000000000001,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.5009999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.024,"15min":0.98099999999999998},"min":{"1min":0.754,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.526,"5min":1.827,"15min":1.827},"last":1.012},{"interface":"front","average":{"1min":1.149,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.786,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.53}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.137,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5960000000000001,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.306}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.92700000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.746,"5min":1.887,"15min":1.887},"last":1.46},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2270000000000001,"15min":1.246},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.621,"5min":2.355,"15min":2.355},"last":1.1659999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3580000000000001},"min":{"1min":0.90600000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.696,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.351},"min":{"1min":0.872,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8069999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.5880000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.387,"15min":1.407},"min":{"1min":1.0700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.724,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.98599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7769999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.3819999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.425,"15min":1.415},"min":{"1min":1.034,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9610000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.641},{"interface":"front","average":{"1min":1.577,"5min":1.472,"15min":1.4690000000000001},"min":{"1min":1.202,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8700000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.5609999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":311687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.97399999999999998,"15min":0.94599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5029999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.2270000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.84099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.387},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.722,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.569}]},{"osd":2,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.196,"15min":1.1819999999999999},"min":{"1min":0.87,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.80000000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.635,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.5149999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.198},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.679,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.363},"min":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.429}]},{"osd":4,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.365,"15min":1.361},"min":{"1min":1.042,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8919999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.46},{"interface":"front","average":{"1min":1.288,"5min":1.268,"15min":1.2569999999999999},"min":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.925,"5min":1.996,"15min":1.996},"last":0.98199999999999998}]},{"osd":5,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":1.087,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.109},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4430000000000001,"15min":1.4299999999999999},"min":{"1min":1.1970000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.6140000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.369,"15min":1.355},"min":{"1min":1.171,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.679,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.4910000000000001,"15min":1.484},"min":{"1min":1.0920000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.837,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.488}]}]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":312339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.998,"15min":1.016},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.331,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.113,"15min":1.141},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5980000000000001,"5min":1.909,"15min":1.909},"last":1.333}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.232},"min":{"1min":0.81799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.373,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.133},{"interface":"front","average":{"1min":1.127,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7949999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7909999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.7589999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4750000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5960000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.335,"15min":1.3680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6950000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.4079999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.284,"15min":1.266},"min":{"1min":1.0569999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9970000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4750000000000001,"15min":1.49},"min":{"1min":0.98499999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.5529999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.79300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7669999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.623},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.46,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1680000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.5820000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.569,"15min":1.581},"min":{"1min":1.1080000000000001,"5min":0.627,"15min":0.627},"max":{"1min":2.238,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.375},{"interface":"front","average":{"1min":1.52,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0369999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.331,"15min":2.331},"last":1.6950000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":704512,"data_stored":313299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.151,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.538,"5min":1.633,"15min":1.633},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.119,"15min":1.123},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.669,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.0940000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.194,"15min":1.1799999999999999},"min":{"1min":0.71999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.806,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.538,"5min":2.117,"15min":2.117},"last":0.85099999999999998}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.502,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.327}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.339,"15min":1.353},"min":{"1min":0.995,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7589999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7070000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.1679999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.885,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.456},"min":{"1min":1.0149999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7230000000000001,"5min":3.343,"15min":3.343},"last":1.4119999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.45,"15min":1.4930000000000001},"min":{"1min":1.0680000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.845,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5529999999999999,"15min":1.583},"min":{"1min":1.012,"5min":0.755,"15min":0.755},"max":{"1min":1.7629999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.619}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.5589999999999999,"15min":1.581},"min":{"1min":1.0529999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8029999999999999,"5min":3.085,"15min":3.085},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.5980000000000001,"15min":1.6519999999999999},"min":{"1min":1.1910000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.964,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.4450000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":311743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88200000000000001,"15min":0.91300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4990000000000001,"5min":1.718,"15min":1.718},"last":0.82299999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.548,"5min":1.71,"15min":1.71},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":1.4419999999999999,"5min":1.575,"15min":1.575},"last":0.872}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.071,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5609999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.155},{"interface":"front","average":{"1min":1.024,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.482,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.0680000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.222,"15min":1.24},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.956,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.254}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3080000000000001},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.212},{"interface":"front","average":{"1min":1.274,"5min":1.29,"15min":1.284},"min":{"1min":0.871,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.623,"5min":1.73,"15min":1.73},"last":1.482}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3069999999999999,"15min":1.3260000000000001},"min":{"1min":0.78400000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6639999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.319},{"interface":"front","average":{"1min":1.429,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.81799999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0259999999999998,"5min":2.198,"15min":2.198},"last":1.302}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3859999999999999,"15min":1.4019999999999999},"min":{"1min":0.93200000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6759999999999999,"5min":1.847,"15min":1.847},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3740000000000001,"15min":1.3979999999999999},"min":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.768,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.371}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":311743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.109},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":1.379}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.1439999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.3080000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.292}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.5940000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.427},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.5149999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":311777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.876}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.504,"5min":1.613,"15min":1.613},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.048,"15min":1.05},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5369999999999999,"5min":2.903,"15min":2.903},"last":1.4690000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.998,"15min":1.002},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.341,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.008,"5min":0.90900000000000003,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4750000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.82999999999999996}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.149,"15min":1.133},"min":{"1min":0.84899999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.036},{"interface":"front","average":{"1min":1.165,"5min":1.167,"15min":1.165},"min":{"1min":0.67000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7430000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.339}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6379999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.093},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3109999999999999,"15min":1.3280000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6240000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.204}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3080000000000001,"15min":1.288},"min":{"1min":0.879,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0659999999999998,"5min":2.867,"15min":2.867},"last":1.24},{"interface":"front","average":{"1min":1.341,"5min":1.357,"15min":1.3640000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.835,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.252}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4119999999999999,"15min":1.4279999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7230000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.355,"15min":1.337},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1240000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.1879999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1302528,"data_stored":904249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.439,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.135,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.363,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.1519999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.014,"15min":1.071},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.018,"15min":1.0429999999999999},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.96199999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.294},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":1.6299999999999999,"5min":2.464,"15min":2.464},"last":0.68100000000000005}]},{"osd":4,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.232},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.621,"5min":2.343,"15min":2.343},"last":1.431},{"interface":"front","average":{"1min":1.22,"5min":1.341,"15min":1.375},"min":{"1min":0.82899999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.5629999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.879}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3049999999999999,"15min":1.333},"min":{"1min":0.878,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.774,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7030000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.2150000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4550000000000001,"15min":1.5029999999999999},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4970000000000001,"5min":2.573,"15min":2.573},"last":1.331},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3500000000000001,"15min":1.381},"min":{"1min":0.91600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.2549999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4039999999999999,"15min":1.4319999999999999},"min":{"1min":0.90800000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.698,"5min":1.968,"15min":1.968},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.353,"15min":1.383},"min":{"1min":0.80100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7969999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:23:00.236 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T09:23:00.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-12T09:23:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.502+0000 7f2cbe301640 1 Processor -- start 2023-12-12T09:23:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.502+0000 7f2cbe301640 1 -- start start 2023-12-12T09:23:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.504+0000 7f2cbe301640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2cb80ce6f0 0x7f2cb813e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.504+0000 7f2cbe301640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80ce260 con 0x7f2cb806dff0 2023-12-12T09:23:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.504+0000 7f2cbe301640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80ceb00 con 0x7f2cb80b40d0 2023-12-12T09:23:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.504+0000 7f2cbe301640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb806e480 con 0x7f2cb80ce6f0 2023-12-12T09:23:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.504+0000 7f2caffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2cb806dff0 0x7f2cb815be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51398/0 (socket says 172.21.15.84:51398) 2023-12-12T09:23:00.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.504+0000 7f2caffff640 1 -- 172.21.15.84:0/1987689278 learned_addr learned my addr 172.21.15.84:0/1987689278 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cbc89e640 1 --2- 172.21.15.84:0/1987689278 >> v2:172.21.15.99:3300/0 conn(0x7f2cb80ce6f0 0x7f2cb813e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690113029 0 0) 0x7f2cb80ce260 con 0x7f2cb806dff0 2023-12-12T09:23:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca4003520 con 0x7f2cb806dff0 2023-12-12T09:23:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2020042470 0 0) 0x7f2ca4003520 con 0x7f2cb806dff0 2023-12-12T09:23:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 >> v2:172.21.15.99:3300/0 conn(0x7f2cb80ce6f0 msgr2=0x7f2cb813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 --2- 172.21.15.84:0/1987689278 >> v2:172.21.15.99:3300/0 conn(0x7f2cb80ce6f0 0x7f2cb813e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 >> v1:172.21.15.99:6789/0 conn(0x7f2cb80b40d0 legacy=0x7f2cb80b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80cd930 con 0x7f2cb806dff0 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2ca0001670 con 0x7f2cb806dff0 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 >> v1:172.21.15.84:6789/0 conn(0x7f2cb806dff0 legacy=0x7f2cb815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ca4003970 0x7f2ca4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ca40047c0 0x7f2ca4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2ca400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb806e480 con 0x7f2ca4005180 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca400c020 con 0x7f2ca40047c0 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.505+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca400c1e0 con 0x7f2ca4003970 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.506+0000 7f2cbc89e640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2ca400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.506+0000 7f2caffff640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ca40047c0 0x7f2ca4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.506+0000 7f2cbc89e640 1 -- 172.21.15.84:0/1987689278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ca4003970 msgr2=0x7f2ca4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.506+0000 7f2cbc89e640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2ca4003970 0x7f2ca4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.506+0000 7f2cbc89e640 1 -- 172.21.15.84:0/1987689278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ca40047c0 msgr2=0x7f2ca4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.506+0000 7f2cbc89e640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ca40047c0 0x7f2ca4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.506+0000 7f2cbc89e640 1 -- 172.21.15.84:0/1987689278 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca4003520 con 0x7f2ca4005180 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.507+0000 7f2cbc89e640 1 -- 172.21.15.84:0/1987689278 reap_dead start 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.507+0000 7f2cbc89e640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2ca400b980 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009fc0 tx=0x7f2ca40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277e2048f4fb5be9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.507+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb002cc60 con 0x7f2ca4005180 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.507+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb000f040 con 0x7f2ca4005180 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.507+0000 7f2cb77fe640 1 -- 172.21.15.84:0/1987689278 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0003990 con 0x7f2ca4005180 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.508+0000 7f2cbe301640 1 -- 172.21.15.84:0/1987689278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 msgr2=0x7f2ca400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.508+0000 7f2cbe301640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2ca400b980 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009fc0 tx=0x7f2ca40057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.508+0000 7f2cbe301640 1 -- 172.21.15.84:0/1987689278 shutdown_connections 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.508+0000 7f2cbe301640 1 --2- 172.21.15.84:0/1987689278 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2ca400b980 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.508+0000 7f2cbe301640 1 -- 172.21.15.84:0/1987689278 >> 172.21.15.84:0/1987689278 conn(0x7f2cb80b0ac0 msgr2=0x7f2cb80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.508+0000 7f2cbe301640 1 -- 172.21.15.84:0/1987689278 shutdown_connections 2023-12-12T09:23:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.508+0000 7f2cbe301640 1 -- 172.21.15.84:0/1987689278 wait complete. 2023-12-12T09:23:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.510+0000 7f2cbe301640 1 Processor -- start 2023-12-12T09:23:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.510+0000 7f2cbe301640 1 -- start start 2023-12-12T09:23:00.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cbe301640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2cb814ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:00.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cbe301640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb81f2cf0 0x7f2cb8150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:00.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cbe301640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80722b0 0x7f2cb81508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:00.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cbe301640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb814f810 con 0x7f2ca4005180 2023-12-12T09:23:00.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cbe301640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb814faf0 con 0x7f2cb81f2cf0 2023-12-12T09:23:00.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cbe301640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb8070040 con 0x7f2cb80722b0 2023-12-12T09:23:00.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cb7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2cb814ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:00.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cb7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2cb814ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51716/0 (socket says 172.21.15.84:51716) 2023-12-12T09:23:00.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.511+0000 7f2cb7fff640 1 -- 172.21.15.84:0/313912401 learned_addr learned my addr 172.21.15.84:0/313912401 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2caffff640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb81f2cf0 0x7f2cb8150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cbc89e640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80722b0 0x7f2cb81508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb7fff640 1 -- 172.21.15.84:0/313912401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80722b0 msgr2=0x7f2cb81508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb7fff640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80722b0 0x7f2cb81508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb7fff640 1 -- 172.21.15.84:0/313912401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb81f2cf0 msgr2=0x7f2cb8150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb7fff640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb81f2cf0 0x7f2cb8150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb7fff640 1 -- 172.21.15.84:0/313912401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8070320 con 0x7f2ca4005180 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb7fff640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2cb814ef10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c400 tx=0x7f2ca800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb57fa640 1 -- 172.21.15.84:0/313912401 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80052d0 con 0x7f2ca4005180 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb57fa640 1 -- 172.21.15.84:0/313912401 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8005470 con 0x7f2ca4005180 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cb57fa640 1 -- 172.21.15.84:0/313912401 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8003830 con 0x7f2ca4005180 2023-12-12T09:23:00.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb8070600 con 0x7f2ca4005180 2023-12-12T09:23:00.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.512+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb813da90 con 0x7f2ca4005180 2023-12-12T09:23:00.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.513+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb814fc60 con 0x7f2ca4005180 2023-12-12T09:23:00.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.514+0000 7f2cb57fa640 1 -- 172.21.15.84:0/313912401 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ca8003990 con 0x7f2ca4005180 2023-12-12T09:23:00.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.515+0000 7f2cb57fa640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c9806ae40 0x7f2c9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:00.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.515+0000 7f2cb57fa640 1 -- 172.21.15.84:0/313912401 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2ca8088870 con 0x7f2ca4005180 2023-12-12T09:23:00.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.515+0000 7f2caffff640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c9806ae40 0x7f2c9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:00.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.516+0000 7f2caffff640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c9806ae40 0x7f2c9806d300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00017a0 tx=0x7f2ca0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:00.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.519+0000 7f2cb57fa640 1 -- 172.21.15.84:0/313912401 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ca8057320 con 0x7f2ca4005180 2023-12-12T09:23:00.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.780+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2cb80673c0 con 0x7f2ca4005180 2023-12-12T09:23:00.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.785+0000 7f2cb57fa640 1 -- 172.21.15.84:0/313912401 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2ca8017020 con 0x7f2ca4005180 2023-12-12T09:23:00.786 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:23:00.787 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:23:00.787 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-12-12T09:23:00.787 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-12-12T09:23:00.787 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-12T09:23:00.787 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-12-12T09:23:00.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.788+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c9806ae40 msgr2=0x7f2c9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.788+0000 7f2cbe301640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c9806ae40 0x7f2c9806d300 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00017a0 tx=0x7f2ca0009040 comp rx=0 tx=0).stop 2023-12-12T09:23:00.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.788+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 msgr2=0x7f2cb814ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:00.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.788+0000 7f2cbe301640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2cb814ef10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c400 tx=0x7f2ca800c8c0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.789+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 shutdown_connections 2023-12-12T09:23:00.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.789+0000 7f2cbe301640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2cb80722b0 0x7f2cb81508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.789+0000 7f2cbe301640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb81f2cf0 0x7f2cb8150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.789+0000 7f2cbe301640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2c9806ae40 0x7f2c9806d300 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.789+0000 7f2cbe301640 1 --2- 172.21.15.84:0/313912401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ca4005180 0x7f2cb814ef10 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.789+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 >> 172.21.15.84:0/313912401 conn(0x7f2cb80b0ac0 msgr2=0x7f2cb815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.789+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 shutdown_connections 2023-12-12T09:23:00.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:00.789+0000 7f2cbe301640 1 -- 172.21.15.84:0/313912401 wait complete. 2023-12-12T09:23:00.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:23:01.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.017+0000 7f71bf4da640 1 Processor -- start 2023-12-12T09:23:01.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.017+0000 7f71bf4da640 1 -- start start 2023-12-12T09:23:01.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bf4da640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f71b8143d20 0x7f71b80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bf4da640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71b80ce550 0x7f71b80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bf4da640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b80cea30 con 0x7f71b81447f0 2023-12-12T09:23:01.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bf4da640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80702b0 con 0x7f71b80ce550 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bf4da640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b8070590 con 0x7f71b8143d20 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bca75640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71b80ce550 0x7f71b80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bda77640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f71b81447f0 0x7f71b815eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51404/0 (socket says 172.21.15.84:51404) 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bda77640 1 -- 172.21.15.84:0/268175680 learned_addr learned my addr 172.21.15.84:0/268175680 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.019+0000 7f71bd276640 1 --2- 172.21.15.84:0/268175680 >> v2:172.21.15.99:3300/0 conn(0x7f71b8143d20 0x7f71b80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.020+0000 7f71bca75640 1 -- 172.21.15.84:0/268175680 >> v2:172.21.15.99:3300/0 conn(0x7f71b8143d20 msgr2=0x7f71b80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.020+0000 7f71bca75640 1 --2- 172.21.15.84:0/268175680 >> v2:172.21.15.99:3300/0 conn(0x7f71b8143d20 0x7f71b80b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.020+0000 7f71bca75640 1 -- 172.21.15.84:0/268175680 >> v1:172.21.15.84:6789/0 conn(0x7f71b81447f0 legacy=0x7f71b815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.020+0000 7f71bca75640 1 -- 172.21.15.84:0/268175680 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8070870 con 0x7f71b80ce550 2023-12-12T09:23:01.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.020+0000 7f71affff640 1 -- 172.21.15.84:0/268175680 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708419123 0 0) 0x7f71b80cea30 con 0x7f71b81447f0 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.021+0000 7f71bca75640 1 --2- 172.21.15.84:0/268175680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b80ce550 0x7f71b80b4610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f71b804f7a0 tx=0x7f71a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b8d13f8882ace8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.021+0000 7f71affff640 1 -- 172.21.15.84:0/268175680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8031830 con 0x7f71b80ce550 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.021+0000 7f71affff640 1 -- 172.21.15.84:0/268175680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8031990 con 0x7f71b80ce550 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.021+0000 7f71affff640 1 -- 172.21.15.84:0/268175680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8031d20 con 0x7f71b80ce550 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.022+0000 7f71bf4da640 1 -- 172.21.15.84:0/268175680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b80ce550 msgr2=0x7f71b80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.022+0000 7f71bf4da640 1 --2- 172.21.15.84:0/268175680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b80ce550 0x7f71b80b4610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f71b804f7a0 tx=0x7f71a802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.022+0000 7f71bf4da640 1 -- 172.21.15.84:0/268175680 shutdown_connections 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.022+0000 7f71bf4da640 1 --2- 172.21.15.84:0/268175680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b80ce550 0x7f71b80b4610 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.022+0000 7f71bf4da640 1 --2- 172.21.15.84:0/268175680 >> v2:172.21.15.99:3300/0 conn(0x7f71b8143d20 0x7f71b80b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.022+0000 7f71bf4da640 1 -- 172.21.15.84:0/268175680 >> 172.21.15.84:0/268175680 conn(0x7f71b806c3d0 msgr2=0x7f71b806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.022+0000 7f71bf4da640 1 -- 172.21.15.84:0/268175680 shutdown_connections 2023-12-12T09:23:01.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.022+0000 7f71bf4da640 1 -- 172.21.15.84:0/268175680 wait complete. 2023-12-12T09:23:01.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.024+0000 7f71bf4da640 1 Processor -- start 2023-12-12T09:23:01.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.024+0000 7f71bf4da640 1 -- start start 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bf4da640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71b80ce550 0x7f71b80ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bf4da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b8143d20 0x7f71b80ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bf4da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b81447f0 0x7f71b81f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bf4da640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80aaef0 con 0x7f71b8143d20 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bf4da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b813bec0 con 0x7f71b81447f0 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bf4da640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b813b340 con 0x7f71b80ce550 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bca75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b8143d20 0x7f71b80ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bca75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b8143d20 0x7f71b80ad5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51728/0 (socket says 172.21.15.84:51728) 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.025+0000 7f71bca75640 1 -- 172.21.15.84:0/4247994314 learned_addr learned my addr 172.21.15.84:0/4247994314 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bd276640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71b80ce550 0x7f71b80ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bca75640 1 -- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71b80ce550 msgr2=0x7f71b80ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bda77640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b81447f0 0x7f71b81f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bca75640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71b80ce550 0x7f71b80ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bca75640 1 -- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b81447f0 msgr2=0x7f71b81f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bca75640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b81447f0 0x7f71b81f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bca75640 1 -- 172.21.15.84:0/4247994314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009400 con 0x7f71b8143d20 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bda77640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b81447f0 0x7f71b81f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bca75640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b8143d20 0x7f71b80ad5a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009890 tx=0x7f71a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71adffb640 1 -- 172.21.15.84:0/4247994314 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80317d0 con 0x7f71b8143d20 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71adffb640 1 -- 172.21.15.84:0/4247994314 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a803ba70 con 0x7f71b8143d20 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71adffb640 1 -- 172.21.15.84:0/4247994314 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a803be20 con 0x7f71b8143d20 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b813b620 con 0x7f71b8143d20 2023-12-12T09:23:01.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.026+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b813bbe0 con 0x7f71b8143d20 2023-12-12T09:23:01.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.028+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b80a8c00 con 0x7f71b8143d20 2023-12-12T09:23:01.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.028+0000 7f71adffb640 1 -- 172.21.15.84:0/4247994314 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71a80453f0 con 0x7f71b8143d20 2023-12-12T09:23:01.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.029+0000 7f71adffb640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f719c06ae40 0x7f719c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.029+0000 7f71adffb640 1 -- 172.21.15.84:0/4247994314 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f71a80abb90 con 0x7f71b8143d20 2023-12-12T09:23:01.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.030+0000 7f71bd276640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f719c06ae40 0x7f719c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.030+0000 7f71bd276640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f719c06ae40 0x7f719c06d300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f71b4006fd0 tx=0x7f71b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.033+0000 7f71adffb640 1 -- 172.21.15.84:0/4247994314 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71b80a8c00 con 0x7f71b8143d20 2023-12-12T09:23:01.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.263+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71b80a8c00 con 0x7f71b8143d20 2023-12-12T09:23:01.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.264+0000 7f71adffb640 1 -- 172.21.15.84:0/4247994314 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f71b80a8c00 con 0x7f71b8143d20 2023-12-12T09:23:01.265 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:01.266 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1966836821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1966836821},{"type":"v1","addr":"172.21.15.99:6835","nonce":1966836821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/4165741100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":4165741100},{"type":"v1","addr":"172.21.15.99:6833","nonce":4165741100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3716664132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3716664132},{"type":"v1","addr":"172.21.15.84:6836","nonce":3716664132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:22:49.741201+0000","modified":"2023-12-12T09:22:52.822545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6237},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6237":{"gid":6237,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/3202590301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3202590301},{"type":"v1","addr":"172.21.15.84:6837","nonce":3202590301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:23:01.266 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f719c06ae40 msgr2=0x7f719c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f719c06ae40 0x7f719c06d300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f71b4006fd0 tx=0x7f71b4008040 comp rx=0 tx=0).stop 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b8143d20 msgr2=0x7f71b80ad5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b8143d20 0x7f71b80ad5a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009890 tx=0x7f71a80046c0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 shutdown_connections 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b81447f0 0x7f71b81f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f719c06ae40 0x7f719c06d300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71b8143d20 0x7f71b80ad5a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 --2- 172.21.15.84:0/4247994314 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f71b80ce550 0x7f71b80ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 >> 172.21.15.84:0/4247994314 conn(0x7f71b806c3d0 msgr2=0x7f71b806d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 shutdown_connections 2023-12-12T09:23:01.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.267+0000 7f71bf4da640 1 -- 172.21.15.84:0/4247994314 wait complete. 2023-12-12T09:23:01.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T09:22:49.741201+0000', 'modified': '2023-12-12T09:22:52.822545+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6237}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6237': {'gid': 6237, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.84:6837/3202590301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6835', 'nonce': 3202590301}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 3202590301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T09:23:01.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T09:23:01.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-12T09:23:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.908+0000 7eff3b599640 1 Processor -- start 2023-12-12T09:23:01.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.909+0000 7eff3b599640 1 -- start start 2023-12-12T09:23:01.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.910+0000 7eff3b599640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff3415d130 0x7eff340d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.910+0000 7eff3b599640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff340b6460 con 0x7eff340cff90 2023-12-12T09:23:01.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.910+0000 7eff3b599640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff340d18d0 con 0x7eff340d1470 2023-12-12T09:23:01.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.910+0000 7eff3b599640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3415d510 con 0x7eff3415d130 2023-12-12T09:23:01.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff3ad98640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7eff340cff90 0x7eff340b68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51406/0 (socket says 172.21.15.84:51406) 2023-12-12T09:23:01.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff3ad98640 1 -- 172.21.15.84:0/316575429 learned_addr learned my addr 172.21.15.84:0/316575429 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:01.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff3a597640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff3415d130 0x7eff340d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518278928 0 0) 0x7eff340b6460 con 0x7eff340cff90 2023-12-12T09:23:01.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff20003520 con 0x7eff340cff90 2023-12-12T09:23:01.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2948633078 0 0) 0x7eff20003520 con 0x7eff340cff90 2023-12-12T09:23:01.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff3415d130 msgr2=0x7eff340d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff3415d130 0x7eff340d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 >> v1:172.21.15.99:6789/0 conn(0x7eff340d1470 legacy=0x7eff340cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340d1b50 con 0x7eff340cff90 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7eff2c0019f0 con 0x7eff340cff90 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 >> v1:172.21.15.84:6789/0 conn(0x7eff340cff90 legacy=0x7eff340b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff20003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.911+0000 7eff39595640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff3415d130 0x7eff200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff39595640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff20004d00 0x7eff20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3415d510 con 0x7eff200039a0 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2000bb60 con 0x7eff20004d00 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2000bd20 con 0x7eff3415d130 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff3a597640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff20003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff39d96640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff3415d130 0x7eff200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff3ad98640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff20004d00 0x7eff20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff3a597640 1 -- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff3415d130 msgr2=0x7eff200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff3a597640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff3415d130 0x7eff200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff3a597640 1 -- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff20004d00 msgr2=0x7eff20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff3a597640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff20004d00 0x7eff20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.912+0000 7eff3a597640 1 -- 172.21.15.84:0/316575429 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20003520 con 0x7eff200039a0 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.914+0000 7eff3a597640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff20003dc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7eff3000ba30 tx=0x7eff200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbf5462d77fcc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.914+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30032640 con 0x7eff200039a0 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.914+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff300327a0 con 0x7eff200039a0 2023-12-12T09:23:01.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.914+0000 7eff39595640 1 -- 172.21.15.84:0/316575429 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30032b30 con 0x7eff200039a0 2023-12-12T09:23:01.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.915+0000 7eff3b599640 1 -- 172.21.15.84:0/316575429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 msgr2=0x7eff20003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.915+0000 7eff3b599640 1 --2- 172.21.15.84:0/316575429 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff20003dc0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7eff3000ba30 tx=0x7eff200057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.915+0000 7eff3ad98640 1 -- 172.21.15.84:0/316575429 reap_dead start 2023-12-12T09:23:01.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.915+0000 7eff3b599640 1 -- 172.21.15.84:0/316575429 shutdown_connections 2023-12-12T09:23:01.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.915+0000 7eff3b599640 1 -- 172.21.15.84:0/316575429 >> 172.21.15.84:0/316575429 conn(0x7eff340d2e90 msgr2=0x7eff340d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:01.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.915+0000 7eff3b599640 1 -- 172.21.15.84:0/316575429 shutdown_connections 2023-12-12T09:23:01.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.915+0000 7eff3b599640 1 -- 172.21.15.84:0/316575429 wait complete. 2023-12-12T09:23:01.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.917+0000 7eff3b599640 1 Processor -- start 2023-12-12T09:23:01.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.917+0000 7eff3b599640 1 -- start start 2023-12-12T09:23:01.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3b599640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff340cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3b599640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff340c9f60 0x7eff340ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3b599640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff34158aa0 0x7eff340c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3b599640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff340cb2a0 con 0x7eff200039a0 2023-12-12T09:23:01.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3b599640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff340cd330 con 0x7eff34158aa0 2023-12-12T09:23:01.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3b599640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff340ca3c0 con 0x7eff340c9f60 2023-12-12T09:23:01.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3a597640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff340cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3a597640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff340cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51754/0 (socket says 172.21.15.84:51754) 2023-12-12T09:23:01.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3a597640 1 -- 172.21.15.84:0/2589235374 learned_addr learned my addr 172.21.15.84:0/2589235374 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff39d96640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff340c9f60 0x7eff340ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3a597640 1 -- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff340c9f60 msgr2=0x7eff340ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3a597640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff340c9f60 0x7eff340ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3a597640 1 -- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff34158aa0 msgr2=0x7eff340c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.918+0000 7eff3ad98640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff34158aa0 0x7eff340c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff3a597640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff34158aa0 0x7eff340c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff3a597640 1 -- 172.21.15.84:0/2589235374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff340ca620 con 0x7eff200039a0 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff3ad98640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff34158aa0 0x7eff340c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff3a597640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff340cb6c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7eff3002bec0 tx=0x7eff30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff2affd640 1 -- 172.21.15.84:0/2589235374 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3003ba70 con 0x7eff200039a0 2023-12-12T09:23:01.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff2affd640 1 -- 172.21.15.84:0/2589235374 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3003bbd0 con 0x7eff200039a0 2023-12-12T09:23:01.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff2affd640 1 -- 172.21.15.84:0/2589235374 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30030410 con 0x7eff200039a0 2023-12-12T09:23:01.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff3b599640 1 -- 172.21.15.84:0/2589235374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff340ca900 con 0x7eff200039a0 2023-12-12T09:23:01.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.919+0000 7eff3b599640 1 -- 172.21.15.84:0/2589235374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff340caec0 con 0x7eff200039a0 2023-12-12T09:23:01.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.922+0000 7eff2affd640 1 -- 172.21.15.84:0/2589235374 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff30030570 con 0x7eff200039a0 2023-12-12T09:23:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.922+0000 7eff2affd640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff1806ae70 0x7eff1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.923+0000 7eff2affd640 1 -- 172.21.15.84:0/2589235374 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7eff300abee0 con 0x7eff200039a0 2023-12-12T09:23:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.923+0000 7eff39d96640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff1806ae70 0x7eff1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.923+0000 7eff3f38d740 1 Processor -- start 2023-12-12T09:23:01.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.923+0000 7eff39d96640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff1806ae70 0x7eff1806d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7eff24007fd0 tx=0x7eff24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.924+0000 7eff3f38d740 1 -- start start 2023-12-12T09:23:01.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.924+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fac1e0 0x55ced1fac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.924+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7c490 0x55ced1fa9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.924+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 0x55ced1fa9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.924+0000 7eff3f38d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ced1eeef40 con 0x55ced1fac1e0 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.924+0000 7eff3f38d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ced1eec630 con 0x55ced1f7fd60 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.924+0000 7eff3f38d740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ced1ee7f20 con 0x55ced1f7c490 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fac1e0 0x55ced1fac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fac1e0 0x55ced1fac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51770/0 (socket says 172.21.15.84:51770) 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 -- 172.21.15.84:0/1458300418 learned_addr learned my addr 172.21.15.84:0/1458300418 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 -- 172.21.15.84:0/1458300418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7c490 msgr2=0x55ced1fa9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 --2- 172.21.15.84:0/1458300418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7c490 0x55ced1fa9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 -- 172.21.15.84:0/1458300418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 msgr2=0x55ced1fa9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 --2- 172.21.15.84:0/1458300418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 0x55ced1fa9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 -- 172.21.15.84:0/1458300418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ced1eaa910 con 0x55ced1fac1e0 2023-12-12T09:23:01.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.925+0000 7eff3a597640 1 --2- 172.21.15.84:0/1458300418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fac1e0 0x55ced1fac5c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7eff30006ce0 tx=0x7eff3007a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303afbf99ffe3764 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff17fff640 1 -- 172.21.15.84:0/1458300418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3007ec50 con 0x55ced1fac1e0 2023-12-12T09:23:01.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff17fff640 1 -- 172.21.15.84:0/1458300418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff30082e00 con 0x55ced1fac1e0 2023-12-12T09:23:01.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff17fff640 1 -- 172.21.15.84:0/1458300418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000b600 con 0x55ced1fac1e0 2023-12-12T09:23:01.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 -- 172.21.15.84:0/1458300418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fac1e0 msgr2=0x55ced1fac5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 --2- 172.21.15.84:0/1458300418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fac1e0 0x55ced1fac5c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7eff30006ce0 tx=0x7eff3007a460 comp rx=0 tx=0).stop 2023-12-12T09:23:01.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 -- 172.21.15.84:0/1458300418 shutdown_connections 2023-12-12T09:23:01.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 --2- 172.21.15.84:0/1458300418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 0x55ced1fa9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 --2- 172.21.15.84:0/1458300418 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7c490 0x55ced1fa9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 --2- 172.21.15.84:0/1458300418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fac1e0 0x55ced1fac5c0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 -- 172.21.15.84:0/1458300418 >> 172.21.15.84:0/1458300418 conn(0x55ced1f7e700 msgr2=0x55ced1fc6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:01.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 -- 172.21.15.84:0/1458300418 shutdown_connections 2023-12-12T09:23:01.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.926+0000 7eff3f38d740 1 -- 172.21.15.84:0/1458300418 wait complete. 2023-12-12T09:23:01.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.927+0000 7eff3f38d740 1 -- start start 2023-12-12T09:23:01.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.927+0000 7eff3f38d740 1 Processor -- start 2023-12-12T09:23:01.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.928+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7fd60 0x55ced1fca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.928+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fac1e0 0x55ced1fa7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.928+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fadb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.928+0000 7eff3f38d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ced1e842f0 con 0x55ced1fc7780 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.928+0000 7eff3f38d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ced1ea1c70 con 0x55ced1fac1e0 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.928+0000 7eff3f38d740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ced1c4af20 con 0x55ced1f7fd60 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.928+0000 7eff3f38d740 10 client.0 _ll_register_callbacks cb 0x55ced1ea63b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fadb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fadb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51774/0 (socket says 172.21.15.84:51774) 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 -- 172.21.15.84:0/3053754007 learned_addr learned my addr 172.21.15.84:0/3053754007 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3a597640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7fd60 0x55ced1fca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff39d96640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fac1e0 0x55ced1fa7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 -- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7fd60 msgr2=0x55ced1fca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7fd60 0x55ced1fca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 -- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fac1e0 msgr2=0x55ced1fa7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fac1e0 0x55ced1fa7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 -- 172.21.15.84:0/3053754007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff340caec0 con 0x55ced1fc7780 2023-12-12T09:23:01.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3a597640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7fd60 0x55ced1fca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff39d96640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fac1e0 0x55ced1fa7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff3ad98640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fadb70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7eff3408d3c0 tx=0x7eff2c007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68802f2b4d3256dd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.929+0000 7eff157fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff157fa640 1 -- 172.21.15.84:0/3053754007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00d070 con 0x55ced1fc7780 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff157fa640 1 -- 172.21.15.84:0/3053754007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7eff2c00f8a0 con 0x55ced1fc7780 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 1 -- 172.21.15.84:0/3053754007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ced1ee0db0 con 0x55ced1fc7780 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff157fa640 1 -- 172.21.15.84:0/3053754007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff2c00fa60 con 0x55ced1fc7780 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 10 client.6402 fetch_fsmap learned FSMap version 27 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 1 -- 172.21.15.84:0/3053754007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55ced1ee65a0 con 0x55ced1fc7780 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff157fa640 1 -- 172.21.15.84:0/3053754007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ced1ee0db0 con 0x55ced1fc7780 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff157fa640 1 -- 172.21.15.84:0/3053754007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) v1 ==== 3294+0+0 (secure 0 0 0) 0x7eff2c00fbc0 con 0x55ced1fc7780 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 10 client.6402 fetch_fsmap finished waiting for FSMap version 27 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 10 client.6402 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 20 client.6402 populate_metadata read hostname 'smithi084' 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] conn(0x55ced1fe06f0 0x55ced1fe4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 4 client.6402 mds_command: new command op to 6237 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T09:23:01.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.930+0000 7eff3f38d740 1 -- 172.21.15.84:0/3053754007 --> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ced1ee0ad0 con 0x55ced1fe06f0 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.931+0000 7eff3a597640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] conn(0x55ced1fe06f0 0x55ced1fe4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.931+0000 7eff3a597640 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] conn(0x55ced1fe06f0 0x55ced1fe4690 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77ced7c47a35af70 server_cookie=e5ca0d48d138b4f in_seq=0 out_seq=0 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.931+0000 7eff157fa640 10 client.6402 ms_handle_connect on v2:172.21.15.84:6835/3202590301 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff157fa640 1 -- 172.21.15.84:0/3053754007 <== mds.0 v2:172.21.15.84:6835/3202590301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ced1ee0ad0 con 0x55ced1fe06f0 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff157fa640 10 client.6402 handle_command_reply: tid=0 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 client.6402 shutdown 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 -- 172.21.15.84:0/3053754007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 msgr2=0x55ced1fadb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fadb70 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7eff3408d3c0 tx=0x7eff2c007a60 comp rx=0 tx=0).stop 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 -- 172.21.15.84:0/3053754007 shutdown_connections 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] conn(0x55ced1fe06f0 0x55ced1fe4690 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fadb70 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fac1e0 0x55ced1fa7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 --2- 172.21.15.84:0/3053754007 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1f7fd60 0x55ced1fca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff157fa640 0 client.6402 ms_handle_reset on v2:172.21.15.84:6835/3202590301 2023-12-12T09:23:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.932+0000 7eff3f38d740 1 -- 172.21.15.84:0/3053754007 >> 172.21.15.84:0/3053754007 conn(0x55ced1f7c490 msgr2=0x55ced1fa88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.933+0000 7eff3f38d740 1 -- 172.21.15.84:0/3053754007 shutdown_connections 2023-12-12T09:23:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.933+0000 7eff3f38d740 1 -- 172.21.15.84:0/3053754007 wait complete. 2023-12-12T09:23:01.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.933+0000 7eff3f38d740 20 client.6402 trim_cache size 0 max 16384 2023-12-12T09:23:01.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.949+0000 7eff3f38d740 1 Processor -- start 2023-12-12T09:23:01.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.950+0000 7eff3f38d740 1 -- start start 2023-12-12T09:23:01.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.950+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1f7fd60 0x55ced1f80420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.950+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 0x55ced1fa4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.950+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fc7780 0x55ced1fa4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3f38d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ced1f823c0 con 0x55ced1f7fd60 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3f38d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ced1f825f0 con 0x55ced1fc7780 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3f38d740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ced1fc7b90 con 0x55ced1fac1e0 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3a597640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1f7fd60 0x55ced1f80420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3a597640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1f7fd60 0x55ced1f80420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51790/0 (socket says 172.21.15.84:51790) 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3a597640 1 -- 172.21.15.84:0/1830511014 learned_addr learned my addr 172.21.15.84:0/1830511014 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff39d96640 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 0x55ced1fa4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3a597640 1 -- 172.21.15.84:0/1830511014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 msgr2=0x55ced1fa4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3a597640 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 0x55ced1fa4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3a597640 1 -- 172.21.15.84:0/1830511014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fc7780 msgr2=0x55ced1fa4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3ad98640 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fc7780 0x55ced1fa4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3a597640 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fc7780 0x55ced1fa4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.951+0000 7eff3a597640 1 -- 172.21.15.84:0/1830511014 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ced1e83b80 con 0x55ced1f7fd60 2023-12-12T09:23:01.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff3a597640 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1f7fd60 0x55ced1f80420 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7eff3007acc0 tx=0x7eff30090000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3db3204881e310 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff28ff9640 1 -- 172.21.15.84:0/1830511014 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30099040 con 0x55ced1f7fd60 2023-12-12T09:23:01.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff28ff9640 1 -- 172.21.15.84:0/1830511014 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3007b200 con 0x55ced1f7fd60 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff28ff9640 1 -- 172.21.15.84:0/1830511014 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3000b600 con 0x55ced1f7fd60 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff3f38d740 1 -- 172.21.15.84:0/1830511014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1f7fd60 msgr2=0x55ced1f80420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff3f38d740 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1f7fd60 0x55ced1f80420 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7eff3007acc0 tx=0x7eff30090000 comp rx=0 tx=0).stop 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff3f38d740 1 -- 172.21.15.84:0/1830511014 shutdown_connections 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff3f38d740 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1fc7780 0x55ced1fa4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff3f38d740 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 0x55ced1fa4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff3f38d740 1 --2- 172.21.15.84:0/1830511014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1f7fd60 0x55ced1f80420 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.952+0000 7eff3f38d740 1 -- 172.21.15.84:0/1830511014 >> 172.21.15.84:0/1830511014 conn(0x55ced1f7c490 msgr2=0x55ced1fa7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.953+0000 7eff3f38d740 1 -- 172.21.15.84:0/1830511014 shutdown_connections 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.953+0000 7eff3f38d740 1 -- 172.21.15.84:0/1830511014 wait complete. 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.953+0000 7eff3f38d740 1 -- start start 2023-12-12T09:23:01.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.954+0000 7eff3f38d740 1 Processor -- start 2023-12-12T09:23:01.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 0x55ced1f812e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 0x55ced1f81820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3f38d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fc8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3f38d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ced1f83870 con 0x55ced1fc7780 2023-12-12T09:23:01.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3f38d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ced1f97ae0 con 0x55ced1f7fd60 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3f38d740 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ced1f97f00 con 0x55ced1fac1e0 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3f38d740 10 client.0 _ll_register_callbacks cb 0x55ced1fa8290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3ad98640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fc8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3ad98640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fc8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51806/0 (socket says 172.21.15.84:51806) 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3ad98640 1 -- 172.21.15.84:0/2536064694 learned_addr learned my addr 172.21.15.84:0/2536064694 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3a597640 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 0x55ced1f812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3ad98640 1 -- 172.21.15.84:0/2536064694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 msgr2=0x55ced1f81820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3ad98640 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 0x55ced1f81820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3ad98640 1 -- 172.21.15.84:0/2536064694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 msgr2=0x55ced1f812e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3ad98640 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 0x55ced1f812e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.955+0000 7eff3ad98640 1 -- 172.21.15.84:0/2536064694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ced1eaa910 con 0x55ced1fc7780 2023-12-12T09:23:01.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff3ad98640 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fc8710 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00fe60 tx=0x7eff2c001ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38443d7c2f313881 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:01.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff157fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-12-12T09:23:01.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff157fa640 1 -- 172.21.15.84:0/2536064694 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0148e0 con 0x55ced1fc7780 2023-12-12T09:23:01.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff157fa640 1 -- 172.21.15.84:0/2536064694 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7eff2c001a40 con 0x55ced1fc7780 2023-12-12T09:23:01.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff3f38d740 1 -- 172.21.15.84:0/2536064694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff30082e00 con 0x55ced1fc7780 2023-12-12T09:23:01.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff157fa640 1 -- 172.21.15.84:0/2536064694 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff2c001f40 con 0x55ced1fc7780 2023-12-12T09:23:01.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff3f38d740 10 client.6408 fetch_fsmap learned FSMap version 27 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff3f38d740 1 -- 172.21.15.84:0/2536064694 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55ced1ea9170 con 0x55ced1fc7780 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.956+0000 7eff157fa640 1 -- 172.21.15.84:0/2536064694 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff30082e00 con 0x55ced1fc7780 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff157fa640 1 -- 172.21.15.84:0/2536064694 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) v1 ==== 3294+0+0 (secure 0 0 0) 0x7eff2c014a40 con 0x55ced1fc7780 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff3f38d740 10 client.6408 fetch_fsmap finished waiting for FSMap version 27 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff3f38d740 10 client.6408 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff3f38d740 20 client.6408 populate_metadata read hostname 'smithi084' 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff3f38d740 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] conn(0x55ced1fc8e90 0x55ced1fc6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff3f38d740 4 client.6408 mds_command: new command op to 6237 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff3f38d740 1 -- 172.21.15.84:0/2536064694 --> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ced1be86c0 con 0x55ced1fc8e90 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff3a597640 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] conn(0x55ced1fc8e90 0x55ced1fc6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff157fa640 10 client.6408 ms_handle_connect on v2:172.21.15.84:6835/3202590301 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.957+0000 7eff3a597640 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] conn(0x55ced1fc8e90 0x55ced1fc6310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=520799f719fd4123 server_cookie=bb084ff35153c5a in_seq=0 out_seq=0 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff157fa640 1 -- 172.21.15.84:0/2536064694 <== mds.0 v2:172.21.15.84:6835/3202590301 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ced1be86c0 con 0x55ced1fc8e90 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff157fa640 10 client.6408 handle_command_reply: tid=0 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 client.6408 shutdown 2023-12-12T09:23:01.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 -- 172.21.15.84:0/2536064694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 msgr2=0x55ced1fc8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fc8710 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00fe60 tx=0x7eff2c001ed0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 -- 172.21.15.84:0/2536064694 shutdown_connections 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.84:6835/3202590301,v1:172.21.15.84:6837/3202590301] conn(0x55ced1fc8e90 0x55ced1fc6310 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ced1fc7780 0x55ced1fc8710 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x55ced1fac1e0 0x55ced1f81820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 --2- 172.21.15.84:0/2536064694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ced1f7fd60 0x55ced1f812e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff157fa640 0 client.6408 ms_handle_reset on v2:172.21.15.84:6835/3202590301 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 -- 172.21.15.84:0/2536064694 >> 172.21.15.84:0/2536064694 conn(0x55ced1f7c490 msgr2=0x55ced1f77a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 -- 172.21.15.84:0/2536064694 shutdown_connections 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 1 -- 172.21.15.84:0/2536064694 wait complete. 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.958+0000 7eff3f38d740 20 client.6408 trim_cache size 0 max 16384 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:01.961 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "6cf288f4-52d2-4b85-a338-100a1ef88319", 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6237, 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.629910494000001, 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 27, 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 58, 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 58, 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 24.066209515000001 2023-12-12T09:23:01.962 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 -- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff1806ae70 msgr2=0x7eff1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff1806ae70 0x7eff1806d330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7eff24007fd0 tx=0x7eff24009040 comp rx=0 tx=0).stop 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 -- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 msgr2=0x7eff340cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff340cb6c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7eff3002bec0 tx=0x7eff30004730 comp rx=0 tx=0).stop 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 -- 172.21.15.84:0/2589235374 shutdown_connections 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff34158aa0 0x7eff340c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7eff340c9f60 0x7eff340ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff1806ae70 0x7eff1806d330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 --2- 172.21.15.84:0/2589235374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff200039a0 0x7eff340cb6c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 -- 172.21.15.84:0/2589235374 >> 172.21.15.84:0/2589235374 conn(0x7eff340d2e90 msgr2=0x7eff3415f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:01.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 -- 172.21.15.84:0/2589235374 shutdown_connections 2023-12-12T09:23:01.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:01.959+0000 7eff3b599640 1 -- 172.21.15.84:0/2589235374 wait complete. 2023-12-12T09:23:01.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:23:02.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.181+0000 7ff3fda31640 1 Processor -- start 2023-12-12T09:23:02.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.181+0000 7ff3fda31640 1 -- start start 2023-12-12T09:23:02.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.183+0000 7ff3fda31640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff3f8143d20 0x7ff3f80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:02.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.183+0000 7ff3fda31640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f80ce550 0x7ff3f80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:02.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.183+0000 7ff3fda31640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f80cea30 con 0x7ff3f81447f0 2023-12-12T09:23:02.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.183+0000 7ff3fda31640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f80702b0 con 0x7ff3f8143d20 2023-12-12T09:23:02.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.183+0000 7ff3fda31640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f8070590 con 0x7ff3f80ce550 2023-12-12T09:23:02.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.183+0000 7ff3f6ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff3f8143d20 0x7ff3f80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:02.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.183+0000 7ff3f67fc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f80ce550 0x7ff3f80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:02.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.183+0000 7ff3f6ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff3f8143d20 0x7ff3f80b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:47278/0 (socket says 172.21.15.84:47278) 2023-12-12T09:23:02.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.184+0000 7ff3f6ffd640 1 -- 172.21.15.84:0/317465414 learned_addr learned my addr 172.21.15.84:0/317465414 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:02.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.184+0000 7ff3f77fe640 1 --1- 172.21.15.84:0/317465414 >> v1:172.21.15.99:6789/0 conn(0x7ff3f81447f0 0x7ff3f815eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.84:47194/0 (socket says 172.21.15.84:47194) 2023-12-12T09:23:02.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.184+0000 7ff3f6ffd640 1 -- 172.21.15.84:0/317465414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f80ce550 msgr2=0x7ff3f80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.184+0000 7ff3f6ffd640 1 --2- 172.21.15.84:0/317465414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f80ce550 0x7ff3f80b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.184+0000 7ff3f6ffd640 1 -- 172.21.15.84:0/317465414 >> v1:172.21.15.99:6789/0 conn(0x7ff3f81447f0 legacy=0x7ff3f815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.184+0000 7ff3f6ffd640 1 -- 172.21.15.84:0/317465414 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8070870 con 0x7ff3f8143d20 2023-12-12T09:23:02.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.185+0000 7ff3f6ffd640 1 --2- 172.21.15.84:0/317465414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f8143d20 0x7ff3f80b40d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009e50 tx=0x7ff3e802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5276d8f0a79a5f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.186+0000 7ff3f5ffb640 1 -- 172.21.15.84:0/317465414 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e802cb00 con 0x7ff3f8143d20 2023-12-12T09:23:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.186+0000 7ff3f5ffb640 1 -- 172.21.15.84:0/317465414 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e802cc60 con 0x7ff3f8143d20 2023-12-12T09:23:02.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.186+0000 7ff3f5ffb640 1 -- 172.21.15.84:0/317465414 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80343f0 con 0x7ff3f8143d20 2023-12-12T09:23:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.187+0000 7ff3fda31640 1 -- 172.21.15.84:0/317465414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f8143d20 msgr2=0x7ff3f80b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.187+0000 7ff3fda31640 1 --2- 172.21.15.84:0/317465414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f8143d20 0x7ff3f80b40d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009e50 tx=0x7ff3e802bf60 comp rx=0 tx=0).stop 2023-12-12T09:23:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.187+0000 7ff3fda31640 1 -- 172.21.15.84:0/317465414 shutdown_connections 2023-12-12T09:23:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.187+0000 7ff3fda31640 1 --2- 172.21.15.84:0/317465414 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f80ce550 0x7ff3f80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.187+0000 7ff3fda31640 1 --2- 172.21.15.84:0/317465414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f8143d20 0x7ff3f80b40d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.187+0000 7ff3fda31640 1 -- 172.21.15.84:0/317465414 >> 172.21.15.84:0/317465414 conn(0x7ff3f806c3d0 msgr2=0x7ff3f806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.187+0000 7ff3fda31640 1 -- 172.21.15.84:0/317465414 shutdown_connections 2023-12-12T09:23:02.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.187+0000 7ff3fda31640 1 -- 172.21.15.84:0/317465414 wait complete. 2023-12-12T09:23:02.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.189+0000 7ff3fda31640 1 Processor -- start 2023-12-12T09:23:02.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.189+0000 7ff3fda31640 1 -- start start 2023-12-12T09:23:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3fda31640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f80ce550 0x7ff3f813b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3fda31640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f8143d20 0x7ff3f80a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3fda31640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81447f0 0x7ff3f8142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3fda31640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80a9690 con 0x7ff3f81447f0 2023-12-12T09:23:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3fda31640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80a8df0 con 0x7ff3f80ce550 2023-12-12T09:23:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3fda31640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80a90d0 con 0x7ff3f8143d20 2023-12-12T09:23:02.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3f77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81447f0 0x7ff3f8142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3f77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81447f0 0x7ff3f8142bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51808/0 (socket says 172.21.15.84:51808) 2023-12-12T09:23:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.190+0000 7ff3f77fe640 1 -- 172.21.15.84:0/1402785714 learned_addr learned my addr 172.21.15.84:0/1402785714 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3f6ffd640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f80ce550 0x7ff3f813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3f67fc640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f8143d20 0x7ff3f80a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3f77fe640 1 -- 172.21.15.84:0/1402785714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f8143d20 msgr2=0x7ff3f80a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3f77fe640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f8143d20 0x7ff3f80a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3f77fe640 1 -- 172.21.15.84:0/1402785714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f80ce550 msgr2=0x7ff3f813b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3f77fe640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f80ce550 0x7ff3f813b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3f77fe640 1 -- 172.21.15.84:0/1402785714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009b30 con 0x7ff3f81447f0 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3f77fe640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81447f0 0x7ff3f8142bb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c3c0 tx=0x7ff3f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3effff640 1 -- 172.21.15.84:0/1402785714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f00074e0 con 0x7ff3f81447f0 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3effff640 1 -- 172.21.15.84:0/1402785714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f0007640 con 0x7ff3f81447f0 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3effff640 1 -- 172.21.15.84:0/1402785714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0004a00 con 0x7ff3f81447f0 2023-12-12T09:23:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.191+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f80a93b0 con 0x7ff3f81447f0 2023-12-12T09:23:02.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.192+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f813ba70 con 0x7ff3f81447f0 2023-12-12T09:23:02.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.193+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f80673c0 con 0x7ff3f81447f0 2023-12-12T09:23:02.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.194+0000 7ff3effff640 1 -- 172.21.15.84:0/1402785714 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3f0004b60 con 0x7ff3f81447f0 2023-12-12T09:23:02.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.194+0000 7ff3effff640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d806ae70 0x7ff3d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:02.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.195+0000 7ff3effff640 1 -- 172.21.15.84:0/1402785714 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff3f0089040 con 0x7ff3f81447f0 2023-12-12T09:23:02.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.195+0000 7ff3f6ffd640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d806ae70 0x7ff3d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:02.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.195+0000 7ff3f6ffd640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d806ae70 0x7ff3d806d330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8035000 tx=0x7ff3e8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:02.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.199+0000 7ff3effff640 1 -- 172.21.15.84:0/1402785714 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3f0054060 con 0x7ff3f81447f0 2023-12-12T09:23:02.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.429+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff3f806e3b0 con 0x7ff3f81447f0 2023-12-12T09:23:02.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.430+0000 7ff3effff640 1 -- 172.21.15.84:0/1402785714 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff3f0057680 con 0x7ff3f81447f0 2023-12-12T09:23:02.431 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.432+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d806ae70 msgr2=0x7ff3d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.432+0000 7ff3fda31640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d806ae70 0x7ff3d806d330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8035000 tx=0x7ff3e8030000 comp rx=0 tx=0).stop 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.432+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81447f0 msgr2=0x7ff3f8142bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.432+0000 7ff3fda31640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81447f0 0x7ff3f8142bb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff3f000c3c0 tx=0x7ff3f000c880 comp rx=0 tx=0).stop 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.433+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 shutdown_connections 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.433+0000 7ff3fda31640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff3d806ae70 0x7ff3d806d330 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.433+0000 7ff3fda31640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3f81447f0 0x7ff3f8142bb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.433+0000 7ff3fda31640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff3f8143d20 0x7ff3f80a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.433+0000 7ff3fda31640 1 --2- 172.21.15.84:0/1402785714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3f80ce550 0x7ff3f813b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.433+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 >> 172.21.15.84:0/1402785714 conn(0x7ff3f806c3d0 msgr2=0x7ff3f815bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:02.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.433+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 shutdown_connections 2023-12-12T09:23:02.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:02.433+0000 7ff3fda31640 1 -- 172.21.15.84:0/1402785714 wait complete. 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:23:02.453 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:02.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:02.454 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:23:02.507 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:23:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:23:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:23:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:23:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:02.507 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:02.507 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42022sec preferred_lft 42022sec 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:02.508 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c8b:52ff:fef6:cd60/64 scope link 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c2:ab:b4:6c:14:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c0ab:b4ff:fe6c:1499/64 scope link 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3c57:6bff:fed3:b000/64 scope link 2023-12-12T09:23:02.509 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:02.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:02.510 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:23:02.600 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:23:02.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:02.604 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:23:02.655 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:23:02.655 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:23:02.655 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:23:02.655 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:23:02.655 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:23:02.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:02.656 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:23:02.656 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:23:02.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:23:02.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:23:02.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:23:02.656 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:23:02.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:02.837 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:23:02.889 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:23:02.889 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T09:23:02.890 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:02.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:02.890 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-12-12T09:23:02.988 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T09:23:02.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:23:02.988 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:03.044 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:03.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:23:03.045 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:03.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:23:03.194 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:23:03.251 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:23:03.251 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:23:03.251 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:23:03.251 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:23:03.251 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:23:03.251 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:23:03.251 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:23:03.252 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:03.253 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:03.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:03.254 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:23:03.305 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:23:03.305 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T09:23:03.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:23:03.386 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:23:03.429 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:23:03.429 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:23:03.430 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:03.432 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:03.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:03.432 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:23:03.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-12-12T09:23:03.494+0000 7efea400d480 -1 init, newargv = 0x556364e53ab0 newargc=15 2023-12-12T09:23:03.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[110409]: starting ceph client 2023-12-12T09:23:03.504 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[110409]: starting fuse 2023-12-12T09:23:03.518 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:23:03.518 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-12T09:23:03.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:23:03.518 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:23:03.518 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:23:03.518 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:23:03.518 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:23:03.518 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:23:03.519 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:23:03.520 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:23:03.520 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:23:03.520 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:03.520 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-12-12T09:23:03.520 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:23:03.712 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.110409.asok 2023-12-12T09:23:03.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:23:03.729 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110409.asok 2023-12-12T09:23:03.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:03.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110409.asok status 2023-12-12T09:23:03.968 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:03.968 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:23:03.968 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "110409", 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6420, 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 6420 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:03.969 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3944682453 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3944682453 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.6420 192.168.0.1:0/3944682453", 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/3944682453", 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:23:03.970 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 27, 2023-12-12T09:23:03.971 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 58, 2023-12-12T09:23:03.971 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:23:03.971 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:23:03.971 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:23:03.971 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:03.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:03.984 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:23:03.984 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:04.038 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:23:04.039 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:04.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:04.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:04.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:04.129 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2023-12-12T09:23:04.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2023-12-12T09:23:04.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.410+0000 7fb22a01e640 1 Processor -- start 2023-12-12T09:23:04.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.410+0000 7fb22a01e640 1 -- start start 2023-12-12T09:23:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.412+0000 7fb22a01e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb2240b2e40 0x7fb22406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.412+0000 7fb22a01e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240b32d0 con 0x7fb22415d320 2023-12-12T09:23:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.412+0000 7fb22a01e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240b29b0 con 0x7fb2240701a0 2023-12-12T09:23:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.412+0000 7fb22a01e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240b3ed0 con 0x7fb2240b2e40 2023-12-12T09:23:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.413+0000 7fb222ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb22415d320 0x7fb2240b37c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51412/0 (socket says 172.21.15.84:51412) 2023-12-12T09:23:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.413+0000 7fb222ffd640 1 -- 172.21.15.84:0/2247556100 learned_addr learned my addr 172.21.15.84:0/2247556100 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.413+0000 7fb223fff640 1 --2- 172.21.15.84:0/2247556100 >> v2:172.21.15.99:3300/0 conn(0x7fb2240b2e40 0x7fb22406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.413+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194675807 0 0) 0x7fb2240b32d0 con 0x7fb22415d320 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.413+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb210003520 con 0x7fb22415d320 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719423992 0 0) 0x7fb210003520 con 0x7fb22415d320 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 >> v2:172.21.15.99:3300/0 conn(0x7fb2240b2e40 msgr2=0x7fb22406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 --2- 172.21.15.84:0/2247556100 >> v2:172.21.15.99:3300/0 conn(0x7fb2240b2e40 0x7fb22406bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 >> v1:172.21.15.99:6789/0 conn(0x7fb2240701a0 legacy=0x7fb224070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240b1da0 con 0x7fb22415d320 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fb20c001670 con 0x7fb22415d320 2023-12-12T09:23:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 >> v1:172.21.15.84:6789/0 conn(0x7fb22415d320 legacy=0x7fb2240b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb210003970 0x7fb210003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb2100047c0 0x7fb210004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb21000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240b3ed0 con 0x7fb210005180 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21000c020 con 0x7fb210003970 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21000c1e0 con 0x7fb2100047c0 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb223fff640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb21000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.414+0000 7fb2237fe640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb210003970 0x7fb210003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.415+0000 7fb223fff640 1 -- 172.21.15.84:0/2247556100 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb2100047c0 msgr2=0x7fb210004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.415+0000 7fb223fff640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb2100047c0 0x7fb210004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.415+0000 7fb223fff640 1 -- 172.21.15.84:0/2247556100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb210003970 msgr2=0x7fb210003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.415+0000 7fb223fff640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb210003970 0x7fb210003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.415+0000 7fb223fff640 1 -- 172.21.15.84:0/2247556100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210003520 con 0x7fb210005180 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.416+0000 7fb223fff640 1 -- 172.21.15.84:0/2247556100 reap_dead start 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.416+0000 7fb223fff640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb21000b980 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009ac0 tx=0x7fb2100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1fa97b00e4c141 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.416+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c004020 con 0x7fb210005180 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.416+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c004180 con 0x7fb210005180 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.416+0000 7fb2227fc640 1 -- 172.21.15.84:0/2247556100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c02c710 con 0x7fb210005180 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.417+0000 7fb22a01e640 1 -- 172.21.15.84:0/2247556100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 msgr2=0x7fb21000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.417+0000 7fb22a01e640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb21000b980 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009ac0 tx=0x7fb2100057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.417+0000 7fb22a01e640 1 -- 172.21.15.84:0/2247556100 shutdown_connections 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.417+0000 7fb22a01e640 1 --2- 172.21.15.84:0/2247556100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb21000b980 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.417+0000 7fb22a01e640 1 -- 172.21.15.84:0/2247556100 >> 172.21.15.84:0/2247556100 conn(0x7fb2240b0a00 msgr2=0x7fb2240b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.417+0000 7fb22a01e640 1 -- 172.21.15.84:0/2247556100 shutdown_connections 2023-12-12T09:23:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.417+0000 7fb22a01e640 1 -- 172.21.15.84:0/2247556100 wait complete. 2023-12-12T09:23:04.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.419+0000 7fb22a01e640 1 Processor -- start 2023-12-12T09:23:04.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.419+0000 7fb22a01e640 1 -- start start 2023-12-12T09:23:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb22a01e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb224156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb22a01e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb22415ec90 0x7fb22415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb22a01e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb22414da30 0x7fb22414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb22a01e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415f630 con 0x7fb210005180 2023-12-12T09:23:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb22a01e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22414e3f0 con 0x7fb22415ec90 2023-12-12T09:23:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb22a01e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415f830 con 0x7fb22414da30 2023-12-12T09:23:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb2237fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb224156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb2237fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb224156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51826/0 (socket says 172.21.15.84:51826) 2023-12-12T09:23:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb2237fe640 1 -- 172.21.15.84:0/3919364575 learned_addr learned my addr 172.21.15.84:0/3919364575 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb223fff640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb22414da30 0x7fb22414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb222ffd640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb22415ec90 0x7fb22415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb2237fe640 1 -- 172.21.15.84:0/3919364575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb22414da30 msgr2=0x7fb22414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb2237fe640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb22414da30 0x7fb22414deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb2237fe640 1 -- 172.21.15.84:0/3919364575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb22415ec90 msgr2=0x7fb22415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb2237fe640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb22415ec90 0x7fb22415f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.420+0000 7fb2237fe640 1 -- 172.21.15.84:0/3919364575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22415fb10 con 0x7fb210005180 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.421+0000 7fb2237fe640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb224156c20 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb21400e850 tx=0x7fb21400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.421+0000 7fb21bfff640 1 -- 172.21.15.84:0/3919364575 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214003b80 con 0x7fb210005180 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.421+0000 7fb21bfff640 1 -- 172.21.15.84:0/3919364575 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb214003ce0 con 0x7fb210005180 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.421+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22414efb0 con 0x7fb210005180 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.421+0000 7fb21bfff640 1 -- 172.21.15.84:0/3919364575 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2140052f0 con 0x7fb210005180 2023-12-12T09:23:04.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.421+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22414e830 con 0x7fb210005180 2023-12-12T09:23:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.423+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224067f60 con 0x7fb210005180 2023-12-12T09:23:04.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.423+0000 7fb21bfff640 1 -- 172.21.15.84:0/3919364575 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb214005450 con 0x7fb210005180 2023-12-12T09:23:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.424+0000 7fb21bfff640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb20406ae40 0x7fb20406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.424+0000 7fb21bfff640 1 -- 172.21.15.84:0/3919364575 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb2140898b0 con 0x7fb210005180 2023-12-12T09:23:04.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.425+0000 7fb222ffd640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb20406ae40 0x7fb20406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:04.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.425+0000 7fb222ffd640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb20406ae40 0x7fb20406d300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb20c001820 tx=0x7fb20c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:04.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.429+0000 7fb21bfff640 1 -- 172.21.15.84:0/3919364575 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2140547a0 con 0x7fb210005180 2023-12-12T09:23:04.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.695+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7fb22414ee10 con 0x7fb210005180 2023-12-12T09:23:04.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.701+0000 7fb21bfff640 1 -- 172.21.15.84:0/3919364575 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 183+0+140 (secure 0 0 0) 0x7fb22414ee10 con 0x7fb210005180 2023-12-12T09:23:04.702 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:23:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:23:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-12-12T09:23:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-12-12T09:23:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow r pool=cephfs_data" 2023-12-12T09:23:04.703 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb20406ae40 msgr2=0x7fb20406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb20406ae40 0x7fb20406d300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb20c001820 tx=0x7fb20c009040 comp rx=0 tx=0).stop 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 msgr2=0x7fb224156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb224156c20 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb21400e850 tx=0x7fb21400ed10 comp rx=0 tx=0).stop 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 shutdown_connections 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb22414da30 0x7fb22414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb22415ec90 0x7fb22415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb20406ae40 0x7fb20406d300 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 --2- 172.21.15.84:0/3919364575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210005180 0x7fb224156c20 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:04.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.703+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 >> 172.21.15.84:0/3919364575 conn(0x7fb2240b0a00 msgr2=0x7fb22406c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:04.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.704+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 shutdown_connections 2023-12-12T09:23:04.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:04.704+0000 7fb22a01e640 1 -- 172.21.15.84:0/3919364575 wait complete. 2023-12-12T09:23:04.722 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:23:04.722 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:04.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:05.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.028+0000 7fe42635a640 1 Processor -- start 2023-12-12T09:23:05.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.028+0000 7fe42635a640 1 -- start start 2023-12-12T09:23:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.029+0000 7fe42635a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe4200b47e0 0x7fe420071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.029+0000 7fe42635a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4200ce550 0x7fe4200715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.029+0000 7fe42635a640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4200cea30 con 0x7fe420143d20 2023-12-12T09:23:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.030+0000 7fe42635a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4200702b0 con 0x7fe4200b47e0 2023-12-12T09:23:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.030+0000 7fe42635a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe420070590 con 0x7fe4200ce550 2023-12-12T09:23:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.030+0000 7fe41ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe420143d20 0x7fe4200b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51424/0 (socket says 172.21.15.84:51424) 2023-12-12T09:23:05.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.030+0000 7fe41ffff640 1 -- 172.21.15.84:0/1358675137 learned_addr learned my addr 172.21.15.84:0/1358675137 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.030+0000 7fe4248f7640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4200ce550 0x7fe4200715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.030+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305872181 0 0) 0x7fe4200cea30 con 0x7fe420143d20 2023-12-12T09:23:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.030+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40c003520 con 0x7fe420143d20 2023-12-12T09:23:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.030+0000 7fe417fff640 1 --2- 172.21.15.84:0/1358675137 >> v2:172.21.15.99:3300/0 conn(0x7fe4200b47e0 0x7fe420071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1353102197 0 0) 0x7fe40c003520 con 0x7fe420143d20 2023-12-12T09:23:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4200ce550 msgr2=0x7fe4200715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4200ce550 0x7fe4200715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 >> v2:172.21.15.99:3300/0 conn(0x7fe4200b47e0 msgr2=0x7fe420071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 --2- 172.21.15.84:0/1358675137 >> v2:172.21.15.99:3300/0 conn(0x7fe4200b47e0 0x7fe420071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420070870 con 0x7fe420143d20 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fe410001670 con 0x7fe420143d20 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 >> v1:172.21.15.84:6789/0 conn(0x7fe420143d20 legacy=0x7fe4200b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4200ce550 0x7fe40c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe40c003f40 0x7fe40c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe40c004d00 0x7fe40c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200702b0 con 0x7fe40c004d00 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420070590 con 0x7fe40c003f40 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c00ba30 con 0x7fe4200ce550 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe417fff640 1 --2- 172.21.15.84:0/1358675137 >> v2:172.21.15.99:3300/0 conn(0x7fe4200b47e0 0x7fe420071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:23:05.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.031+0000 7fe4248f7640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe40c004d00 0x7fe40c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.032+0000 7fe417fff640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe40c003f40 0x7fe40c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.032+0000 7fe4248f7640 1 -- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4200ce550 msgr2=0x7fe40c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.032+0000 7fe41ffff640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4200ce550 0x7fe40c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.032+0000 7fe4248f7640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe4200ce550 0x7fe40c003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.032+0000 7fe4248f7640 1 -- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe40c003f40 msgr2=0x7fe40c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.032+0000 7fe4248f7640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe40c003f40 0x7fe40c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.032+0000 7fe4248f7640 1 -- 172.21.15.84:0/1358675137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c003520 con 0x7fe40c004d00 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.032+0000 7fe417fff640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe40c003f40 0x7fe40c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:05.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.033+0000 7fe4248f7640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe40c004d00 0x7fe40c005180 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe418009f90 tx=0x7fe40c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e664800486930d43 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.033+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41802cbd0 con 0x7fe40c004d00 2023-12-12T09:23:05.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.033+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41800f040 con 0x7fe40c004d00 2023-12-12T09:23:05.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.033+0000 7fe41f7fe640 1 -- 172.21.15.84:0/1358675137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418034440 con 0x7fe40c004d00 2023-12-12T09:23:05.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.034+0000 7fe42635a640 1 -- 172.21.15.84:0/1358675137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe40c004d00 msgr2=0x7fe40c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.034+0000 7fe42635a640 1 --2- 172.21.15.84:0/1358675137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe40c004d00 0x7fe40c005180 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe418009f90 tx=0x7fe40c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.034+0000 7fe4248f7640 1 -- 172.21.15.84:0/1358675137 reap_dead start 2023-12-12T09:23:05.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.034+0000 7fe42635a640 1 -- 172.21.15.84:0/1358675137 shutdown_connections 2023-12-12T09:23:05.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.034+0000 7fe42635a640 1 -- 172.21.15.84:0/1358675137 >> 172.21.15.84:0/1358675137 conn(0x7fe42006c3d0 msgr2=0x7fe42006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:05.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.034+0000 7fe42635a640 1 -- 172.21.15.84:0/1358675137 shutdown_connections 2023-12-12T09:23:05.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.034+0000 7fe42635a640 1 -- 172.21.15.84:0/1358675137 wait complete. 2023-12-12T09:23:05.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.036+0000 7fe42635a640 1 Processor -- start 2023-12-12T09:23:05.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.036+0000 7fe42635a640 1 -- start start 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe42635a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe40c004d00 0x7fe4200a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe42635a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42013c2a0 0x7fe42014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe42635a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe420141150 0x7fe420141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe42635a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420141b40 con 0x7fe42013c2a0 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe42635a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200a9af0 con 0x7fe420141150 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe42635a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4200aa270 con 0x7fe40c004d00 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe417fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42013c2a0 0x7fe42014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe417fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42013c2a0 0x7fe42014ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51846/0 (socket says 172.21.15.84:51846) 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe417fff640 1 -- 172.21.15.84:0/1875267122 learned_addr learned my addr 172.21.15.84:0/1875267122 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe41ffff640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe40c004d00 0x7fe4200a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe4248f7640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe420141150 0x7fe420141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe417fff640 1 -- 172.21.15.84:0/1875267122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe40c004d00 msgr2=0x7fe4200a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe417fff640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe40c004d00 0x7fe4200a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe417fff640 1 -- 172.21.15.84:0/1875267122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe420141150 msgr2=0x7fe420141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.037+0000 7fe417fff640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe420141150 0x7fe420141600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.038+0000 7fe417fff640 1 -- 172.21.15.84:0/1875267122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200aa550 con 0x7fe42013c2a0 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.038+0000 7fe417fff640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42013c2a0 0x7fe42014ee10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe40800f600 tx=0x7fe40800fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.038+0000 7fe41d7fa640 1 -- 172.21.15.84:0/1875267122 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408014890 con 0x7fe42013c2a0 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.038+0000 7fe41d7fa640 1 -- 172.21.15.84:0/1875267122 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800c030 con 0x7fe42013c2a0 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.038+0000 7fe41d7fa640 1 -- 172.21.15.84:0/1875267122 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408014c30 con 0x7fe42013c2a0 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.038+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4200aa830 con 0x7fe42013c2a0 2023-12-12T09:23:05.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.038+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4200aadf0 con 0x7fe42013c2a0 2023-12-12T09:23:05.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.040+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4200cd540 con 0x7fe42013c2a0 2023-12-12T09:23:05.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.040+0000 7fe41d7fa640 1 -- 172.21.15.84:0/1875267122 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe40800d490 con 0x7fe42013c2a0 2023-12-12T09:23:05.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.042+0000 7fe41d7fa640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe40006ae70 0x7fe40006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.042+0000 7fe41d7fa640 1 -- 172.21.15.84:0/1875267122 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe408089b90 con 0x7fe42013c2a0 2023-12-12T09:23:05.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.042+0000 7fe41ffff640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe40006ae70 0x7fe40006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.043+0000 7fe41ffff640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe40006ae70 0x7fe40006d330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe410001200 tx=0x7fe410009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.046+0000 7fe41d7fa640 1 -- 172.21.15.84:0/1875267122 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe408054b00 con 0x7fe42013c2a0 2023-12-12T09:23:05.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.241+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe420067c00 con 0x7fe42013c2a0 2023-12-12T09:23:05.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.244+0000 7fe41d7fa640 1 -- 172.21.15.84:0/1875267122 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7fe408022090 con 0x7fe42013c2a0 2023-12-12T09:23:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:05.246 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.246+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe40006ae70 msgr2=0x7fe40006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.246+0000 7fe42635a640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe40006ae70 0x7fe40006d330 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe410001200 tx=0x7fe410009040 comp rx=0 tx=0).stop 2023-12-12T09:23:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42013c2a0 msgr2=0x7fe42014ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42013c2a0 0x7fe42014ee10 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe40800f600 tx=0x7fe40800fac0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 shutdown_connections 2023-12-12T09:23:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe420141150 0x7fe420141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe40006ae70 0x7fe40006d330 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42013c2a0 0x7fe42014ee10 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 --2- 172.21.15.84:0/1875267122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe40c004d00 0x7fe4200a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 >> 172.21.15.84:0/1875267122 conn(0x7fe42006c3d0 msgr2=0x7fe42015cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 shutdown_connections 2023-12-12T09:23:05.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.247+0000 7fe42635a640 1 -- 172.21.15.84:0/1875267122 wait complete. 2023-12-12T09:23:05.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:22:47.550419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:22:48.743328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:23:05.266 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:23:05.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.474+0000 7f63d71ce640 1 Processor -- start 2023-12-12T09:23:05.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.475+0000 7f63d71ce640 1 -- start start 2023-12-12T09:23:05.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.476+0000 7f63d71ce640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63d015d810 0x7f63d00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.476+0000 7f63d71ce640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00b4e80 con 0x7f63d006d5e0 2023-12-12T09:23:05.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.476+0000 7f63d71ce640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d015dc90 con 0x7f63d00b4560 2023-12-12T09:23:05.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.476+0000 7f63d71ce640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d015e8a0 con 0x7f63d015d810 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.477+0000 7f63d576b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f63d006d5e0 0x7f63d0070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:51426/0 (socket says 172.21.15.84:51426) 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.477+0000 7f63d576b640 1 -- 172.21.15.84:0/3961927271 learned_addr learned my addr 172.21.15.84:0/3961927271 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.477+0000 7f63cffff640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63d015d810 0x7f63d00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.477+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909255589 0 0) 0x7f63d00b4e80 con 0x7f63d006d5e0 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.477+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b8003520 con 0x7f63d006d5e0 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4034578604 0 0) 0x7f63b8003520 con 0x7f63d006d5e0 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63d015d810 msgr2=0x7f63d00b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63d015d810 0x7f63d00b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 >> v1:172.21.15.99:6789/0 conn(0x7f63d00b4560 legacy=0x7f63d00b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d015df70 con 0x7f63d006d5e0 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f63c80019f0 con 0x7f63d006d5e0 2023-12-12T09:23:05.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 >> v1:172.21.15.84:6789/0 conn(0x7f63d006d5e0 legacy=0x7f63d0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63d015d810 0x7f63b80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63b8003f70 0x7f63b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004d00 0x7f63b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d015e8a0 con 0x7f63b8004d00 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b800bb70 con 0x7f63b8003f70 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b800bd30 con 0x7f63d015d810 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63d576b640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004d00 0x7f63b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63cffff640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63b8003f70 0x7f63b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.478+0000 7f63d576b640 1 -- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63d015d810 msgr2=0x7f63b80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.479+0000 7f63d576b640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63d015d810 0x7f63b80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.479+0000 7f63d576b640 1 -- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63b8003f70 msgr2=0x7f63b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.479+0000 7f63d576b640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63b8003f70 0x7f63b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.479+0000 7f63d576b640 1 -- 172.21.15.84:0/3961927271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b8003520 con 0x7f63b8004d00 2023-12-12T09:23:05.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.479+0000 7f63cffff640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63b8003f70 0x7f63b80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.480+0000 7f63d576b640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004d00 0x7f63b8005180 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f63c800a760 tx=0x7f63b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942b71d78fd29252 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.480+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8034630 con 0x7f63b8004d00 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.480+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c802f070 con 0x7f63b8004d00 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.480+0000 7f63cf7fe640 1 -- 172.21.15.84:0/3961927271 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8034a50 con 0x7f63b8004d00 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.480+0000 7f63d71ce640 1 -- 172.21.15.84:0/3961927271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004d00 msgr2=0x7f63b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.480+0000 7f63d71ce640 1 --2- 172.21.15.84:0/3961927271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63b8004d00 0x7f63b8005180 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f63c800a760 tx=0x7f63b80057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.480+0000 7f63d576b640 1 -- 172.21.15.84:0/3961927271 reap_dead start 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.481+0000 7f63d71ce640 1 -- 172.21.15.84:0/3961927271 shutdown_connections 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.481+0000 7f63d71ce640 1 -- 172.21.15.84:0/3961927271 >> 172.21.15.84:0/3961927271 conn(0x7f63d00b0ac0 msgr2=0x7f63d00b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.481+0000 7f63d71ce640 1 -- 172.21.15.84:0/3961927271 shutdown_connections 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.481+0000 7f63d71ce640 1 -- 172.21.15.84:0/3961927271 wait complete. 2023-12-12T09:23:05.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.482+0000 7f63d71ce640 1 Processor -- start 2023-12-12T09:23:05.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.483+0000 7f63d71ce640 1 -- start start 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.483+0000 7f63d71ce640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63b8004d00 0x7f63d00c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.483+0000 7f63d71ce640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d0143e80 0x7f63d0144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.483+0000 7f63d71ce640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63d0159130 0x7f63d01595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.483+0000 7f63d71ce640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0147b80 con 0x7f63d0143e80 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63d71ce640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0144840 con 0x7f63d0159130 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63d71ce640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0159e60 con 0x7f63b8004d00 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63cffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d0143e80 0x7f63d0144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63cffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d0143e80 0x7f63d0144300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51864/0 (socket says 172.21.15.84:51864) 2023-12-12T09:23:05.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63cffff640 1 -- 172.21.15.84:0/3563044152 learned_addr learned my addr 172.21.15.84:0/3563044152 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63d4f6a640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63b8004d00 0x7f63d00c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63d576b640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63d0159130 0x7f63d01595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63cffff640 1 -- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63b8004d00 msgr2=0x7f63d00c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63cffff640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63b8004d00 0x7f63d00c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63cffff640 1 -- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63d0159130 msgr2=0x7f63d01595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63cffff640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63d0159130 0x7f63d01595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63cffff640 1 -- 172.21.15.84:0/3563044152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d015a140 con 0x7f63d0143e80 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63d4f6a640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63b8004d00 0x7f63d00c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.484+0000 7f63d576b640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63d0159130 0x7f63d01595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.485+0000 7f63cffff640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d0143e80 0x7f63d0144300 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f63c00107e0 tx=0x7f63c0010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.485+0000 7f63cd7fa640 1 -- 172.21.15.84:0/3563044152 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000eb60 con 0x7f63d0143e80 2023-12-12T09:23:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.485+0000 7f63cd7fa640 1 -- 172.21.15.84:0/3563044152 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000ecc0 con 0x7f63d0143e80 2023-12-12T09:23:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.485+0000 7f63cd7fa640 1 -- 172.21.15.84:0/3563044152 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c001c400 con 0x7f63d0143e80 2023-12-12T09:23:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.485+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d015a420 con 0x7f63d0143e80 2023-12-12T09:23:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.485+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d0144be0 con 0x7f63d0143e80 2023-12-12T09:23:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.486+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d00673c0 con 0x7f63d0143e80 2023-12-12T09:23:05.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.487+0000 7f63cd7fa640 1 -- 172.21.15.84:0/3563044152 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f63c001c560 con 0x7f63d0143e80 2023-12-12T09:23:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.488+0000 7f63cd7fa640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f63bc06ae40 0x7f63bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.489+0000 7f63cd7fa640 1 -- 172.21.15.84:0/3563044152 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f63c0089cf0 con 0x7f63d0143e80 2023-12-12T09:23:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.489+0000 7f63d4f6a640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f63bc06ae40 0x7f63bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.490+0000 7f63d4f6a640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f63bc06ae40 0x7f63bc06d300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f63d00b1a70 tx=0x7f63c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.493+0000 7f63cd7fa640 1 -- 172.21.15.84:0/3563044152 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f63c0054d00 con 0x7f63d0143e80 2023-12-12T09:23:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.681+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f63d00b2d70 con 0x7f63d0143e80 2023-12-12T09:23:05.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.682+0000 7f63cd7fa640 1 -- 172.21.15.84:0/3563044152 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f63c0058320 con 0x7f63d0143e80 2023-12-12T09:23:05.683 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:23:05.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f63bc06ae40 msgr2=0x7f63bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f63bc06ae40 0x7f63bc06d300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f63d00b1a70 tx=0x7f63c4009040 comp rx=0 tx=0).stop 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d0143e80 msgr2=0x7f63d0144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d0143e80 0x7f63d0144300 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f63c00107e0 tx=0x7f63c0010ca0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 shutdown_connections 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63d0159130 0x7f63d01595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f63bc06ae40 0x7f63bc06d300 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d0143e80 0x7f63d0144300 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 --2- 172.21.15.84:0/3563044152 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f63b8004d00 0x7f63d00c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 >> 172.21.15.84:0/3563044152 conn(0x7f63d00b0ac0 msgr2=0x7f63d00ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 shutdown_connections 2023-12-12T09:23:05.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.685+0000 7f63d71ce640 1 -- 172.21.15.84:0/3563044152 wait complete. 2023-12-12T09:23:05.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:23:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.919+0000 7f61cd8bb640 1 Processor -- start 2023-12-12T09:23:05.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.919+0000 7f61cd8bb640 1 -- start start 2023-12-12T09:23:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.920+0000 7f61cd8bb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f61c81412c0 0x7f61c815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.920+0000 7f61cd8bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c815f000 0x7f61c8070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.920+0000 7f61cd8bb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c80cdb80 con 0x7f61c813de10 2023-12-12T09:23:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.921+0000 7f61cd8bb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c815f4b0 con 0x7f61c81412c0 2023-12-12T09:23:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.921+0000 7f61cd8bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80cde60 con 0x7f61c815f000 2023-12-12T09:23:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.921+0000 7f61cc8b9640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f61c813de10 0x7f61c80cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50350/0 (socket says 172.21.15.84:50350) 2023-12-12T09:23:05.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.921+0000 7f61cc8b9640 1 -- 172.21.15.84:0/1343119608 learned_addr learned my addr 172.21.15.84:0/1343119608 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.921+0000 7f61cd0ba640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c815f000 0x7f61c8070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.921+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692889856 0 0) 0x7f61c80cdb80 con 0x7f61c813de10 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.921+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b8003520 con 0x7f61c813de10 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.921+0000 7f61c7fff640 1 --2- 172.21.15.84:0/1343119608 >> v2:172.21.15.99:3300/0 conn(0x7f61c81412c0 0x7f61c815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984029059 0 0) 0x7f61b8003520 con 0x7f61c813de10 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c815f000 msgr2=0x7f61c8070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c815f000 0x7f61c8070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 >> v2:172.21.15.99:3300/0 conn(0x7f61c81412c0 msgr2=0x7f61c815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 --2- 172.21.15.84:0/1343119608 >> v2:172.21.15.99:3300/0 conn(0x7f61c81412c0 0x7f61c815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c80ce140 con 0x7f61c813de10 2023-12-12T09:23:05.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f61bc001670 con 0x7f61c813de10 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 >> v1:172.21.15.84:6789/0 conn(0x7f61c813de10 legacy=0x7f61c80cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c815f000 0x7f61b80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b8004d00 0x7f61b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c815f4b0 con 0x7f61b8003fb0 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80cde60 con 0x7f61b8004d00 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b800ba00 con 0x7f61c815f000 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c7fff640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c7fff640 1 -- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c815f000 msgr2=0x7f61b80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c7fff640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c815f000 0x7f61b80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c7fff640 1 -- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b8004d00 msgr2=0x7f61b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.922+0000 7f61c7fff640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61b8004d00 0x7f61b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.923+0000 7f61c7fff640 1 -- 172.21.15.84:0/1343119608 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8003520 con 0x7f61b8003fb0 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.924+0000 7f61c7fff640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61b80047c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009ac0 tx=0x7f61b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22ce15d984f5531 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.924+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b402c710 con 0x7f61b8003fb0 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.924+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b402c870 con 0x7f61b8003fb0 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.924+0000 7f61c77fe640 1 -- 172.21.15.84:0/1343119608 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b402cc00 con 0x7f61b8003fb0 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.924+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1343119608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 msgr2=0x7f61b80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.924+0000 7f61cd8bb640 1 --2- 172.21.15.84:0/1343119608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61b80047c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009ac0 tx=0x7f61b80057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.925+0000 7f61cd0ba640 1 -- 172.21.15.84:0/1343119608 reap_dead start 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.925+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1343119608 shutdown_connections 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.925+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1343119608 >> 172.21.15.84:0/1343119608 conn(0x7f61c80b0780 msgr2=0x7f61c80b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.925+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1343119608 shutdown_connections 2023-12-12T09:23:05.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.925+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1343119608 wait complete. 2023-12-12T09:23:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.927+0000 7f61cd8bb640 1 Processor -- start 2023-12-12T09:23:05.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.927+0000 7f61cd8bb640 1 -- start start 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cd8bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61c815d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cd8bb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c80b37d0 0x7f61c815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cd8bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61c815bf30 0x7f61c80aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cd8bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c815dcd0 con 0x7f61b8003fb0 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cd8bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c815dfb0 con 0x7f61c815bf30 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cd8bb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c815b450 con 0x7f61c80b37d0 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cc8b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61c815d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cc8b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61c815d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35766/0 (socket says 172.21.15.84:35766) 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cc8b9640 1 -- 172.21.15.84:0/1274002209 learned_addr learned my addr 172.21.15.84:0/1274002209 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cc8b9640 1 -- 172.21.15.84:0/1274002209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c80b37d0 msgr2=0x7f61c815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cc8b9640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c80b37d0 0x7f61c815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cc8b9640 1 -- 172.21.15.84:0/1274002209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61c815bf30 msgr2=0x7f61c80aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.928+0000 7f61cc8b9640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61c815bf30 0x7f61c80aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.929+0000 7f61cc8b9640 1 -- 172.21.15.84:0/1274002209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c815b730 con 0x7f61b8003fb0 2023-12-12T09:23:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.929+0000 7f61cc8b9640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61c815d480 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c730 tx=0x7f61bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.929+0000 7f61c57fa640 1 -- 172.21.15.84:0/1274002209 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc0074e0 con 0x7f61b8003fb0 2023-12-12T09:23:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.929+0000 7f61c57fa640 1 -- 172.21.15.84:0/1274002209 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc007660 con 0x7f61b8003fb0 2023-12-12T09:23:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.929+0000 7f61c57fa640 1 -- 172.21.15.84:0/1274002209 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc004a20 con 0x7f61b8003fb0 2023-12-12T09:23:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.929+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c815ba10 con 0x7f61b8003fb0 2023-12-12T09:23:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.929+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c815d190 con 0x7f61b8003fb0 2023-12-12T09:23:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.930+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c815b2b0 con 0x7f61b8003fb0 2023-12-12T09:23:05.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.931+0000 7f61c57fa640 1 -- 172.21.15.84:0/1274002209 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61bc004b80 con 0x7f61b8003fb0 2023-12-12T09:23:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.932+0000 7f61c57fa640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f61ac06ae40 0x7f61ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:05.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.932+0000 7f61c57fa640 1 -- 172.21.15.84:0/1274002209 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f61bc088b70 con 0x7f61b8003fb0 2023-12-12T09:23:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.933+0000 7f61c7fff640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f61ac06ae40 0x7f61ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:05.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.934+0000 7f61c7fff640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f61ac06ae40 0x7f61ac06d300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f61b4036000 tx=0x7f61b402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:05.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:05.936+0000 7f61c57fa640 1 -- 172.21.15.84:0/1274002209 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61c815b2b0 con 0x7f61b8003fb0 2023-12-12T09:23:06.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.125+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61c815b2b0 con 0x7f61b8003fb0 2023-12-12T09:23:06.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.126+0000 7f61c57fa640 1 -- 172.21.15.84:0/1274002209 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61c815b2b0 con 0x7f61b8003fb0 2023-12-12T09:23:06.127 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:23:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.128+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f61ac06ae40 msgr2=0x7f61ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.128+0000 7f61cd8bb640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f61ac06ae40 0x7f61ac06d300 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f61b4036000 tx=0x7f61b402e000 comp rx=0 tx=0).stop 2023-12-12T09:23:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.128+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 msgr2=0x7f61c815d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.128+0000 7f61cd8bb640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61c815d480 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c730 tx=0x7f61bc00cbf0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.129+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 shutdown_connections 2023-12-12T09:23:06.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.129+0000 7f61cd8bb640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61c815bf30 0x7f61c80aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.129+0000 7f61cd8bb640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f61c80b37d0 0x7f61c815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.129+0000 7f61cd8bb640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f61ac06ae40 0x7f61ac06d300 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.129+0000 7f61cd8bb640 1 --2- 172.21.15.84:0/1274002209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61b8003fb0 0x7f61c815d480 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.129+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 >> 172.21.15.84:0/1274002209 conn(0x7f61c80b0780 msgr2=0x7f61c80ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.129+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 shutdown_connections 2023-12-12T09:23:06.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.129+0000 7f61cd8bb640 1 -- 172.21.15.84:0/1274002209 wait complete. 2023-12-12T09:23:06.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:23:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.358+0000 7f6cead3c640 1 Processor -- start 2023-12-12T09:23:06.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.358+0000 7f6cead3c640 1 -- start start 2023-12-12T09:23:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.360+0000 7f6cead3c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce406dff0 0x7f6ce40ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.360+0000 7f6cead3c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40ce260 con 0x7f6ce40b40d0 2023-12-12T09:23:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.360+0000 7f6cead3c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40cd930 con 0x7f6ce415be60 2023-12-12T09:23:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.360+0000 7f6cead3c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce406e480 con 0x7f6ce406dff0 2023-12-12T09:23:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.360+0000 7f6ce8ad8640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6ce40b40d0 0x7f6ce40b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50366/0 (socket says 172.21.15.84:50366) 2023-12-12T09:23:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.360+0000 7f6ce8ad8640 1 -- 172.21.15.84:0/132835712 learned_addr learned my addr 172.21.15.84:0/132835712 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:06.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.360+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681394049 0 0) 0x7f6ce40ce260 con 0x7f6ce40b40d0 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.360+0000 7f6ce3fff640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce406dff0 0x7f6ce40ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd4003520 con 0x7f6ce40b40d0 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2591317149 0 0) 0x7f6cd4003520 con 0x7f6ce40b40d0 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce406dff0 msgr2=0x7f6ce40ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce406dff0 0x7f6ce40ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 >> v1:172.21.15.99:6789/0 conn(0x7f6ce415be60 legacy=0x7f6ce413e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40cdc10 con 0x7f6ce40b40d0 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f6cd8001670 con 0x7f6ce40b40d0 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 >> v1:172.21.15.84:6789/0 conn(0x7f6ce40b40d0 legacy=0x7f6ce40b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce406dff0 0x7f6cd40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd4003f20 0x7f6cd40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004d00 0x7f6cd4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce406e480 con 0x7f6cd4004d00 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd400ba60 con 0x7f6cd4003f20 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.361+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd400bc20 con 0x7f6ce406dff0 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.362+0000 7f6ce92d9640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004d00 0x7f6cd4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.362+0000 7f6ce3fff640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd4003f20 0x7f6cd40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.362+0000 7f6ce8ad8640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce406dff0 0x7f6cd40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.362+0000 7f6ce92d9640 1 -- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce406dff0 msgr2=0x7f6cd40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.362+0000 7f6ce92d9640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce406dff0 0x7f6cd40039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.362+0000 7f6ce92d9640 1 -- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd4003f20 msgr2=0x7f6cd40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.362+0000 7f6ce92d9640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cd4003f20 0x7f6cd40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.362+0000 7f6ce92d9640 1 -- 172.21.15.84:0/132835712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4003520 con 0x7f6cd4004d00 2023-12-12T09:23:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.363+0000 7f6ce92d9640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004d00 0x7f6cd4005180 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc001e50 tx=0x7f6cd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193407b3e8fbb189 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:06.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.363+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc003b70 con 0x7f6cd4004d00 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.363+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc003cd0 con 0x7f6cd4004d00 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.363+0000 7f6ce37fe640 1 -- 172.21.15.84:0/132835712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc005310 con 0x7f6cd4004d00 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.364+0000 7f6cead3c640 1 -- 172.21.15.84:0/132835712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004d00 msgr2=0x7f6cd4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.364+0000 7f6cead3c640 1 --2- 172.21.15.84:0/132835712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd4004d00 0x7f6cd4005180 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc001e50 tx=0x7f6cd40057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.364+0000 7f6ce92d9640 1 -- 172.21.15.84:0/132835712 reap_dead start 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.364+0000 7f6cead3c640 1 -- 172.21.15.84:0/132835712 shutdown_connections 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.364+0000 7f6cead3c640 1 -- 172.21.15.84:0/132835712 >> 172.21.15.84:0/132835712 conn(0x7f6ce40b0ac0 msgr2=0x7f6ce40b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.364+0000 7f6cead3c640 1 -- 172.21.15.84:0/132835712 shutdown_connections 2023-12-12T09:23:06.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.364+0000 7f6cead3c640 1 -- 172.21.15.84:0/132835712 wait complete. 2023-12-12T09:23:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.366+0000 7f6cead3c640 1 Processor -- start 2023-12-12T09:23:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.366+0000 7f6cead3c640 1 -- start start 2023-12-12T09:23:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6cead3c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce4158a60 0x7f6ce40b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6cead3c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ce4135e00 0x7f6ce4130220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6cead3c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce4130760 0x7f6ce4130be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6cead3c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b30c0 con 0x7f6ce4130760 2023-12-12T09:23:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6cead3c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4158e40 con 0x7f6ce4135e00 2023-12-12T09:23:06.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6cead3c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4152b50 con 0x7f6ce4158a60 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6ce92d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce4130760 0x7f6ce4130be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6ce92d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce4130760 0x7f6ce4130be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35784/0 (socket says 172.21.15.84:35784) 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.367+0000 7f6ce92d9640 1 -- 172.21.15.84:0/401021168 learned_addr learned my addr 172.21.15.84:0/401021168 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce3fff640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ce4135e00 0x7f6ce4130220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce92d9640 1 -- 172.21.15.84:0/401021168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce4158a60 msgr2=0x7f6ce40b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce92d9640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce4158a60 0x7f6ce40b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce92d9640 1 -- 172.21.15.84:0/401021168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ce4135e00 msgr2=0x7f6ce4130220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce92d9640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ce4135e00 0x7f6ce4130220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce92d9640 1 -- 172.21.15.84:0/401021168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4152e30 con 0x7f6ce4130760 2023-12-12T09:23:06.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce92d9640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce4130760 0x7f6ce4130be0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc001f70 tx=0x7f6cdc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce17fa640 1 -- 172.21.15.84:0/401021168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc03e070 con 0x7f6ce4130760 2023-12-12T09:23:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce17fa640 1 -- 172.21.15.84:0/401021168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc003e40 con 0x7f6ce4130760 2023-12-12T09:23:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6ce17fa640 1 -- 172.21.15.84:0/401021168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc006d90 con 0x7f6ce4130760 2023-12-12T09:23:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.368+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce40b2a70 con 0x7f6ce4130760 2023-12-12T09:23:06.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.369+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce4152800 con 0x7f6ce4130760 2023-12-12T09:23:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.370+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce40b28d0 con 0x7f6ce4130760 2023-12-12T09:23:06.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.371+0000 7f6ce17fa640 1 -- 172.21.15.84:0/401021168 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6cdc007030 con 0x7f6ce4130760 2023-12-12T09:23:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.371+0000 7f6ce17fa640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6cc806aec0 0x7f6cc806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.372+0000 7f6ce17fa640 1 -- 172.21.15.84:0/401021168 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6cdc0aa920 con 0x7f6ce4130760 2023-12-12T09:23:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.372+0000 7f6ce8ad8640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6cc806aec0 0x7f6cc806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.372+0000 7f6ce8ad8640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6cc806aec0 0x7f6cc806d380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80017a0 tx=0x7f6cd8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:06.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.376+0000 7f6ce17fa640 1 -- 172.21.15.84:0/401021168 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ce40b28d0 con 0x7f6ce4130760 2023-12-12T09:23:06.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.565+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ce40b28d0 con 0x7f6ce4130760 2023-12-12T09:23:06.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.566+0000 7f6ce17fa640 1 -- 172.21.15.84:0/401021168 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ce40b28d0 con 0x7f6ce4130760 2023-12-12T09:23:06.568 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6cc806aec0 msgr2=0x7f6cc806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6cc806aec0 0x7f6cc806d380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6cd80017a0 tx=0x7f6cd8009040 comp rx=0 tx=0).stop 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce4130760 msgr2=0x7f6ce4130be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce4130760 0x7f6ce4130be0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc001f70 tx=0x7f6cdc0014a0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 shutdown_connections 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6cc806aec0 0x7f6cc806d380 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce4130760 0x7f6ce4130be0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ce4135e00 0x7f6ce4130220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 --2- 172.21.15.84:0/401021168 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6ce4158a60 0x7f6ce40b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 >> 172.21.15.84:0/401021168 conn(0x7f6ce40b0ac0 msgr2=0x7f6ce4152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.569+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 shutdown_connections 2023-12-12T09:23:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.570+0000 7f6cead3c640 1 -- 172.21.15.84:0/401021168 wait complete. 2023-12-12T09:23:06.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:23:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.803+0000 7fc10e3c9640 1 Processor -- start 2023-12-12T09:23:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.803+0000 7fc10e3c9640 1 -- start start 2023-12-12T09:23:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.804+0000 7fc10e3c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc108144740 0x7fc10806de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10e3c9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc10815f4c0 0x7fc1080705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10e3c9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc108144b20 con 0x7fc10815e950 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10e3c9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10806d670 con 0x7fc10815f4c0 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10e3c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10806cdd0 con 0x7fc108144740 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10dbc8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc10815f4c0 0x7fc1080705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10dbc8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc10815f4c0 0x7fc1080705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35798/0 (socket says 172.21.15.84:35798) 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10dbc8640 1 -- 172.21.15.84:0/462721469 learned_addr learned my addr 172.21.15.84:0/462721469 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10dbc8640 1 -- 172.21.15.84:0/462721469 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc108144740 msgr2=0x7fc10806de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10d3c7640 1 --2- 172.21.15.84:0/462721469 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc108144740 0x7fc10806de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10dbc8640 1 --2- 172.21.15.84:0/462721469 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc108144740 0x7fc10806de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10dbc8640 1 -- 172.21.15.84:0/462721469 >> v1:172.21.15.99:6789/0 conn(0x7fc10815e950 legacy=0x7fc10815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.805+0000 7fc10dbc8640 1 -- 172.21.15.84:0/462721469 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10806d0b0 con 0x7fc10815f4c0 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.806+0000 7fc10dbc8640 1 --2- 172.21.15.84:0/462721469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10815f4c0 0x7fc1080705b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc100009e50 tx=0x7fc10002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2806fc0b265beb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc0fffff640 1 -- 172.21.15.84:0/462721469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10002ca80 con 0x7fc10815f4c0 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc0fffff640 1 -- 172.21.15.84:0/462721469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10002cbe0 con 0x7fc10815f4c0 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc0fffff640 1 -- 172.21.15.84:0/462721469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1000343f0 con 0x7fc10815f4c0 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc10e3c9640 1 -- 172.21.15.84:0/462721469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10815f4c0 msgr2=0x7fc1080705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/462721469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10815f4c0 0x7fc1080705b0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc100009e50 tx=0x7fc10002bee0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc10e3c9640 1 -- 172.21.15.84:0/462721469 shutdown_connections 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/462721469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc10815f4c0 0x7fc1080705b0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/462721469 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc108144740 0x7fc10806de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.807+0000 7fc10e3c9640 1 -- 172.21.15.84:0/462721469 >> 172.21.15.84:0/462721469 conn(0x7fc1080b07f0 msgr2=0x7fc1080b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.808+0000 7fc10e3c9640 1 -- 172.21.15.84:0/462721469 shutdown_connections 2023-12-12T09:23:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.808+0000 7fc10e3c9640 1 -- 172.21.15.84:0/462721469 wait complete. 2023-12-12T09:23:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.809+0000 7fc10e3c9640 1 Processor -- start 2023-12-12T09:23:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.809+0000 7fc10e3c9640 1 -- start start 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.810+0000 7fc10e3c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc108144740 0x7fc10813aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.810+0000 7fc10e3c9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc10815e950 0x7fc1081f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.810+0000 7fc10e3c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10815f4c0 0x7fc108139590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.810+0000 7fc10e3c9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1081f3c40 con 0x7fc108144740 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.810+0000 7fc10e3c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10813eb10 con 0x7fc10815f4c0 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.810+0000 7fc10e3c9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10813b3e0 con 0x7fc10815e950 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc108144740 0x7fc10813aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc108144740 0x7fc10813aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35808/0 (socket says 172.21.15.84:35808) 2023-12-12T09:23:06.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 -- 172.21.15.84:0/2571962716 learned_addr learned my addr 172.21.15.84:0/2571962716 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10cbc6640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc10815e950 0x7fc1081f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10dbc8640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10815f4c0 0x7fc108139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 -- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc10815e950 msgr2=0x7fc1081f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc10815e950 0x7fc1081f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 -- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10815f4c0 msgr2=0x7fc108139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10815f4c0 0x7fc108139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 -- 172.21.15.84:0/2571962716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc100009b30 con 0x7fc108144740 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10dbc8640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10815f4c0 0x7fc108139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.811+0000 7fc10d3c7640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc108144740 0x7fc10813aea0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c7f0 tx=0x7fc10400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:06.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.812+0000 7fc0fdffb640 1 -- 172.21.15.84:0/2571962716 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104004220 con 0x7fc108144740 2023-12-12T09:23:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.812+0000 7fc0fdffb640 1 -- 172.21.15.84:0/2571962716 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1040043a0 con 0x7fc108144740 2023-12-12T09:23:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.812+0000 7fc0fdffb640 1 -- 172.21.15.84:0/2571962716 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104007860 con 0x7fc108144740 2023-12-12T09:23:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.812+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1081f3120 con 0x7fc108144740 2023-12-12T09:23:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.812+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1081f3680 con 0x7fc108144740 2023-12-12T09:23:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.813+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1080673c0 con 0x7fc108144740 2023-12-12T09:23:06.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.814+0000 7fc0fdffb640 1 -- 172.21.15.84:0/2571962716 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc104007bd0 con 0x7fc108144740 2023-12-12T09:23:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.815+0000 7fc0fdffb640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc0ec06ae40 0x7fc0ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.815+0000 7fc0fdffb640 1 -- 172.21.15.84:0/2571962716 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc104089770 con 0x7fc108144740 2023-12-12T09:23:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.815+0000 7fc10cbc6640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc0ec06ae40 0x7fc0ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:06.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.816+0000 7fc10cbc6640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc0ec06ae40 0x7fc0ec06d300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc10815dec0 tx=0x7fc0f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:06.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:06.819+0000 7fc0fdffb640 1 -- 172.21.15.84:0/2571962716 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc104054640 con 0x7fc108144740 2023-12-12T09:23:07.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.022+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc10813e870 con 0x7fc108144740 2023-12-12T09:23:07.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.023+0000 7fc0fdffb640 1 -- 172.21.15.84:0/2571962716 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc104057c60 con 0x7fc108144740 2023-12-12T09:23:07.024 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc0ec06ae40 msgr2=0x7fc0ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc0ec06ae40 0x7fc0ec06d300 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc10815dec0 tx=0x7fc0f8009040 comp rx=0 tx=0).stop 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc108144740 msgr2=0x7fc10813aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc108144740 0x7fc10813aea0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c7f0 tx=0x7fc10400ccb0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 shutdown_connections 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc10815f4c0 0x7fc108139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc10815e950 0x7fc1081f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc0ec06ae40 0x7fc0ec06d300 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 --2- 172.21.15.84:0/2571962716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc108144740 0x7fc10813aea0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 >> 172.21.15.84:0/2571962716 conn(0x7fc1080b07f0 msgr2=0x7fc10806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:07.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 shutdown_connections 2023-12-12T09:23:07.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.026+0000 7fc10e3c9640 1 -- 172.21.15.84:0/2571962716 wait complete. 2023-12-12T09:23:07.046 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:23:07.046 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:07.097 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:07.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.354+0000 7f443067c640 1 Processor -- start 2023-12-12T09:23:07.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.354+0000 7f443067c640 1 -- start start 2023-12-12T09:23:07.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.356+0000 7f443067c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f44280ce550 0x7f4428071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.356+0000 7f443067c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44280cea30 con 0x7f4428143d20 2023-12-12T09:23:07.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.356+0000 7f443067c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44280702b0 con 0x7f44280b47e0 2023-12-12T09:23:07.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.356+0000 7f443067c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4428070590 con 0x7f44280ce550 2023-12-12T09:23:07.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.356+0000 7f442e418640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4428143d20 0x7f44280b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50382/0 (socket says 172.21.15.84:50382) 2023-12-12T09:23:07.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.356+0000 7f442e418640 1 -- 172.21.15.84:0/383641457 learned_addr learned my addr 172.21.15.84:0/383641457 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442ec19640 1 --2- 172.21.15.84:0/383641457 >> v2:172.21.15.99:3300/0 conn(0x7f44280ce550 0x7f4428071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603088977 0 0) 0x7f44280cea30 con 0x7f4428143d20 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4414003520 con 0x7f4428143d20 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 939148677 0 0) 0x7f4414003520 con 0x7f4428143d20 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 >> v2:172.21.15.99:3300/0 conn(0x7f44280ce550 msgr2=0x7f4428071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 --2- 172.21.15.84:0/383641457 >> v2:172.21.15.99:3300/0 conn(0x7f44280ce550 0x7f4428071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 >> v1:172.21.15.99:6789/0 conn(0x7f44280b47e0 legacy=0x7f4428071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428070870 con 0x7f4428143d20 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f4424001670 con 0x7f4428143d20 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 >> v1:172.21.15.84:6789/0 conn(0x7f4428143d20 legacy=0x7f44280b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.357+0000 7f442d416640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4414003970 0x7f4414003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442d416640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44140047c0 0x7f4414004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442d416640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f441400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4428070590 con 0x7f4414005180 2023-12-12T09:23:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441400c020 con 0x7f44140047c0 2023-12-12T09:23:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44140105f0 con 0x7f4414003970 2023-12-12T09:23:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442ec19640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f441400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442ec19640 1 -- 172.21.15.84:0/383641457 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4414003970 msgr2=0x7f4414003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442ec19640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4414003970 0x7f4414003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442ec19640 1 -- 172.21.15.84:0/383641457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44140047c0 msgr2=0x7f4414004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442ec19640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44140047c0 0x7f4414004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.358+0000 7f442ec19640 1 -- 172.21.15.84:0/383641457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414003520 con 0x7f4414005180 2023-12-12T09:23:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.359+0000 7f442ec19640 1 -- 172.21.15.84:0/383641457 reap_dead start 2023-12-12T09:23:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.359+0000 7f442ec19640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f441400b980 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f44280b1e70 tx=0x7f44140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afbc1c780f06dae server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.359+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442002cbf0 con 0x7f4414005180 2023-12-12T09:23:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.359+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442000f040 con 0x7f4414005180 2023-12-12T09:23:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.359+0000 7f442d416640 1 -- 172.21.15.84:0/383641457 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4420034440 con 0x7f4414005180 2023-12-12T09:23:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.360+0000 7f443067c640 1 -- 172.21.15.84:0/383641457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 msgr2=0x7f441400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.360+0000 7f443067c640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f441400b980 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f44280b1e70 tx=0x7f44140057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.360+0000 7f443067c640 1 -- 172.21.15.84:0/383641457 shutdown_connections 2023-12-12T09:23:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.360+0000 7f443067c640 1 --2- 172.21.15.84:0/383641457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f441400b980 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.360+0000 7f443067c640 1 -- 172.21.15.84:0/383641457 >> 172.21.15.84:0/383641457 conn(0x7f442806c3d0 msgr2=0x7f442806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.360+0000 7f443067c640 1 -- 172.21.15.84:0/383641457 shutdown_connections 2023-12-12T09:23:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.360+0000 7f443067c640 1 -- 172.21.15.84:0/383641457 wait complete. 2023-12-12T09:23:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.362+0000 7f443067c640 1 Processor -- start 2023-12-12T09:23:07.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.362+0000 7f443067c640 1 -- start start 2023-12-12T09:23:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.363+0000 7f443067c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f442815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.363+0000 7f443067c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44280b1bb0 0x7f44280b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.363+0000 7f443067c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f442813d980 0x7f442813de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.363+0000 7f443067c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442813e340 con 0x7f4414005180 2023-12-12T09:23:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.363+0000 7f443067c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280b20b0 con 0x7f442813d980 2023-12-12T09:23:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.363+0000 7f443067c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44280b2390 con 0x7f44280b1bb0 2023-12-12T09:23:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.363+0000 7f442e418640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f442815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f442e418640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f442815a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35830/0 (socket says 172.21.15.84:35830) 2023-12-12T09:23:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f442e418640 1 -- 172.21.15.84:0/4022898735 learned_addr learned my addr 172.21.15.84:0/4022898735 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f442e418640 1 -- 172.21.15.84:0/4022898735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44280b1bb0 msgr2=0x7f44280b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f442e418640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44280b1bb0 0x7f44280b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f442e418640 1 -- 172.21.15.84:0/4022898735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f442813d980 msgr2=0x7f442813de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f442e418640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f442813d980 0x7f442813de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f442e418640 1 -- 172.21.15.84:0/4022898735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280b2670 con 0x7f4414005180 2023-12-12T09:23:07.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f442e418640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f442815a640 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f442400c700 tx=0x7f442400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f441effd640 1 -- 172.21.15.84:0/4022898735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240074e0 con 0x7f4414005180 2023-12-12T09:23:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f441effd640 1 -- 172.21.15.84:0/4022898735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424007640 con 0x7f4414005180 2023-12-12T09:23:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.364+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44280b2950 con 0x7f4414005180 2023-12-12T09:23:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.365+0000 7f441effd640 1 -- 172.21.15.84:0/4022898735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424004a20 con 0x7f4414005180 2023-12-12T09:23:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.365+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442815ab80 con 0x7f4414005180 2023-12-12T09:23:07.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.366+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4428136f30 con 0x7f4414005180 2023-12-12T09:23:07.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.367+0000 7f441effd640 1 -- 172.21.15.84:0/4022898735 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4424004b80 con 0x7f4414005180 2023-12-12T09:23:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.368+0000 7f441effd640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f440c06ae70 0x7f440c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.368+0000 7f441effd640 1 -- 172.21.15.84:0/4022898735 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4424088ae0 con 0x7f4414005180 2023-12-12T09:23:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.368+0000 7f442dc17640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f440c06ae70 0x7f440c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.368+0000 7f442dc17640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f440c06ae70 0x7f440c06d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f442813e630 tx=0x7f44180079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:07.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.372+0000 7f441effd640 1 -- 172.21.15.84:0/4022898735 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4424053a50 con 0x7f4414005180 2023-12-12T09:23:07.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.567+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44280673c0 con 0x7f4414005180 2023-12-12T09:23:07.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.569+0000 7f441effd640 1 -- 172.21.15.84:0/4022898735 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7f4424018020 con 0x7f4414005180 2023-12-12T09:23:07.570 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:07.570 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f440c06ae70 msgr2=0x7f440c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f440c06ae70 0x7f440c06d330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f442813e630 tx=0x7f44180079b0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 msgr2=0x7f442815a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f442815a640 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f442400c700 tx=0x7f442400cbc0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 shutdown_connections 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f442813d980 0x7f442813de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44280b1bb0 0x7f44280b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f440c06ae70 0x7f440c06d330 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 --2- 172.21.15.84:0/4022898735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4414005180 0x7f442815a640 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.571+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 >> 172.21.15.84:0/4022898735 conn(0x7f442806c3d0 msgr2=0x7f4428142030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.572+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 shutdown_connections 2023-12-12T09:23:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.572+0000 7f443067c640 1 -- 172.21.15.84:0/4022898735 wait complete. 2023-12-12T09:23:07.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:22:47.550419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:22:48.743328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:23:07.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:23:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.799+0000 7f8b9e16c640 1 Processor -- start 2023-12-12T09:23:07.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.800+0000 7f8b9e16c640 1 -- start start 2023-12-12T09:23:07.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.801+0000 7f8b9e16c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8b98157860 0x7f8b9815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.801+0000 7f8b9e16c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 0x7f8b980cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.801+0000 7f8b9e16c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9815ddf0 con 0x7f8b980b1a80 2023-12-12T09:23:07.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.801+0000 7f8b9e16c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b980cf900 con 0x7f8b98157860 2023-12-12T09:23:07.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.801+0000 7f8b9e16c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9815acb0 con 0x7f8b980cef30 2023-12-12T09:23:07.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.802+0000 7f8b9d16a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8b98157860 0x7f8b9815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.802+0000 7f8b9d16a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8b98157860 0x7f8b9815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:38012/0 (socket says 172.21.15.84:38012) 2023-12-12T09:23:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.802+0000 7f8b9d16a640 1 -- 172.21.15.84:0/1967896475 learned_addr learned my addr 172.21.15.84:0/1967896475 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.802+0000 7f8b9d96b640 1 --2- 172.21.15.84:0/1967896475 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 0x7f8b980cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.803+0000 7f8b9d16a640 1 -- 172.21.15.84:0/1967896475 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 msgr2=0x7f8b980cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.803+0000 7f8b9d16a640 1 --2- 172.21.15.84:0/1967896475 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 0x7f8b980cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.803+0000 7f8b9d16a640 1 -- 172.21.15.84:0/1967896475 >> v1:172.21.15.99:6789/0 conn(0x7f8b980b1a80 legacy=0x7f8b9815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.803+0000 7f8b9d16a640 1 -- 172.21.15.84:0/1967896475 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9815af90 con 0x7f8b98157860 2023-12-12T09:23:07.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.804+0000 7f8b9d16a640 1 --2- 172.21.15.84:0/1967896475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b98157860 0x7f8b9815a400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009870 tx=0x7f8b9402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2efb31441efb41a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b8bfff640 1 -- 172.21.15.84:0/1967896475 <== mon.1 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94030840 con 0x7f8b98157860 2023-12-12T09:23:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b8bfff640 1 -- 172.21.15.84:0/1967896475 <== mon.1 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b940309a0 con 0x7f8b98157860 2023-12-12T09:23:07.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b8bfff640 1 -- 172.21.15.84:0/1967896475 <== mon.1 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94030d30 con 0x7f8b98157860 2023-12-12T09:23:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b9e16c640 1 -- 172.21.15.84:0/1967896475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b98157860 msgr2=0x7f8b9815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/1967896475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b98157860 0x7f8b9815a400 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009870 tx=0x7f8b9402b980 comp rx=0 tx=0).stop 2023-12-12T09:23:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b9e16c640 1 -- 172.21.15.84:0/1967896475 shutdown_connections 2023-12-12T09:23:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/1967896475 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 0x7f8b980cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/1967896475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b98157860 0x7f8b9815a400 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.805+0000 7f8b9e16c640 1 -- 172.21.15.84:0/1967896475 >> 172.21.15.84:0/1967896475 conn(0x7f8b9806a920 msgr2=0x7f8b9806ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.806+0000 7f8b9e16c640 1 -- 172.21.15.84:0/1967896475 shutdown_connections 2023-12-12T09:23:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.806+0000 7f8b9e16c640 1 -- 172.21.15.84:0/1967896475 wait complete. 2023-12-12T09:23:07.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.808+0000 7f8b9e16c640 1 Processor -- start 2023-12-12T09:23:07.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.808+0000 7f8b9e16c640 1 -- start start 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9e16c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b980b1a80 0x7f8b980acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9e16c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 0x7f8b981fa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9e16c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b98157860 0x7f8b981fad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9e16c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980acb30 con 0x7f8b98157860 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9e16c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980abeb0 con 0x7f8b980b1a80 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9e16c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980ac190 con 0x7f8b980cef30 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9d96b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b98157860 0x7f8b981fad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9d96b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b98157860 0x7f8b981fad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35846/0 (socket says 172.21.15.84:35846) 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9d96b640 1 -- 172.21.15.84:0/3757254347 learned_addr learned my addr 172.21.15.84:0/3757254347 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:07.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9d16a640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b980b1a80 0x7f8b980acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.810+0000 7f8b9c969640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 0x7f8b981fa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b9d96b640 1 -- 172.21.15.84:0/3757254347 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 msgr2=0x7f8b981fa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b9d96b640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 0x7f8b981fa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b9d96b640 1 -- 172.21.15.84:0/3757254347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b980b1a80 msgr2=0x7f8b980acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b9d96b640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b980b1a80 0x7f8b980acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b9d96b640 1 -- 172.21.15.84:0/3757254347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940094d0 con 0x7f8b98157860 2023-12-12T09:23:07.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b9d96b640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b98157860 0x7f8b981fad10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000efc0 tx=0x7f8b9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b89ffb640 1 -- 172.21.15.84:0/3757254347 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90014480 con 0x7f8b98157860 2023-12-12T09:23:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b89ffb640 1 -- 172.21.15.84:0/3757254347 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000f040 con 0x7f8b98157860 2023-12-12T09:23:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b89ffb640 1 -- 172.21.15.84:0/3757254347 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90014820 con 0x7f8b98157860 2023-12-12T09:23:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b980ac470 con 0x7f8b98157860 2023-12-12T09:23:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.811+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b980ab920 con 0x7f8b98157860 2023-12-12T09:23:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.812+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b980673c0 con 0x7f8b98157860 2023-12-12T09:23:07.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.813+0000 7f8b89ffb640 1 -- 172.21.15.84:0/3757254347 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b90014980 con 0x7f8b98157860 2023-12-12T09:23:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.814+0000 7f8b89ffb640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b7c06ae40 0x7f8b7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:07.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.814+0000 7f8b89ffb640 1 -- 172.21.15.84:0/3757254347 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8b9008a320 con 0x7f8b98157860 2023-12-12T09:23:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.815+0000 7f8b9d16a640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b7c06ae40 0x7f8b7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:07.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.815+0000 7f8b9d16a640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b7c06ae40 0x7f8b7c06d300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8b94036000 tx=0x7f8b94008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:07.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:07.819+0000 7f8b89ffb640 1 -- 172.21.15.84:0/3757254347 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b90055290 con 0x7f8b98157860 2023-12-12T09:23:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.010+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b980cda60 con 0x7f8b98157860 2023-12-12T09:23:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.011+0000 7f8b89ffb640 1 -- 172.21.15.84:0/3757254347 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b900588b0 con 0x7f8b98157860 2023-12-12T09:23:08.012 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:23:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.013+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b7c06ae40 msgr2=0x7f8b7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.013+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b7c06ae40 0x7f8b7c06d300 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8b94036000 tx=0x7f8b94008030 comp rx=0 tx=0).stop 2023-12-12T09:23:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.013+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b98157860 msgr2=0x7f8b981fad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.013+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b98157860 0x7f8b981fad10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000efc0 tx=0x7f8b9000c490 comp rx=0 tx=0).stop 2023-12-12T09:23:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.014+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 shutdown_connections 2023-12-12T09:23:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.014+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b7c06ae40 0x7f8b7c06d300 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.014+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b98157860 0x7f8b981fad10 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.014+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b980cef30 0x7f8b981fa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.014+0000 7f8b9e16c640 1 --2- 172.21.15.84:0/3757254347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b980b1a80 0x7f8b980acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.014+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 >> 172.21.15.84:0/3757254347 conn(0x7f8b9806a920 msgr2=0x7f8b980b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.014+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 shutdown_connections 2023-12-12T09:23:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.014+0000 7f8b9e16c640 1 -- 172.21.15.84:0/3757254347 wait complete. 2023-12-12T09:23:08.033 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:23:08.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.243+0000 7f4b1f2c3640 1 Processor -- start 2023-12-12T09:23:08.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.243+0000 7f4b1f2c3640 1 -- start start 2023-12-12T09:23:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.245+0000 7f4b1f2c3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b180d1af0 0x7f4b180cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.245+0000 7f4b1f2c3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b18160cb0 con 0x7f4b180b88e0 2023-12-12T09:23:08.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.245+0000 7f4b1f2c3640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b180b8cc0 con 0x7f4b180b7ac0 2023-12-12T09:23:08.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.245+0000 7f4b1f2c3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180d3c70 con 0x7f4b180d1af0 2023-12-12T09:23:08.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.245+0000 7f4b1e2c1640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4b180b88e0 0x7f4b180d13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50396/0 (socket says 172.21.15.84:50396) 2023-12-12T09:23:08.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.245+0000 7f4b1e2c1640 1 -- 172.21.15.84:0/3364466086 learned_addr learned my addr 172.21.15.84:0/3364466086 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993164977 0 0) 0x7f4b18160cb0 con 0x7f4b180b88e0 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b04003520 con 0x7f4b180b88e0 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1dac0640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b180d1af0 0x7f4b180cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 28150823 0 0) 0x7f4b04003520 con 0x7f4b180b88e0 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b180d1af0 msgr2=0x7f4b180cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b180d1af0 0x7f4b180cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 >> v1:172.21.15.99:6789/0 conn(0x7f4b180b7ac0 legacy=0x7f4b180cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180b5cf0 con 0x7f4b180b88e0 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f4b14001670 con 0x7f4b180b88e0 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 >> v1:172.21.15.84:6789/0 conn(0x7f4b180b88e0 legacy=0x7f4b180d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b180d1af0 0x7f4b04003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004020 0x7f4b040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b04004d00 0x7f4b04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180d3c70 con 0x7f4b04004d00 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0400bc50 con 0x7f4b04004020 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.246+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0400be10 con 0x7f4b180d1af0 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.247+0000 7f4b1eac2640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b04004d00 0x7f4b04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.247+0000 7f4b1e2c1640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b180d1af0 0x7f4b04003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.247+0000 7f4b1dac0640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004020 0x7f4b040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.247+0000 7f4b1eac2640 1 -- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b180d1af0 msgr2=0x7f4b04003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.247+0000 7f4b1eac2640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b180d1af0 0x7f4b04003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.247+0000 7f4b1eac2640 1 -- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004020 msgr2=0x7f4b040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.247+0000 7f4b1eac2640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004020 0x7f4b040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.247+0000 7f4b1eac2640 1 -- 172.21.15.84:0/3364466086 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04003520 con 0x7f4b04004d00 2023-12-12T09:23:08.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.248+0000 7f4b1eac2640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b04004d00 0x7f4b04005180 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4b10004480 tx=0x7f4b040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636a40a59bcd0e8f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.248+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10030400 con 0x7f4b04004d00 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10030560 con 0x7f4b04004d00 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1d2bf640 1 -- 172.21.15.84:0/3364466086 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10030950 con 0x7f4b04004d00 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/3364466086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b04004d00 msgr2=0x7f4b04005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1f2c3640 1 --2- 172.21.15.84:0/3364466086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b04004d00 0x7f4b04005180 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4b10004480 tx=0x7f4b040057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1eac2640 1 -- 172.21.15.84:0/3364466086 reap_dead start 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/3364466086 shutdown_connections 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/3364466086 >> 172.21.15.84:0/3364466086 conn(0x7f4b180d2e00 msgr2=0x7f4b180d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/3364466086 shutdown_connections 2023-12-12T09:23:08.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.249+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/3364466086 wait complete. 2023-12-12T09:23:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.251+0000 7f4b1f2c3640 1 Processor -- start 2023-12-12T09:23:08.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.251+0000 7f4b1f2c3640 1 -- start start 2023-12-12T09:23:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.252+0000 7f4b1f2c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004d00 0x7f4b181f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.252+0000 7f4b1f2c3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b18157140 0x7f4b180c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.252+0000 7f4b1f2c3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b181f30f0 0x7f4b180b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.252+0000 7f4b1f2c3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181f6bd0 con 0x7f4b18157140 2023-12-12T09:23:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.252+0000 7f4b1f2c3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b180c7300 con 0x7f4b04004d00 2023-12-12T09:23:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.252+0000 7f4b1f2c3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b181575c0 con 0x7f4b181f30f0 2023-12-12T09:23:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.252+0000 7f4b1dac0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b18157140 0x7f4b180c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1dac0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b18157140 0x7f4b180c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35864/0 (socket says 172.21.15.84:35864) 2023-12-12T09:23:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1dac0640 1 -- 172.21.15.84:0/2739723321 learned_addr learned my addr 172.21.15.84:0/2739723321 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1e2c1640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004d00 0x7f4b181f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1eac2640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b181f30f0 0x7f4b180b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1dac0640 1 -- 172.21.15.84:0/2739723321 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b181f30f0 msgr2=0x7f4b180b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1dac0640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b181f30f0 0x7f4b180b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1dac0640 1 -- 172.21.15.84:0/2739723321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004d00 msgr2=0x7f4b181f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1dac0640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004d00 0x7f4b181f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1dac0640 1 -- 172.21.15.84:0/2739723321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180ca410 con 0x7f4b18157140 2023-12-12T09:23:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b1dac0640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b18157140 0x7f4b180c9ed0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800f5b0 tx=0x7f4b0800fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.253+0000 7f4b0effd640 1 -- 172.21.15.84:0/2739723321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08014870 con 0x7f4b18157140 2023-12-12T09:23:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.254+0000 7f4b0effd640 1 -- 172.21.15.84:0/2739723321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b080149d0 con 0x7f4b18157140 2023-12-12T09:23:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.254+0000 7f4b0effd640 1 -- 172.21.15.84:0/2739723321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08014d80 con 0x7f4b18157140 2023-12-12T09:23:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.254+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b181f6330 con 0x7f4b18157140 2023-12-12T09:23:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.254+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b181f68f0 con 0x7f4b18157140 2023-12-12T09:23:08.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.255+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b180ce090 con 0x7f4b18157140 2023-12-12T09:23:08.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.256+0000 7f4b0effd640 1 -- 172.21.15.84:0/2739723321 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b08015410 con 0x7f4b18157140 2023-12-12T09:23:08.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.257+0000 7f4b0effd640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4afc06ae70 0x7f4afc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.257+0000 7f4b0effd640 1 -- 172.21.15.84:0/2739723321 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4b0808a100 con 0x7f4b18157140 2023-12-12T09:23:08.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.257+0000 7f4b1e2c1640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4afc06ae70 0x7f4afc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.258+0000 7f4b1e2c1640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4afc06ae70 0x7f4afc06d330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b14001050 tx=0x7f4b14001d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:08.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.261+0000 7f4b0effd640 1 -- 172.21.15.84:0/2739723321 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b08054fd0 con 0x7f4b18157140 2023-12-12T09:23:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.447+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b1804e840 con 0x7f4b18157140 2023-12-12T09:23:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.448+0000 7f4b0effd640 1 -- 172.21.15.84:0/2739723321 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b080585f0 con 0x7f4b18157140 2023-12-12T09:23:08.450 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:23:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.450+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4afc06ae70 msgr2=0x7f4afc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.450+0000 7f4b1f2c3640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4afc06ae70 0x7f4afc06d330 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b14001050 tx=0x7f4b14001d60 comp rx=0 tx=0).stop 2023-12-12T09:23:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b18157140 msgr2=0x7f4b180c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b18157140 0x7f4b180c9ed0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800f5b0 tx=0x7f4b0800fa70 comp rx=0 tx=0).stop 2023-12-12T09:23:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 shutdown_connections 2023-12-12T09:23:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4b181f30f0 0x7f4b180b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4afc06ae70 0x7f4afc06d330 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b18157140 0x7f4b180c9ed0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 --2- 172.21.15.84:0/2739723321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b04004d00 0x7f4b181f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 >> 172.21.15.84:0/2739723321 conn(0x7f4b180d2e00 msgr2=0x7f4b180d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 shutdown_connections 2023-12-12T09:23:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.451+0000 7f4b1f2c3640 1 -- 172.21.15.84:0/2739723321 wait complete. 2023-12-12T09:23:08.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:23:08.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.671+0000 7fe9031b6640 1 Processor -- start 2023-12-12T09:23:08.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.671+0000 7fe9031b6640 1 -- start start 2023-12-12T09:23:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.673+0000 7fe9031b6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc0b40d0 0x7fe8fc06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.673+0000 7fe9031b6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8fc0ce6f0 0x7fe8fc0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.673+0000 7fe9031b6640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15be60 0x7fe8fc13e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.673+0000 7fe9031b6640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0ceb80 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.673+0000 7fe9031b6640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8fc0ce260 con 0x7fe8fc15be60 2023-12-12T09:23:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.673+0000 7fe9031b6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc0b49f0 con 0x7fe8fc0b40d0 2023-12-12T09:23:08.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.673+0000 7fe8fbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8fc0ce6f0 0x7fe8fc0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe8fbfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe8fc0ce6f0 0x7fe8fc0b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35866/0 (socket says 172.21.15.84:35866) 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe8fbfff640 1 -- 172.21.15.84:0/2226452483 learned_addr learned my addr 172.21.15.84:0/2226452483 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe900f52640 1 --2- 172.21.15.84:0/2226452483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc0b40d0 0x7fe8fc06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe8fbfff640 1 -- 172.21.15.84:0/2226452483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc0b40d0 msgr2=0x7fe8fc06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe8fbfff640 1 --2- 172.21.15.84:0/2226452483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc0b40d0 0x7fe8fc06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe901753640 1 --2- 172.21.15.84:0/2226452483 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15be60 0x7fe8fc13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe8fbfff640 1 -- 172.21.15.84:0/2226452483 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15be60 msgr2=0x7fe8fc13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe8fbfff640 1 --2- 172.21.15.84:0/2226452483 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15be60 0x7fe8fc13e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe8fbfff640 1 -- 172.21.15.84:0/2226452483 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0cd930 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.674+0000 7fe901753640 1 --2- 172.21.15.84:0/2226452483 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15be60 0x7fe8fc13e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.675+0000 7fe8fbfff640 1 --2- 172.21.15.84:0/2226452483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc0b44b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0b1e50 tx=0x7fe8e802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b947bdf54551ef server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.675+0000 7fe8fb7fe640 1 -- 172.21.15.84:0/2226452483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8031860 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.675+0000 7fe8fb7fe640 1 -- 172.21.15.84:0/2226452483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e80319c0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe8fb7fe640 1 -- 172.21.15.84:0/2226452483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8031d50 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe9031b6640 1 -- 172.21.15.84:0/2226452483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 msgr2=0x7fe8fc0b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2226452483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc0b44b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0b1e50 tx=0x7fe8e802b900 comp rx=0 tx=0).stop 2023-12-12T09:23:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe9031b6640 1 -- 172.21.15.84:0/2226452483 shutdown_connections 2023-12-12T09:23:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2226452483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc0b44b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2226452483 >> v2:172.21.15.99:3300/0 conn(0x7fe8fc15be60 0x7fe8fc13e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2226452483 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc0b40d0 0x7fe8fc06dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe9031b6640 1 -- 172.21.15.84:0/2226452483 >> 172.21.15.84:0/2226452483 conn(0x7fe8fc0b0ac0 msgr2=0x7fe8fc0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.676+0000 7fe9031b6640 1 -- 172.21.15.84:0/2226452483 shutdown_connections 2023-12-12T09:23:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.677+0000 7fe9031b6640 1 -- 172.21.15.84:0/2226452483 wait complete. 2023-12-12T09:23:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.678+0000 7fe9031b6640 1 Processor -- start 2023-12-12T09:23:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.678+0000 7fe9031b6640 1 -- start start 2023-12-12T09:23:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.679+0000 7fe9031b6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc0b40d0 0x7fe8fc13a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.679+0000 7fe9031b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.679+0000 7fe9031b6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc15be60 0x7fe8fc071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.679+0000 7fe9031b6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc158bd0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.679+0000 7fe9031b6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc13ad30 con 0x7fe8fc0b40d0 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.679+0000 7fe9031b6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc157fc0 con 0x7fe8fc15be60 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc1567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35868/0 (socket says 172.21.15.84:35868) 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 -- 172.21.15.84:0/2605098504 learned_addr learned my addr 172.21.15.84:0/2605098504 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe901753640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc15be60 0x7fe8fc071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe900f52640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc0b40d0 0x7fe8fc13a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 -- 172.21.15.84:0/2605098504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc15be60 msgr2=0x7fe8fc071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc15be60 0x7fe8fc071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 -- 172.21.15.84:0/2605098504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc0b40d0 msgr2=0x7fe8fc13a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc0b40d0 0x7fe8fc13a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 -- 172.21.15.84:0/2605098504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80094d0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.680+0000 7fe8fbfff640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc1567b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe8e802b940 tx=0x7fe8e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.681+0000 7fe8f97fa640 1 -- 172.21.15.84:0/2605098504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e803ad30 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.681+0000 7fe8f97fa640 1 -- 172.21.15.84:0/2605098504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e80443f0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.681+0000 7fe8f97fa640 1 -- 172.21.15.84:0/2605098504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80447a0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.681+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8fc1582a0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.681+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8fc158860 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.682+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8fc13e5f0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.683+0000 7fe8f97fa640 1 -- 172.21.15.84:0/2605098504 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8e804d450 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.684+0000 7fe8f97fa640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe8e006f280 0x7fe8e0071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.684+0000 7fe8f97fa640 1 -- 172.21.15.84:0/2605098504 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe8e80abc70 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.684+0000 7fe900f52640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe8e006f280 0x7fe8e0071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:08.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.685+0000 7fe900f52640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe8e006f280 0x7fe8e0071740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0006fd0 tx=0x7fe8f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:08.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.688+0000 7fe8f97fa640 1 -- 172.21.15.84:0/2605098504 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe8fc13e5f0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.878+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8fc13e5f0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.879+0000 7fe8f97fa640 1 -- 172.21.15.84:0/2605098504 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8fc13e5f0 con 0x7fe8fc0ce6f0 2023-12-12T09:23:08.880 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe8e006f280 msgr2=0x7fe8e0071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe8e006f280 0x7fe8e0071740 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0006fd0 tx=0x7fe8f0008040 comp rx=0 tx=0).stop 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 msgr2=0x7fe8fc1567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc1567b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe8e802b940 tx=0x7fe8e80046c0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 shutdown_connections 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe8fc15be60 0x7fe8fc071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe8e006f280 0x7fe8e0071740 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8fc0ce6f0 0x7fe8fc1567b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 --2- 172.21.15.84:0/2605098504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8fc0b40d0 0x7fe8fc13a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:08.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.881+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 >> 172.21.15.84:0/2605098504 conn(0x7fe8fc0b0ac0 msgr2=0x7fe8fc0b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:08.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.882+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 shutdown_connections 2023-12-12T09:23:08.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:08.882+0000 7fe9031b6640 1 -- 172.21.15.84:0/2605098504 wait complete. 2023-12-12T09:23:08.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:23:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.099+0000 7fce9872c640 1 Processor -- start 2023-12-12T09:23:09.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.099+0000 7fce9872c640 1 -- start start 2023-12-12T09:23:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.100+0000 7fce9872c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce90143d20 0x7fce900b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.100+0000 7fce9872c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce900ce550 0x7fce900b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.100+0000 7fce9872c640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce900cea30 con 0x7fce901447f0 2023-12-12T09:23:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.101+0000 7fce9872c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900702b0 con 0x7fce900ce550 2023-12-12T09:23:09.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.101+0000 7fce9872c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce90070590 con 0x7fce90143d20 2023-12-12T09:23:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.101+0000 7fce964c8640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce90143d20 0x7fce900b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.101+0000 7fce95cc7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce900ce550 0x7fce900b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.101+0000 7fce95cc7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce900ce550 0x7fce900b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.84:38076/0 (socket says 172.21.15.84:38076) 2023-12-12T09:23:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.101+0000 7fce95cc7640 1 -- 172.21.15.84:0/1913352783 learned_addr learned my addr 172.21.15.84:0/1913352783 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.102+0000 7fce964c8640 1 -- 172.21.15.84:0/1913352783 >> v2:172.21.15.99:3300/0 conn(0x7fce900ce550 msgr2=0x7fce900b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:09.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.102+0000 7fce964c8640 1 --2- 172.21.15.84:0/1913352783 >> v2:172.21.15.99:3300/0 conn(0x7fce900ce550 0x7fce900b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.102+0000 7fce964c8640 1 -- 172.21.15.84:0/1913352783 >> v1:172.21.15.99:6789/0 conn(0x7fce901447f0 legacy=0x7fce9015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.102+0000 7fce964c8640 1 -- 172.21.15.84:0/1913352783 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90070870 con 0x7fce90143d20 2023-12-12T09:23:09.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.103+0000 7fce964c8640 1 --2- 172.21.15.84:0/1913352783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce90143d20 0x7fce900b40d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0097a0 tx=0x7fce8c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc35228ad8338a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.104+0000 7fce954c6640 1 -- 172.21.15.84:0/1913352783 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c031830 con 0x7fce90143d20 2023-12-12T09:23:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.104+0000 7fce954c6640 1 -- 172.21.15.84:0/1913352783 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c031990 con 0x7fce90143d20 2023-12-12T09:23:09.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.104+0000 7fce954c6640 1 -- 172.21.15.84:0/1913352783 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c031d20 con 0x7fce90143d20 2023-12-12T09:23:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.104+0000 7fce9872c640 1 -- 172.21.15.84:0/1913352783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce90143d20 msgr2=0x7fce900b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.104+0000 7fce9872c640 1 --2- 172.21.15.84:0/1913352783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce90143d20 0x7fce900b40d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0097a0 tx=0x7fce8c02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.104+0000 7fce9872c640 1 -- 172.21.15.84:0/1913352783 shutdown_connections 2023-12-12T09:23:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.105+0000 7fce9872c640 1 --2- 172.21.15.84:0/1913352783 >> v2:172.21.15.99:3300/0 conn(0x7fce900ce550 0x7fce900b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.105+0000 7fce9872c640 1 --2- 172.21.15.84:0/1913352783 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce90143d20 0x7fce900b40d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.105+0000 7fce9872c640 1 -- 172.21.15.84:0/1913352783 >> 172.21.15.84:0/1913352783 conn(0x7fce9006c3d0 msgr2=0x7fce9006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.105+0000 7fce9872c640 1 -- 172.21.15.84:0/1913352783 shutdown_connections 2023-12-12T09:23:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.105+0000 7fce9872c640 1 -- 172.21.15.84:0/1913352783 wait complete. 2023-12-12T09:23:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.106+0000 7fce9872c640 1 Processor -- start 2023-12-12T09:23:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.106+0000 7fce9872c640 1 -- start start 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.107+0000 7fce9872c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce900ce550 0x7fce900b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.107+0000 7fce9872c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce90143d20 0x7fce9015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.107+0000 7fce9872c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce901447f0 0x7fce900c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.107+0000 7fce9872c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b2a70 con 0x7fce900ce550 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.107+0000 7fce9872c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b2d50 con 0x7fce90143d20 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.107+0000 7fce9872c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce900b3030 con 0x7fce901447f0 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce964c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce900ce550 0x7fce900b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce964c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce900ce550 0x7fce900b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35880/0 (socket says 172.21.15.84:35880) 2023-12-12T09:23:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce964c8640 1 -- 172.21.15.84:0/3011388697 learned_addr learned my addr 172.21.15.84:0/3011388697 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce95cc7640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce90143d20 0x7fce9015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce96cc9640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce901447f0 0x7fce900c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce964c8640 1 -- 172.21.15.84:0/3011388697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce901447f0 msgr2=0x7fce900c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce964c8640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce901447f0 0x7fce900c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce964c8640 1 -- 172.21.15.84:0/3011388697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce90143d20 msgr2=0x7fce9015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce964c8640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce90143d20 0x7fce9015a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.108+0000 7fce964c8640 1 -- 172.21.15.84:0/3011388697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c009400 con 0x7fce900ce550 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.109+0000 7fce964c8640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce900ce550 0x7fce900b3b10 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fce8c02bee0 tx=0x7fce8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.109+0000 7fce86ffd640 1 -- 172.21.15.84:0/3011388697 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c03a6f0 con 0x7fce900ce550 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.109+0000 7fce86ffd640 1 -- 172.21.15.84:0/3011388697 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c03a870 con 0x7fce900ce550 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.109+0000 7fce86ffd640 1 -- 172.21.15.84:0/3011388697 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c03ac20 con 0x7fce900ce550 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.109+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce900b3310 con 0x7fce900ce550 2023-12-12T09:23:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.109+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9015abf0 con 0x7fce900ce550 2023-12-12T09:23:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.110+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce900b3830 con 0x7fce900ce550 2023-12-12T09:23:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.111+0000 7fce86ffd640 1 -- 172.21.15.84:0/3011388697 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce8c030380 con 0x7fce900ce550 2023-12-12T09:23:09.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.112+0000 7fce86ffd640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fce7406ae40 0x7fce7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.112+0000 7fce86ffd640 1 -- 172.21.15.84:0/3011388697 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fce8c0ab030 con 0x7fce900ce550 2023-12-12T09:23:09.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.113+0000 7fce95cc7640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fce7406ae40 0x7fce7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.113+0000 7fce95cc7640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fce7406ae40 0x7fce7406d300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fce9015b200 tx=0x7fce80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.117+0000 7fce86ffd640 1 -- 172.21.15.84:0/3011388697 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce900b3830 con 0x7fce900ce550 2023-12-12T09:23:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.324+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fce900673c0 con 0x7fce900ce550 2023-12-12T09:23:09.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.324+0000 7fce86ffd640 1 -- 172.21.15.84:0/3011388697 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7fce8c076030 con 0x7fce900ce550 2023-12-12T09:23:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fce7406ae40 msgr2=0x7fce7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fce7406ae40 0x7fce7406d300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fce9015b200 tx=0x7fce80008040 comp rx=0 tx=0).stop 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce900ce550 msgr2=0x7fce900b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce900ce550 0x7fce900b3b10 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fce8c02bee0 tx=0x7fce8c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 shutdown_connections 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fce901447f0 0x7fce900c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce90143d20 0x7fce9015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fce7406ae40 0x7fce7406d300 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 --2- 172.21.15.84:0/3011388697 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce900ce550 0x7fce900b3b10 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 >> 172.21.15.84:0/3011388697 conn(0x7fce9006c3d0 msgr2=0x7fce9015c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 shutdown_connections 2023-12-12T09:23:09.329 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.327+0000 7fce9872c640 1 -- 172.21.15.84:0/3011388697 wait complete. 2023-12-12T09:23:09.346 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:23:09.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:09.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:09.433 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[110409]: fuse finished with error 0 and tester_r 0 2023-12-12T09:23:09.437 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:23:09.494 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:23:09.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:09.494 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:23:09.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:23:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.755+0000 7f07c4cad640 1 Processor -- start 2023-12-12T09:23:09.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.755+0000 7f07c4cad640 1 -- start start 2023-12-12T09:23:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.757+0000 7f07c4cad640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07c0071bb0 0x7f07c0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.757+0000 7f07c4cad640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f07c013dae0 0x7f07c013f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.757+0000 7f07c4cad640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c00724d0 con 0x7f07c00ce330 2023-12-12T09:23:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.757+0000 7f07c4cad640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c0140270 con 0x7f07c013dae0 2023-12-12T09:23:09.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.757+0000 7f07c4cad640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00cd850 con 0x7f07c0071bb0 2023-12-12T09:23:09.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.757+0000 7f07bdd9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f07c00ce330 0x7f07c013d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50398/0 (socket says 172.21.15.84:50398) 2023-12-12T09:23:09.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.757+0000 7f07bdd9b640 1 -- 172.21.15.84:0/2007009398 learned_addr learned my addr 172.21.15.84:0/2007009398 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07be59c640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07c0071bb0 0x7f07c0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bed9d640 1 --2- 172.21.15.84:0/2007009398 >> v2:172.21.15.99:3300/0 conn(0x7f07c013dae0 0x7f07c013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370192920 0 0) 0x7f07c00724d0 con 0x7f07c00ce330 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a8003520 con 0x7f07c00ce330 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4143793462 0 0) 0x7f07a8003520 con 0x7f07c00ce330 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07c0071bb0 msgr2=0x7f07c0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07c0071bb0 0x7f07c0071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 >> v2:172.21.15.99:3300/0 conn(0x7f07c013dae0 msgr2=0x7f07c013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 --2- 172.21.15.84:0/2007009398 >> v2:172.21.15.99:3300/0 conn(0x7f07c013dae0 0x7f07c013f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00cdb30 con 0x7f07c00ce330 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f07b4001670 con 0x7f07c00ce330 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 >> v1:172.21.15.84:6789/0 conn(0x7f07c00ce330 legacy=0x7f07c013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07c0071bb0 0x7f07a8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07a8003ef0 0x7f07a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a8004d00 0x7f07a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0140270 con 0x7f07a8004d00 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00cd850 con 0x7f07a8003ef0 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.758+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a800b980 con 0x7f07c0071bb0 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.759+0000 7f07bed9d640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a8004d00 0x7f07a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.759+0000 7f07be59c640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07c0071bb0 0x7f07a8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.759+0000 7f07bed9d640 1 -- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07c0071bb0 msgr2=0x7f07a8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.759+0000 7f07bed9d640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07c0071bb0 0x7f07a8003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.759+0000 7f07bdd9b640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07a8003ef0 0x7f07a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.759+0000 7f07bed9d640 1 -- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07a8003ef0 msgr2=0x7f07a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.759+0000 7f07bed9d640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07a8003ef0 0x7f07a80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.759+0000 7f07bed9d640 1 -- 172.21.15.84:0/2007009398 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8003520 con 0x7f07a8004d00 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.760+0000 7f07bed9d640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a8004d00 0x7f07a8005180 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f07c00701c0 tx=0x7f07a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7788a8997bf2138 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.760+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b802cbc0 con 0x7f07a8004d00 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.760+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b800f040 con 0x7f07a8004d00 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.760+0000 7f07bd59a640 1 -- 172.21.15.84:0/2007009398 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8034440 con 0x7f07a8004d00 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.761+0000 7f07c4cad640 1 -- 172.21.15.84:0/2007009398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a8004d00 msgr2=0x7f07a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.761+0000 7f07c4cad640 1 --2- 172.21.15.84:0/2007009398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a8004d00 0x7f07a8005180 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f07c00701c0 tx=0x7f07a80057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.761+0000 7f07bed9d640 1 -- 172.21.15.84:0/2007009398 reap_dead start 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.761+0000 7f07c4cad640 1 -- 172.21.15.84:0/2007009398 shutdown_connections 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.761+0000 7f07c4cad640 1 -- 172.21.15.84:0/2007009398 >> 172.21.15.84:0/2007009398 conn(0x7f07c006c3d0 msgr2=0x7f07c006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.761+0000 7f07c4cad640 1 -- 172.21.15.84:0/2007009398 shutdown_connections 2023-12-12T09:23:09.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.761+0000 7f07c4cad640 1 -- 172.21.15.84:0/2007009398 wait complete. 2023-12-12T09:23:09.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.763+0000 7f07c4cad640 1 Processor -- start 2023-12-12T09:23:09.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.763+0000 7f07c4cad640 1 -- start start 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07c4cad640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07a8004d00 0x7f07c0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07c4cad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07c0070aa0 0x7f07c0070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07c4cad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07c01f09b0 0x7f07c01f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07c4cad640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c01f22e0 con 0x7f07c01f09b0 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07c4cad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c013b910 con 0x7f07c0070aa0 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07c4cad640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0071460 con 0x7f07a8004d00 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07bed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07c01f09b0 0x7f07c01f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07bed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07c01f09b0 0x7f07c01f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35894/0 (socket says 172.21.15.84:35894) 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.764+0000 7f07bed9d640 1 -- 172.21.15.84:0/672246202 learned_addr learned my addr 172.21.15.84:0/672246202 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:09.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07be59c640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07a8004d00 0x7f07c0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07bed9d640 1 -- 172.21.15.84:0/672246202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07a8004d00 msgr2=0x7f07c0153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07bed9d640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07a8004d00 0x7f07c0153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07bed9d640 1 -- 172.21.15.84:0/672246202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07c0070aa0 msgr2=0x7f07c0070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:09.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07bed9d640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07c0070aa0 0x7f07c0070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:09.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07bed9d640 1 -- 172.21.15.84:0/672246202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c01f13a0 con 0x7f07c01f09b0 2023-12-12T09:23:09.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07bed9d640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07c01f09b0 0x7f07c01f0e60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f07b8002230 tx=0x7f07b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:09.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07aeffd640 1 -- 172.21.15.84:0/672246202 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8034bc0 con 0x7f07c01f09b0 2023-12-12T09:23:09.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.765+0000 7f07aeffd640 1 -- 172.21.15.84:0/672246202 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8034d40 con 0x7f07c01f09b0 2023-12-12T09:23:09.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.766+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c01f1660 con 0x7f07c01f09b0 2023-12-12T09:23:09.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.766+0000 7f07aeffd640 1 -- 172.21.15.84:0/672246202 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b803e680 con 0x7f07c01f09b0 2023-12-12T09:23:09.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.766+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c01f1c20 con 0x7f07c01f09b0 2023-12-12T09:23:09.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.767+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c00673c0 con 0x7f07c01f09b0 2023-12-12T09:23:09.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.768+0000 7f07aeffd640 1 -- 172.21.15.84:0/672246202 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07b803e7e0 con 0x7f07c01f09b0 2023-12-12T09:23:09.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.769+0000 7f07aeffd640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f07a006ae70 0x7f07a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:09.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.770+0000 7f07aeffd640 1 -- 172.21.15.84:0/672246202 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f07b80aba80 con 0x7f07c01f09b0 2023-12-12T09:23:09.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.770+0000 7f07be59c640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f07a006ae70 0x7f07a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:09.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.770+0000 7f07be59c640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f07a006ae70 0x7f07a006d330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009910 tx=0x7f07b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:09.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:09.775+0000 7f07aeffd640 1 -- 172.21.15.84:0/672246202 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07b80769e0 con 0x7f07c01f09b0 2023-12-12T09:23:10.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.008+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f07c00ae710 con 0x7f07c01f09b0 2023-12-12T09:23:10.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.009+0000 7f07aeffd640 1 -- 172.21.15.84:0/672246202 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f07b8042070 con 0x7f07c01f09b0 2023-12-12T09:23:10.010 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:23:10.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f07a006ae70 msgr2=0x7f07a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:10.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f07a006ae70 0x7f07a006d330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f07b0009910 tx=0x7f07b0008040 comp rx=0 tx=0).stop 2023-12-12T09:23:10.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07c01f09b0 msgr2=0x7f07c01f0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:10.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07c01f09b0 0x7f07c01f0e60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f07b8002230 tx=0x7f07b8009750 comp rx=0 tx=0).stop 2023-12-12T09:23:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 shutdown_connections 2023-12-12T09:23:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f07a006ae70 0x7f07a006d330 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07c01f09b0 0x7f07c01f0e60 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07c0070aa0 0x7f07c0070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 --2- 172.21.15.84:0/672246202 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f07a8004d00 0x7f07c0153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 >> 172.21.15.84:0/672246202 conn(0x7f07c006c3d0 msgr2=0x7f07c013f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 shutdown_connections 2023-12-12T09:23:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:10.012+0000 7f07c4cad640 1 -- 172.21.15.84:0/672246202 wait complete. 2023-12-12T09:23:10.030 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:23:10.030 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:23:10.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:23:10.031 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:23:10.031 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:10.031 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:23:10.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:23:10.031 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:23:10.031 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:10.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:10.031 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:23:10.078 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42014sec preferred_lft 42014sec 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:23:10.079 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c8b:52ff:fef6:cd60/64 scope link 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c2:ab:b4:6c:14:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c0ab:b4ff:fe6c:1499/64 scope link 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3c57:6bff:fed3:b000/64 scope link 2023-12-12T09:23:10.080 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:10.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:10.081 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:23:10.217 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:23:10.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:10.221 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:23:10.275 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:23:10.275 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:23:10.275 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:23:10.275 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:23:10.275 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:23:10.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:10.275 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:23:10.275 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:23:10.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:23:10.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:23:10.276 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:23:10.276 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:23:10.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:10.456 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:23:10.507 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:23:10.507 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T09:23:10.508 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:10.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:10.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-12-12T09:23:10.603 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T09:23:10.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:23:10.603 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:10.659 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:10.659 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:23:10.659 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:10.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:23:10.807 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:23:10.863 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:23:10.864 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:10.865 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:10.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:10.866 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:23:10.917 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:23:10.918 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T09:23:10.923 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:23:10.999 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:23:11.042 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:23:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:11.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:11.046 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:23:11.101 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-12-12T09:23:11.100+0000 7efd4bd41480 -1 init, newargv = 0x561521934b90 newargc=15 2023-12-12T09:23:11.102 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[111372]: starting ceph client 2023-12-12T09:23:11.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[111372]: starting fuse 2023-12-12T09:23:11.132 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:23:11.132 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-12T09:23:11.132 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:23:11.132 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:23:11.132 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:23:11.132 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:23:11.132 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:23:11.132 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:11.132 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:23:11.133 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:23:11.134 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:23:11.134 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:11.134 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-12-12T09:23:11.134 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:23:11.340 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.111372.asok 2023-12-12T09:23:11.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:23:11.357 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.111372.asok 2023-12-12T09:23:11.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:11.357 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.111372.asok status 2023-12-12T09:23:11.600 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:23:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:23:11.600 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "111372", 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6492, 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 6492 2023-12-12T09:23:11.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1043268287 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1043268287 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.6492 192.168.0.1:0/1043268287", 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/1043268287", 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:23:11.602 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 27, 2023-12-12T09:23:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 58, 2023-12-12T09:23:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:23:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:23:11.603 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:23:11.603 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:11.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:11.616 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:23:11.616 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:11.669 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:23:11.669 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:11.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:11.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:11.767 DEBUG:teuthology.orchestra.run.smithi084:> stdin-killer -- python3 -c ' 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> import errno 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> try: 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> if False: 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> ret = os.read(fd, 1024) 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> else: 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> os.write(fd, b'"'"'content'"'"') 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> except OSError as e: 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> if e.errno != errno.EPERM: 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> raise 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> else: 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("client does not check permission of data pool") 2023-12-12T09:23:11.768 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:23:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:23:11.927 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2023-12-12T09:23:12.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.193+0000 7f28a6b89640 1 Processor -- start 2023-12-12T09:23:12.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.193+0000 7f28a6b89640 1 -- start start 2023-12-12T09:23:12.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.194+0000 7f28a6b89640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f28a00cdd00 0x7f28a00cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.194+0000 7f28a6b89640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00b6b10 0x7f28a00b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.194+0000 7f28a6b89640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00b6680 con 0x7f28a015d8a0 2023-12-12T09:23:12.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.195+0000 7f28a6b89640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00cf310 con 0x7f28a00cdd00 2023-12-12T09:23:12.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.195+0000 7f28a6b89640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00ce190 con 0x7f28a00b6b10 2023-12-12T09:23:12.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.195+0000 7f28a4925640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f28a015d8a0 0x7f28a00cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50404/0 (socket says 172.21.15.84:50404) 2023-12-12T09:23:12.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.195+0000 7f28a4925640 1 -- 172.21.15.84:0/1763824965 learned_addr learned my addr 172.21.15.84:0/1763824965 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:12.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.195+0000 7f289ffff640 1 --2- 172.21.15.84:0/1763824965 >> v2:172.21.15.84:3300/0 conn(0x7f28a00cdd00 0x7f28a00cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:12.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.195+0000 7f289f7fe640 1 -- 172.21.15.84:0/1763824965 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751762113 0 0) 0x7f28a00b6680 con 0x7f28a015d8a0 2023-12-12T09:23:12.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.195+0000 7f289f7fe640 1 -- 172.21.15.84:0/1763824965 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2888003520 con 0x7f28a015d8a0 2023-12-12T09:23:12.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.195+0000 7f28a5126640 1 --2- 172.21.15.84:0/1763824965 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00b6b10 0x7f28a00b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:12.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.196+0000 7f289ffff640 1 -- 172.21.15.84:0/1763824965 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00b6b10 msgr2=0x7f28a00b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:12.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.196+0000 7f289ffff640 1 --2- 172.21.15.84:0/1763824965 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00b6b10 0x7f28a00b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.196+0000 7f289ffff640 1 -- 172.21.15.84:0/1763824965 >> v1:172.21.15.84:6789/0 conn(0x7f28a015d8a0 legacy=0x7f28a00cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.196+0000 7f289ffff640 1 -- 172.21.15.84:0/1763824965 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00cf030 con 0x7f28a00cdd00 2023-12-12T09:23:12.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.197+0000 7f289ffff640 1 --2- 172.21.15.84:0/1763824965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00cdd00 0x7f28a00cfd80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f28900097a0 tx=0x7f289002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d8fbe6c3a06f46 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:12.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.197+0000 7f289f7fe640 1 -- 172.21.15.84:0/1763824965 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289002f050 con 0x7f28a00cdd00 2023-12-12T09:23:12.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.197+0000 7f289f7fe640 1 -- 172.21.15.84:0/1763824965 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890031700 con 0x7f28a00cdd00 2023-12-12T09:23:12.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.197+0000 7f289f7fe640 1 -- 172.21.15.84:0/1763824965 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890031a90 con 0x7f28a00cdd00 2023-12-12T09:23:12.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.198+0000 7f28a6b89640 1 -- 172.21.15.84:0/1763824965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00cdd00 msgr2=0x7f28a00cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.198+0000 7f28a6b89640 1 --2- 172.21.15.84:0/1763824965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00cdd00 0x7f28a00cfd80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f28900097a0 tx=0x7f289002b7a0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.198+0000 7f28a6b89640 1 -- 172.21.15.84:0/1763824965 shutdown_connections 2023-12-12T09:23:12.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.198+0000 7f28a6b89640 1 --2- 172.21.15.84:0/1763824965 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00b6b10 0x7f28a00b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.198+0000 7f28a6b89640 1 --2- 172.21.15.84:0/1763824965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00cdd00 0x7f28a00cfd80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.198+0000 7f28a6b89640 1 -- 172.21.15.84:0/1763824965 >> 172.21.15.84:0/1763824965 conn(0x7f28a00d3040 msgr2=0x7f28a00d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:12.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.198+0000 7f28a6b89640 1 -- 172.21.15.84:0/1763824965 shutdown_connections 2023-12-12T09:23:12.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.198+0000 7f28a6b89640 1 -- 172.21.15.84:0/1763824965 wait complete. 2023-12-12T09:23:12.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.200+0000 7f28a6b89640 1 Processor -- start 2023-12-12T09:23:12.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.200+0000 7f28a6b89640 1 -- start start 2023-12-12T09:23:12.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a6b89640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00b6b10 0x7f28a01f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a6b89640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00cdd00 0x7f28a00cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a6b89640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28a015d8a0 0x7f28a00b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a6b89640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b3020 con 0x7f28a00b6b10 2023-12-12T09:23:12.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a6b89640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b32c0 con 0x7f28a015d8a0 2023-12-12T09:23:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a6b89640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b35a0 con 0x7f28a00cdd00 2023-12-12T09:23:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a4925640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00b6b10 0x7f28a01f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a4925640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00b6b10 0x7f28a01f2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35918/0 (socket says 172.21.15.84:35918) 2023-12-12T09:23:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a4925640 1 -- 172.21.15.84:0/3619005918 learned_addr learned my addr 172.21.15.84:0/3619005918 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:12.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f289ffff640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00cdd00 0x7f28a00cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:12.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a4925640 1 -- 172.21.15.84:0/3619005918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00cdd00 msgr2=0x7f28a00cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a4925640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00cdd00 0x7f28a00cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a4925640 1 -- 172.21.15.84:0/3619005918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28a015d8a0 msgr2=0x7f28a00b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a4925640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28a015d8a0 0x7f28a00b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.202+0000 7f28a4925640 1 -- 172.21.15.84:0/3619005918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890009400 con 0x7f28a00b6b10 2023-12-12T09:23:12.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.203+0000 7f28a4925640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00b6b10 0x7f28a01f2320 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f289400c500 tx=0x7f289400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:12.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.203+0000 7f289d7fa640 1 -- 172.21.15.84:0/3619005918 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894005ce0 con 0x7f28a00b6b10 2023-12-12T09:23:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.203+0000 7f289d7fa640 1 -- 172.21.15.84:0/3619005918 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2894005e40 con 0x7f28a00b6b10 2023-12-12T09:23:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.203+0000 7f289d7fa640 1 -- 172.21.15.84:0/3619005918 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894007330 con 0x7f28a00b6b10 2023-12-12T09:23:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.203+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a00b3880 con 0x7f28a00b6b10 2023-12-12T09:23:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.203+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a00afdb0 con 0x7f28a00b6b10 2023-12-12T09:23:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.204+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a00affa0 con 0x7f28a00b6b10 2023-12-12T09:23:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.205+0000 7f289d7fa640 1 -- 172.21.15.84:0/3619005918 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2894007550 con 0x7f28a00b6b10 2023-12-12T09:23:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.206+0000 7f289d7fa640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f288c06ae40 0x7f288c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.206+0000 7f289d7fa640 1 -- 172.21.15.84:0/3619005918 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2894088d60 con 0x7f28a00b6b10 2023-12-12T09:23:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.206+0000 7f289ffff640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f288c06ae40 0x7f288c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.207+0000 7f289ffff640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f288c06ae40 0x7f288c06d300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2890035000 tx=0x7f2890008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:12.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.211+0000 7f289d7fa640 1 -- 172.21.15.84:0/3619005918 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2894053e20 con 0x7f28a00b6b10 2023-12-12T09:23:12.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.471+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7f28a0072eb0 con 0x7f28a00b6b10 2023-12-12T09:23:12.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.475+0000 7f289d7fa640 1 -- 172.21.15.84:0/3619005918 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 183+0+140 (secure 0 0 0) 0x7f2894017020 con 0x7f28a00b6b10 2023-12-12T09:23:12.477 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:23:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:23:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-12-12T09:23:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-12-12T09:23:12.477 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow w pool=cephfs_data" 2023-12-12T09:23:12.477 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f288c06ae40 msgr2=0x7f288c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f288c06ae40 0x7f288c06d300 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2890035000 tx=0x7f2890008030 comp rx=0 tx=0).stop 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00b6b10 msgr2=0x7f28a01f2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00b6b10 0x7f28a01f2320 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f289400c500 tx=0x7f289400c9c0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 shutdown_connections 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28a015d8a0 0x7f28a00b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f28a00cdd00 0x7f28a00cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f288c06ae40 0x7f288c06d300 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 --2- 172.21.15.84:0/3619005918 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28a00b6b10 0x7f28a01f2320 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 >> 172.21.15.84:0/3619005918 conn(0x7f28a00d3040 msgr2=0x7f28a00b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 shutdown_connections 2023-12-12T09:23:12.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.478+0000 7f28a6b89640 1 -- 172.21.15.84:0/3619005918 wait complete. 2023-12-12T09:23:12.498 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:23:12.498 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:12.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:12.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.803+0000 7f54b9d16640 1 Processor -- start 2023-12-12T09:23:12.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.804+0000 7f54b9d16640 1 -- start start 2023-12-12T09:23:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.805+0000 7f54b9d16640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f54b4143d20 0x7f54b40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.805+0000 7f54b9d16640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b415f910 con 0x7f54b40ce550 2023-12-12T09:23:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.805+0000 7f54b9d16640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40cea30 con 0x7f54b41447f0 2023-12-12T09:23:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.805+0000 7f54b9d16640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b40702b0 con 0x7f54b4143d20 2023-12-12T09:23:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.805+0000 7f54b37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f54b4143d20 0x7f54b40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.805+0000 7f54abfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f54b40ce550 0x7f54b415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50418/0 (socket says 172.21.15.84:50418) 2023-12-12T09:23:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.806+0000 7f54abfff640 1 -- 172.21.15.84:0/2471357325 learned_addr learned my addr 172.21.15.84:0/2471357325 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:12.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.806+0000 7f54b37fe640 1 -- 172.21.15.84:0/2471357325 >> v1:172.21.15.99:6789/0 conn(0x7f54b41447f0 legacy=0x7f54b415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.806+0000 7f54b37fe640 1 -- 172.21.15.84:0/2471357325 >> v1:172.21.15.84:6789/0 conn(0x7f54b40ce550 legacy=0x7f54b415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.806+0000 7f54b37fe640 1 -- 172.21.15.84:0/2471357325 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4070590 con 0x7f54b4143d20 2023-12-12T09:23:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.807+0000 7f54b37fe640 1 --2- 172.21.15.84:0/2471357325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b40b40d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f54a40097a0 tx=0x7f54a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ddcd325021a78 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:12.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.807+0000 7f54b2ffd640 1 -- 172.21.15.84:0/2471357325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4031830 con 0x7f54b4143d20 2023-12-12T09:23:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.807+0000 7f54b2ffd640 1 -- 172.21.15.84:0/2471357325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a4031990 con 0x7f54b4143d20 2023-12-12T09:23:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.807+0000 7f54b2ffd640 1 -- 172.21.15.84:0/2471357325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4031d20 con 0x7f54b4143d20 2023-12-12T09:23:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.808+0000 7f54b9d16640 1 -- 172.21.15.84:0/2471357325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 msgr2=0x7f54b40b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.808+0000 7f54b9d16640 1 --2- 172.21.15.84:0/2471357325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b40b40d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f54a40097a0 tx=0x7f54a402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.808+0000 7f54b9d16640 1 -- 172.21.15.84:0/2471357325 shutdown_connections 2023-12-12T09:23:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.808+0000 7f54b9d16640 1 --2- 172.21.15.84:0/2471357325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b40b40d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.808+0000 7f54b9d16640 1 -- 172.21.15.84:0/2471357325 >> 172.21.15.84:0/2471357325 conn(0x7f54b406c3d0 msgr2=0x7f54b406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.808+0000 7f54b9d16640 1 -- 172.21.15.84:0/2471357325 shutdown_connections 2023-12-12T09:23:12.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.808+0000 7f54b9d16640 1 -- 172.21.15.84:0/2471357325 wait complete. 2023-12-12T09:23:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.810+0000 7f54b9d16640 1 Processor -- start 2023-12-12T09:23:12.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.810+0000 7f54b9d16640 1 -- start start 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54b9d16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54b40ce550 0x7f54b4138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54b9d16640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54b9d16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b41447f0 0x7f54b40ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54b9d16640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4136f30 con 0x7f54b4143d20 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54b9d16640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b4137210 con 0x7f54b41447f0 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54b9d16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b41374f0 con 0x7f54b40ce550 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54abfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54abfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b415a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35934/0 (socket says 172.21.15.84:35934) 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.811+0000 7f54abfff640 1 -- 172.21.15.84:0/1178677501 learned_addr learned my addr 172.21.15.84:0/1178677501 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54abfff640 1 -- 172.21.15.84:0/1178677501 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54b40ce550 msgr2=0x7f54b4138530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54abfff640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54b40ce550 0x7f54b4138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54abfff640 1 -- 172.21.15.84:0/1178677501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b41447f0 msgr2=0x7f54b40ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54abfff640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b41447f0 0x7f54b40ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54abfff640 1 -- 172.21.15.84:0/1178677501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4009400 con 0x7f54b4143d20 2023-12-12T09:23:12.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54abfff640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b415a380 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c4a0 tx=0x7f549c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54b0ff9640 1 -- 172.21.15.84:0/1178677501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c005ce0 con 0x7f54b4143d20 2023-12-12T09:23:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54b0ff9640 1 -- 172.21.15.84:0/1178677501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c005e40 con 0x7f54b4143d20 2023-12-12T09:23:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b41377d0 con 0x7f54b4143d20 2023-12-12T09:23:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54b0ff9640 1 -- 172.21.15.84:0/1178677501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c007270 con 0x7f54b4143d20 2023-12-12T09:23:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.812+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b4138a70 con 0x7f54b4143d20 2023-12-12T09:23:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.813+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4137cf0 con 0x7f54b4143d20 2023-12-12T09:23:12.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.815+0000 7f54b0ff9640 1 -- 172.21.15.84:0/1178677501 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f549c007490 con 0x7f54b4143d20 2023-12-12T09:23:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.815+0000 7f54b0ff9640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f549406ae40 0x7f549406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.816+0000 7f54b0ff9640 1 -- 172.21.15.84:0/1178677501 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f549c088c10 con 0x7f54b4143d20 2023-12-12T09:23:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.816+0000 7f54b37fe640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f549406ae40 0x7f549406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:12.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.816+0000 7f54b37fe640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f549406ae40 0x7f549406d300 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f54a4036000 tx=0x7f54a4030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:12.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:12.822+0000 7f54b0ff9640 1 -- 172.21.15.84:0/1178677501 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54b4137cf0 con 0x7f54b4143d20 2023-12-12T09:23:13.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.018+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54b4137cf0 con 0x7f54b4143d20 2023-12-12T09:23:13.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.020+0000 7f54b0ff9640 1 -- 172.21.15.84:0/1178677501 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7f54b4137cf0 con 0x7f54b4143d20 2023-12-12T09:23:13.021 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:13.022 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:13.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f549406ae40 msgr2=0x7f549406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f549406ae40 0x7f549406d300 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f54a4036000 tx=0x7f54a4030000 comp rx=0 tx=0).stop 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 msgr2=0x7f54b415a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b415a380 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c4a0 tx=0x7f549c00c960 comp rx=0 tx=0).stop 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 shutdown_connections 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b41447f0 0x7f54b40ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f549406ae40 0x7f549406d300 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54b4143d20 0x7f54b415a380 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 --2- 172.21.15.84:0/1178677501 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f54b40ce550 0x7f54b4138530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 >> 172.21.15.84:0/1178677501 conn(0x7f54b406c3d0 msgr2=0x7f54b415df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 shutdown_connections 2023-12-12T09:23:13.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.023+0000 7f54b9d16640 1 -- 172.21.15.84:0/1178677501 wait complete. 2023-12-12T09:23:13.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:22:47.550419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:22:48.743328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:23:13.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:23:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.257+0000 7f00ccba9640 1 Processor -- start 2023-12-12T09:23:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.257+0000 7f00ccba9640 1 -- start start 2023-12-12T09:23:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.258+0000 7f00ccba9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f00c80b40d0 0x7f00c806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.259+0000 7f00ccba9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c80ceb80 con 0x7f00c80ce6f0 2023-12-12T09:23:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.259+0000 7f00ccba9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c80ce260 con 0x7f00c815be60 2023-12-12T09:23:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.259+0000 7f00ccba9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c80cd930 con 0x7f00c80b40d0 2023-12-12T09:23:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.259+0000 7f00c5d9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f00c80ce6f0 0x7f00c80b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50428/0 (socket says 172.21.15.84:50428) 2023-12-12T09:23:13.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.259+0000 7f00c5d9b640 1 -- 172.21.15.84:0/2685023226 learned_addr learned my addr 172.21.15.84:0/2685023226 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.259+0000 7f00c659c640 1 --2- 172.21.15.84:0/2685023226 >> v2:172.21.15.99:3300/0 conn(0x7f00c80b40d0 0x7f00c806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.259+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809762523 0 0) 0x7f00c80ceb80 con 0x7f00c80ce6f0 2023-12-12T09:23:13.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.259+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b4003520 con 0x7f00c80ce6f0 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155180043 0 0) 0x7f00b4003520 con 0x7f00c80ce6f0 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 >> v2:172.21.15.99:3300/0 conn(0x7f00c80b40d0 msgr2=0x7f00c806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 --2- 172.21.15.84:0/2685023226 >> v2:172.21.15.99:3300/0 conn(0x7f00c80b40d0 0x7f00c806dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 >> v1:172.21.15.99:6789/0 conn(0x7f00c815be60 legacy=0x7f00c813e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80cdc10 con 0x7f00c80ce6f0 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f00b0001670 con 0x7f00c80ce6f0 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 >> v1:172.21.15.84:6789/0 conn(0x7f00c80ce6f0 legacy=0x7f00c80b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b40039c0 0x7f00b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00b40047c0 0x7f00b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40051d0 0x7f00b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80cd930 con 0x7f00b40039c0 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b400c100 con 0x7f00b40051d0 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b400c2c0 con 0x7f00b40047c0 2023-12-12T09:23:13.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.260+0000 7f00c659c640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b40039c0 0x7f00b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.261+0000 7f00c659c640 1 -- 172.21.15.84:0/2685023226 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00b40047c0 msgr2=0x7f00b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.261+0000 7f00c659c640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00b40047c0 0x7f00b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.261+0000 7f00c6d9d640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40051d0 0x7f00b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.261+0000 7f00c659c640 1 -- 172.21.15.84:0/2685023226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40051d0 msgr2=0x7f00b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.261+0000 7f00c659c640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40051d0 0x7f00b400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.261+0000 7f00c659c640 1 -- 172.21.15.84:0/2685023226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4003520 con 0x7f00b40039c0 2023-12-12T09:23:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.261+0000 7f00c6d9d640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40051d0 0x7f00b400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:13.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.261+0000 7f00c6d9d640 1 -- 172.21.15.84:0/2685023226 reap_dead start 2023-12-12T09:23:13.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.262+0000 7f00c659c640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b40039c0 0x7f00b4003dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f00b8007330 tx=0x7f00b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8de0503acfee7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:13.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.262+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b802cca0 con 0x7f00b40039c0 2023-12-12T09:23:13.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.262+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b802ce00 con 0x7f00b40039c0 2023-12-12T09:23:13.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.262+0000 7f00c559a640 1 -- 172.21.15.84:0/2685023226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8034660 con 0x7f00b40039c0 2023-12-12T09:23:13.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.263+0000 7f00ccba9640 1 -- 172.21.15.84:0/2685023226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b40039c0 msgr2=0x7f00b4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.263+0000 7f00ccba9640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b40039c0 0x7f00b4003dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f00b8007330 tx=0x7f00b40057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.263+0000 7f00ccba9640 1 -- 172.21.15.84:0/2685023226 shutdown_connections 2023-12-12T09:23:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.263+0000 7f00ccba9640 1 --2- 172.21.15.84:0/2685023226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00b40039c0 0x7f00b4003dc0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.263+0000 7f00ccba9640 1 -- 172.21.15.84:0/2685023226 >> 172.21.15.84:0/2685023226 conn(0x7f00c80b0ac0 msgr2=0x7f00c80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.263+0000 7f00ccba9640 1 -- 172.21.15.84:0/2685023226 shutdown_connections 2023-12-12T09:23:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.263+0000 7f00ccba9640 1 -- 172.21.15.84:0/2685023226 wait complete. 2023-12-12T09:23:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.265+0000 7f00ccba9640 1 Processor -- start 2023-12-12T09:23:13.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.265+0000 7f00ccba9640 1 -- start start 2023-12-12T09:23:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00ccba9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40039c0 0x7f00c815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00ccba9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c80b2a40 0x7f00c81f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00ccba9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00c80b2ec0 0x7f00c81f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00ccba9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80b0590 con 0x7f00c80b2a40 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00ccba9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80af960 con 0x7f00b40039c0 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00ccba9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80af680 con 0x7f00c80b2ec0 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00c5d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c80b2a40 0x7f00c81f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00c5d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c80b2a40 0x7f00c81f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35952/0 (socket says 172.21.15.84:35952) 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.266+0000 7f00c5d9b640 1 -- 172.21.15.84:0/487101465 learned_addr learned my addr 172.21.15.84:0/487101465 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c659c640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40039c0 0x7f00c815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c6d9d640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00c80b2ec0 0x7f00c81f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c5d9b640 1 -- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00c80b2ec0 msgr2=0x7f00c81f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c5d9b640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00c80b2ec0 0x7f00c81f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c5d9b640 1 -- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40039c0 msgr2=0x7f00c815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c5d9b640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40039c0 0x7f00c815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c5d9b640 1 -- 172.21.15.84:0/487101465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80b1f60 con 0x7f00c80b2a40 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c659c640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40039c0 0x7f00c815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00c5d9b640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c80b2a40 0x7f00c81f3cc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c7a0 tx=0x7f00b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00beffd640 1 -- 172.21.15.84:0/487101465 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b00074e0 con 0x7f00c80b2a40 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00beffd640 1 -- 172.21.15.84:0/487101465 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b0007640 con 0x7f00c80b2a40 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c80b2240 con 0x7f00c80b2a40 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.267+0000 7f00beffd640 1 -- 172.21.15.84:0/487101465 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0004a20 con 0x7f00c80b2a40 2023-12-12T09:23:13.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.268+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c815a960 con 0x7f00c80b2a40 2023-12-12T09:23:13.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.269+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c80b2760 con 0x7f00c80b2a40 2023-12-12T09:23:13.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.269+0000 7f00beffd640 1 -- 172.21.15.84:0/487101465 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00b0004b80 con 0x7f00c80b2a40 2023-12-12T09:23:13.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.270+0000 7f00beffd640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00a806ae70 0x7f00a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.270+0000 7f00beffd640 1 -- 172.21.15.84:0/487101465 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f00b0088f40 con 0x7f00c80b2a40 2023-12-12T09:23:13.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.271+0000 7f00c659c640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00a806ae70 0x7f00a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.271+0000 7f00c659c640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00a806ae70 0x7f00a806d330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f00b8036000 tx=0x7f00b8030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:13.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.275+0000 7f00beffd640 1 -- 172.21.15.84:0/487101465 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00c80b2760 con 0x7f00c80b2a40 2023-12-12T09:23:13.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.467+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00c80673c0 con 0x7f00c80b2a40 2023-12-12T09:23:13.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.468+0000 7f00beffd640 1 -- 172.21.15.84:0/487101465 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00b0018020 con 0x7f00c80b2a40 2023-12-12T09:23:13.469 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00a806ae70 msgr2=0x7f00a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00a806ae70 0x7f00a806d330 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f00b8036000 tx=0x7f00b8030000 comp rx=0 tx=0).stop 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c80b2a40 msgr2=0x7f00c81f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c80b2a40 0x7f00c81f3cc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c7a0 tx=0x7f00b000cc60 comp rx=0 tx=0).stop 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 shutdown_connections 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f00c80b2ec0 0x7f00c81f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00a806ae70 0x7f00a806d330 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00c80b2a40 0x7f00c81f3cc0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 --2- 172.21.15.84:0/487101465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00b40039c0 0x7f00c815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.470+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 >> 172.21.15.84:0/487101465 conn(0x7f00c80b0ac0 msgr2=0x7f00c815d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.471+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 shutdown_connections 2023-12-12T09:23:13.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.471+0000 7f00ccba9640 1 -- 172.21.15.84:0/487101465 wait complete. 2023-12-12T09:23:13.490 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:23:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.708+0000 7fd9869a9640 1 Processor -- start 2023-12-12T09:23:13.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.708+0000 7fd9869a9640 1 -- start start 2023-12-12T09:23:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.709+0000 7fd9869a9640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9800cde40 0x7fd9800ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.709+0000 7fd9869a9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd98015b4f0 0x7fd98015b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.709+0000 7fd9869a9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd980155a70 con 0x7fd980155690 2023-12-12T09:23:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.709+0000 7fd9869a9640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800ce830 con 0x7fd9800cde40 2023-12-12T09:23:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.709+0000 7fd9869a9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98015c120 con 0x7fd98015b4f0 2023-12-12T09:23:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.709+0000 7fd977fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9800cde40 0x7fd9800ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.710+0000 7fd977fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd9800cde40 0x7fd9800ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35954/0 (socket says 172.21.15.84:35954) 2023-12-12T09:23:13.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.710+0000 7fd977fff640 1 -- 172.21.15.84:0/3789047083 learned_addr learned my addr 172.21.15.84:0/3789047083 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.710+0000 7fd984f46640 1 --2- 172.21.15.84:0/3789047083 >> v2:172.21.15.99:3300/0 conn(0x7fd98015b4f0 0x7fd98015b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.710+0000 7fd977fff640 1 -- 172.21.15.84:0/3789047083 >> v2:172.21.15.99:3300/0 conn(0x7fd98015b4f0 msgr2=0x7fd98015b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.710+0000 7fd977fff640 1 --2- 172.21.15.84:0/3789047083 >> v2:172.21.15.99:3300/0 conn(0x7fd98015b4f0 0x7fd98015b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.710+0000 7fd977fff640 1 -- 172.21.15.84:0/3789047083 >> v1:172.21.15.84:6789/0 conn(0x7fd980155690 legacy=0x7fd98006ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.710+0000 7fd977fff640 1 -- 172.21.15.84:0/3789047083 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98015c400 con 0x7fd9800cde40 2023-12-12T09:23:13.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.710+0000 7fd97f7fe640 1 -- 172.21.15.84:0/3789047083 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142887422 0 0) 0x7fd980155a70 con 0x7fd980155690 2023-12-12T09:23:13.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.711+0000 7fd977fff640 1 --2- 172.21.15.84:0/3789047083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9800cde40 0x7fd9800ce2f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd980159110 tx=0x7fd96802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876d4ca993d53bf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:13.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd97f7fe640 1 -- 172.21.15.84:0/3789047083 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968030860 con 0x7fd9800cde40 2023-12-12T09:23:13.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd97f7fe640 1 -- 172.21.15.84:0/3789047083 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680309c0 con 0x7fd9800cde40 2023-12-12T09:23:13.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd97f7fe640 1 -- 172.21.15.84:0/3789047083 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968030d50 con 0x7fd9800cde40 2023-12-12T09:23:13.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd9869a9640 1 -- 172.21.15.84:0/3789047083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9800cde40 msgr2=0x7fd9800ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd9869a9640 1 --2- 172.21.15.84:0/3789047083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9800cde40 0x7fd9800ce2f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd980159110 tx=0x7fd96802b9a0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd9869a9640 1 -- 172.21.15.84:0/3789047083 shutdown_connections 2023-12-12T09:23:13.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd9869a9640 1 --2- 172.21.15.84:0/3789047083 >> v2:172.21.15.99:3300/0 conn(0x7fd98015b4f0 0x7fd98015b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd9869a9640 1 --2- 172.21.15.84:0/3789047083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9800cde40 0x7fd9800ce2f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd9869a9640 1 -- 172.21.15.84:0/3789047083 >> 172.21.15.84:0/3789047083 conn(0x7fd9800b0900 msgr2=0x7fd9800b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:13.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd9869a9640 1 -- 172.21.15.84:0/3789047083 shutdown_connections 2023-12-12T09:23:13.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.712+0000 7fd9869a9640 1 -- 172.21.15.84:0/3789047083 wait complete. 2023-12-12T09:23:13.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.714+0000 7fd9869a9640 1 Processor -- start 2023-12-12T09:23:13.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.714+0000 7fd9869a9640 1 -- start start 2023-12-12T09:23:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.715+0000 7fd9869a9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9800cde40 0x7fd9801466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.715+0000 7fd9869a9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd980155690 0x7fd980157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.715+0000 7fd9869a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98015b4f0 0x7fd980146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.715+0000 7fd9869a9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd980157940 con 0x7fd98015b4f0 2023-12-12T09:23:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.715+0000 7fd9869a9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd980156960 con 0x7fd9800cde40 2023-12-12T09:23:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.715+0000 7fd9869a9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800ad6e0 con 0x7fd980155690 2023-12-12T09:23:13.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98015b4f0 0x7fd980146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98015b4f0 0x7fd980146de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35966/0 (socket says 172.21.15.84:35966) 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 -- 172.21.15.84:0/4069700438 learned_addr learned my addr 172.21.15.84:0/4069700438 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd977fff640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd980155690 0x7fd980157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 -- 172.21.15.84:0/4069700438 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd980155690 msgr2=0x7fd980157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd980155690 0x7fd980157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd97ffff640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9800cde40 0x7fd9801466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 -- 172.21.15.84:0/4069700438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9800cde40 msgr2=0x7fd9801466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9800cde40 0x7fd9801466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 -- 172.21.15.84:0/4069700438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680094d0 con 0x7fd98015b4f0 2023-12-12T09:23:13.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.716+0000 7fd984f46640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98015b4f0 0x7fd980146de0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd978007e60 tx=0x7fd97800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:13.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.717+0000 7fd97d7fa640 1 -- 172.21.15.84:0/4069700438 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978014420 con 0x7fd98015b4f0 2023-12-12T09:23:13.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.717+0000 7fd97d7fa640 1 -- 172.21.15.84:0/4069700438 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9780145a0 con 0x7fd98015b4f0 2023-12-12T09:23:13.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.717+0000 7fd97d7fa640 1 -- 172.21.15.84:0/4069700438 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd978014950 con 0x7fd98015b4f0 2023-12-12T09:23:13.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.717+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9800ad9c0 con 0x7fd98015b4f0 2023-12-12T09:23:13.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.717+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd980156ee0 con 0x7fd98015b4f0 2023-12-12T09:23:13.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.718+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9800673c0 con 0x7fd98015b4f0 2023-12-12T09:23:13.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.719+0000 7fd97d7fa640 1 -- 172.21.15.84:0/4069700438 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd978014ab0 con 0x7fd98015b4f0 2023-12-12T09:23:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.720+0000 7fd97d7fa640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd96006ae40 0x7fd96006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.720+0000 7fd97d7fa640 1 -- 172.21.15.84:0/4069700438 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd97808a010 con 0x7fd98015b4f0 2023-12-12T09:23:13.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.720+0000 7fd97ffff640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd96006ae40 0x7fd96006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:13.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.721+0000 7fd97ffff640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd96006ae40 0x7fd96006d300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd970000f60 tx=0x7fd970009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:13.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.725+0000 7fd97d7fa640 1 -- 172.21.15.84:0/4069700438 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd978055010 con 0x7fd98015b4f0 2023-12-12T09:23:13.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.913+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd980071320 con 0x7fd98015b4f0 2023-12-12T09:23:13.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.914+0000 7fd97d7fa640 1 -- 172.21.15.84:0/4069700438 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd978058630 con 0x7fd98015b4f0 2023-12-12T09:23:13.915 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:23:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.916+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd96006ae40 msgr2=0x7fd96006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.916+0000 7fd9869a9640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd96006ae40 0x7fd96006d300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd970000f60 tx=0x7fd970009040 comp rx=0 tx=0).stop 2023-12-12T09:23:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.916+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98015b4f0 msgr2=0x7fd980146de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.916+0000 7fd9869a9640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98015b4f0 0x7fd980146de0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd978007e60 tx=0x7fd97800e4b0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.916+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 shutdown_connections 2023-12-12T09:23:13.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.917+0000 7fd9869a9640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fd96006ae40 0x7fd96006d300 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.917+0000 7fd9869a9640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd98015b4f0 0x7fd980146de0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.917+0000 7fd9869a9640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fd980155690 0x7fd980157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.917+0000 7fd9869a9640 1 --2- 172.21.15.84:0/4069700438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9800cde40 0x7fd9801466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.917+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 >> 172.21.15.84:0/4069700438 conn(0x7fd9800b0900 msgr2=0x7fd98015ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.917+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 shutdown_connections 2023-12-12T09:23:13.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:13.917+0000 7fd9869a9640 1 -- 172.21.15.84:0/4069700438 wait complete. 2023-12-12T09:23:13.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:23:14.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.151+0000 7f44f3fff640 1 Processor -- start 2023-12-12T09:23:14.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.151+0000 7f44f3fff640 1 -- start start 2023-12-12T09:23:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.153+0000 7f44f3fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f44f40b1a80 0x7f44f415e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.153+0000 7f44f3fff640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f415ddf0 con 0x7f44f4157860 2023-12-12T09:23:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.153+0000 7f44f3fff640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f415acb0 con 0x7f44f40cef30 2023-12-12T09:23:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.153+0000 7f44f3fff640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f415af90 con 0x7f44f40b1a80 2023-12-12T09:23:14.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.153+0000 7f44f2ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f44f4157860 0x7f44f415a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50446/0 (socket says 172.21.15.84:50446) 2023-12-12T09:23:14.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.153+0000 7f44f2ffd640 1 -- 172.21.15.84:0/3800406653 learned_addr learned my addr 172.21.15.84:0/3800406653 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:14.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.153+0000 7f44ebfff640 1 --2- 172.21.15.84:0/3800406653 >> v2:172.21.15.84:3300/0 conn(0x7f44f40b1a80 0x7f44f415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.154+0000 7f44ebfff640 1 -- 172.21.15.84:0/3800406653 >> v1:172.21.15.99:6789/0 conn(0x7f44f40cef30 legacy=0x7f44f406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:14.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.154+0000 7f44ebfff640 1 -- 172.21.15.84:0/3800406653 >> v1:172.21.15.84:6789/0 conn(0x7f44f4157860 legacy=0x7f44f415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.154+0000 7f44ebfff640 1 -- 172.21.15.84:0/3800406653 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f415da80 con 0x7f44f40b1a80 2023-12-12T09:23:14.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.155+0000 7f44ebfff640 1 --2- 172.21.15.84:0/3800406653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40b1a80 0x7f44f415e280 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0097a0 tx=0x7f44dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b71d824708530a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.155+0000 7f44f27fc640 1 -- 172.21.15.84:0/3800406653 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc031830 con 0x7f44f40b1a80 2023-12-12T09:23:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.155+0000 7f44f27fc640 1 -- 172.21.15.84:0/3800406653 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc031990 con 0x7f44f40b1a80 2023-12-12T09:23:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.155+0000 7f44f27fc640 1 -- 172.21.15.84:0/3800406653 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc031d20 con 0x7f44f40b1a80 2023-12-12T09:23:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.156+0000 7f44f3fff640 1 -- 172.21.15.84:0/3800406653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40b1a80 msgr2=0x7f44f415e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.156+0000 7f44f3fff640 1 --2- 172.21.15.84:0/3800406653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40b1a80 0x7f44f415e280 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0097a0 tx=0x7f44dc02b8d0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.156+0000 7f44f3fff640 1 -- 172.21.15.84:0/3800406653 shutdown_connections 2023-12-12T09:23:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.156+0000 7f44f3fff640 1 --2- 172.21.15.84:0/3800406653 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40b1a80 0x7f44f415e280 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.156+0000 7f44f3fff640 1 -- 172.21.15.84:0/3800406653 >> 172.21.15.84:0/3800406653 conn(0x7f44f406a920 msgr2=0x7f44f406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.156+0000 7f44f3fff640 1 -- 172.21.15.84:0/3800406653 shutdown_connections 2023-12-12T09:23:14.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.156+0000 7f44f3fff640 1 -- 172.21.15.84:0/3800406653 wait complete. 2023-12-12T09:23:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.158+0000 7f44f3fff640 1 Processor -- start 2023-12-12T09:23:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.158+0000 7f44f3fff640 1 -- start start 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44f3fff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44f40b1a80 0x7f44f4151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44f3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40cef30 0x7f44f40ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44f3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f4157860 0x7f44f41591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44f3fff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40ad750 con 0x7f44f40cef30 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44f3fff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40ae750 con 0x7f44f4157860 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44f3fff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40ad190 con 0x7f44f40b1a80 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40cef30 0x7f44f40ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40cef30 0x7f44f40ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35992/0 (socket says 172.21.15.84:35992) 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44ebfff640 1 -- 172.21.15.84:0/3199303010 learned_addr learned my addr 172.21.15.84:0/3199303010 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44ebfff640 1 -- 172.21.15.84:0/3199303010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44f40b1a80 msgr2=0x7f44f4151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44ebfff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44f40b1a80 0x7f44f4151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44ebfff640 1 -- 172.21.15.84:0/3199303010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f4157860 msgr2=0x7f44f41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44ebfff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f4157860 0x7f44f41591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.159+0000 7f44ebfff640 1 -- 172.21.15.84:0/3199303010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc009400 con 0x7f44f40cef30 2023-12-12T09:23:14.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.160+0000 7f44ebfff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40cef30 0x7f44f40ac840 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0098c0 tx=0x7f44dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.160+0000 7f44eb7fe640 1 -- 172.21.15.84:0/3199303010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc03bb70 con 0x7f44f40cef30 2023-12-12T09:23:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.160+0000 7f44eb7fe640 1 -- 172.21.15.84:0/3199303010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc03bcf0 con 0x7f44f40cef30 2023-12-12T09:23:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.160+0000 7f44eb7fe640 1 -- 172.21.15.84:0/3199303010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc045630 con 0x7f44f40cef30 2023-12-12T09:23:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.160+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f40ad470 con 0x7f44f40cef30 2023-12-12T09:23:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.160+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f4151ca0 con 0x7f44f40cef30 2023-12-12T09:23:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.161+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f40ae5b0 con 0x7f44f40cef30 2023-12-12T09:23:14.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.162+0000 7f44eb7fe640 1 -- 172.21.15.84:0/3199303010 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44dc045790 con 0x7f44f40cef30 2023-12-12T09:23:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.163+0000 7f44eb7fe640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44d406ae40 0x7f44d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.163+0000 7f44eb7fe640 1 -- 172.21.15.84:0/3199303010 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f44dc0abad0 con 0x7f44f40cef30 2023-12-12T09:23:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.163+0000 7f44f2ffd640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44d406ae40 0x7f44d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.164+0000 7f44f2ffd640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44d406ae40 0x7f44d406d300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f44e4000f60 tx=0x7f44e4007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:14.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.168+0000 7f44eb7fe640 1 -- 172.21.15.84:0/3199303010 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44f40ae5b0 con 0x7f44f40cef30 2023-12-12T09:23:14.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.362+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44f40aec30 con 0x7f44f40cef30 2023-12-12T09:23:14.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.364+0000 7f44eb7fe640 1 -- 172.21.15.84:0/3199303010 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44f40aec30 con 0x7f44f40cef30 2023-12-12T09:23:14.365 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:23:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.366+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44d406ae40 msgr2=0x7f44d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.366+0000 7f44f3fff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44d406ae40 0x7f44d406d300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f44e4000f60 tx=0x7f44e4007a80 comp rx=0 tx=0).stop 2023-12-12T09:23:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.366+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40cef30 msgr2=0x7f44f40ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.366+0000 7f44f3fff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40cef30 0x7f44f40ac840 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0098c0 tx=0x7f44dc0046c0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.366+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 shutdown_connections 2023-12-12T09:23:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.366+0000 7f44f3fff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44f4157860 0x7f44f41591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.367+0000 7f44f3fff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f44d406ae40 0x7f44d406d300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.367+0000 7f44f3fff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44f40cef30 0x7f44f40ac840 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.367+0000 7f44f3fff640 1 --2- 172.21.15.84:0/3199303010 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f44f40b1a80 0x7f44f4151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.367+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 >> 172.21.15.84:0/3199303010 conn(0x7f44f406a920 msgr2=0x7f44f406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.367+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 shutdown_connections 2023-12-12T09:23:14.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.367+0000 7f44f3fff640 1 -- 172.21.15.84:0/3199303010 wait complete. 2023-12-12T09:23:14.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:23:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.584+0000 7f04b6ba5640 1 Processor -- start 2023-12-12T09:23:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.584+0000 7f04b6ba5640 1 -- start start 2023-12-12T09:23:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.585+0000 7f04b6ba5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 0x7f04b00b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.585+0000 7f04b6ba5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00afd40 con 0x7f04b015d490 2023-12-12T09:23:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.585+0000 7f04b6ba5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b00ce860 con 0x7f04b00d16f0 2023-12-12T09:23:14.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.585+0000 7f04b6ba5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00b0090 con 0x7f04b00d1b80 2023-12-12T09:23:14.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.585+0000 7f04b4941640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f04b015d490 0x7f04b00d3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50452/0 (socket says 172.21.15.84:50452) 2023-12-12T09:23:14.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.585+0000 7f04b4941640 1 -- 172.21.15.84:0/2067025356 learned_addr learned my addr 172.21.15.84:0/2067025356 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148368414 0 0) 0x7f04b00afd40 con 0x7f04b015d490 2023-12-12T09:23:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04b5142640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 0x7f04b00b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f049c003520 con 0x7f04b015d490 2023-12-12T09:23:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4033963955 0 0) 0x7f049c003520 con 0x7f04b015d490 2023-12-12T09:23:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 msgr2=0x7f04b00b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 0x7f04b00b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 >> v1:172.21.15.99:6789/0 conn(0x7f04b00d16f0 legacy=0x7f04b00b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00ceb40 con 0x7f04b015d490 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f04a00019f0 con 0x7f04b015d490 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04b5142640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 0x7f04b00b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 >> v1:172.21.15.84:6789/0 conn(0x7f04b015d490 legacy=0x7f04b00d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c0039a0 0x7f049c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 0x7f049c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f049c004d00 0x7f049c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00b0090 con 0x7f049c004d00 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c00bb10 con 0x7f049c0039a0 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c00bcd0 con 0x7f04b00d1b80 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.586+0000 7f04b5142640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f049c004d00 0x7f049c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.587+0000 7f04b5142640 1 -- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 msgr2=0x7f049c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.587+0000 7f04affff640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 0x7f049c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.587+0000 7f04b4941640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c0039a0 0x7f049c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.587+0000 7f04b5142640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b00d1b80 0x7f049c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.587+0000 7f04b5142640 1 -- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c0039a0 msgr2=0x7f049c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.587+0000 7f04b5142640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c0039a0 0x7f049c003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.587+0000 7f04b5142640 1 -- 172.21.15.84:0/2067025356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c003520 con 0x7f049c004d00 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.588+0000 7f04b5142640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f049c004d00 0x7f049c005180 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f04a80098a0 tx=0x7f049c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d51ea3e64a19bd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.588+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8004230 con 0x7f049c004d00 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.588+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a8004390 con 0x7f049c004d00 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.588+0000 7f04af7fe640 1 -- 172.21.15.84:0/2067025356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8003830 con 0x7f049c004d00 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.588+0000 7f04b6ba5640 1 -- 172.21.15.84:0/2067025356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f049c004d00 msgr2=0x7f049c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.588+0000 7f04b6ba5640 1 --2- 172.21.15.84:0/2067025356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f049c004d00 0x7f049c005180 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f04a80098a0 tx=0x7f049c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.589+0000 7f04b5142640 1 -- 172.21.15.84:0/2067025356 reap_dead start 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.589+0000 7f04b6ba5640 1 -- 172.21.15.84:0/2067025356 shutdown_connections 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.589+0000 7f04b6ba5640 1 -- 172.21.15.84:0/2067025356 >> 172.21.15.84:0/2067025356 conn(0x7f04b009c450 msgr2=0x7f04b00d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.589+0000 7f04b6ba5640 1 -- 172.21.15.84:0/2067025356 shutdown_connections 2023-12-12T09:23:14.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.589+0000 7f04b6ba5640 1 -- 172.21.15.84:0/2067025356 wait complete. 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.590+0000 7f04b6ba5640 1 Processor -- start 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.591+0000 7f04b6ba5640 1 -- start start 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.591+0000 7f04b6ba5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c004d00 0x7f04b00ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.591+0000 7f04b6ba5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b015eda0 0x7f04b01590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.591+0000 7f04b6ba5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b015f220 0x7f04b0159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.591+0000 7f04b6ba5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01f64a0 con 0x7f04b015eda0 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.591+0000 7f04b6ba5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01f6780 con 0x7f049c004d00 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.591+0000 7f04b6ba5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b01f6a60 con 0x7f04b015f220 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b015eda0 0x7f04b01590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b015eda0 0x7f04b01590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35998/0 (socket says 172.21.15.84:35998) 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 -- 172.21.15.84:0/3424103866 learned_addr learned my addr 172.21.15.84:0/3424103866 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:14.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 -- 172.21.15.84:0/3424103866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b015f220 msgr2=0x7f04b0159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b015f220 0x7f04b0159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 -- 172.21.15.84:0/3424103866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c004d00 msgr2=0x7f04b00ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04b4941640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c004d00 0x7f04b00ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c004d00 0x7f04b00ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 -- 172.21.15.84:0/3424103866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b01f6d40 con 0x7f04b015eda0 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.592+0000 7f04affff640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b015eda0 0x7f04b01590e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f049800d4f0 tx=0x7f049800d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.593+0000 7f04ad7fa640 1 -- 172.21.15.84:0/3424103866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498005480 con 0x7f04b015eda0 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.593+0000 7f04ad7fa640 1 -- 172.21.15.84:0/3424103866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0498003610 con 0x7f04b015eda0 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.593+0000 7f04ad7fa640 1 -- 172.21.15.84:0/3424103866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498003980 con 0x7f04b015eda0 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.593+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b0159b60 con 0x7f04b015eda0 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.593+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b01f7020 con 0x7f04b015eda0 2023-12-12T09:23:14.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.594+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0072b80 con 0x7f04b015eda0 2023-12-12T09:23:14.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.595+0000 7f04ad7fa640 1 -- 172.21.15.84:0/3424103866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0498003ae0 con 0x7f04b015eda0 2023-12-12T09:23:14.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.595+0000 7f04ad7fa640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f049006ae40 0x7f049006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:14.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.596+0000 7f04ad7fa640 1 -- 172.21.15.84:0/3424103866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f04980895f0 con 0x7f04b015eda0 2023-12-12T09:23:14.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.596+0000 7f04b4941640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f049006ae40 0x7f049006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:14.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.596+0000 7f04b4941640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f049006ae40 0x7f049006d300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f04a0001b20 tx=0x7f04a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:14.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.600+0000 7f04ad7fa640 1 -- 172.21.15.84:0/3424103866 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0498054550 con 0x7f04b015eda0 2023-12-12T09:23:14.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.802+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f04b00673c0 con 0x7f04b015eda0 2023-12-12T09:23:14.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.803+0000 7f04ad7fa640 1 -- 172.21.15.84:0/3424103866 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0498001230 con 0x7f04b015eda0 2023-12-12T09:23:14.804 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:23:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f049006ae40 msgr2=0x7f049006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f049006ae40 0x7f049006d300 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f04a0001b20 tx=0x7f04a0009040 comp rx=0 tx=0).stop 2023-12-12T09:23:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b015eda0 msgr2=0x7f04b01590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b015eda0 0x7f04b01590e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f049800d4f0 tx=0x7f049800d9b0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 shutdown_connections 2023-12-12T09:23:14.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f04b015f220 0x7f04b0159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f049006ae40 0x7f049006d300 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f04b015eda0 0x7f04b01590e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 --2- 172.21.15.84:0/3424103866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f049c004d00 0x7f04b00ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:14.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 >> 172.21.15.84:0/3424103866 conn(0x7f04b009c450 msgr2=0x7f04b00b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:14.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 shutdown_connections 2023-12-12T09:23:14.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:14.805+0000 7f04b6ba5640 1 -- 172.21.15.84:0/3424103866 wait complete. 2023-12-12T09:23:14.825 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:23:14.825 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:14.875 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:15.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.126+0000 7f4ab2af3640 1 Processor -- start 2023-12-12T09:23:15.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.126+0000 7f4ab2af3640 1 -- start start 2023-12-12T09:23:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.127+0000 7f4ab2af3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4aac0ce550 0x7f4aac071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.127+0000 7f4ab2af3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aac0cea30 con 0x7f4aac143d20 2023-12-12T09:23:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.127+0000 7f4ab2af3640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aac0702b0 con 0x7f4aac0b47e0 2023-12-12T09:23:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.127+0000 7f4ab2af3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac070590 con 0x7f4aac0ce550 2023-12-12T09:23:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.128+0000 7f4ab1090640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4aac0ce550 0x7f4aac071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.128+0000 7f4ab1090640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4aac0ce550 0x7f4aac071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36004/0 (socket says 172.21.15.84:36004) 2023-12-12T09:23:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.128+0000 7f4ab088f640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4aac143d20 0x7f4aac0b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50466/0 (socket says 172.21.15.84:50466) 2023-12-12T09:23:15.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.128+0000 7f4ab1090640 1 -- 172.21.15.84:0/381820830 learned_addr learned my addr 172.21.15.84:0/381820830 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:15.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.128+0000 7f4ab1090640 1 -- 172.21.15.84:0/381820830 >> v1:172.21.15.99:6789/0 conn(0x7f4aac0b47e0 legacy=0x7f4aac071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:15.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.128+0000 7f4ab1090640 1 -- 172.21.15.84:0/381820830 >> v1:172.21.15.84:6789/0 conn(0x7f4aac143d20 legacy=0x7f4aac0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.128+0000 7f4ab1090640 1 -- 172.21.15.84:0/381820830 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac070870 con 0x7f4aac0ce550 2023-12-12T09:23:15.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.129+0000 7f4ab1090640 1 --2- 172.21.15.84:0/381820830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0ce550 0x7f4aac071780 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009e50 tx=0x7f4aa402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfacdc6b7ccafe7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:15.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.130+0000 7f4aab7fe640 1 -- 172.21.15.84:0/381820830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa402cb10 con 0x7f4aac0ce550 2023-12-12T09:23:15.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.130+0000 7f4aab7fe640 1 -- 172.21.15.84:0/381820830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa402cc70 con 0x7f4aac0ce550 2023-12-12T09:23:15.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.130+0000 7f4aab7fe640 1 -- 172.21.15.84:0/381820830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40343f0 con 0x7f4aac0ce550 2023-12-12T09:23:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.130+0000 7f4ab2af3640 1 -- 172.21.15.84:0/381820830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0ce550 msgr2=0x7f4aac071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.130+0000 7f4ab2af3640 1 --2- 172.21.15.84:0/381820830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0ce550 0x7f4aac071780 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009e50 tx=0x7f4aa402bf70 comp rx=0 tx=0).stop 2023-12-12T09:23:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.130+0000 7f4ab2af3640 1 -- 172.21.15.84:0/381820830 shutdown_connections 2023-12-12T09:23:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.130+0000 7f4ab2af3640 1 --2- 172.21.15.84:0/381820830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0ce550 0x7f4aac071780 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.130+0000 7f4ab2af3640 1 -- 172.21.15.84:0/381820830 >> 172.21.15.84:0/381820830 conn(0x7f4aac06c3d0 msgr2=0x7f4aac06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.131+0000 7f4ab2af3640 1 -- 172.21.15.84:0/381820830 shutdown_connections 2023-12-12T09:23:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.131+0000 7f4ab2af3640 1 -- 172.21.15.84:0/381820830 wait complete. 2023-12-12T09:23:15.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.132+0000 7f4ab2af3640 1 Processor -- start 2023-12-12T09:23:15.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.132+0000 7f4ab2af3640 1 -- start start 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.133+0000 7f4ab2af3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0b47e0 0x7f4aac1f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.133+0000 7f4ab2af3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aac0ce550 0x7f4aac15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.133+0000 7f4ab2af3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aac143d20 0x7f4aac13c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.133+0000 7f4ab2af3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac15cb40 con 0x7f4aac0b47e0 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.133+0000 7f4ab2af3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac15bec0 con 0x7f4aac0ce550 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.133+0000 7f4ab2af3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac15c1a0 con 0x7f4aac143d20 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0b47e0 0x7f4aac1f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0b47e0 0x7f4aac1f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36014/0 (socket says 172.21.15.84:36014) 2023-12-12T09:23:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 -- 172.21.15.84:0/2690269317 learned_addr learned my addr 172.21.15.84:0/2690269317 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab1090640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aac143d20 0x7f4aac13c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 -- 172.21.15.84:0/2690269317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aac143d20 msgr2=0x7f4aac13c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4aabfff640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aac0ce550 0x7f4aac15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aac143d20 0x7f4aac13c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 -- 172.21.15.84:0/2690269317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aac0ce550 msgr2=0x7f4aac15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aac0ce550 0x7f4aac15b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 -- 172.21.15.84:0/2690269317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4009b30 con 0x7f4aac0b47e0 2023-12-12T09:23:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4ab088f640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0b47e0 0x7f4aac1f5db0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000c3e0 tx=0x7f4aa000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.134+0000 7f4aa97fa640 1 -- 172.21.15.84:0/2690269317 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00074e0 con 0x7f4aac0b47e0 2023-12-12T09:23:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.135+0000 7f4aa97fa640 1 -- 172.21.15.84:0/2690269317 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0007640 con 0x7f4aac0b47e0 2023-12-12T09:23:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.135+0000 7f4aa97fa640 1 -- 172.21.15.84:0/2690269317 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00049e0 con 0x7f4aac0b47e0 2023-12-12T09:23:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.135+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac15c480 con 0x7f4aac0b47e0 2023-12-12T09:23:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.135+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac1f62f0 con 0x7f4aac0b47e0 2023-12-12T09:23:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.136+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac0673c0 con 0x7f4aac0b47e0 2023-12-12T09:23:15.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.137+0000 7f4aa97fa640 1 -- 172.21.15.84:0/2690269317 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4aa0004b40 con 0x7f4aac0b47e0 2023-12-12T09:23:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.138+0000 7f4aa97fa640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4a9006ae70 0x7f4a9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.138+0000 7f4aa97fa640 1 -- 172.21.15.84:0/2690269317 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4aa00891b0 con 0x7f4aac0b47e0 2023-12-12T09:23:15.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.139+0000 7f4aabfff640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4a9006ae70 0x7f4a9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.139+0000 7f4aabfff640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4a9006ae70 0x7f4a9006d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0b4560 tx=0x7f4a98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:15.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.143+0000 7f4aa97fa640 1 -- 172.21.15.84:0/2690269317 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4aa0054080 con 0x7f4aac0b47e0 2023-12-12T09:23:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.340+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4aac06e3b0 con 0x7f4aac0b47e0 2023-12-12T09:23:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.343+0000 7f4aa97fa640 1 -- 172.21.15.84:0/2690269317 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7f4aa00576a0 con 0x7f4aac0b47e0 2023-12-12T09:23:15.344 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:15.344 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:15.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4a9006ae70 msgr2=0x7f4a9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4a9006ae70 0x7f4a9006d330 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0b4560 tx=0x7f4a98009040 comp rx=0 tx=0).stop 2023-12-12T09:23:15.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0b47e0 msgr2=0x7f4aac1f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0b47e0 0x7f4aac1f5db0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4aa000c3e0 tx=0x7f4aa000c8a0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 shutdown_connections 2023-12-12T09:23:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4aac143d20 0x7f4aac13c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4aac0ce550 0x7f4aac15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4a9006ae70 0x7f4a9006d330 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 --2- 172.21.15.84:0/2690269317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4aac0b47e0 0x7f4aac1f5db0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.346+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 >> 172.21.15.84:0/2690269317 conn(0x7f4aac06c3d0 msgr2=0x7f4aac06c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.347+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 shutdown_connections 2023-12-12T09:23:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.347+0000 7f4ab2af3640 1 -- 172.21.15.84:0/2690269317 wait complete. 2023-12-12T09:23:15.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:22:47.550419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:22:48.743328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:23:15.368 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:23:15.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.587+0000 7effbf2d3640 1 Processor -- start 2023-12-12T09:23:15.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.588+0000 7effbf2d3640 1 -- start start 2023-12-12T09:23:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.589+0000 7effbf2d3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7effb806d5e0 0x7effb806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.589+0000 7effbf2d3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb815dc90 con 0x7effb815d810 2023-12-12T09:23:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.589+0000 7effbf2d3640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb815df70 con 0x7effb80b4560 2023-12-12T09:23:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.589+0000 7effbf2d3640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb815e8a0 con 0x7effb806d5e0 2023-12-12T09:23:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.590+0000 7effbd870640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7effb806d5e0 0x7effb806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.590+0000 7effbd870640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7effb806d5e0 0x7effb806da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36030/0 (socket says 172.21.15.84:36030) 2023-12-12T09:23:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.590+0000 7effbd870640 1 -- 172.21.15.84:0/2170009399 learned_addr learned my addr 172.21.15.84:0/2170009399 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.590+0000 7effbc86e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7effb815d810 0x7effb80b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50468/0 (socket says 172.21.15.84:50468) 2023-12-12T09:23:15.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.590+0000 7effbd870640 1 -- 172.21.15.84:0/2170009399 >> v1:172.21.15.99:6789/0 conn(0x7effb80b4560 legacy=0x7effb80b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:15.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.590+0000 7effbd870640 1 -- 172.21.15.84:0/2170009399 >> v1:172.21.15.84:6789/0 conn(0x7effb815d810 legacy=0x7effb80b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.590+0000 7effbd870640 1 -- 172.21.15.84:0/2170009399 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb815e250 con 0x7effb806d5e0 2023-12-12T09:23:15.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.590+0000 7effaffff640 1 -- 172.21.15.84:0/2170009399 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917284686 0 0) 0x7effb815dc90 con 0x7effb815d810 2023-12-12T09:23:15.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.591+0000 7effbd870640 1 --2- 172.21.15.84:0/2170009399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb806d5e0 0x7effb806da30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7effb0009e50 tx=0x7effb002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ee5ef06981125 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:15.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effaffff640 1 -- 172.21.15.84:0/2170009399 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb002ca80 con 0x7effb806d5e0 2023-12-12T09:23:15.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effaffff640 1 -- 172.21.15.84:0/2170009399 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb002cbe0 con 0x7effb806d5e0 2023-12-12T09:23:15.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effaffff640 1 -- 172.21.15.84:0/2170009399 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00343f0 con 0x7effb806d5e0 2023-12-12T09:23:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effbf2d3640 1 -- 172.21.15.84:0/2170009399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb806d5e0 msgr2=0x7effb806da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effbf2d3640 1 --2- 172.21.15.84:0/2170009399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb806d5e0 0x7effb806da30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7effb0009e50 tx=0x7effb002bee0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effbf2d3640 1 -- 172.21.15.84:0/2170009399 shutdown_connections 2023-12-12T09:23:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effbf2d3640 1 --2- 172.21.15.84:0/2170009399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb806d5e0 0x7effb806da30 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effbf2d3640 1 -- 172.21.15.84:0/2170009399 >> 172.21.15.84:0/2170009399 conn(0x7effb80b0ac0 msgr2=0x7effb80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.592+0000 7effbf2d3640 1 -- 172.21.15.84:0/2170009399 shutdown_connections 2023-12-12T09:23:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.593+0000 7effbf2d3640 1 -- 172.21.15.84:0/2170009399 wait complete. 2023-12-12T09:23:15.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.594+0000 7effbf2d3640 1 Processor -- start 2023-12-12T09:23:15.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.594+0000 7effbf2d3640 1 -- start start 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.595+0000 7effbf2d3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb806d5e0 0x7effb8148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.595+0000 7effbf2d3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb80b4560 0x7effb8154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.595+0000 7effbf2d3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7effb815d810 0x7effb8151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.595+0000 7effbf2d3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb8148cd0 con 0x7effb80b4560 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.595+0000 7effbf2d3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb8156800 con 0x7effb806d5e0 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.595+0000 7effbf2d3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb8156ae0 con 0x7effb815d810 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbc86e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb80b4560 0x7effb8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbc86e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb80b4560 0x7effb8154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36044/0 (socket says 172.21.15.84:36044) 2023-12-12T09:23:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbc86e640 1 -- 172.21.15.84:0/1687893957 learned_addr learned my addr 172.21.15.84:0/1687893957 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbd06f640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb806d5e0 0x7effb8148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbd870640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7effb815d810 0x7effb8151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbc86e640 1 -- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7effb815d810 msgr2=0x7effb8151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbc86e640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7effb815d810 0x7effb8151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbc86e640 1 -- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb806d5e0 msgr2=0x7effb8148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbc86e640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb806d5e0 0x7effb8148790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbc86e640 1 -- 172.21.15.84:0/1687893957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009b30 con 0x7effb80b4560 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbd06f640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb806d5e0 0x7effb8148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.596+0000 7effbd870640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7effb815d810 0x7effb8151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.597+0000 7effbc86e640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb80b4560 0x7effb8154670 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7effa800c410 tx=0x7effa800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.597+0000 7effadffb640 1 -- 172.21.15.84:0/1687893957 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa80074e0 con 0x7effb80b4560 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.597+0000 7effadffb640 1 -- 172.21.15.84:0/1687893957 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa8007660 con 0x7effb80b4560 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.597+0000 7effadffb640 1 -- 172.21.15.84:0/1687893957 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8004a20 con 0x7effb80b4560 2023-12-12T09:23:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.597+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb8156dc0 con 0x7effb80b4560 2023-12-12T09:23:15.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.597+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb8159400 con 0x7effb80b4560 2023-12-12T09:23:15.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.598+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb81572e0 con 0x7effb80b4560 2023-12-12T09:23:15.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.599+0000 7effadffb640 1 -- 172.21.15.84:0/1687893957 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effa8004b80 con 0x7effb80b4560 2023-12-12T09:23:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.600+0000 7effadffb640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff9c06ae40 0x7eff9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.600+0000 7effadffb640 1 -- 172.21.15.84:0/1687893957 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7effa8089550 con 0x7effb80b4560 2023-12-12T09:23:15.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.600+0000 7effbd06f640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff9c06ae40 0x7eff9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:15.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.601+0000 7effbd06f640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff9c06ae40 0x7eff9c06d300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7effb4007fd0 tx=0x7effb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:15.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.604+0000 7effadffb640 1 -- 172.21.15.84:0/1687893957 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effb81572e0 con 0x7effb80b4560 2023-12-12T09:23:15.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.796+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effb81572e0 con 0x7effb80b4560 2023-12-12T09:23:15.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.796+0000 7effadffb640 1 -- 172.21.15.84:0/1687893957 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7effb81572e0 con 0x7effb80b4560 2023-12-12T09:23:15.797 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:23:15.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff9c06ae40 msgr2=0x7eff9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff9c06ae40 0x7eff9c06d300 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7effb4007fd0 tx=0x7effb4009040 comp rx=0 tx=0).stop 2023-12-12T09:23:15.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb80b4560 msgr2=0x7effb8154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:15.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb80b4560 0x7effb8154670 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7effa800c410 tx=0x7effa800c8d0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 shutdown_connections 2023-12-12T09:23:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7effb815d810 0x7effb8151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7eff9c06ae40 0x7eff9c06d300 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effb80b4560 0x7effb8154670 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 --2- 172.21.15.84:0/1687893957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effb806d5e0 0x7effb8148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:15.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 >> 172.21.15.84:0/1687893957 conn(0x7effb80b0ac0 msgr2=0x7effb80ad2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:15.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.799+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 shutdown_connections 2023-12-12T09:23:15.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:15.800+0000 7effbf2d3640 1 -- 172.21.15.84:0/1687893957 wait complete. 2023-12-12T09:23:15.819 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:23:16.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.035+0000 7f1f159bc640 1 Processor -- start 2023-12-12T09:23:16.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.035+0000 7f1f159bc640 1 -- start start 2023-12-12T09:23:16.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f159bc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f1013cb90 0x7f1f1015e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f159bc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1013d370 0x7f1f1013d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f159bc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1f1006d9d0 0x7f1f1006de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f159bc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f10070de0 con 0x7f1f1013cb90 2023-12-12T09:23:16.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f159bc640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1006e3a0 con 0x7f1f1006d9d0 2023-12-12T09:23:16.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f159bc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10070160 con 0x7f1f1013d370 2023-12-12T09:23:16.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f149ba640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f1013cb90 0x7f1f1015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f149ba640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1f1013cb90 0x7f1f1015e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42440/0 (socket says 172.21.15.84:42440) 2023-12-12T09:23:16.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.037+0000 7f1f149ba640 1 -- 172.21.15.84:0/1996284247 learned_addr learned my addr 172.21.15.84:0/1996284247 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:16.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.038+0000 7f1f149ba640 1 -- 172.21.15.84:0/1996284247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1013d370 msgr2=0x7f1f1013d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:16.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.038+0000 7f1f0ffff640 1 --2- 172.21.15.84:0/1996284247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1013d370 0x7f1f1013d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.038+0000 7f1f151bb640 1 --2- 172.21.15.84:0/1996284247 >> v2:172.21.15.99:3300/0 conn(0x7f1f1006d9d0 0x7f1f1006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.038+0000 7f1f149ba640 1 --2- 172.21.15.84:0/1996284247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1013d370 0x7f1f1013d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.038+0000 7f1f149ba640 1 -- 172.21.15.84:0/1996284247 >> v2:172.21.15.99:3300/0 conn(0x7f1f1006d9d0 msgr2=0x7f1f1006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.038+0000 7f1f149ba640 1 --2- 172.21.15.84:0/1996284247 >> v2:172.21.15.99:3300/0 conn(0x7f1f1006d9d0 0x7f1f1006de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.038+0000 7f1f149ba640 1 -- 172.21.15.84:0/1996284247 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f10070440 con 0x7f1f1013cb90 2023-12-12T09:23:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.038+0000 7f1f151bb640 1 --2- 172.21.15.84:0/1996284247 >> v2:172.21.15.99:3300/0 conn(0x7f1f1006d9d0 0x7f1f1006de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.039+0000 7f1f149ba640 1 --2- 172.21.15.84:0/1996284247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013cb90 0x7f1f1015e190 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1f101404a0 tx=0x7f1f0402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883447889fb9de36 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.039+0000 7f1f0f7fe640 1 -- 172.21.15.84:0/1996284247 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04031740 con 0x7f1f1013cb90 2023-12-12T09:23:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.039+0000 7f1f0f7fe640 1 -- 172.21.15.84:0/1996284247 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f040318a0 con 0x7f1f1013cb90 2023-12-12T09:23:16.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.039+0000 7f1f0f7fe640 1 -- 172.21.15.84:0/1996284247 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04031c30 con 0x7f1f1013cb90 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 -- 172.21.15.84:0/1996284247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013cb90 msgr2=0x7f1f1015e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 --2- 172.21.15.84:0/1996284247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013cb90 0x7f1f1015e190 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1f101404a0 tx=0x7f1f0402b7e0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 -- 172.21.15.84:0/1996284247 shutdown_connections 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 --2- 172.21.15.84:0/1996284247 >> v2:172.21.15.99:3300/0 conn(0x7f1f1006d9d0 0x7f1f1006de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 --2- 172.21.15.84:0/1996284247 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1013d370 0x7f1f1013d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 --2- 172.21.15.84:0/1996284247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013cb90 0x7f1f1015e190 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 -- 172.21.15.84:0/1996284247 >> 172.21.15.84:0/1996284247 conn(0x7f1f100b0780 msgr2=0x7f1f100b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 -- 172.21.15.84:0/1996284247 shutdown_connections 2023-12-12T09:23:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.040+0000 7f1f159bc640 1 -- 172.21.15.84:0/1996284247 wait complete. 2023-12-12T09:23:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.042+0000 7f1f159bc640 1 Processor -- start 2023-12-12T09:23:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.043+0000 7f1f159bc640 1 -- start start 2023-12-12T09:23:16.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f159bc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1006d9d0 0x7f1f101e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f159bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f1013cb90 0x7f1f101f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f159bc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013d370 0x7f1f101f3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f159bc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1015ae50 con 0x7f1f1013d370 2023-12-12T09:23:16.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f159bc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1015b130 con 0x7f1f1013cb90 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f159bc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1015b410 con 0x7f1f1006d9d0 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f151bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013d370 0x7f1f101f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f151bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013d370 0x7f1f101f3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42444/0 (socket says 172.21.15.84:42444) 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f151bb640 1 -- 172.21.15.84:0/2820128068 learned_addr learned my addr 172.21.15.84:0/2820128068 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.044+0000 7f1f149ba640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1006d9d0 0x7f1f101e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f0ffff640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f1013cb90 0x7f1f101f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f151bb640 1 -- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1006d9d0 msgr2=0x7f1f101e2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f151bb640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1006d9d0 0x7f1f101e2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f151bb640 1 -- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f1013cb90 msgr2=0x7f1f101f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f151bb640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f1013cb90 0x7f1f101f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f151bb640 1 -- 172.21.15.84:0/2820128068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f040094d0 con 0x7f1f1013d370 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f149ba640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1006d9d0 0x7f1f101e2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f0ffff640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f1013cb90 0x7f1f101f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f151bb640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013d370 0x7f1f101f3480 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800cd10 tx=0x7f1f0800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f0d7fa640 1 -- 172.21.15.84:0/2820128068 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800f680 con 0x7f1f1013d370 2023-12-12T09:23:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f0d7fa640 1 -- 172.21.15.84:0/2820128068 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0800f800 con 0x7f1f1013d370 2023-12-12T09:23:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f0d7fa640 1 -- 172.21.15.84:0/2820128068 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800fbb0 con 0x7f1f1013d370 2023-12-12T09:23:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.045+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1015b6f0 con 0x7f1f1013d370 2023-12-12T09:23:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.046+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f101e34a0 con 0x7f1f1013d370 2023-12-12T09:23:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.047+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1015bc10 con 0x7f1f1013d370 2023-12-12T09:23:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.048+0000 7f1f0d7fa640 1 -- 172.21.15.84:0/2820128068 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f0800b040 con 0x7f1f1013d370 2023-12-12T09:23:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.048+0000 7f1f0d7fa640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ef406ae40 0x7f1ef406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.049+0000 7f1f0d7fa640 1 -- 172.21.15.84:0/2820128068 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1f0808a0f0 con 0x7f1f1013d370 2023-12-12T09:23:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.049+0000 7f1f149ba640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ef406ae40 0x7f1ef406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.049+0000 7f1f149ba640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ef406ae40 0x7f1ef406d300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1f04035000 tx=0x7f1f04008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.053+0000 7f1f0d7fa640 1 -- 172.21.15.84:0/2820128068 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f1015bc10 con 0x7f1f1013d370 2023-12-12T09:23:16.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.241+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f1015bc10 con 0x7f1f1013d370 2023-12-12T09:23:16.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.241+0000 7f1f0d7fa640 1 -- 172.21.15.84:0/2820128068 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f1015bc10 con 0x7f1f1013d370 2023-12-12T09:23:16.242 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ef406ae40 msgr2=0x7f1ef406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ef406ae40 0x7f1ef406d300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1f04035000 tx=0x7f1f04008030 comp rx=0 tx=0).stop 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013d370 msgr2=0x7f1f101f3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013d370 0x7f1f101f3480 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800cd10 tx=0x7f1f0800a650 comp rx=0 tx=0).stop 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 shutdown_connections 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1ef406ae40 0x7f1ef406d300 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f1013d370 0x7f1f101f3480 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f1013cb90 0x7f1f101f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 --2- 172.21.15.84:0/2820128068 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1f1006d9d0 0x7f1f101e2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 >> 172.21.15.84:0/2820128068 conn(0x7f1f100b0780 msgr2=0x7f1f100affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.244+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 shutdown_connections 2023-12-12T09:23:16.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.245+0000 7f1f159bc640 1 -- 172.21.15.84:0/2820128068 wait complete. 2023-12-12T09:23:16.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:23:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.458+0000 7f86f9671640 1 Processor -- start 2023-12-12T09:23:16.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.458+0000 7f86f9671640 1 -- start start 2023-12-12T09:23:16.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f9671640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86f415c140 0x7f86f40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f9671640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f86f40cf470 0x7f86f40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f9671640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f40cf8c0 con 0x7f86f4144600 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f9671640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f415eb20 con 0x7f86f415c140 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f9671640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f415ee00 con 0x7f86f40cf470 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86f415c140 0x7f86f40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f37fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f86f415c140 0x7f86f40cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42450/0 (socket says 172.21.15.84:42450) 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f37fe640 1 -- 172.21.15.84:0/19336746 learned_addr learned my addr 172.21.15.84:0/19336746 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f8e70640 1 --2- 172.21.15.84:0/19336746 >> v2:172.21.15.99:3300/0 conn(0x7f86f40cf470 0x7f86f40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f37fe640 1 -- 172.21.15.84:0/19336746 >> v2:172.21.15.99:3300/0 conn(0x7f86f40cf470 msgr2=0x7f86f40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f37fe640 1 --2- 172.21.15.84:0/19336746 >> v2:172.21.15.99:3300/0 conn(0x7f86f40cf470 0x7f86f40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.460+0000 7f86f37fe640 1 -- 172.21.15.84:0/19336746 >> v1:172.21.15.99:6789/0 conn(0x7f86f4144600 legacy=0x7f86f40b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:16.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.461+0000 7f86f37fe640 1 -- 172.21.15.84:0/19336746 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f415f0e0 con 0x7f86f415c140 2023-12-12T09:23:16.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.462+0000 7f86f37fe640 1 --2- 172.21.15.84:0/19336746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f40cef30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f86f40cc950 tx=0x7f86dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e30cf5cf498c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.462+0000 7f86f2ffd640 1 -- 172.21.15.84:0/19336746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc031870 con 0x7f86f415c140 2023-12-12T09:23:16.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.462+0000 7f86f2ffd640 1 -- 172.21.15.84:0/19336746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc0319d0 con 0x7f86f415c140 2023-12-12T09:23:16.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.462+0000 7f86f2ffd640 1 -- 172.21.15.84:0/19336746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc031d60 con 0x7f86f415c140 2023-12-12T09:23:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.463+0000 7f86f9671640 1 -- 172.21.15.84:0/19336746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 msgr2=0x7f86f40cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.463+0000 7f86f9671640 1 --2- 172.21.15.84:0/19336746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f40cef30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f86f40cc950 tx=0x7f86dc02b910 comp rx=0 tx=0).stop 2023-12-12T09:23:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.463+0000 7f86f9671640 1 -- 172.21.15.84:0/19336746 shutdown_connections 2023-12-12T09:23:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.463+0000 7f86f9671640 1 --2- 172.21.15.84:0/19336746 >> v2:172.21.15.99:3300/0 conn(0x7f86f40cf470 0x7f86f40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.463+0000 7f86f9671640 1 --2- 172.21.15.84:0/19336746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f40cef30 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.463+0000 7f86f9671640 1 -- 172.21.15.84:0/19336746 >> 172.21.15.84:0/19336746 conn(0x7f86f406a920 msgr2=0x7f86f406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.463+0000 7f86f9671640 1 -- 172.21.15.84:0/19336746 shutdown_connections 2023-12-12T09:23:16.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.463+0000 7f86f9671640 1 -- 172.21.15.84:0/19336746 wait complete. 2023-12-12T09:23:16.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.464+0000 7f86f9671640 1 Processor -- start 2023-12-12T09:23:16.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.465+0000 7f86f9671640 1 -- start start 2023-12-12T09:23:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.465+0000 7f86f9671640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f40cf470 0x7f86f4139f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.465+0000 7f86f9671640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86f4144600 0x7f86f41399c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.465+0000 7f86f9671640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f4143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.465+0000 7f86f9671640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f406e090 con 0x7f86f415c140 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.465+0000 7f86f9671640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f406d8d0 con 0x7f86f40cf470 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.465+0000 7f86f9671640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4141d20 con 0x7f86f4144600 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f4143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f4143860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42456/0 (socket says 172.21.15.84:42456) 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 -- 172.21.15.84:0/2939184285 learned_addr learned my addr 172.21.15.84:0/2939184285 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 -- 172.21.15.84:0/2939184285 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86f4144600 msgr2=0x7f86f41399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86f4144600 0x7f86f41399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f3fff640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f40cf470 0x7f86f4139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 -- 172.21.15.84:0/2939184285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f40cf470 msgr2=0x7f86f4139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f40cf470 0x7f86f4139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 -- 172.21.15.84:0/2939184285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0094d0 con 0x7f86f415c140 2023-12-12T09:23:16.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.466+0000 7f86f8e70640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f4143860 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00d800 tx=0x7f86ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.467+0000 7f86f0ff9640 1 -- 172.21.15.84:0/2939184285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00b6c0 con 0x7f86f415c140 2023-12-12T09:23:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.467+0000 7f86f0ff9640 1 -- 172.21.15.84:0/2939184285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec00b840 con 0x7f86f415c140 2023-12-12T09:23:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.467+0000 7f86f0ff9640 1 -- 172.21.15.84:0/2939184285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00bbf0 con 0x7f86f415c140 2023-12-12T09:23:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.467+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f4142000 con 0x7f86f415c140 2023-12-12T09:23:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.467+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f4143da0 con 0x7f86f415c140 2023-12-12T09:23:16.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.468+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f406ddb0 con 0x7f86f415c140 2023-12-12T09:23:16.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.469+0000 7f86f0ff9640 1 -- 172.21.15.84:0/2939184285 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f86ec00bd50 con 0x7f86f415c140 2023-12-12T09:23:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.470+0000 7f86f0ff9640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f86d406ae40 0x7f86d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.470+0000 7f86f0ff9640 1 -- 172.21.15.84:0/2939184285 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f86ec089d40 con 0x7f86f415c140 2023-12-12T09:23:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.470+0000 7f86f3fff640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f86d406ae40 0x7f86d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.470+0000 7f86f3fff640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f86d406ae40 0x7f86d406d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86e4007fd0 tx=0x7f86e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.474+0000 7f86f0ff9640 1 -- 172.21.15.84:0/2939184285 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86f406ddb0 con 0x7f86f415c140 2023-12-12T09:23:16.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.649+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86f406ddb0 con 0x7f86f415c140 2023-12-12T09:23:16.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.650+0000 7f86f0ff9640 1 -- 172.21.15.84:0/2939184285 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86f406ddb0 con 0x7f86f415c140 2023-12-12T09:23:16.651 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f86d406ae40 msgr2=0x7f86d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f86d406ae40 0x7f86d406d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86e4007fd0 tx=0x7f86e4009040 comp rx=0 tx=0).stop 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 msgr2=0x7f86f4143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f4143860 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00d800 tx=0x7f86ec00dcc0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 shutdown_connections 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f86d406ae40 0x7f86d406d300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86f415c140 0x7f86f4143860 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f86f4144600 0x7f86f41399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 --2- 172.21.15.84:0/2939184285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f40cf470 0x7f86f4139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 >> 172.21.15.84:0/2939184285 conn(0x7f86f406a920 msgr2=0x7f86f415d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 shutdown_connections 2023-12-12T09:23:16.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.653+0000 7f86f9671640 1 -- 172.21.15.84:0/2939184285 wait complete. 2023-12-12T09:23:16.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:23:16.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.876+0000 7f69ed7a9640 1 Processor -- start 2023-12-12T09:23:16.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.876+0000 7f69ed7a9640 1 -- start start 2023-12-12T09:23:16.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.878+0000 7f69ed7a9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f69e8143d20 0x7f69e80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.878+0000 7f69ed7a9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e81447f0 0x7f69e80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.878+0000 7f69ed7a9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e80cea30 con 0x7f69e80ce550 2023-12-12T09:23:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.878+0000 7f69ed7a9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e80702b0 con 0x7f69e8143d20 2023-12-12T09:23:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.878+0000 7f69ed7a9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8070590 con 0x7f69e81447f0 2023-12-12T09:23:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.879+0000 7f69e6ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f69e8143d20 0x7f69e80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.879+0000 7f69e77fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e81447f0 0x7f69e80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.879+0000 7f69e77fe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e81447f0 0x7f69e80b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:33708/0 (socket says 172.21.15.84:33708) 2023-12-12T09:23:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.879+0000 7f69e77fe640 1 -- 172.21.15.84:0/3408424618 learned_addr learned my addr 172.21.15.84:0/3408424618 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.880+0000 7f69e77fe640 1 -- 172.21.15.84:0/3408424618 >> v2:172.21.15.99:3300/0 conn(0x7f69e8143d20 msgr2=0x7f69e80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.880+0000 7f69e77fe640 1 --2- 172.21.15.84:0/3408424618 >> v2:172.21.15.99:3300/0 conn(0x7f69e8143d20 0x7f69e80b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.880+0000 7f69e77fe640 1 -- 172.21.15.84:0/3408424618 >> v1:172.21.15.99:6789/0 conn(0x7f69e80ce550 legacy=0x7f69e815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.880+0000 7f69e77fe640 1 -- 172.21.15.84:0/3408424618 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8070870 con 0x7f69e81447f0 2023-12-12T09:23:16.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.880+0000 7f69e6ffd640 1 --2- 172.21.15.84:0/3408424618 >> v2:172.21.15.99:3300/0 conn(0x7f69e8143d20 0x7f69e80b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:23:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.882+0000 7f69e77fe640 1 --2- 172.21.15.84:0/3408424618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e81447f0 0x7f69e80b4610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009e50 tx=0x7f69e002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3573cc4d35057108 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.882+0000 7f69e67fc640 1 -- 172.21.15.84:0/3408424618 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e002cb00 con 0x7f69e81447f0 2023-12-12T09:23:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.882+0000 7f69e67fc640 1 -- 172.21.15.84:0/3408424618 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e002cc60 con 0x7f69e81447f0 2023-12-12T09:23:16.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.882+0000 7f69e67fc640 1 -- 172.21.15.84:0/3408424618 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e00343f0 con 0x7f69e81447f0 2023-12-12T09:23:16.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.883+0000 7f69ed7a9640 1 -- 172.21.15.84:0/3408424618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e81447f0 msgr2=0x7f69e80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.883+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/3408424618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e81447f0 0x7f69e80b4610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009e50 tx=0x7f69e002bf60 comp rx=0 tx=0).stop 2023-12-12T09:23:16.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.883+0000 7f69ed7a9640 1 -- 172.21.15.84:0/3408424618 shutdown_connections 2023-12-12T09:23:16.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.883+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/3408424618 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e81447f0 0x7f69e80b4610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.883+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/3408424618 >> v2:172.21.15.99:3300/0 conn(0x7f69e8143d20 0x7f69e80b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.883+0000 7f69ed7a9640 1 -- 172.21.15.84:0/3408424618 >> 172.21.15.84:0/3408424618 conn(0x7f69e806c3d0 msgr2=0x7f69e806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:16.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.883+0000 7f69ed7a9640 1 -- 172.21.15.84:0/3408424618 shutdown_connections 2023-12-12T09:23:16.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.883+0000 7f69ed7a9640 1 -- 172.21.15.84:0/3408424618 wait complete. 2023-12-12T09:23:16.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.885+0000 7f69ed7a9640 1 Processor -- start 2023-12-12T09:23:16.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.886+0000 7f69ed7a9640 1 -- start start 2023-12-12T09:23:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69ed7a9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e80ce550 0x7f69e80b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69ed7a9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e8143d20 0x7f69e813a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69ed7a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e81447f0 0x7f69e813a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69ed7a9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8154c30 con 0x7f69e81447f0 2023-12-12T09:23:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69ed7a9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80c3d30 con 0x7f69e80ce550 2023-12-12T09:23:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69ed7a9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8154020 con 0x7f69e8143d20 2023-12-12T09:23:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69e77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e81447f0 0x7f69e813a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69e77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e81447f0 0x7f69e813a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42460/0 (socket says 172.21.15.84:42460) 2023-12-12T09:23:16.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.887+0000 7f69e77fe640 1 -- 172.21.15.84:0/2994788541 learned_addr learned my addr 172.21.15.84:0/2994788541 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69de7fc640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e8143d20 0x7f69e813a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69e6ffd640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e80ce550 0x7f69e80b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69e77fe640 1 -- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e8143d20 msgr2=0x7f69e813a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69e77fe640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e8143d20 0x7f69e813a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69e77fe640 1 -- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e80ce550 msgr2=0x7f69e80b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69e77fe640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e80ce550 0x7f69e80b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69e77fe640 1 -- 172.21.15.84:0/2994788541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8009400 con 0x7f69e81447f0 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69de7fc640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e8143d20 0x7f69e813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69e77fe640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e81447f0 0x7f69e813a980 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009e50 tx=0x7f69e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.888+0000 7f69dffff640 1 -- 172.21.15.84:0/2994788541 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0040670 con 0x7f69e81447f0 2023-12-12T09:23:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.889+0000 7f69dffff640 1 -- 172.21.15.84:0/2994788541 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0040810 con 0x7f69e81447f0 2023-12-12T09:23:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.889+0000 7f69dffff640 1 -- 172.21.15.84:0/2994788541 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0040bc0 con 0x7f69e81447f0 2023-12-12T09:23:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.889+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e0009b30 con 0x7f69e81447f0 2023-12-12T09:23:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.889+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e81545e0 con 0x7f69e81447f0 2023-12-12T09:23:16.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.890+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e8154de0 con 0x7f69e81447f0 2023-12-12T09:23:16.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.891+0000 7f69dffff640 1 -- 172.21.15.84:0/2994788541 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f69e0040d20 con 0x7f69e81447f0 2023-12-12T09:23:16.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.892+0000 7f69dffff640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f69c806ae40 0x7f69c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.893+0000 7f69dffff640 1 -- 172.21.15.84:0/2994788541 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f69e00ac7b0 con 0x7f69e81447f0 2023-12-12T09:23:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.893+0000 7f69e6ffd640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f69c806ae40 0x7f69c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:16.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.893+0000 7f69e6ffd640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f69c806ae40 0x7f69c806d300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009c60 tx=0x7f69d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:16.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:16.897+0000 7f69dffff640 1 -- 172.21.15.84:0/2994788541 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f69e8154de0 con 0x7f69e81447f0 2023-12-12T09:23:17.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.085+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69e80673c0 con 0x7f69e81447f0 2023-12-12T09:23:17.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.085+0000 7f69dffff640 1 -- 172.21.15.84:0/2994788541 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69e00777a0 con 0x7f69e81447f0 2023-12-12T09:23:17.086 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:23:17.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f69c806ae40 msgr2=0x7f69c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:17.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f69c806ae40 0x7f69c806d300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009c60 tx=0x7f69d8008040 comp rx=0 tx=0).stop 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e81447f0 msgr2=0x7f69e813a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e81447f0 0x7f69e813a980 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009e50 tx=0x7f69e0004a40 comp rx=0 tx=0).stop 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 shutdown_connections 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f69c806ae40 0x7f69c806d300 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f69e81447f0 0x7f69e813a980 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f69e8143d20 0x7f69e813a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 --2- 172.21.15.84:0/2994788541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e80ce550 0x7f69e80b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 >> 172.21.15.84:0/2994788541 conn(0x7f69e806c3d0 msgr2=0x7f69e813c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 shutdown_connections 2023-12-12T09:23:17.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:17.088+0000 7f69ed7a9640 1 -- 172.21.15.84:0/2994788541 wait complete. 2023-12-12T09:23:17.106 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:23:17.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:17.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:17.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[111372]: fuse finished with error 0 and tester_r 0 2023-12-12T09:23:17.201 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:23:23.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:23:23.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:23.303 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:23:23.365 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T09:23:23.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.579+0000 7f4ecbbbe640 1 Processor -- start 2023-12-12T09:23:23.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.579+0000 7f4ecbbbe640 1 -- start start 2023-12-12T09:23:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.581+0000 7f4ecbbbe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec40b4ba0 0x7f4ec415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.581+0000 7f4ecbbbe640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec40b3b60 con 0x7f4ec4142f40 2023-12-12T09:23:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.581+0000 7f4ecbbbe640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec40b3de0 con 0x7f4ec413ff90 2023-12-12T09:23:23.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.581+0000 7f4ecbbbe640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec415e6d0 con 0x7f4ec40b4ba0 2023-12-12T09:23:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.581+0000 7f4ec9159640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4ec4142f40 0x7f4ec415d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:33822/0 (socket says 172.21.15.84:33822) 2023-12-12T09:23:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.581+0000 7f4ec9159640 1 -- 172.21.15.84:0/43044855 learned_addr learned my addr 172.21.15.84:0/43044855 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4eca15b640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec40b4ba0 0x7f4ec415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482657448 0 0) 0x7f4ec40b3b60 con 0x7f4ec4142f40 2023-12-12T09:23:23.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb0003520 con 0x7f4ec4142f40 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263412370 0 0) 0x7f4eb0003520 con 0x7f4ec4142f40 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec40b4ba0 msgr2=0x7f4ec415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec40b4ba0 0x7f4ec415e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 >> v1:172.21.15.99:6789/0 conn(0x7f4ec413ff90 legacy=0x7f4ec4142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40b40c0 con 0x7f4ec4142f40 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f4eb4001670 con 0x7f4ec4142f40 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 >> v1:172.21.15.84:6789/0 conn(0x7f4ec4142f40 legacy=0x7f4ec415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eb00039a0 0x7f4eb0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec40b4ba0 0x7f4eb00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4eb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec415e6d0 con 0x7f4eb0004d00 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb000ba60 con 0x7f4eb00039a0 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb000bc20 con 0x7f4ec40b4ba0 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.582+0000 7f4eca15b640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4eb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:23.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.583+0000 7f4ec995a640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eb00039a0 0x7f4eb0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:23.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.583+0000 7f4ec9159640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec40b4ba0 0x7f4eb00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:23.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.583+0000 7f4eca15b640 1 -- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec40b4ba0 msgr2=0x7f4eb00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:23.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.583+0000 7f4eca15b640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec40b4ba0 0x7f4eb00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.583+0000 7f4eca15b640 1 -- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eb00039a0 msgr2=0x7f4eb0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:23.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.583+0000 7f4eca15b640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4eb00039a0 0x7f4eb0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.583+0000 7f4eca15b640 1 -- 172.21.15.84:0/43044855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb0003520 con 0x7f4eb0004d00 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.584+0000 7f4eca15b640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4eb0005180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009f90 tx=0x7f4eb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f5c51270e73f54 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.584+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc02cbd0 con 0x7f4eb0004d00 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.584+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc00f040 con 0x7f4eb0004d00 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.584+0000 7f4ec8958640 1 -- 172.21.15.84:0/43044855 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc034440 con 0x7f4eb0004d00 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.585+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/43044855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 msgr2=0x7f4eb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.585+0000 7f4ecbbbe640 1 --2- 172.21.15.84:0/43044855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4eb0005180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009f90 tx=0x7f4eb00057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.585+0000 7f4eca15b640 1 -- 172.21.15.84:0/43044855 reap_dead start 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.585+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/43044855 shutdown_connections 2023-12-12T09:23:23.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.585+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/43044855 >> 172.21.15.84:0/43044855 conn(0x7f4ec406c3d0 msgr2=0x7f4ec406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:23.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.585+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/43044855 shutdown_connections 2023-12-12T09:23:23.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.585+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/43044855 wait complete. 2023-12-12T09:23:23.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.587+0000 7f4ecbbbe640 1 Processor -- start 2023-12-12T09:23:23.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.587+0000 7f4ecbbbe640 1 -- start start 2023-12-12T09:23:23.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ecbbbe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4ec4156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:23.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ecbbbe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ec4136c30 0x7f4ec4137090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:23.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ecbbbe640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec4141920 0x7f4ec4141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:23.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ecbbbe640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41422e0 con 0x7f4eb0004d00 2023-12-12T09:23:23.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ecbbbe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4137740 con 0x7f4ec4136c30 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ecbbbe640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec4138750 con 0x7f4ec4141920 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec995a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4ec4156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec995a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4ec4156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42464/0 (socket says 172.21.15.84:42464) 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec995a640 1 -- 172.21.15.84:0/2142075335 learned_addr learned my addr 172.21.15.84:0/2142075335 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec9159640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ec4136c30 0x7f4ec4137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4eca15b640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec4141920 0x7f4ec4141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec995a640 1 -- 172.21.15.84:0/2142075335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec4141920 msgr2=0x7f4ec4141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec995a640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec4141920 0x7f4ec4141da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec995a640 1 -- 172.21.15.84:0/2142075335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ec4136c30 msgr2=0x7f4ec4137090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec995a640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ec4136c30 0x7f4ec4137090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.588+0000 7f4ec995a640 1 -- 172.21.15.84:0/2142075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4138a30 con 0x7f4eb0004d00 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.589+0000 7f4ec995a640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4ec4156eb0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000e550 tx=0x7f4ec000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:23.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.589+0000 7f4eba7fc640 1 -- 172.21.15.84:0/2142075335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00052e0 con 0x7f4eb0004d00 2023-12-12T09:23:23.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.589+0000 7f4eba7fc640 1 -- 172.21.15.84:0/2142075335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0005440 con 0x7f4eb0004d00 2023-12-12T09:23:23.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.589+0000 7f4eba7fc640 1 -- 172.21.15.84:0/2142075335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0003810 con 0x7f4eb0004d00 2023-12-12T09:23:23.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.589+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec4138d10 con 0x7f4eb0004d00 2023-12-12T09:23:23.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.589+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec4072340 con 0x7f4eb0004d00 2023-12-12T09:23:23.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.590+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec40673c0 con 0x7f4eb0004d00 2023-12-12T09:23:23.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.591+0000 7f4eba7fc640 1 -- 172.21.15.84:0/2142075335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ec0003970 con 0x7f4eb0004d00 2023-12-12T09:23:23.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.592+0000 7f4eba7fc640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ea806ae40 0x7f4ea806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:23.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.592+0000 7f4eba7fc640 1 -- 172.21.15.84:0/2142075335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4ec00895d0 con 0x7f4eb0004d00 2023-12-12T09:23:23.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.592+0000 7f4ec9159640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ea806ae40 0x7f4ea806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:23.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.593+0000 7f4ec9159640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ea806ae40 0x7f4ea806d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4001c90 tx=0x7f4eb4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:23.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.599+0000 7f4eba7fc640 1 -- 172.21.15.84:0/2142075335 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ec0054410 con 0x7f4eb0004d00 2023-12-12T09:23:23.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.827+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ec406dcd0 con 0x7f4eb0004d00 2023-12-12T09:23:23.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.827+0000 7f4eba7fc640 1 -- 172.21.15.84:0/2142075335 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4ec0057a30 con 0x7f4eb0004d00 2023-12-12T09:23:23.828 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T09:23:23.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ea806ae40 msgr2=0x7f4ea806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:23.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ea806ae40 0x7f4ea806d300 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4001c90 tx=0x7f4eb4009040 comp rx=0 tx=0).stop 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 msgr2=0x7f4ec4156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4ec4156eb0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000e550 tx=0x7f4ec000ea10 comp rx=0 tx=0).stop 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 shutdown_connections 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f4ec4141920 0x7f4ec4141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ec4136c30 0x7f4ec4137090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f4ea806ae40 0x7f4ea806d300 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 --2- 172.21.15.84:0/2142075335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4eb0004d00 0x7f4ec4156eb0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 >> 172.21.15.84:0/2142075335 conn(0x7f4ec406c3d0 msgr2=0x7f4ec406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 shutdown_connections 2023-12-12T09:23:23.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:23.830+0000 7f4ecbbbe640 1 -- 172.21.15.84:0/2142075335 wait complete. 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T09:23:23.848 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:23.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:23.849 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:23.903 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42000sec preferred_lft 42000sec 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c8b:52ff:fef6:cd60/64 scope link 2023-12-12T09:23:23.904 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:23:23.905 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c2:ab:b4:6c:14:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:23.905 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c0ab:b4ff:fe6c:1499/64 scope link 2023-12-12T09:23:23.905 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:23.905 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T09:23:23.905 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:57:6b:d3:b0:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:23.905 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3c57:6bff:fed3:b000/64 scope link 2023-12-12T09:23:23.905 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-12-12T09:23:23.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:23.906 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T09:23:23.995 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-12-12T09:23:23.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:23.999 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-12-12T09:23:24.051 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-12-12T09:23:24.051 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T09:23:24.051 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T09:23:24.052 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T09:23:24.052 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T09:23:24.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:24.052 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-12-12T09:23:24.052 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-12-12T09:23:24.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T09:23:24.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T09:23:24.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T09:23:24.052 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-12-12T09:23:24.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:24.232 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:23:24.283 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:23:24.283 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T09:23:24.284 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:24.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:24.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-12-12T09:23:24.377 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T09:23:24.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:23:24.377 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:24.429 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T09:23:24.429 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T09:23:24.430 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:24.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:23:24.577 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:23:24.634 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:23:24.635 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:23:24.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:23:24.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:24.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:24.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:24.636 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:24.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:24.637 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:23:24.685 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T09:23:24.685 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T09:23:24.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-12-12T09:23:24.765 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2023-12-12T09:23:24.807 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:24.808 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:24.809 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:24.809 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:24.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:24.809 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-12-12T09:23:24.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-12-12T09:23:24.877+0000 7f0ac0759480 -1 init, newargv = 0x55a54fc2eaf0 newargc=15 2023-12-12T09:23:24.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[112334]: starting ceph client 2023-12-12T09:23:24.885 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[112334]: starting fuse 2023-12-12T09:23:24.897 INFO:teuthology.orchestra.run.smithi084.stdout:39 2023-12-12T09:23:24.898 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-12-12T09:23:24.898 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-12-12T09:23:24.899 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:23:25.095 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.112334.asok 2023-12-12T09:23:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T09:23:25.112 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112334.asok 2023-12-12T09:23:25.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:25.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112334.asok status 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "112334", 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-12-12T09:23:25.344 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 6585, 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 6585 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2204831545 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-12-12T09:23:25.345 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2204831545 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.6585 192.168.0.1:0/2204831545", 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2204831545", 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 27, 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 58, 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-12-12T09:23:25.346 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:25.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:25.359 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-12-12T09:23:25.359 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:25.413 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-12-12T09:23:25.414 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:25.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:25.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> stdin-killer -- python3 -c ' 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> import errno 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> try: 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> if True: 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> ret = os.read(fd, 1024) 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> else: 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> os.write(fd, b'"'"'content'"'"') 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> except OSError as e: 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> if e.errno != errno.EPERM: 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> raise 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> else: 2023-12-12T09:23:25.507 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("client does not check permission of data pool") 2023-12-12T09:23:25.508 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-12-12T09:23:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:Traceback (most recent call last): 2023-12-12T09:23:25.658 INFO:teuthology.orchestra.run.smithi084.stderr: File "", line 15, in 2023-12-12T09:23:25.658 INFO:teuthology.orchestra.run.smithi084.stderr:RuntimeError: client does not check permission of data pool 2023-12-12T09:23:25.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-12-12T09:23:25.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:23:25.672 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-12-12T09:23:25.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.940+0000 7fa420b51640 1 Processor -- start 2023-12-12T09:23:25.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.940+0000 7fa420b51640 1 -- start start 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.942+0000 7fa420b51640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa41c15d3b0 0x7fa41c0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.942+0000 7fa420b51640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c0b2140 0x7fa41c0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.942+0000 7fa420b51640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c0b0630 con 0x7fa41c0ad260 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.942+0000 7fa420b51640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c0b2b00 con 0x7fa41c15d3b0 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.942+0000 7fa420b51640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0acad0 con 0x7fa41c0b2140 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.942+0000 7fa41a59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa41c15d3b0 0x7fa41c0b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.942+0000 7fa41a59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa41c15d3b0 0x7fa41c0b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32982/0 (socket says 172.21.15.84:32982) 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.942+0000 7fa41a59c640 1 -- 172.21.15.84:0/159915845 learned_addr learned my addr 172.21.15.84:0/159915845 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:25.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.943+0000 7fa413fff640 1 --2- 172.21.15.84:0/159915845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c0b2140 0x7fa41c0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.943+0000 7fa41a59c640 1 -- 172.21.15.84:0/159915845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c0b2140 msgr2=0x7fa41c0b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.943+0000 7fa41a59c640 1 --2- 172.21.15.84:0/159915845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c0b2140 0x7fa41c0b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.943+0000 7fa41a59c640 1 -- 172.21.15.84:0/159915845 >> v1:172.21.15.99:6789/0 conn(0x7fa41c0ad260 legacy=0x7fa41c0ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.943+0000 7fa41a59c640 1 -- 172.21.15.84:0/159915845 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0b3fb0 con 0x7fa41c15d3b0 2023-12-12T09:23:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.943+0000 7fa413fff640 1 --2- 172.21.15.84:0/159915845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c0b2140 0x7fa41c0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:25.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.944+0000 7fa41a59c640 1 --2- 172.21.15.84:0/159915845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c15d3b0 0x7fa41c0b00f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009870 tx=0x7fa40c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ba0d9010b9fc35 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:25.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.944+0000 7fa419d9b640 1 -- 172.21.15.84:0/159915845 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c031640 con 0x7fa41c15d3b0 2023-12-12T09:23:25.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.944+0000 7fa419d9b640 1 -- 172.21.15.84:0/159915845 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c0317a0 con 0x7fa41c15d3b0 2023-12-12T09:23:25.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.944+0000 7fa419d9b640 1 -- 172.21.15.84:0/159915845 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c031b30 con 0x7fa41c15d3b0 2023-12-12T09:23:25.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.945+0000 7fa420b51640 1 -- 172.21.15.84:0/159915845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c15d3b0 msgr2=0x7fa41c0b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:25.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.945+0000 7fa420b51640 1 --2- 172.21.15.84:0/159915845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c15d3b0 0x7fa41c0b00f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009870 tx=0x7fa40c02b8f0 comp rx=0 tx=0).stop 2023-12-12T09:23:25.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.945+0000 7fa420b51640 1 -- 172.21.15.84:0/159915845 shutdown_connections 2023-12-12T09:23:25.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.945+0000 7fa420b51640 1 --2- 172.21.15.84:0/159915845 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c0b2140 0x7fa41c0b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:25.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.945+0000 7fa420b51640 1 --2- 172.21.15.84:0/159915845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c15d3b0 0x7fa41c0b00f0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:25.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.945+0000 7fa420b51640 1 -- 172.21.15.84:0/159915845 >> 172.21.15.84:0/159915845 conn(0x7fa41c070ad0 msgr2=0x7fa41c071980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:25.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.945+0000 7fa420b51640 1 -- 172.21.15.84:0/159915845 shutdown_connections 2023-12-12T09:23:25.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.945+0000 7fa420b51640 1 -- 172.21.15.84:0/159915845 wait complete. 2023-12-12T09:23:25.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.947+0000 7fa420b51640 1 Processor -- start 2023-12-12T09:23:25.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.947+0000 7fa420b51640 1 -- start start 2023-12-12T09:23:25.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.948+0000 7fa420b51640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0ad260 0x7fa41c1f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.948+0000 7fa420b51640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c0b2140 0x7fa41c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.948+0000 7fa420b51640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c15d3b0 0x7fa41c0992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.948+0000 7fa420b51640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c13f320 con 0x7fa41c0b2140 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.948+0000 7fa420b51640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c13eff0 con 0x7fa41c0ad260 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.948+0000 7fa420b51640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c15fd70 con 0x7fa41c15d3b0 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c0b2140 0x7fa41c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c0b2140 0x7fa41c15f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32998/0 (socket says 172.21.15.84:32998) 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 -- 172.21.15.84:0/159140039 learned_addr learned my addr 172.21.15.84:0/159140039 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa41a59c640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0ad260 0x7fa41c1f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa41ad9d640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c15d3b0 0x7fa41c0992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 -- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c15d3b0 msgr2=0x7fa41c0992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c15d3b0 0x7fa41c0992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 -- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0ad260 msgr2=0x7fa41c1f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0ad260 0x7fa41c1f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:25.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 -- 172.21.15.84:0/159140039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c0094d0 con 0x7fa41c0b2140 2023-12-12T09:23:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa41ad9d640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c15d3b0 0x7fa41c0992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.949+0000 7fa413fff640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c0b2140 0x7fa41c15f520 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c7f0 tx=0x7fa40400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.950+0000 7fa412ffd640 1 -- 172.21.15.84:0/159140039 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404007a30 con 0x7fa41c0b2140 2023-12-12T09:23:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.950+0000 7fa412ffd640 1 -- 172.21.15.84:0/159140039 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa404007b90 con 0x7fa41c0b2140 2023-12-12T09:23:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.950+0000 7fa412ffd640 1 -- 172.21.15.84:0/159140039 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400ce40 con 0x7fa41c0b2140 2023-12-12T09:23:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.950+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c160050 con 0x7fa41c0b2140 2023-12-12T09:23:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.950+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c15fa60 con 0x7fa41c0b2140 2023-12-12T09:23:25.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.951+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c074210 con 0x7fa41c0b2140 2023-12-12T09:23:25.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.952+0000 7fa412ffd640 1 -- 172.21.15.84:0/159140039 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4040113f0 con 0x7fa41c0b2140 2023-12-12T09:23:25.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.953+0000 7fa412ffd640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa3fc06ae40 0x7fa3fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:25.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.953+0000 7fa412ffd640 1 -- 172.21.15.84:0/159140039 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa404089940 con 0x7fa41c0b2140 2023-12-12T09:23:25.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.953+0000 7fa41a59c640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa3fc06ae40 0x7fa3fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:25.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.954+0000 7fa41a59c640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa3fc06ae40 0x7fa3fc06d300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa40c036000 tx=0x7fa40c03c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:25.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:25.957+0000 7fa412ffd640 1 -- 172.21.15.84:0/159140039 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa404054810 con 0x7fa41c0b2140 2023-12-12T09:23:26.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.215+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa41c0673c0 con 0x7fa41c0b2140 2023-12-12T09:23:26.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.226+0000 7fa412ffd640 1 -- 172.21.15.84:0/159140039 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+141 (secure 0 0 0) 0x7fa40401f0e0 con 0x7fa41c0b2140 2023-12-12T09:23:26.227 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-12-12T09:23:26.227 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBoJXhlaP2XDxAAN2+EKbJMoplntw3F5QJsvg== 2023-12-12T09:23:26.227 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-12-12T09:23:26.227 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-12-12T09:23:26.227 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw pool=cephfs_data" 2023-12-12T09:23:26.227 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-12-12T09:23:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.229+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa3fc06ae40 msgr2=0x7fa3fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.229+0000 7fa420b51640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa3fc06ae40 0x7fa3fc06d300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa40c036000 tx=0x7fa40c03c040 comp rx=0 tx=0).stop 2023-12-12T09:23:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.229+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c0b2140 msgr2=0x7fa41c15f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.229+0000 7fa420b51640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c0b2140 0x7fa41c15f520 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa40400c7f0 tx=0x7fa40400cbf0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.230+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 shutdown_connections 2023-12-12T09:23:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.230+0000 7fa420b51640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa41c15d3b0 0x7fa41c0992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.230+0000 7fa420b51640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa3fc06ae40 0x7fa3fc06d300 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.230+0000 7fa420b51640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa41c0b2140 0x7fa41c15f520 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.230+0000 7fa420b51640 1 --2- 172.21.15.84:0/159140039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa41c0ad260 0x7fa41c1f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.230+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 >> 172.21.15.84:0/159140039 conn(0x7fa41c070ad0 msgr2=0x7fa41c154700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.230+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 shutdown_connections 2023-12-12T09:23:26.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.230+0000 7fa420b51640 1 -- 172.21.15.84:0/159140039 wait complete. 2023-12-12T09:23:26.248 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T09:23:26.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:23:26.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T09:23:26.469 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T09:23:26.470 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:23:26.470 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:26.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:26.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.739+0000 7fc7eb5d7640 1 Processor -- start 2023-12-12T09:23:26.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.739+0000 7fc7eb5d7640 1 -- start start 2023-12-12T09:23:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7eb5d7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc7e40b47e0 0x7fc7e4071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7eb5d7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7e40ce550 0x7fc7e40715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7eb5d7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e40cea30 con 0x7fc7e4143d20 2023-12-12T09:23:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7eb5d7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e40702b0 con 0x7fc7e40ce550 2023-12-12T09:23:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7eb5d7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e4070590 con 0x7fc7e40b47e0 2023-12-12T09:23:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7e9b74640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7e40ce550 0x7fc7e40715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7e9373640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc7e4143d20 0x7fc7e40b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34166/0 (socket says 172.21.15.84:34166) 2023-12-12T09:23:26.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7e9373640 1 -- 172.21.15.84:0/3304433456 learned_addr learned my addr 172.21.15.84:0/3304433456 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:26.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.741+0000 7fc7e9b74640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7e40ce550 0x7fc7e40715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33012/0 (socket says 172.21.15.84:33012) 2023-12-12T09:23:26.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.742+0000 7fc7e8b72640 1 --2- 172.21.15.84:0/3304433456 >> v2:172.21.15.99:3300/0 conn(0x7fc7e40b47e0 0x7fc7e4071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:26.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.742+0000 7fc7e9b74640 1 -- 172.21.15.84:0/3304433456 >> v2:172.21.15.99:3300/0 conn(0x7fc7e40b47e0 msgr2=0x7fc7e4071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:26.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.742+0000 7fc7e9b74640 1 --2- 172.21.15.84:0/3304433456 >> v2:172.21.15.99:3300/0 conn(0x7fc7e40b47e0 0x7fc7e4071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.742+0000 7fc7e9b74640 1 -- 172.21.15.84:0/3304433456 >> v1:172.21.15.84:6789/0 conn(0x7fc7e4143d20 legacy=0x7fc7e40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:26.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.742+0000 7fc7e9b74640 1 -- 172.21.15.84:0/3304433456 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4070870 con 0x7fc7e40ce550 2023-12-12T09:23:26.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.743+0000 7fc7e9b74640 1 --2- 172.21.15.84:0/3304433456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40715b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc7e406be30 tx=0x7fc7dc02bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dbb9be7991352 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:26.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.743+0000 7fc7dbfff640 1 -- 172.21.15.84:0/3304433456 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc02ca30 con 0x7fc7e40ce550 2023-12-12T09:23:26.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.743+0000 7fc7dbfff640 1 -- 172.21.15.84:0/3304433456 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc02cb90 con 0x7fc7e40ce550 2023-12-12T09:23:26.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.743+0000 7fc7dbfff640 1 -- 172.21.15.84:0/3304433456 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc034440 con 0x7fc7e40ce550 2023-12-12T09:23:26.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.744+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/3304433456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 msgr2=0x7fc7e40715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:26.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.744+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/3304433456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40715b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc7e406be30 tx=0x7fc7dc02bd00 comp rx=0 tx=0).stop 2023-12-12T09:23:26.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.744+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/3304433456 shutdown_connections 2023-12-12T09:23:26.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.744+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/3304433456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40715b0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.744+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/3304433456 >> v2:172.21.15.99:3300/0 conn(0x7fc7e40b47e0 0x7fc7e4071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.744+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/3304433456 >> 172.21.15.84:0/3304433456 conn(0x7fc7e406c3d0 msgr2=0x7fc7e406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:26.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.744+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/3304433456 shutdown_connections 2023-12-12T09:23:26.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.744+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/3304433456 wait complete. 2023-12-12T09:23:26.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.747+0000 7fc7eb5d7640 1 Processor -- start 2023-12-12T09:23:26.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.747+0000 7fc7eb5d7640 1 -- start start 2023-12-12T09:23:26.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7eb5d7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7e40b47e0 0x7fc7e413f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:26.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7eb5d7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:26.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7eb5d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7e4143d20 0x7fc7e415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:26.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7eb5d7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40abe20 con 0x7fc7e40ce550 2023-12-12T09:23:26.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7eb5d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e413f540 con 0x7fc7e4143d20 2023-12-12T09:23:26.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7eb5d7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40ac070 con 0x7fc7e40b47e0 2023-12-12T09:23:26.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7e8b72640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:26.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7e8b72640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33022/0 (socket says 172.21.15.84:33022) 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.748+0000 7fc7e8b72640 1 -- 172.21.15.84:0/4136292279 learned_addr learned my addr 172.21.15.84:0/4136292279 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7e9b74640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7e4143d20 0x7fc7e415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7e8b72640 1 -- 172.21.15.84:0/4136292279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7e40b47e0 msgr2=0x7fc7e413f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7e8b72640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7e40b47e0 0x7fc7e413f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7e8b72640 1 -- 172.21.15.84:0/4136292279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7e4143d20 msgr2=0x7fc7e415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7e8b72640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7e4143d20 0x7fc7e415a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7e8b72640 1 -- 172.21.15.84:0/4136292279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009a70 con 0x7fc7e40ce550 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7e9b74640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7e4143d20 0x7fc7e415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:26.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7e8b72640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40ab8e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400d800 tx=0x7fc7d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:26.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7d9ffb640 1 -- 172.21.15.84:0/4136292279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400b6c0 con 0x7fc7e40ce550 2023-12-12T09:23:26.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7d9ffb640 1 -- 172.21.15.84:0/4136292279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d400b820 con 0x7fc7e40ce550 2023-12-12T09:23:26.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7d9ffb640 1 -- 172.21.15.84:0/4136292279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400bbb0 con 0x7fc7e40ce550 2023-12-12T09:23:26.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.749+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e40ac350 con 0x7fc7e40ce550 2023-12-12T09:23:26.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.750+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e40ac910 con 0x7fc7e40ce550 2023-12-12T09:23:26.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.751+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e40673c0 con 0x7fc7e40ce550 2023-12-12T09:23:26.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.752+0000 7fc7d9ffb640 1 -- 172.21.15.84:0/4136292279 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7d400bd10 con 0x7fc7e40ce550 2023-12-12T09:23:26.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.753+0000 7fc7d9ffb640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc7c806ae40 0x7fc7c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:26.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.753+0000 7fc7d9ffb640 1 -- 172.21.15.84:0/4136292279 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc7d4089d90 con 0x7fc7e40ce550 2023-12-12T09:23:26.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.753+0000 7fc7e9373640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc7c806ae40 0x7fc7c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:26.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.754+0000 7fc7e9373640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc7c806ae40 0x7fc7c806d300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0007fd0 tx=0x7fc7e0007980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:26.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.757+0000 7fc7d9ffb640 1 -- 172.21.15.84:0/4136292279 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7d4054c60 con 0x7fc7e40ce550 2023-12-12T09:23:26.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.948+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7e406e3b0 con 0x7fc7e40ce550 2023-12-12T09:23:26.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.951+0000 7fc7d9ffb640 1 -- 172.21.15.84:0/4136292279 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7fc7d4058280 con 0x7fc7e40ce550 2023-12-12T09:23:26.952 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:26.952 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:26.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc7c806ae40 msgr2=0x7fc7c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:26.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc7c806ae40 0x7fc7c806d300 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0007fd0 tx=0x7fc7e0007980 comp rx=0 tx=0).stop 2023-12-12T09:23:26.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 msgr2=0x7fc7e40ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:26.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40ab8e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400d800 tx=0x7fc7d400dcc0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 shutdown_connections 2023-12-12T09:23:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7e4143d20 0x7fc7e415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc7c806ae40 0x7fc7c806d300 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7e40ce550 0x7fc7e40ab8e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 --2- 172.21.15.84:0/4136292279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc7e40b47e0 0x7fc7e413f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 >> 172.21.15.84:0/4136292279 conn(0x7fc7e406c3d0 msgr2=0x7fc7e4070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 shutdown_connections 2023-12-12T09:23:26.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:26.954+0000 7fc7eb5d7640 1 -- 172.21.15.84:0/4136292279 wait complete. 2023-12-12T09:23:26.975 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:22:47.550419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:22:48.743328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:23:26.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:23:27.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.197+0000 7f130b59e640 1 Processor -- start 2023-12-12T09:23:27.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.197+0000 7f130b59e640 1 -- start start 2023-12-12T09:23:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130b59e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f130c15cef0 0x7f130c06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130b59e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f130c0b2f70 0x7f130c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130b59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c06cf80 0x7f130c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130b59e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0b21b0 con 0x7f130c15cef0 2023-12-12T09:23:27.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130b59e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0b2490 con 0x7f130c0b2f70 2023-12-12T09:23:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130b59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0b2770 con 0x7f130c06cf80 2023-12-12T09:23:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130a59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f130c15cef0 0x7f130c06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130a59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f130c15cef0 0x7f130c06ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33038/0 (socket says 172.21.15.84:33038) 2023-12-12T09:23:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130a59c640 1 -- 172.21.15.84:0/1556428358 learned_addr learned my addr 172.21.15.84:0/1556428358 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130a59c640 1 -- 172.21.15.84:0/1556428358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c06cf80 msgr2=0x7f130c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:27.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130a59c640 1 --2- 172.21.15.84:0/1556428358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c06cf80 0x7f130c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130a59c640 1 -- 172.21.15.84:0/1556428358 >> v2:172.21.15.99:3300/0 conn(0x7f130c0b2f70 msgr2=0x7f130c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:27.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f1309d9b640 1 --2- 172.21.15.84:0/1556428358 >> v2:172.21.15.99:3300/0 conn(0x7f130c0b2f70 0x7f130c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.199+0000 7f130a59c640 1 --2- 172.21.15.84:0/1556428358 >> v2:172.21.15.99:3300/0 conn(0x7f130c0b2f70 0x7f130c0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.200+0000 7f130a59c640 1 -- 172.21.15.84:0/1556428358 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0b2a50 con 0x7f130c15cef0 2023-12-12T09:23:27.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.201+0000 7f130a59c640 1 --2- 172.21.15.84:0/1556428358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c06ca40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009870 tx=0x7f12fc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c501d01ce03a9e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.201+0000 7f130959a640 1 -- 172.21.15.84:0/1556428358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0317c0 con 0x7f130c15cef0 2023-12-12T09:23:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.201+0000 7f130959a640 1 -- 172.21.15.84:0/1556428358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc031920 con 0x7f130c15cef0 2023-12-12T09:23:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.201+0000 7f130959a640 1 -- 172.21.15.84:0/1556428358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc031cb0 con 0x7f130c15cef0 2023-12-12T09:23:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 -- 172.21.15.84:0/1556428358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 msgr2=0x7f130c06ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 --2- 172.21.15.84:0/1556428358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c06ca40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009870 tx=0x7f12fc02b860 comp rx=0 tx=0).stop 2023-12-12T09:23:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 -- 172.21.15.84:0/1556428358 shutdown_connections 2023-12-12T09:23:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 --2- 172.21.15.84:0/1556428358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c06cf80 0x7f130c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 --2- 172.21.15.84:0/1556428358 >> v2:172.21.15.99:3300/0 conn(0x7f130c0b2f70 0x7f130c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 --2- 172.21.15.84:0/1556428358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c06ca40 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 -- 172.21.15.84:0/1556428358 >> 172.21.15.84:0/1556428358 conn(0x7f130c06a920 msgr2=0x7f130c06ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:27.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 -- 172.21.15.84:0/1556428358 shutdown_connections 2023-12-12T09:23:27.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.202+0000 7f130b59e640 1 -- 172.21.15.84:0/1556428358 wait complete. 2023-12-12T09:23:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.204+0000 7f130b59e640 1 Processor -- start 2023-12-12T09:23:27.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.204+0000 7f130b59e640 1 -- start start 2023-12-12T09:23:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130b59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f130c06cf80 0x7f130c153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130b59e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c0b2f70 0x7f130c150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130b59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c1465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130b59e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1536c0 con 0x7f130c15cef0 2023-12-12T09:23:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130b59e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c1f7370 con 0x7f130c06cf80 2023-12-12T09:23:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130b59e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c155f40 con 0x7f130c0b2f70 2023-12-12T09:23:27.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c1465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c1465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33048/0 (socket says 172.21.15.84:33048) 2023-12-12T09:23:27.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130ad9d640 1 -- 172.21.15.84:0/3502200657 learned_addr learned my addr 172.21.15.84:0/3502200657 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f130a59c640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f130c06cf80 0x7f130c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.205+0000 7f1309d9b640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c0b2f70 0x7f130c150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130ad9d640 1 -- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c0b2f70 msgr2=0x7f130c150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130ad9d640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c0b2f70 0x7f130c150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130ad9d640 1 -- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f130c06cf80 msgr2=0x7f130c153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130ad9d640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f130c06cf80 0x7f130c153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130ad9d640 1 -- 172.21.15.84:0/3502200657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc0094d0 con 0x7f130c15cef0 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f1309d9b640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c0b2f70 0x7f130c150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:27.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130a59c640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f130c06cf80 0x7f130c153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130ad9d640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c1465b0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f130400b9e0 tx=0x7f130400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f12faffd640 1 -- 172.21.15.84:0/3502200657 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400cb20 con 0x7f130c15cef0 2023-12-12T09:23:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f12faffd640 1 -- 172.21.15.84:0/3502200657 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130400cc80 con 0x7f130c15cef0 2023-12-12T09:23:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f12faffd640 1 -- 172.21.15.84:0/3502200657 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304014680 con 0x7f130c15cef0 2023-12-12T09:23:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c150d60 con 0x7f130c15cef0 2023-12-12T09:23:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.206+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c155650 con 0x7f130c15cef0 2023-12-12T09:23:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.208+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c06dbb0 con 0x7f130c15cef0 2023-12-12T09:23:27.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.208+0000 7f12faffd640 1 -- 172.21.15.84:0/3502200657 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f130401d3b0 con 0x7f130c15cef0 2023-12-12T09:23:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.210+0000 7f12faffd640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f12ec06ae70 0x7f12ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.210+0000 7f12faffd640 1 -- 172.21.15.84:0/3502200657 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1304089630 con 0x7f130c15cef0 2023-12-12T09:23:27.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.210+0000 7f130a59c640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f12ec06ae70 0x7f12ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.211+0000 7f130a59c640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f12ec06ae70 0x7f12ec06d330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f12fc036000 tx=0x7f12fc03d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:27.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.215+0000 7f12faffd640 1 -- 172.21.15.84:0/3502200657 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13040545a0 con 0x7f130c15cef0 2023-12-12T09:23:27.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.412+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f130c0673c0 con 0x7f130c15cef0 2023-12-12T09:23:27.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.413+0000 7f12faffd640 1 -- 172.21.15.84:0/3502200657 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1304019020 con 0x7f130c15cef0 2023-12-12T09:23:27.413 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:23:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.415+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f12ec06ae70 msgr2=0x7f12ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.415+0000 7f130b59e640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f12ec06ae70 0x7f12ec06d330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f12fc036000 tx=0x7f12fc03d040 comp rx=0 tx=0).stop 2023-12-12T09:23:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.415+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 msgr2=0x7f130c1465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.415+0000 7f130b59e640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c1465b0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f130400b9e0 tx=0x7f130400bea0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.416+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 shutdown_connections 2023-12-12T09:23:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.416+0000 7f130b59e640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f12ec06ae70 0x7f12ec06d330 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.416+0000 7f130b59e640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f130c15cef0 0x7f130c1465b0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.416+0000 7f130b59e640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f130c0b2f70 0x7f130c150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.416+0000 7f130b59e640 1 --2- 172.21.15.84:0/3502200657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f130c06cf80 0x7f130c153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.416+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 >> 172.21.15.84:0/3502200657 conn(0x7f130c06a920 msgr2=0x7f130c0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:27.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.416+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 shutdown_connections 2023-12-12T09:23:27.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.416+0000 7f130b59e640 1 -- 172.21.15.84:0/3502200657 wait complete. 2023-12-12T09:23:27.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:23:27.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.650+0000 7f7e012da640 1 Processor -- start 2023-12-12T09:23:27.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.651+0000 7f7e012da640 1 -- start start 2023-12-12T09:23:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.652+0000 7f7e012da640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc15b0e0 0x7f7dfc0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.652+0000 7f7e012da640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0ccaf0 0x7f7dfc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.652+0000 7f7e012da640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dfc0cc660 con 0x7f7dfc0ce550 2023-12-12T09:23:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.652+0000 7f7e012da640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dfc0cbd30 con 0x7f7dfc0ccaf0 2023-12-12T09:23:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.652+0000 7f7e012da640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc0cc010 con 0x7f7dfc15b0e0 2023-12-12T09:23:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.652+0000 7f7dfa7fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0ccaf0 0x7f7dfc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.652+0000 7f7dfa7fc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7dfc0ccaf0 0x7f7dfc0cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33054/0 (socket says 172.21.15.84:33054) 2023-12-12T09:23:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.652+0000 7f7dfa7fc640 1 -- 172.21.15.84:0/151499006 learned_addr learned my addr 172.21.15.84:0/151499006 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.653+0000 7f7dfaffd640 1 --2- 172.21.15.84:0/151499006 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc15b0e0 0x7f7dfc0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.653+0000 7f7dfa7fc640 1 -- 172.21.15.84:0/151499006 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc15b0e0 msgr2=0x7f7dfc0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.653+0000 7f7dfa7fc640 1 --2- 172.21.15.84:0/151499006 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc15b0e0 0x7f7dfc0cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.653+0000 7f7dfa7fc640 1 -- 172.21.15.84:0/151499006 >> v1:172.21.15.99:6789/0 conn(0x7f7dfc0ce550 legacy=0x7f7dfc06f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.653+0000 7f7dfa7fc640 1 -- 172.21.15.84:0/151499006 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc0cc2f0 con 0x7f7dfc0ccaf0 2023-12-12T09:23:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.654+0000 7f7dfa7fc640 1 --2- 172.21.15.84:0/151499006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ccaf0 0x7f7dfc0cf420 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009e50 tx=0x7f7dec02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65038d1c046aae7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7df9ffb640 1 -- 172.21.15.84:0/151499006 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec02cb00 con 0x7f7dfc0ccaf0 2023-12-12T09:23:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7df9ffb640 1 -- 172.21.15.84:0/151499006 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec02cc60 con 0x7f7dfc0ccaf0 2023-12-12T09:23:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7df9ffb640 1 -- 172.21.15.84:0/151499006 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0343f0 con 0x7f7dfc0ccaf0 2023-12-12T09:23:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7e012da640 1 -- 172.21.15.84:0/151499006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ccaf0 msgr2=0x7f7dfc0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7e012da640 1 --2- 172.21.15.84:0/151499006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ccaf0 0x7f7dfc0cf420 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009e50 tx=0x7f7dec02bf60 comp rx=0 tx=0).stop 2023-12-12T09:23:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7e012da640 1 -- 172.21.15.84:0/151499006 shutdown_connections 2023-12-12T09:23:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7e012da640 1 --2- 172.21.15.84:0/151499006 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ccaf0 0x7f7dfc0cf420 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7e012da640 1 --2- 172.21.15.84:0/151499006 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc15b0e0 0x7f7dfc0cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.655+0000 7f7e012da640 1 -- 172.21.15.84:0/151499006 >> 172.21.15.84:0/151499006 conn(0x7f7dfc0b29b0 msgr2=0x7f7dfc0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.656+0000 7f7e012da640 1 -- 172.21.15.84:0/151499006 shutdown_connections 2023-12-12T09:23:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.656+0000 7f7e012da640 1 -- 172.21.15.84:0/151499006 wait complete. 2023-12-12T09:23:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.657+0000 7f7e012da640 1 Processor -- start 2023-12-12T09:23:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.658+0000 7f7e012da640 1 -- start start 2023-12-12T09:23:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.658+0000 7f7e012da640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc0ccaf0 0x7f7dfc14da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.658+0000 7f7e012da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ce550 0x7f7dfc06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7e012da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc15b0e0 0x7f7dfc14b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7e012da640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc14e660 con 0x7f7dfc0ce550 2023-12-12T09:23:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7e012da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc06c670 con 0x7f7dfc15b0e0 2023-12-12T09:23:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7e012da640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc0ca920 con 0x7f7dfc0ccaf0 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfa7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ce550 0x7f7dfc06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfa7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ce550 0x7f7dfc06cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33062/0 (socket says 172.21.15.84:33062) 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfa7fc640 1 -- 172.21.15.84:0/945771934 learned_addr learned my addr 172.21.15.84:0/945771934 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfaffd640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc0ccaf0 0x7f7dfc14da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfb7fe640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc15b0e0 0x7f7dfc14b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfa7fc640 1 -- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc0ccaf0 msgr2=0x7f7dfc14da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfa7fc640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc0ccaf0 0x7f7dfc14da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfa7fc640 1 -- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc15b0e0 msgr2=0x7f7dfc14b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfa7fc640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc15b0e0 0x7f7dfc14b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfa7fc640 1 -- 172.21.15.84:0/945771934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec009b30 con 0x7f7dfc0ce550 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.659+0000 7f7dfb7fe640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc15b0e0 0x7f7dfc14b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.660+0000 7f7dfa7fc640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ce550 0x7f7dfc06cb00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7dec000f80 tx=0x7f7dec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.660+0000 7f7df37fe640 1 -- 172.21.15.84:0/945771934 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec009510 con 0x7f7dfc0ce550 2023-12-12T09:23:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.660+0000 7f7df37fe640 1 -- 172.21.15.84:0/945771934 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec03e450 con 0x7f7dfc0ce550 2023-12-12T09:23:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.660+0000 7f7df37fe640 1 -- 172.21.15.84:0/945771934 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec03e800 con 0x7f7dfc0ce550 2023-12-12T09:23:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.660+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dfc0cac00 con 0x7f7dfc0ce550 2023-12-12T09:23:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.660+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dfc06bff0 con 0x7f7dfc0ce550 2023-12-12T09:23:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.661+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dfc0d09e0 con 0x7f7dfc0ce550 2023-12-12T09:23:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.662+0000 7f7df37fe640 1 -- 172.21.15.84:0/945771934 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7dec03e960 con 0x7f7dfc0ce550 2023-12-12T09:23:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.663+0000 7f7df37fe640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ddc06ae40 0x7f7ddc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.663+0000 7f7df37fe640 1 -- 172.21.15.84:0/945771934 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7dec0ac5a0 con 0x7f7dfc0ce550 2023-12-12T09:23:27.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.663+0000 7f7dfaffd640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ddc06ae40 0x7f7ddc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:27.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.664+0000 7f7dfaffd640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ddc06ae40 0x7f7ddc06d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7de4006fd0 tx=0x7f7de4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:27.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.667+0000 7f7df37fe640 1 -- 172.21.15.84:0/945771934 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7dec077470 con 0x7f7dfc0ce550 2023-12-12T09:23:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.860+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7dfc06b030 con 0x7f7dfc0ce550 2023-12-12T09:23:27.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.861+0000 7f7df37fe640 1 -- 172.21.15.84:0/945771934 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7dec07aa90 con 0x7f7dfc0ce550 2023-12-12T09:23:27.862 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:23:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ddc06ae40 msgr2=0x7f7ddc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ddc06ae40 0x7f7ddc06d300 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7de4006fd0 tx=0x7f7de4008040 comp rx=0 tx=0).stop 2023-12-12T09:23:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ce550 msgr2=0x7f7dfc06cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ce550 0x7f7dfc06cb00 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7dec000f80 tx=0x7f7dec004a40 comp rx=0 tx=0).stop 2023-12-12T09:23:27.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 shutdown_connections 2023-12-12T09:23:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7dfc15b0e0 0x7f7dfc14b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7ddc06ae40 0x7f7ddc06d300 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dfc0ce550 0x7f7dfc06cb00 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 --2- 172.21.15.84:0/945771934 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7dfc0ccaf0 0x7f7dfc14da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 >> 172.21.15.84:0/945771934 conn(0x7f7dfc0b29b0 msgr2=0x7f7dfc1572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 shutdown_connections 2023-12-12T09:23:27.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:27.864+0000 7f7e012da640 1 -- 172.21.15.84:0/945771934 wait complete. 2023-12-12T09:23:27.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:23:28.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.096+0000 7fc5fed01640 1 Processor -- start 2023-12-12T09:23:28.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.096+0000 7fc5fed01640 1 -- start start 2023-12-12T09:23:28.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.098+0000 7fc5fed01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5f80b4560 0x7fc5f80b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.098+0000 7fc5fed01640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc5f815d810 0x7fc5f80b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.098+0000 7fc5fed01640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f80b30a0 con 0x7fc5f806d5e0 2023-12-12T09:23:28.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.098+0000 7fc5fed01640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f815e8a0 con 0x7fc5f815d810 2023-12-12T09:23:28.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.098+0000 7fc5fed01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80b4e80 con 0x7fc5f80b4560 2023-12-12T09:23:28.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.098+0000 7fc5fd29e640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc5f806d5e0 0x7fc5f8070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34170/0 (socket says 172.21.15.84:34170) 2023-12-12T09:23:28.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.098+0000 7fc5fd29e640 1 -- 172.21.15.84:0/1636275497 learned_addr learned my addr 172.21.15.84:0/1636275497 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5fca9d640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5f80b4560 0x7fc5f80b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f7fff640 1 --2- 172.21.15.84:0/1636275497 >> v2:172.21.15.99:3300/0 conn(0x7fc5f815d810 0x7fc5f80b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877886105 0 0) 0x7fc5f80b30a0 con 0x7fc5f806d5e0 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e8003520 con 0x7fc5f806d5e0 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3840404328 0 0) 0x7fc5e8003520 con 0x7fc5f806d5e0 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5f80b4560 msgr2=0x7fc5f80b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5f80b4560 0x7fc5f80b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 >> v2:172.21.15.99:3300/0 conn(0x7fc5f815d810 msgr2=0x7fc5f80b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 --2- 172.21.15.84:0/1636275497 >> v2:172.21.15.99:3300/0 conn(0x7fc5f815d810 0x7fc5f80b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f815dc90 con 0x7fc5f806d5e0 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fc5f00019f0 con 0x7fc5f806d5e0 2023-12-12T09:23:28.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 >> v1:172.21.15.84:6789/0 conn(0x7fc5f806d5e0 legacy=0x7fc5f8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.099+0000 7fc5f77fe640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5f80b4560 0x7fc5e8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5f77fe640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e8003ef0 0x7fc5e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5f77fe640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5e8004d00 0x7fc5e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f815e8a0 con 0x7fc5e8004d00 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80b4e80 con 0x7fc5e8003ef0 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e800b9d0 con 0x7fc5f80b4560 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5fd29e640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5e8004d00 0x7fc5e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5f7fff640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e8003ef0 0x7fc5e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5fca9d640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5f80b4560 0x7fc5e8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5fd29e640 1 -- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5f80b4560 msgr2=0x7fc5e8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5fd29e640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5f80b4560 0x7fc5e8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5fd29e640 1 -- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e8003ef0 msgr2=0x7fc5e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:28.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5fd29e640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e8003ef0 0x7fc5e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5fd29e640 1 -- 172.21.15.84:0/1636275497 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e8003520 con 0x7fc5e8004d00 2023-12-12T09:23:28.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.100+0000 7fc5f7fff640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5e8003ef0 0x7fc5e80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.101+0000 7fc5fd29e640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5e8004d00 0x7fc5e8005180 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000a890 tx=0x7fc5e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a91ab7b5915e47 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0034630 con 0x7fc5e8004d00 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f002f070 con 0x7fc5e8004d00 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5f77fe640 1 -- 172.21.15.84:0/1636275497 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0034a30 con 0x7fc5e8004d00 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5fed01640 1 -- 172.21.15.84:0/1636275497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5e8004d00 msgr2=0x7fc5e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5fed01640 1 --2- 172.21.15.84:0/1636275497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5e8004d00 0x7fc5e8005180 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000a890 tx=0x7fc5e80057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5fd29e640 1 -- 172.21.15.84:0/1636275497 reap_dead start 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5fed01640 1 -- 172.21.15.84:0/1636275497 shutdown_connections 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5fed01640 1 -- 172.21.15.84:0/1636275497 >> 172.21.15.84:0/1636275497 conn(0x7fc5f80b0ac0 msgr2=0x7fc5f80b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5fed01640 1 -- 172.21.15.84:0/1636275497 shutdown_connections 2023-12-12T09:23:28.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.102+0000 7fc5fed01640 1 -- 172.21.15.84:0/1636275497 wait complete. 2023-12-12T09:23:28.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.104+0000 7fc5fed01640 1 Processor -- start 2023-12-12T09:23:28.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.104+0000 7fc5fed01640 1 -- start start 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.105+0000 7fc5fed01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e8004d00 0x7fc5f813a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.105+0000 7fc5fed01640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f814fdb0 0x7fc5f8153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.105+0000 7fc5fed01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8153870 0x7fc5f81541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.105+0000 7fc5fed01640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8153d00 con 0x7fc5f814fdb0 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.105+0000 7fc5fed01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8150270 con 0x7fc5f8153870 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.105+0000 7fc5fed01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8152c90 con 0x7fc5e8004d00 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f814fdb0 0x7fc5f8153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f814fdb0 0x7fc5f8153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33068/0 (socket says 172.21.15.84:33068) 2023-12-12T09:23:28.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 -- 172.21.15.84:0/2115938748 learned_addr learned my addr 172.21.15.84:0/2115938748 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5fca9d640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e8004d00 0x7fc5f813a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5fd29e640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8153870 0x7fc5f81541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 -- 172.21.15.84:0/2115938748 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e8004d00 msgr2=0x7fc5f813a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e8004d00 0x7fc5f813a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 -- 172.21.15.84:0/2115938748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8153870 msgr2=0x7fc5f81541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8153870 0x7fc5f81541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 -- 172.21.15.84:0/2115938748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8152f70 con 0x7fc5f814fdb0 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.106+0000 7fc5f7fff640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f814fdb0 0x7fc5f8153330 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40109a0 tx=0x7fc5e4010e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.107+0000 7fc5f57fa640 1 -- 172.21.15.84:0/2115938748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e400ec20 con 0x7fc5f814fdb0 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.107+0000 7fc5f57fa640 1 -- 172.21.15.84:0/2115938748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e400ed80 con 0x7fc5f814fdb0 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.107+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f813acc0 con 0x7fc5f814fdb0 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.107+0000 7fc5f57fa640 1 -- 172.21.15.84:0/2115938748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e401c620 con 0x7fc5f814fdb0 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.107+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f8154710 con 0x7fc5f814fdb0 2023-12-12T09:23:28.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.108+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f8153e70 con 0x7fc5f814fdb0 2023-12-12T09:23:28.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.109+0000 7fc5f57fa640 1 -- 172.21.15.84:0/2115938748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5e401c780 con 0x7fc5f814fdb0 2023-12-12T09:23:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.110+0000 7fc5f57fa640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc5dc06ae70 0x7fc5dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.110+0000 7fc5f57fa640 1 -- 172.21.15.84:0/2115938748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc5e4089d60 con 0x7fc5f814fdb0 2023-12-12T09:23:28.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.110+0000 7fc5fca9d640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc5dc06ae70 0x7fc5dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.111+0000 7fc5fca9d640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc5dc06ae70 0x7fc5dc06d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009950 tx=0x7fc5ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:28.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.114+0000 7fc5f57fa640 1 -- 172.21.15.84:0/2115938748 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5e4054cc0 con 0x7fc5f814fdb0 2023-12-12T09:23:28.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.306+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5f80673c0 con 0x7fc5f814fdb0 2023-12-12T09:23:28.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.307+0000 7fc5f57fa640 1 -- 172.21.15.84:0/2115938748 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5e40582e0 con 0x7fc5f814fdb0 2023-12-12T09:23:28.308 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc5dc06ae70 msgr2=0x7fc5dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc5dc06ae70 0x7fc5dc06d330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec009950 tx=0x7fc5ec008040 comp rx=0 tx=0).stop 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f814fdb0 msgr2=0x7fc5f8153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f814fdb0 0x7fc5f8153330 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40109a0 tx=0x7fc5e4010e60 comp rx=0 tx=0).stop 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 shutdown_connections 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f8153870 0x7fc5f81541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc5dc06ae70 0x7fc5dc06d330 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5f814fdb0 0x7fc5f8153330 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 --2- 172.21.15.84:0/2115938748 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc5e8004d00 0x7fc5f813a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 >> 172.21.15.84:0/2115938748 conn(0x7fc5f80b0ac0 msgr2=0x7fc5f8156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:28.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 shutdown_connections 2023-12-12T09:23:28.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.310+0000 7fc5fed01640 1 -- 172.21.15.84:0/2115938748 wait complete. 2023-12-12T09:23:28.330 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T09:23:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.542+0000 7f5983de5640 1 Processor -- start 2023-12-12T09:23:28.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.543+0000 7f5983de5640 1 -- start start 2023-12-12T09:23:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.544+0000 7f5983de5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0ce330 0x7f597c13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.544+0000 7f5983de5640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c140270 con 0x7f597c071bb0 2023-12-12T09:23:28.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.544+0000 7f5983de5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c0cd850 con 0x7f597c0ce790 2023-12-12T09:23:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.544+0000 7f5983de5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0cdb30 con 0x7f597c0ce330 2023-12-12T09:23:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.544+0000 7f5981b81640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f597c071bb0 0x7f597c071f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34182/0 (socket says 172.21.15.84:34182) 2023-12-12T09:23:28.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.544+0000 7f5981b81640 1 -- 172.21.15.84:0/1840576358 learned_addr learned my addr 172.21.15.84:0/1840576358 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5981380640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0ce330 0x7f597c13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040294713 0 0) 0x7f597c140270 con 0x7f597c071bb0 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5968003520 con 0x7f597c071bb0 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3638481133 0 0) 0x7f5968003520 con 0x7f597c071bb0 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0ce330 msgr2=0x7f597c13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0ce330 0x7f597c13d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 >> v1:172.21.15.99:6789/0 conn(0x7f597c0ce790 legacy=0x7f597c13f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0cde10 con 0x7f597c071bb0 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f5978001670 con 0x7f597c071bb0 2023-12-12T09:23:28.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 >> v1:172.21.15.84:6789/0 conn(0x7f597c071bb0 legacy=0x7f597c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f5968003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0ce330 0x7f59680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5968004d00 0x7f5968005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0cdb30 con 0x7f59680039a0 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596800ba60 con 0x7f5968004d00 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.545+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596800de30 con 0x7f597c0ce330 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.546+0000 7f5981b81640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f5968003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.546+0000 7f5981b81640 1 -- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0ce330 msgr2=0x7f59680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.546+0000 7f5981380640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0ce330 0x7f59680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.546+0000 7f5981b81640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0ce330 0x7f59680047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.546+0000 7f5982382640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5968004d00 0x7f5968005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.546+0000 7f5981b81640 1 -- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5968004d00 msgr2=0x7f5968005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.546+0000 7f5981b81640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5968004d00 0x7f5968005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.546+0000 7f5981b81640 1 -- 172.21.15.84:0/1840576358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968003520 con 0x7f59680039a0 2023-12-12T09:23:28.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.547+0000 7f5981b81640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f5968003dc0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f597800c210 tx=0x7f59680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2e89d689fd3dc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.547+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978005ad0 con 0x7f59680039a0 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.547+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5978005c50 con 0x7f59680039a0 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.547+0000 7f5980b7f640 1 -- 172.21.15.84:0/1840576358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597802c890 con 0x7f59680039a0 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.548+0000 7f5983de5640 1 -- 172.21.15.84:0/1840576358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 msgr2=0x7f5968003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.548+0000 7f5983de5640 1 --2- 172.21.15.84:0/1840576358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f5968003dc0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f597800c210 tx=0x7f59680057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.548+0000 7f5982382640 1 -- 172.21.15.84:0/1840576358 reap_dead start 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.548+0000 7f5983de5640 1 -- 172.21.15.84:0/1840576358 shutdown_connections 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.548+0000 7f5983de5640 1 -- 172.21.15.84:0/1840576358 >> 172.21.15.84:0/1840576358 conn(0x7f597c06c3d0 msgr2=0x7f597c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.548+0000 7f5983de5640 1 -- 172.21.15.84:0/1840576358 shutdown_connections 2023-12-12T09:23:28.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.548+0000 7f5983de5640 1 -- 172.21.15.84:0/1840576358 wait complete. 2023-12-12T09:23:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.550+0000 7f5983de5640 1 Processor -- start 2023-12-12T09:23:28.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.550+0000 7f5983de5640 1 -- start start 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5983de5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f597c0ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5983de5640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0a8480 0x7f597c0aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5983de5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597c0ab0f0 0x7f597c138810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5983de5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c1383f0 con 0x7f59680039a0 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5983de5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0ab570 con 0x7f597c0ab0f0 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5983de5640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c12a1a0 con 0x7f597c0a8480 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5981b81640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f597c0ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5981b81640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f597c0ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33094/0 (socket says 172.21.15.84:33094) 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.551+0000 7f5981b81640 1 -- 172.21.15.84:0/1502148245 learned_addr learned my addr 172.21.15.84:0/1502148245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f5982382640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597c0ab0f0 0x7f597c138810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f5981380640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0a8480 0x7f597c0aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f5981b81640 1 -- 172.21.15.84:0/1502148245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0a8480 msgr2=0x7f597c0aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f5981b81640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0a8480 0x7f597c0aabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f5981b81640 1 -- 172.21.15.84:0/1502148245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597c0ab0f0 msgr2=0x7f597c138810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f5981b81640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597c0ab0f0 0x7f597c138810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f5981b81640 1 -- 172.21.15.84:0/1502148245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0adc90 con 0x7f59680039a0 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f5981b81640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f597c0ad6b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f597802c430 tx=0x7f5978001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.552+0000 7f59727fc640 1 -- 172.21.15.84:0/1502148245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978039070 con 0x7f59680039a0 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.553+0000 7f59727fc640 1 -- 172.21.15.84:0/1502148245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597802dd30 con 0x7f59680039a0 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.553+0000 7f59727fc640 1 -- 172.21.15.84:0/1502148245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597803c040 con 0x7f59680039a0 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.553+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c0adf70 con 0x7f59680039a0 2023-12-12T09:23:28.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.553+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c137a30 con 0x7f59680039a0 2023-12-12T09:23:28.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.554+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c138660 con 0x7f59680039a0 2023-12-12T09:23:28.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.555+0000 7f59727fc640 1 -- 172.21.15.84:0/1502148245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5978032070 con 0x7f59680039a0 2023-12-12T09:23:28.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.556+0000 7f59727fc640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f596006ae40 0x7f596006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:28.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.556+0000 7f59727fc640 1 -- 172.21.15.84:0/1502148245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f59780aa990 con 0x7f59680039a0 2023-12-12T09:23:28.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.556+0000 7f5981380640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f596006ae40 0x7f596006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:28.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.557+0000 7f5981380640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f596006ae40 0x7f596006d300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f597c1371f0 tx=0x7f596c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:28.560 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.560+0000 7f59727fc640 1 -- 172.21.15.84:0/1502148245 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5978075900 con 0x7f59680039a0 2023-12-12T09:23:28.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:23:28.665 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:23:28.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.763+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f597c06fcf0 con 0x7f59680039a0 2023-12-12T09:23:28.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.764+0000 7f59727fc640 1 -- 172.21.15.84:0/1502148245 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5978046070 con 0x7f59680039a0 2023-12-12T09:23:28.764 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-12-12T09:23:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f596006ae40 msgr2=0x7f596006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f596006ae40 0x7f596006d300 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f597c1371f0 tx=0x7f596c008040 comp rx=0 tx=0).stop 2023-12-12T09:23:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 msgr2=0x7f597c0ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:28.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f597c0ad6b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f597802c430 tx=0x7f5978001a00 comp rx=0 tx=0).stop 2023-12-12T09:23:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 shutdown_connections 2023-12-12T09:23:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f597c0ab0f0 0x7f597c138810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f597c0a8480 0x7f597c0aabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f596006ae40 0x7f596006d300 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 --2- 172.21.15.84:0/1502148245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59680039a0 0x7f597c0ad6b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 >> 172.21.15.84:0/1502148245 conn(0x7f597c06c3d0 msgr2=0x7f597c0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 shutdown_connections 2023-12-12T09:23:28.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:28.767+0000 7f5983de5640 1 -- 172.21.15.84:0/1502148245 wait complete. 2023-12-12T09:23:28.785 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-12-12T09:23:28.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:28.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-12T09:23:28.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[112334]: fuse finished with error 0 and tester_r 0 2023-12-12T09:23:28.925 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:23:28.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:28.925 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T09:23:29.074 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:23:29.074 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:29.134 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T09:23:29.134 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:23:29.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:29.134 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T09:23:29.184 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-12T09:23:29.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:23:29.186 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:23:29.186 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:29.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T09:23:29.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:23:29.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:29.246 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-12T09:23:29.301 INFO:teuthology.orchestra.run.smithi084.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-12T09:23:29.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:23:29.302 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:23:29.302 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:29.361 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T09:23:29.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:23:29.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:29.362 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-12T09:23:29.408 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-12T09:23:29.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:23:29.409 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:23:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.632+0000 7f40e8d01640 1 Processor -- start 2023-12-12T09:23:29.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.632+0000 7f40e8d01640 1 -- start start 2023-12-12T09:23:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.633+0000 7f40e8d01640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40e4071bb0 0x7f40e4071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.633+0000 7f40e8d01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e413dae0 0x7f40e413f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.633+0000 7f40e8d01640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40724d0 con 0x7f40e40ce330 2023-12-12T09:23:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.633+0000 7f40e8d01640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e4140270 con 0x7f40e4071bb0 2023-12-12T09:23:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.633+0000 7f40e8d01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40cd850 con 0x7f40e413dae0 2023-12-12T09:23:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40dbfff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f40e40ce330 0x7f40e413d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34186/0 (socket says 172.21.15.84:34186) 2023-12-12T09:23:29.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40dbfff640 1 -- 172.21.15.84:0/2753175859 learned_addr learned my addr 172.21.15.84:0/2753175859 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e259c640 1 --2- 172.21.15.84:0/2753175859 >> v2:172.21.15.99:3300/0 conn(0x7f40e4071bb0 0x7f40e4071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e2d9d640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e413dae0 0x7f40e413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067746001 0 0) 0x7f40e40724d0 con 0x7f40e40ce330 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d0003520 con 0x7f40e40ce330 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514605816 0 0) 0x7f40d0003520 con 0x7f40e40ce330 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e413dae0 msgr2=0x7f40e413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e413dae0 0x7f40e413f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 >> v2:172.21.15.99:3300/0 conn(0x7f40e4071bb0 msgr2=0x7f40e4071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 --2- 172.21.15.84:0/2753175859 >> v2:172.21.15.99:3300/0 conn(0x7f40e4071bb0 0x7f40e4071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40cdb30 con 0x7f40e40ce330 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.634+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f40cc001670 con 0x7f40e40ce330 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 >> v1:172.21.15.84:6789/0 conn(0x7f40e40ce330 legacy=0x7f40e413d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e1d9b640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40d0003970 0x7f40d0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e1d9b640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004380 0x7f40d0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e1d9b640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40d0004f80 0x7f40d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4140270 con 0x7f40d0004f80 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40cd850 con 0x7f40d0004380 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d000bec0 con 0x7f40d0003970 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e2d9d640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40d0004f80 0x7f40d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e259c640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40d0003970 0x7f40d0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e2d9d640 1 -- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40d0003970 msgr2=0x7f40d0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e2d9d640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40d0003970 0x7f40d0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e2d9d640 1 -- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004380 msgr2=0x7f40d0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:29.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40dbfff640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004380 0x7f40d0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e2d9d640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004380 0x7f40d0004860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.635+0000 7f40e2d9d640 1 -- 172.21.15.84:0/2753175859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0003520 con 0x7f40d0004f80 2023-12-12T09:23:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.636+0000 7f40e2d9d640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40d0004f80 0x7f40d000b980 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007330 tx=0x7f40d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d96675884871ac server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc02cca0 con 0x7f40d0004f80 2023-12-12T09:23:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc02ce00 con 0x7f40d0004f80 2023-12-12T09:23:29.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e1d9b640 1 -- 172.21.15.84:0/2753175859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc034660 con 0x7f40d0004f80 2023-12-12T09:23:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e8d01640 1 -- 172.21.15.84:0/2753175859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40d0004f80 msgr2=0x7f40d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e8d01640 1 --2- 172.21.15.84:0/2753175859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40d0004f80 0x7f40d000b980 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007330 tx=0x7f40d00057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e2d9d640 1 -- 172.21.15.84:0/2753175859 reap_dead start 2023-12-12T09:23:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e8d01640 1 -- 172.21.15.84:0/2753175859 shutdown_connections 2023-12-12T09:23:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e8d01640 1 -- 172.21.15.84:0/2753175859 >> 172.21.15.84:0/2753175859 conn(0x7f40e406c3d0 msgr2=0x7f40e406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e8d01640 1 -- 172.21.15.84:0/2753175859 shutdown_connections 2023-12-12T09:23:29.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.637+0000 7f40e8d01640 1 -- 172.21.15.84:0/2753175859 wait complete. 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.639+0000 7f40e8d01640 1 Processor -- start 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.639+0000 7f40e8d01640 1 -- start start 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.640+0000 7f40e8d01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004f80 0x7f40e4130ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.640+0000 7f40e8d01640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e413b5d0 0x7f40e4155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.640+0000 7f40e8d01640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e412f4b0 0x7f40e4131540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.640+0000 7f40e8d01640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e412fe20 con 0x7f40e413b5d0 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.640+0000 7f40e8d01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4130100 con 0x7f40d0004f80 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.640+0000 7f40e8d01640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41303e0 con 0x7f40e412f4b0 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e413b5d0 0x7f40e4155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e413b5d0 0x7f40e4155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33120/0 (socket says 172.21.15.84:33120) 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 -- 172.21.15.84:0/3720443279 learned_addr learned my addr 172.21.15.84:0/3720443279 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:29.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40e259c640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004f80 0x7f40e4130ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40e2d9d640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e412f4b0 0x7f40e4131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 -- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e412f4b0 msgr2=0x7f40e4131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e412f4b0 0x7f40e4131540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 -- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004f80 msgr2=0x7f40e4130ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004f80 0x7f40e4130ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 -- 172.21.15.84:0/3720443279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e41306c0 con 0x7f40e413b5d0 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40e2d9d640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e412f4b0 0x7f40e4131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40e259c640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004f80 0x7f40e4130ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.641+0000 7f40dbfff640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e413b5d0 0x7f40e4155ff0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00d8e0 tx=0x7f40cc00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.642+0000 7f40daffd640 1 -- 172.21.15.84:0/3720443279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc007620 con 0x7f40e413b5d0 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.642+0000 7f40daffd640 1 -- 172.21.15.84:0/3720443279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc0047e0 con 0x7f40e413b5d0 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.642+0000 7f40daffd640 1 -- 172.21.15.84:0/3720443279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc004b90 con 0x7f40e413b5d0 2023-12-12T09:23:29.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.642+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e41309a0 con 0x7f40e413b5d0 2023-12-12T09:23:29.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.642+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e412f940 con 0x7f40e413b5d0 2023-12-12T09:23:29.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.643+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4130be0 con 0x7f40e413b5d0 2023-12-12T09:23:29.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.644+0000 7f40daffd640 1 -- 172.21.15.84:0/3720443279 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40cc004cf0 con 0x7f40e413b5d0 2023-12-12T09:23:29.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.645+0000 7f40daffd640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f40c406ae70 0x7f40c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:29.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.645+0000 7f40daffd640 1 -- 172.21.15.84:0/3720443279 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f40cc0892f0 con 0x7f40e413b5d0 2023-12-12T09:23:29.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.645+0000 7f40e259c640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f40c406ae70 0x7f40c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:29.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.646+0000 7f40e259c640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f40c406ae70 0x7f40c406d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f40d4006fd0 tx=0x7f40d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:29.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.649+0000 7f40daffd640 1 -- 172.21.15.84:0/3720443279 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40e4130be0 con 0x7f40e413b5d0 2023-12-12T09:23:29.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.880+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e412fbc0 con 0x7f40e413b5d0 2023-12-12T09:23:29.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.881+0000 7f40daffd640 1 -- 172.21.15.84:0/3720443279 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f40cc054250 con 0x7f40e413b5d0 2023-12-12T09:23:29.882 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:29.882 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1966836821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1966836821},{"type":"v1","addr":"172.21.15.99:6835","nonce":1966836821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/4165741100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":4165741100},{"type":"v1","addr":"172.21.15.99:6833","nonce":4165741100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3716664132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3716664132},{"type":"v1","addr":"172.21.15.84:6836","nonce":3716664132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:22:49.741201+0000","modified":"2023-12-12T09:22:52.822545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6237},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6237":{"gid":6237,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/3202590301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3202590301},{"type":"v1","addr":"172.21.15.84:6837","nonce":3202590301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:23:29.882 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-12-12T09:23:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f40c406ae70 msgr2=0x7f40c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f40c406ae70 0x7f40c406d330 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f40d4006fd0 tx=0x7f40d4008040 comp rx=0 tx=0).stop 2023-12-12T09:23:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e413b5d0 msgr2=0x7f40e4155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e413b5d0 0x7f40e4155ff0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00d8e0 tx=0x7f40cc00dda0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 shutdown_connections 2023-12-12T09:23:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f40e412f4b0 0x7f40e4131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f40c406ae70 0x7f40c406d330 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40e413b5d0 0x7f40e4155ff0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 --2- 172.21.15.84:0/3720443279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40d0004f80 0x7f40e4130ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.883+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 >> 172.21.15.84:0/3720443279 conn(0x7f40e406c3d0 msgr2=0x7f40e40b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.884+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 shutdown_connections 2023-12-12T09:23:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:29.884+0000 7f40e8d01640 1 -- 172.21.15.84:0/3720443279 wait complete. 2023-12-12T09:23:29.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.116+0000 7f6a4211d640 1 Processor -- start 2023-12-12T09:23:30.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.116+0000 7f6a4211d640 1 -- start start 2023-12-12T09:23:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.118+0000 7f6a4211d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6a3c13dae0 0x7f6a3c13f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.118+0000 7f6a4211d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c140270 con 0x7f6a3c0ce330 2023-12-12T09:23:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.118+0000 7f6a4211d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c0cd850 con 0x7f6a3c071bb0 2023-12-12T09:23:30.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.118+0000 7f6a4211d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c0cdb30 con 0x7f6a3c13dae0 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a32ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f6a3c0ce330 0x7f6a3c13d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34200/0 (socket says 172.21.15.84:34200) 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a32ffd640 1 -- 172.21.15.84:0/4117350277 learned_addr learned my addr 172.21.15.84:0/4117350277 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3bfff640 1 --2- 172.21.15.84:0/4117350277 >> v2:172.21.15.99:3300/0 conn(0x7f6a3c13dae0 0x7f6a3c13f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275352861 0 0) 0x7f6a3c140270 con 0x7f6a3c0ce330 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a28003520 con 0x7f6a3c0ce330 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2373348337 0 0) 0x7f6a28003520 con 0x7f6a3c0ce330 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 >> v2:172.21.15.99:3300/0 conn(0x7f6a3c13dae0 msgr2=0x7f6a3c13f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 --2- 172.21.15.84:0/4117350277 >> v2:172.21.15.99:3300/0 conn(0x7f6a3c13dae0 0x7f6a3c13f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 >> v1:172.21.15.99:6789/0 conn(0x7f6a3c071bb0 legacy=0x7f6a3c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0cde10 con 0x7f6a3c0ce330 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f6a24001670 con 0x7f6a3c0ce330 2023-12-12T09:23:30.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 >> v1:172.21.15.84:6789/0 conn(0x7f6a3c0ce330 legacy=0x7f6a3c13d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.119+0000 7f6a3affd640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a280039c0 0x7f6a28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3affd640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a280047c0 0x7f6a28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3affd640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a28005180 0x7f6a2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0cdb30 con 0x7f6a28005180 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2800c080 con 0x7f6a280047c0 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2800c240 con 0x7f6a280039c0 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3bfff640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a28005180 0x7f6a2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3b7fe640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a280039c0 0x7f6a28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3bfff640 1 -- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a280039c0 msgr2=0x7f6a28003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a32ffd640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a280047c0 0x7f6a28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3bfff640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a280039c0 0x7f6a28003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3bfff640 1 -- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a280047c0 msgr2=0x7f6a28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3bfff640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a280047c0 0x7f6a28004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3bfff640 1 -- 172.21.15.84:0/4117350277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28003520 con 0x7f6a28005180 2023-12-12T09:23:30.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.120+0000 7f6a3b7fe640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a280039c0 0x7f6a28003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.121+0000 7f6a3bfff640 1 -- 172.21.15.84:0/4117350277 reap_dead start 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.121+0000 7f6a3bfff640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a28005180 0x7f6a2800b980 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009a90 tx=0x7f6a280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a008d9a4ca06114 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3402c6b0 con 0x7f6a28005180 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3402c810 con 0x7f6a28005180 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a3affd640 1 -- 172.21.15.84:0/4117350277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3402cbc0 con 0x7f6a28005180 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a4211d640 1 -- 172.21.15.84:0/4117350277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a28005180 msgr2=0x7f6a2800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a4211d640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a28005180 0x7f6a2800b980 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009a90 tx=0x7f6a280057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a4211d640 1 -- 172.21.15.84:0/4117350277 shutdown_connections 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a4211d640 1 --2- 172.21.15.84:0/4117350277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a28005180 0x7f6a2800b980 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a4211d640 1 -- 172.21.15.84:0/4117350277 >> 172.21.15.84:0/4117350277 conn(0x7f6a3c06c3d0 msgr2=0x7f6a3c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:30.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a4211d640 1 -- 172.21.15.84:0/4117350277 shutdown_connections 2023-12-12T09:23:30.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.122+0000 7f6a4211d640 1 -- 172.21.15.84:0/4117350277 wait complete. 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.124+0000 7f6a4211d640 1 Processor -- start 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.124+0000 7f6a4211d640 1 -- start start 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.125+0000 7f6a4211d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a28005180 0x7f6a3c0adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.125+0000 7f6a4211d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c1549b0 0x7f6a3c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.125+0000 7f6a4211d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a3c0b4110 0x7f6a3c1f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.125+0000 7f6a4211d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c157910 con 0x7f6a3c1549b0 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.125+0000 7f6a4211d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c14e0d0 con 0x7f6a3c0b4110 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.125+0000 7f6a4211d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c157b60 con 0x7f6a28005180 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.125+0000 7f6a32ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c1549b0 0x7f6a3c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a32ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c1549b0 0x7f6a3c0b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33130/0 (socket says 172.21.15.84:33130) 2023-12-12T09:23:30.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a32ffd640 1 -- 172.21.15.84:0/164880329 learned_addr learned my addr 172.21.15.84:0/164880329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:30.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a32ffd640 1 -- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a28005180 msgr2=0x7f6a3c0adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a3b7fe640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a28005180 0x7f6a3c0adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a32ffd640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a28005180 0x7f6a3c0adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a3bfff640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a3c0b4110 0x7f6a3c1f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a32ffd640 1 -- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a3c0b4110 msgr2=0x7f6a3c1f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a32ffd640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a3c0b4110 0x7f6a3c1f4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a32ffd640 1 -- 172.21.15.84:0/164880329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c157e40 con 0x7f6a3c1549b0 2023-12-12T09:23:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a3b7fe640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a28005180 0x7f6a3c0adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:30.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.126+0000 7f6a32ffd640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c1549b0 0x7f6a3c0b3bd0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400d6f0 tx=0x7f6a2400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.127+0000 7f6a38ff9640 1 -- 172.21.15.84:0/164880329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240072e0 con 0x7f6a3c1549b0 2023-12-12T09:23:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.127+0000 7f6a38ff9640 1 -- 172.21.15.84:0/164880329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24007440 con 0x7f6a3c1549b0 2023-12-12T09:23:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.127+0000 7f6a38ff9640 1 -- 172.21.15.84:0/164880329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240047e0 con 0x7f6a3c1549b0 2023-12-12T09:23:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.127+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c158120 con 0x7f6a3c1549b0 2023-12-12T09:23:30.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.127+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c0ae100 con 0x7f6a3c1549b0 2023-12-12T09:23:30.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.128+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c0ae2f0 con 0x7f6a3c1549b0 2023-12-12T09:23:30.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.129+0000 7f6a38ff9640 1 -- 172.21.15.84:0/164880329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a24004940 con 0x7f6a3c1549b0 2023-12-12T09:23:30.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.130+0000 7f6a38ff9640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6a1c06ae70 0x7f6a1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.130+0000 7f6a38ff9640 1 -- 172.21.15.84:0/164880329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6a24089100 con 0x7f6a3c1549b0 2023-12-12T09:23:30.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.130+0000 7f6a3b7fe640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6a1c06ae70 0x7f6a1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.130+0000 7f6a3b7fe640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6a1c06ae70 0x7f6a1c06d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c13ccc0 tx=0x7f6a2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:30.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.134+0000 7f6a38ff9640 1 -- 172.21.15.84:0/164880329 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a24053fd0 con 0x7f6a3c1549b0 2023-12-12T09:23:30.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.331+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a3c0673c0 con 0x7f6a3c1549b0 2023-12-12T09:23:30.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.334+0000 7f6a38ff9640 1 -- 172.21.15.84:0/164880329 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7f6a240575f0 con 0x7f6a3c1549b0 2023-12-12T09:23:30.335 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6a1c06ae70 msgr2=0x7f6a1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6a1c06ae70 0x7f6a1c06d330 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c13ccc0 tx=0x7f6a2c009040 comp rx=0 tx=0).stop 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c1549b0 msgr2=0x7f6a3c0b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c1549b0 0x7f6a3c0b3bd0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400d6f0 tx=0x7f6a2400dbb0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 shutdown_connections 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a3c0b4110 0x7f6a3c1f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f6a1c06ae70 0x7f6a1c06d330 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a3c1549b0 0x7f6a3c0b3bd0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 --2- 172.21.15.84:0/164880329 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f6a28005180 0x7f6a3c0adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 >> 172.21.15.84:0/164880329 conn(0x7f6a3c06c3d0 msgr2=0x7f6a3c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.337+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 shutdown_connections 2023-12-12T09:23:30.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.338+0000 7f6a4211d640 1 -- 172.21.15.84:0/164880329 wait complete. 2023-12-12T09:23:30.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T09:19:35.147515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T09:22:47.550419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T09:22:48.743328+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T09:23:30.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T09:23:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.565+0000 7ff942116640 1 Processor -- start 2023-12-12T09:23:30.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.565+0000 7ff942116640 1 -- start start 2023-12-12T09:23:30.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.566+0000 7ff942116640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff93c143860 0x7ff93c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.566+0000 7ff942116640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff93c06db40 0x7ff93c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.567+0000 7ff942116640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c071c00 con 0x7ff93c0b4170 2023-12-12T09:23:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.567+0000 7ff942116640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c143c40 con 0x7ff93c143860 2023-12-12T09:23:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.567+0000 7ff942116640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93c0b4780 con 0x7ff93c06db40 2023-12-12T09:23:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.567+0000 7ff93b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff93c143860 0x7ff93c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.567+0000 7ff93b7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff93c143860 0x7ff93c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33140/0 (socket says 172.21.15.84:33140) 2023-12-12T09:23:30.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.567+0000 7ff93b7fe640 1 -- 172.21.15.84:0/159753029 learned_addr learned my addr 172.21.15.84:0/159753029 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.567+0000 7ff93bfff640 1 --2- 172.21.15.84:0/159753029 >> v2:172.21.15.99:3300/0 conn(0x7ff93c06db40 0x7ff93c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.568+0000 7ff93b7fe640 1 -- 172.21.15.84:0/159753029 >> v2:172.21.15.99:3300/0 conn(0x7ff93c06db40 msgr2=0x7ff93c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.568+0000 7ff93b7fe640 1 --2- 172.21.15.84:0/159753029 >> v2:172.21.15.99:3300/0 conn(0x7ff93c06db40 0x7ff93c0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.568+0000 7ff93b7fe640 1 -- 172.21.15.84:0/159753029 >> v1:172.21.15.99:6789/0 conn(0x7ff93c0b4170 legacy=0x7ff93c06d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.568+0000 7ff93b7fe640 1 -- 172.21.15.84:0/159753029 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0712d0 con 0x7ff93c143860 2023-12-12T09:23:30.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.569+0000 7ff93b7fe640 1 --2- 172.21.15.84:0/159753029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c143860 0x7ff93c0b3c30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0700d0 tx=0x7ff92c02dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c5ab3b69c5632e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:30.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.569+0000 7ff93a7fc640 1 -- 172.21.15.84:0/159753029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c02ed70 con 0x7ff93c143860 2023-12-12T09:23:30.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.569+0000 7ff93a7fc640 1 -- 172.21.15.84:0/159753029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c036440 con 0x7ff93c143860 2023-12-12T09:23:30.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.569+0000 7ff93a7fc640 1 -- 172.21.15.84:0/159753029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0367d0 con 0x7ff93c143860 2023-12-12T09:23:30.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.570+0000 7ff942116640 1 -- 172.21.15.84:0/159753029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c143860 msgr2=0x7ff93c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.570+0000 7ff942116640 1 --2- 172.21.15.84:0/159753029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c143860 0x7ff93c0b3c30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0700d0 tx=0x7ff92c02dfc0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.570+0000 7ff942116640 1 -- 172.21.15.84:0/159753029 shutdown_connections 2023-12-12T09:23:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.570+0000 7ff942116640 1 --2- 172.21.15.84:0/159753029 >> v2:172.21.15.99:3300/0 conn(0x7ff93c06db40 0x7ff93c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.570+0000 7ff942116640 1 --2- 172.21.15.84:0/159753029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c143860 0x7ff93c0b3c30 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.570+0000 7ff942116640 1 -- 172.21.15.84:0/159753029 >> 172.21.15.84:0/159753029 conn(0x7ff93c0b0ac0 msgr2=0x7ff93c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:30.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.570+0000 7ff942116640 1 -- 172.21.15.84:0/159753029 shutdown_connections 2023-12-12T09:23:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.570+0000 7ff942116640 1 -- 172.21.15.84:0/159753029 wait complete. 2023-12-12T09:23:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.572+0000 7ff942116640 1 Processor -- start 2023-12-12T09:23:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.572+0000 7ff942116640 1 -- start start 2023-12-12T09:23:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff942116640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c06db40 0x7ff93c0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff942116640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff93c0b4170 0x7ff93c134ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff942116640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff93c143860 0x7ff93c06cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff942116640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0ce5b0 con 0x7ff93c06db40 2023-12-12T09:23:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff942116640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c15b110 con 0x7ff93c0b4170 2023-12-12T09:23:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff942116640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c0cae30 con 0x7ff93c143860 2023-12-12T09:23:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff93b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c06db40 0x7ff93c0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff93b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c06db40 0x7ff93c0ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33152/0 (socket says 172.21.15.84:33152) 2023-12-12T09:23:30.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.573+0000 7ff93b7fe640 1 -- 172.21.15.84:0/2515027357 learned_addr learned my addr 172.21.15.84:0/2515027357 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:30.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff93bfff640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff93c143860 0x7ff93c06cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff93affd640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff93c0b4170 0x7ff93c134ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff93b7fe640 1 -- 172.21.15.84:0/2515027357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff93c143860 msgr2=0x7ff93c06cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff93b7fe640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff93c143860 0x7ff93c06cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff93b7fe640 1 -- 172.21.15.84:0/2515027357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff93c0b4170 msgr2=0x7ff93c134ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff93b7fe640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff93c0b4170 0x7ff93c134ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff93b7fe640 1 -- 172.21.15.84:0/2515027357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c00b770 con 0x7ff93c06db40 2023-12-12T09:23:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff93b7fe640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c06db40 0x7ff93c0ca8f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00b2c0 tx=0x7ff92c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff923fff640 1 -- 172.21.15.84:0/2515027357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c034750 con 0x7ff93c06db40 2023-12-12T09:23:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff923fff640 1 -- 172.21.15.84:0/2515027357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c0348b0 con 0x7ff93c06db40 2023-12-12T09:23:30.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.574+0000 7ff923fff640 1 -- 172.21.15.84:0/2515027357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c034c60 con 0x7ff93c06db40 2023-12-12T09:23:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.575+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c13f5e0 con 0x7ff93c06db40 2023-12-12T09:23:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.575+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c0cd930 con 0x7ff93c06db40 2023-12-12T09:23:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.576+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c0673c0 con 0x7ff93c06db40 2023-12-12T09:23:30.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.577+0000 7ff923fff640 1 -- 172.21.15.84:0/2515027357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff92c04a3b0 con 0x7ff93c06db40 2023-12-12T09:23:30.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.578+0000 7ff923fff640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92806ae40 0x7ff92806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.578+0000 7ff923fff640 1 -- 172.21.15.84:0/2515027357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff92c0abd60 con 0x7ff93c06db40 2023-12-12T09:23:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.578+0000 7ff93affd640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92806ae40 0x7ff92806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.579+0000 7ff93affd640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92806ae40 0x7ff92806d300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0cd420 tx=0x7ff930009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:30.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.582+0000 7ff923fff640 1 -- 172.21.15.84:0/2515027357 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff92c076cc0 con 0x7ff93c06db40 2023-12-12T09:23:30.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.770+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff93c072320 con 0x7ff93c06db40 2023-12-12T09:23:30.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.771+0000 7ff923fff640 1 -- 172.21.15.84:0/2515027357 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff92c0460a0 con 0x7ff93c06db40 2023-12-12T09:23:30.772 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-12-12T09:23:30.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92806ae40 msgr2=0x7ff92806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92806ae40 0x7ff92806d300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0cd420 tx=0x7ff930009040 comp rx=0 tx=0).stop 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c06db40 msgr2=0x7ff93c0ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c06db40 0x7ff93c0ca8f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00b2c0 tx=0x7ff92c0046c0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 shutdown_connections 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff93c143860 0x7ff93c06cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff93c0b4170 0x7ff93c134ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff92806ae40 0x7ff92806d300 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 --2- 172.21.15.84:0/2515027357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff93c06db40 0x7ff93c0ca8f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 >> 172.21.15.84:0/2515027357 conn(0x7ff93c0b0ac0 msgr2=0x7ff93c15c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:30.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 shutdown_connections 2023-12-12T09:23:30.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:30.774+0000 7ff942116640 1 -- 172.21.15.84:0/2515027357 wait complete. 2023-12-12T09:23:30.792 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T09:23:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.011+0000 7f76a1287640 1 Processor -- start 2023-12-12T09:23:31.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.012+0000 7f76a1287640 1 -- start start 2023-12-12T09:23:31.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.013+0000 7f76a1287640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f769c1607d0 0x7f769c0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.013+0000 7f76a1287640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0b28c0 con 0x7f769c0b4090 2023-12-12T09:23:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.013+0000 7f76a1287640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0d1a60 con 0x7f769c160bb0 2023-12-12T09:23:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.013+0000 7f76a1287640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c0d1d40 con 0x7f769c1607d0 2023-12-12T09:23:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.013+0000 7f769affd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f769c1607d0 0x7f769c0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.014+0000 7f769affd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f769c1607d0 0x7f769c0cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33164/0 (socket says 172.21.15.84:33164) 2023-12-12T09:23:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.014+0000 7f769affd640 1 -- 172.21.15.84:0/423811981 learned_addr learned my addr 172.21.15.84:0/423811981 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:31.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.014+0000 7f769b7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f769c0b4090 0x7f769c0cdc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34202/0 (socket says 172.21.15.84:34202) 2023-12-12T09:23:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.014+0000 7f769affd640 1 -- 172.21.15.84:0/423811981 >> v1:172.21.15.99:6789/0 conn(0x7f769c160bb0 legacy=0x7f769c0cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.014+0000 7f769affd640 1 -- 172.21.15.84:0/423811981 >> v1:172.21.15.84:6789/0 conn(0x7f769c0b4090 legacy=0x7f769c0cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.014+0000 7f769affd640 1 -- 172.21.15.84:0/423811981 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c0b2b60 con 0x7f769c1607d0 2023-12-12T09:23:31.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.015+0000 7f769affd640 1 --2- 172.21.15.84:0/423811981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c0cf9c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f768c009e50 tx=0x7f768c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a7502a5664abb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.016+0000 7f7699ffb640 1 -- 172.21.15.84:0/423811981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c02cb10 con 0x7f769c1607d0 2023-12-12T09:23:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.016+0000 7f7699ffb640 1 -- 172.21.15.84:0/423811981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c02cc70 con 0x7f769c1607d0 2023-12-12T09:23:31.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.016+0000 7f7699ffb640 1 -- 172.21.15.84:0/423811981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c0343f0 con 0x7f769c1607d0 2023-12-12T09:23:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.016+0000 7f76a1287640 1 -- 172.21.15.84:0/423811981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 msgr2=0x7f769c0cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.016+0000 7f76a1287640 1 --2- 172.21.15.84:0/423811981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c0cf9c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f768c009e50 tx=0x7f768c02bf70 comp rx=0 tx=0).stop 2023-12-12T09:23:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.016+0000 7f76a1287640 1 -- 172.21.15.84:0/423811981 shutdown_connections 2023-12-12T09:23:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.016+0000 7f76a1287640 1 --2- 172.21.15.84:0/423811981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c0cf9c0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.016+0000 7f76a1287640 1 -- 172.21.15.84:0/423811981 >> 172.21.15.84:0/423811981 conn(0x7f769c09c400 msgr2=0x7f769c0d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.017+0000 7f76a1287640 1 -- 172.21.15.84:0/423811981 shutdown_connections 2023-12-12T09:23:31.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.017+0000 7f76a1287640 1 -- 172.21.15.84:0/423811981 wait complete. 2023-12-12T09:23:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.018+0000 7f76a1287640 1 Processor -- start 2023-12-12T09:23:31.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.018+0000 7f76a1287640 1 -- start start 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.019+0000 7f76a1287640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f769c0b4090 0x7f769c14a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.019+0000 7f76a1287640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c1f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.019+0000 7f76a1287640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f769c160bb0 0x7f769c0b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.019+0000 7f76a1287640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c1f71d0 con 0x7f769c1607d0 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.019+0000 7f76a1287640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0cb1f0 con 0x7f769c160bb0 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.019+0000 7f76a1287640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c06c1d0 con 0x7f769c0b4090 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c1f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c1f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33168/0 (socket says 172.21.15.84:33168) 2023-12-12T09:23:31.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 -- 172.21.15.84:0/2023809332 learned_addr learned my addr 172.21.15.84:0/2023809332 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769affd640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f769c0b4090 0x7f769c14a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 -- 172.21.15.84:0/2023809332 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f769c0b4090 msgr2=0x7f769c14a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f769c0b4090 0x7f769c14a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 -- 172.21.15.84:0/2023809332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f769c160bb0 msgr2=0x7f769c0b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769b7fe640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f769c160bb0 0x7f769c0b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f769c160bb0 0x7f769c0b82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 -- 172.21.15.84:0/2023809332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c009b30 con 0x7f769c1607d0 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.020+0000 7f769a7fc640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c1f6c90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f768400c430 tx=0x7f768400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.021+0000 7f76937fe640 1 -- 172.21.15.84:0/2023809332 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684011790 con 0x7f769c1607d0 2023-12-12T09:23:31.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.021+0000 7f76937fe640 1 -- 172.21.15.84:0/2023809332 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76840118f0 con 0x7f769c1607d0 2023-12-12T09:23:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.021+0000 7f76937fe640 1 -- 172.21.15.84:0/2023809332 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684011ce0 con 0x7f769c1607d0 2023-12-12T09:23:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.021+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c14c590 con 0x7f769c1607d0 2023-12-12T09:23:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.021+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c14cb50 con 0x7f769c1607d0 2023-12-12T09:23:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.022+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c072b80 con 0x7f769c1607d0 2023-12-12T09:23:31.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.023+0000 7f76937fe640 1 -- 172.21.15.84:0/2023809332 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f768401c460 con 0x7f769c1607d0 2023-12-12T09:23:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.024+0000 7f76937fe640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f767c06ae40 0x7f767c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.024+0000 7f76937fe640 1 -- 172.21.15.84:0/2023809332 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7684089790 con 0x7f769c1607d0 2023-12-12T09:23:31.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.024+0000 7f769affd640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f767c06ae40 0x7f767c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.025+0000 7f769affd640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f767c06ae40 0x7f767c06d300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f768c035000 tx=0x7f768c030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.028+0000 7f76937fe640 1 -- 172.21.15.84:0/2023809332 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7684054660 con 0x7f769c1607d0 2023-12-12T09:23:31.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.218+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f769c0673c0 con 0x7f769c1607d0 2023-12-12T09:23:31.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.218+0000 7f76937fe640 1 -- 172.21.15.84:0/2023809332 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7684057c80 con 0x7f769c1607d0 2023-12-12T09:23:31.219 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f767c06ae40 msgr2=0x7f767c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f767c06ae40 0x7f767c06d300 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f768c035000 tx=0x7f768c030000 comp rx=0 tx=0).stop 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 msgr2=0x7f769c1f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c1f6c90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f768400c430 tx=0x7f768400c8f0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 shutdown_connections 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f769c160bb0 0x7f769c0b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f767c06ae40 0x7f767c06d300 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f769c1607d0 0x7f769c1f6c90 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.221+0000 7f76a1287640 1 --2- 172.21.15.84:0/2023809332 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f769c0b4090 0x7f769c14a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.222+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 >> 172.21.15.84:0/2023809332 conn(0x7f769c09c400 msgr2=0x7f769c06b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:31.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.222+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 shutdown_connections 2023-12-12T09:23:31.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.222+0000 7f76a1287640 1 -- 172.21.15.84:0/2023809332 wait complete. 2023-12-12T09:23:31.240 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T09:23:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.464+0000 7fde652d7640 1 Processor -- start 2023-12-12T09:23:31.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.464+0000 7fde652d7640 1 -- start start 2023-12-12T09:23:31.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.465+0000 7fde652d7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fde60144600 0x7fde600b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.465+0000 7fde652d7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6015eb20 con 0x7fde600cf640 2023-12-12T09:23:31.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.466+0000 7fde652d7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6015ee00 con 0x7fde6015c140 2023-12-12T09:23:31.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.466+0000 7fde652d7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6015f0e0 con 0x7fde60144600 2023-12-12T09:23:31.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.466+0000 7fde64ad6640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fde600cf640 0x7fde600b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34210/0 (socket says 172.21.15.84:34210) 2023-12-12T09:23:31.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.466+0000 7fde64ad6640 1 -- 172.21.15.84:0/2595750602 learned_addr learned my addr 172.21.15.84:0/2595750602 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.466+0000 7fde5ffff640 1 --2- 172.21.15.84:0/2595750602 >> v2:172.21.15.99:3300/0 conn(0x7fde60144600 0x7fde600b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.466+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511766402 0 0) 0x7fde6015eb20 con 0x7fde600cf640 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.466+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde4c003520 con 0x7fde600cf640 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 760776129 0 0) 0x7fde4c003520 con 0x7fde600cf640 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 >> v2:172.21.15.99:3300/0 conn(0x7fde60144600 msgr2=0x7fde600b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 --2- 172.21.15.84:0/2595750602 >> v2:172.21.15.99:3300/0 conn(0x7fde60144600 0x7fde600b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 >> v1:172.21.15.99:6789/0 conn(0x7fde6015c140 legacy=0x7fde600cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6015f3c0 con 0x7fde600cf640 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fde58001670 con 0x7fde600cf640 2023-12-12T09:23:31.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 >> v1:172.21.15.84:6789/0 conn(0x7fde600cf640 legacy=0x7fde600b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde4c0039c0 0x7fde4c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde4c0047c0 0x7fde4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde4c0051d0 0x7fde4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6015f0e0 con 0x7fde4c0051d0 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c00c100 con 0x7fde4c0039c0 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4c00c2c0 con 0x7fde4c0047c0 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde5ffff640 1 --2- 172.21.15.84:0/2595750602 >> v2:172.21.15.99:3300/0 conn(0x7fde60144600 0x7fde600b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.467+0000 7fde64ad6640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde4c0051d0 0x7fde4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.468+0000 7fde64ad6640 1 -- 172.21.15.84:0/2595750602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde4c0047c0 msgr2=0x7fde4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.468+0000 7fde64ad6640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde4c0047c0 0x7fde4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.468+0000 7fde64ad6640 1 -- 172.21.15.84:0/2595750602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde4c0039c0 msgr2=0x7fde4c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.468+0000 7fde64ad6640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde4c0039c0 0x7fde4c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.468+0000 7fde64ad6640 1 -- 172.21.15.84:0/2595750602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c003520 con 0x7fde4c0051d0 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.468+0000 7fde64ad6640 1 -- 172.21.15.84:0/2595750602 reap_dead start 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.469+0000 7fde64ad6640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde4c0051d0 0x7fde4c00b980 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fde6015b460 tx=0x7fde4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0588369e4d84ec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.469+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58030dd0 con 0x7fde4c0051d0 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.469+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde580058d0 con 0x7fde4c0051d0 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.469+0000 7fde5f7fe640 1 -- 172.21.15.84:0/2595750602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58005c80 con 0x7fde4c0051d0 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.469+0000 7fde652d7640 1 -- 172.21.15.84:0/2595750602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde4c0051d0 msgr2=0x7fde4c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.469+0000 7fde652d7640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde4c0051d0 0x7fde4c00b980 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fde6015b460 tx=0x7fde4c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.469+0000 7fde652d7640 1 -- 172.21.15.84:0/2595750602 shutdown_connections 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.469+0000 7fde652d7640 1 --2- 172.21.15.84:0/2595750602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde4c0051d0 0x7fde4c00b980 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.470+0000 7fde652d7640 1 -- 172.21.15.84:0/2595750602 >> 172.21.15.84:0/2595750602 conn(0x7fde6006a920 msgr2=0x7fde6006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.470+0000 7fde652d7640 1 -- 172.21.15.84:0/2595750602 shutdown_connections 2023-12-12T09:23:31.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.470+0000 7fde652d7640 1 -- 172.21.15.84:0/2595750602 wait complete. 2023-12-12T09:23:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.471+0000 7fde652d7640 1 Processor -- start 2023-12-12T09:23:31.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.472+0000 7fde652d7640 1 -- start start 2023-12-12T09:23:31.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde652d7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde4c0051d0 0x7fde60158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde652d7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde600b2050 0x7fde600b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde652d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde60139470 0x7fde601398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde652d7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600b2a10 con 0x7fde600b2050 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde652d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6013aad0 con 0x7fde60139470 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde652d7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde60158a50 con 0x7fde4c0051d0 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde57fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde600b2050 0x7fde600b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde57fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde600b2050 0x7fde600b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33180/0 (socket says 172.21.15.84:33180) 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde57fff640 1 -- 172.21.15.84:0/1445093738 learned_addr learned my addr 172.21.15.84:0/1445093738 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde57fff640 1 -- 172.21.15.84:0/1445093738 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde4c0051d0 msgr2=0x7fde60158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde5ffff640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde4c0051d0 0x7fde60158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde64ad6640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde60139470 0x7fde601398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde57fff640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde4c0051d0 0x7fde60158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde57fff640 1 -- 172.21.15.84:0/1445093738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde60139470 msgr2=0x7fde601398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde57fff640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde60139470 0x7fde601398f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.473+0000 7fde57fff640 1 -- 172.21.15.84:0/1445093738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6013a230 con 0x7fde600b2050 2023-12-12T09:23:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.474+0000 7fde57fff640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde600b2050 0x7fde600b24d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fde4800c3e0 tx=0x7fde4800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.474+0000 7fde5d7fa640 1 -- 172.21.15.84:0/1445093738 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48011790 con 0x7fde600b2050 2023-12-12T09:23:31.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.474+0000 7fde5d7fa640 1 -- 172.21.15.84:0/1445093738 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480118f0 con 0x7fde600b2050 2023-12-12T09:23:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.474+0000 7fde5d7fa640 1 -- 172.21.15.84:0/1445093738 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48011ca0 con 0x7fde600b2050 2023-12-12T09:23:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.474+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6013a510 con 0x7fde600b2050 2023-12-12T09:23:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.474+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde600ae790 con 0x7fde600b2050 2023-12-12T09:23:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.475+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600673c0 con 0x7fde600b2050 2023-12-12T09:23:31.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.476+0000 7fde5d7fa640 1 -- 172.21.15.84:0/1445093738 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde4801c460 con 0x7fde600b2050 2023-12-12T09:23:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.477+0000 7fde5d7fa640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fde4006ae40 0x7fde4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.477+0000 7fde5d7fa640 1 -- 172.21.15.84:0/1445093738 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde48089650 con 0x7fde600b2050 2023-12-12T09:23:31.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.477+0000 7fde5ffff640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fde4006ae40 0x7fde4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.478+0000 7fde5ffff640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fde4006ae40 0x7fde4006d300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fde500070b0 tx=0x7fde5000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.481+0000 7fde5d7fa640 1 -- 172.21.15.84:0/1445093738 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde480545b0 con 0x7fde600b2050 2023-12-12T09:23:31.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.670+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde60071e10 con 0x7fde600b2050 2023-12-12T09:23:31.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.671+0000 7fde5d7fa640 1 -- 172.21.15.84:0/1445093738 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde48057bd0 con 0x7fde600b2050 2023-12-12T09:23:31.672 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-12-12T09:23:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fde4006ae40 msgr2=0x7fde4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fde4006ae40 0x7fde4006d300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fde500070b0 tx=0x7fde5000b040 comp rx=0 tx=0).stop 2023-12-12T09:23:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde600b2050 msgr2=0x7fde600b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde600b2050 0x7fde600b24d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fde4800c3e0 tx=0x7fde4800c8a0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 shutdown_connections 2023-12-12T09:23:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde60139470 0x7fde601398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fde4006ae40 0x7fde4006d300 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde600b2050 0x7fde600b24d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 --2- 172.21.15.84:0/1445093738 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fde4c0051d0 0x7fde60158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 >> 172.21.15.84:0/1445093738 conn(0x7fde6006a920 msgr2=0x7fde60159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 shutdown_connections 2023-12-12T09:23:31.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.673+0000 7fde652d7640 1 -- 172.21.15.84:0/1445093738 wait complete. 2023-12-12T09:23:31.692 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:23:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.898+0000 7f9e267b6640 1 Processor -- start 2023-12-12T09:23:31.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.898+0000 7f9e267b6640 1 -- start start 2023-12-12T09:23:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.899+0000 7f9e267b6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e20071bb0 0x7f9e20071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.899+0000 7f9e267b6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 0x7f9e2013d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e267b6640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e200724d0 con 0x7f9e200ce790 2023-12-12T09:23:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e267b6640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e20140270 con 0x7f9e20071bb0 2023-12-12T09:23:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e267b6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200cd850 con 0x7f9e200ce330 2023-12-12T09:23:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e1ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9e20071bb0 0x7f9e20071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e24d53640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9e200ce790 0x7f9e2013f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34224/0 (socket says 172.21.15.84:34224) 2023-12-12T09:23:31.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e24d53640 1 -- 172.21.15.84:0/1151715499 learned_addr learned my addr 172.21.15.84:0/1151715499 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e1ffff640 1 -- 172.21.15.84:0/1151715499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 msgr2=0x7f9e2013d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e1ffff640 1 --2- 172.21.15.84:0/1151715499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 0x7f9e2013d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e1ffff640 1 -- 172.21.15.84:0/1151715499 >> v1:172.21.15.84:6789/0 conn(0x7f9e200ce790 legacy=0x7f9e2013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.900+0000 7f9e1ffff640 1 -- 172.21.15.84:0/1151715499 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200cdb30 con 0x7f9e20071bb0 2023-12-12T09:23:31.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.901+0000 7f9e1ffff640 1 --2- 172.21.15.84:0/1151715499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e20071bb0 0x7f9e20071f90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f9e100097a0 tx=0x7f9e1002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1da48021bf49a33 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e1f7fe640 1 -- 172.21.15.84:0/1151715499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1002d040 con 0x7f9e20071bb0 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e1f7fe640 1 -- 172.21.15.84:0/1151715499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e10031810 con 0x7f9e20071bb0 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e1f7fe640 1 -- 172.21.15.84:0/1151715499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10031ba0 con 0x7f9e20071bb0 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e267b6640 1 -- 172.21.15.84:0/1151715499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e20071bb0 msgr2=0x7f9e20071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e267b6640 1 --2- 172.21.15.84:0/1151715499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e20071bb0 0x7f9e20071f90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f9e100097a0 tx=0x7f9e1002b8b0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e267b6640 1 -- 172.21.15.84:0/1151715499 shutdown_connections 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e267b6640 1 --2- 172.21.15.84:0/1151715499 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 0x7f9e2013d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e267b6640 1 --2- 172.21.15.84:0/1151715499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e20071bb0 0x7f9e20071f90 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e267b6640 1 -- 172.21.15.84:0/1151715499 >> 172.21.15.84:0/1151715499 conn(0x7f9e2006c3d0 msgr2=0x7f9e2006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e267b6640 1 -- 172.21.15.84:0/1151715499 shutdown_connections 2023-12-12T09:23:31.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.902+0000 7f9e267b6640 1 -- 172.21.15.84:0/1151715499 wait complete. 2023-12-12T09:23:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.904+0000 7f9e267b6640 1 Processor -- start 2023-12-12T09:23:31.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.904+0000 7f9e267b6640 1 -- start start 2023-12-12T09:23:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.905+0000 7f9e267b6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e20071bb0 0x7f9e201538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.905+0000 7f9e267b6640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 0x7f9e2013c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.905+0000 7f9e267b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200ce790 0x7f9e2013e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.905+0000 7f9e267b6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200b4950 con 0x7f9e200ce790 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.905+0000 7f9e267b6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20139b80 con 0x7f9e20071bb0 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.905+0000 7f9e267b6640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200b40b0 con 0x7f9e200ce330 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200ce790 0x7f9e2013e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200ce790 0x7f9e2013e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33186/0 (socket says 172.21.15.84:33186) 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 -- 172.21.15.84:0/403078017 learned_addr learned my addr 172.21.15.84:0/403078017 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e1ffff640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e20071bb0 0x7f9e201538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e17fff640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 0x7f9e2013c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 -- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 msgr2=0x7f9e2013c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 0x7f9e2013c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 -- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e20071bb0 msgr2=0x7f9e201538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e20071bb0 0x7f9e201538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 -- 172.21.15.84:0/403078017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10009400 con 0x7f9e200ce790 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e1ffff640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e20071bb0 0x7f9e201538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:31.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.906+0000 7f9e24d53640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200ce790 0x7f9e2013e4d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800ca80 tx=0x7f9e1800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.907+0000 7f9e1d7fa640 1 -- 172.21.15.84:0/403078017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800ac30 con 0x7f9e200ce790 2023-12-12T09:23:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.907+0000 7f9e1d7fa640 1 -- 172.21.15.84:0/403078017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800ad90 con 0x7f9e200ce790 2023-12-12T09:23:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.907+0000 7f9e1d7fa640 1 -- 172.21.15.84:0/403078017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18012600 con 0x7f9e200ce790 2023-12-12T09:23:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.907+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e200b4390 con 0x7f9e200ce790 2023-12-12T09:23:31.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.907+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e20153de0 con 0x7f9e200ce790 2023-12-12T09:23:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.908+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e20139950 con 0x7f9e200ce790 2023-12-12T09:23:31.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.909+0000 7f9e1d7fa640 1 -- 172.21.15.84:0/403078017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e18007070 con 0x7f9e200ce790 2023-12-12T09:23:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.910+0000 7f9e1d7fa640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9e0006ae40 0x7f9e0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.910+0000 7f9e1d7fa640 1 -- 172.21.15.84:0/403078017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9e18089530 con 0x7f9e200ce790 2023-12-12T09:23:31.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.910+0000 7f9e1ffff640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9e0006ae40 0x7f9e0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:31.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.911+0000 7f9e1ffff640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9e0006ae40 0x7f9e0006d300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9e10036000 tx=0x7f9e1003c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:31.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:31.914+0000 7f9e1d7fa640 1 -- 172.21.15.84:0/403078017 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e20139950 con 0x7f9e200ce790 2023-12-12T09:23:32.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.130+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e20139950 con 0x7f9e200ce790 2023-12-12T09:23:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.132+0000 7f9e1d7fa640 1 -- 172.21.15.84:0/403078017 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f9e20139950 con 0x7f9e200ce790 2023-12-12T09:23:32.132 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:32.132 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1966836821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1966836821},{"type":"v1","addr":"172.21.15.99:6835","nonce":1966836821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/4165741100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":4165741100},{"type":"v1","addr":"172.21.15.99:6833","nonce":4165741100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3716664132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3716664132},{"type":"v1","addr":"172.21.15.84:6836","nonce":3716664132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:22:49.741201+0000","modified":"2023-12-12T09:22:52.822545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6237},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6237":{"gid":6237,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/3202590301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3202590301},{"type":"v1","addr":"172.21.15.84:6837","nonce":3202590301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:23:32.132 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9e0006ae40 msgr2=0x7f9e0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9e0006ae40 0x7f9e0006d300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9e10036000 tx=0x7f9e1003c040 comp rx=0 tx=0).stop 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200ce790 msgr2=0x7f9e2013e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200ce790 0x7f9e2013e4d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800ca80 tx=0x7f9e1800cf40 comp rx=0 tx=0).stop 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 shutdown_connections 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9e0006ae40 0x7f9e0006d300 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e200ce790 0x7f9e2013e4d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9e200ce330 0x7f9e2013c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 --2- 172.21.15.84:0/403078017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e20071bb0 0x7f9e201538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.134+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 >> 172.21.15.84:0/403078017 conn(0x7f9e2006c3d0 msgr2=0x7f9e20135bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:32.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.135+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 shutdown_connections 2023-12-12T09:23:32.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.135+0000 7f9e267b6640 1 -- 172.21.15.84:0/403078017 wait complete. 2023-12-12T09:23:32.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.354+0000 7f010ec00640 1 Processor -- start 2023-12-12T09:23:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.355+0000 7f010ec00640 1 -- start start 2023-12-12T09:23:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.356+0000 7f010ec00640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108143d20 0x7f01080b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.356+0000 7f010ec00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f01081447f0 0x7f01080b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.356+0000 7f010ec00640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01080cea30 con 0x7f01080ce550 2023-12-12T09:23:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.356+0000 7f010ec00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080702b0 con 0x7f01081447f0 2023-12-12T09:23:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.356+0000 7f010ec00640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0108070590 con 0x7f0108143d20 2023-12-12T09:23:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.356+0000 7f0107fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f01080ce550 0x7f010815eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34228/0 (socket says 172.21.15.84:34228) 2023-12-12T09:23:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.356+0000 7f0107fff640 1 -- 172.21.15.84:0/3274916111 learned_addr learned my addr 172.21.15.84:0/3274916111 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f010c99c640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108143d20 0x7f01080b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f010d19d640 1 --2- 172.21.15.84:0/3274916111 >> v2:172.21.15.99:3300/0 conn(0x7f01081447f0 0x7f01080b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610292260 0 0) 0x7f01080cea30 con 0x7f01080ce550 2023-12-12T09:23:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f8003520 con 0x7f01080ce550 2023-12-12T09:23:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2920099229 0 0) 0x7f00f8003520 con 0x7f01080ce550 2023-12-12T09:23:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108143d20 msgr2=0x7f01080b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108143d20 0x7f01080b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 >> v2:172.21.15.99:3300/0 conn(0x7f01081447f0 msgr2=0x7f01080b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 --2- 172.21.15.84:0/3274916111 >> v2:172.21.15.99:3300/0 conn(0x7f01081447f0 0x7f01080b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0108070870 con 0x7f01080ce550 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.357+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f00f4001670 con 0x7f01080ce550 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 >> v1:172.21.15.84:6789/0 conn(0x7f01080ce550 legacy=0x7f010815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f01077fe640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f8003970 0x7f00f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f01077fe640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f80047c0 0x7f00f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f01077fe640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108143d20 0x7f00f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01080702b0 con 0x7f00f8003970 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108070590 con 0x7f00f80047c0 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f800b980 con 0x7f0108143d20 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f010c99c640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f8003970 0x7f00f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f0107fff640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f80047c0 0x7f00f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f010c99c640 1 -- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108143d20 msgr2=0x7f00f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f010c99c640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108143d20 0x7f00f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f010c99c640 1 -- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f80047c0 msgr2=0x7f00f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f010c99c640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f80047c0 0x7f00f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f010c99c640 1 -- 172.21.15.84:0/3274916111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f8003520 con 0x7f00f8003970 2023-12-12T09:23:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.358+0000 7f0107fff640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f80047c0 0x7f00f8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.359+0000 7f010c99c640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f8003970 0x7f00f8003d90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009ac0 tx=0x7f00f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd0c0ba66f8edaf server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc02c710 con 0x7f00f8003970 2023-12-12T09:23:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc02c870 con 0x7f00f8003970 2023-12-12T09:23:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f01077fe640 1 -- 172.21.15.84:0/3274916111 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc02cc00 con 0x7f00f8003970 2023-12-12T09:23:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f010ec00640 1 -- 172.21.15.84:0/3274916111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f8003970 msgr2=0x7f00f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f010ec00640 1 --2- 172.21.15.84:0/3274916111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00f8003970 0x7f00f8003d90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009ac0 tx=0x7f00f80057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f010d19d640 1 -- 172.21.15.84:0/3274916111 reap_dead start 2023-12-12T09:23:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f010ec00640 1 -- 172.21.15.84:0/3274916111 shutdown_connections 2023-12-12T09:23:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f010ec00640 1 -- 172.21.15.84:0/3274916111 >> 172.21.15.84:0/3274916111 conn(0x7f010806c3d0 msgr2=0x7f010806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f010ec00640 1 -- 172.21.15.84:0/3274916111 shutdown_connections 2023-12-12T09:23:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.360+0000 7f010ec00640 1 -- 172.21.15.84:0/3274916111 wait complete. 2023-12-12T09:23:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.362+0000 7f010ec00640 1 Processor -- start 2023-12-12T09:23:32.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.362+0000 7f010ec00640 1 -- start start 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.363+0000 7f010ec00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f8003970 0x7f01081f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.363+0000 7f010ec00640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108139150 0x7f010813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.363+0000 7f010ec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f010815c0a0 0x7f010815c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.363+0000 7f010ec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010813efd0 con 0x7f010815c0a0 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.363+0000 7f010ec00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010815bc10 con 0x7f00f8003970 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.363+0000 7f010ec00640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010813e170 con 0x7f0108139150 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010d19d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f010815c0a0 0x7f010815c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010d19d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f010815c0a0 0x7f010815c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33204/0 (socket says 172.21.15.84:33204) 2023-12-12T09:23:32.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010d19d640 1 -- 172.21.15.84:0/2510446233 learned_addr learned my addr 172.21.15.84:0/2510446233 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:32.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010d19d640 1 -- 172.21.15.84:0/2510446233 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108139150 msgr2=0x7f010813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010d19d640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108139150 0x7f010813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010d19d640 1 -- 172.21.15.84:0/2510446233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f8003970 msgr2=0x7f01081f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010c99c640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f8003970 0x7f01081f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010d19d640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f8003970 0x7f01081f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.364+0000 7f010d19d640 1 -- 172.21.15.84:0/2510446233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010813f220 con 0x7f010815c0a0 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.365+0000 7f010d19d640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f010815c0a0 0x7f010815c520 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0108144c40 tx=0x7f010000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.365+0000 7f01057fa640 1 -- 172.21.15.84:0/2510446233 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100010040 con 0x7f010815c0a0 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.365+0000 7f01057fa640 1 -- 172.21.15.84:0/2510446233 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010000bab0 con 0x7f010815c0a0 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.365+0000 7f01057fa640 1 -- 172.21.15.84:0/2510446233 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010000be40 con 0x7f010815c0a0 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.365+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010813f500 con 0x7f010815c0a0 2023-12-12T09:23:32.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.365+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010815b8a0 con 0x7f010815c0a0 2023-12-12T09:23:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.366+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01080673c0 con 0x7f010815c0a0 2023-12-12T09:23:32.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.367+0000 7f01057fa640 1 -- 172.21.15.84:0/2510446233 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f010001d400 con 0x7f010815c0a0 2023-12-12T09:23:32.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.368+0000 7f01057fa640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00ec06ae70 0x7f00ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.368+0000 7f01057fa640 1 -- 172.21.15.84:0/2510446233 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0100089cc0 con 0x7f010815c0a0 2023-12-12T09:23:32.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.368+0000 7f010c99c640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00ec06ae70 0x7f00ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.369+0000 7f010c99c640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00ec06ae70 0x7f00ec06d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f00fc036000 tx=0x7f00fc030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:32.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.372+0000 7f01057fa640 1 -- 172.21.15.84:0/2510446233 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0100090080 con 0x7f010815c0a0 2023-12-12T09:23:32.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.563+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f010806e3b0 con 0x7f010815c0a0 2023-12-12T09:23:32.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.566+0000 7f01057fa640 1 -- 172.21.15.84:0/2510446233 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7f0100018090 con 0x7f010815c0a0 2023-12-12T09:23:32.567 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:32.567 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00ec06ae70 msgr2=0x7f00ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00ec06ae70 0x7f00ec06d330 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f00fc036000 tx=0x7f00fc030000 comp rx=0 tx=0).stop 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f010815c0a0 msgr2=0x7f010815c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f010815c0a0 0x7f010815c520 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0108144c40 tx=0x7f010000b480 comp rx=0 tx=0).stop 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 shutdown_connections 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f00ec06ae70 0x7f00ec06d330 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f010815c0a0 0x7f010815c520 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0108139150 0x7f010813dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 --2- 172.21.15.84:0/2510446233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f00f8003970 0x7f01081f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 >> 172.21.15.84:0/2510446233 conn(0x7f010806c3d0 msgr2=0x7f010806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:32.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 shutdown_connections 2023-12-12T09:23:32.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.569+0000 7f010ec00640 1 -- 172.21.15.84:0/2510446233 wait complete. 2023-12-12T09:23:32.589 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:23:32.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:23:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.797+0000 7ff6c4b9a640 1 Processor -- start 2023-12-12T09:23:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.797+0000 7ff6c4b9a640 1 -- start start 2023-12-12T09:23:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.798+0000 7ff6c4b9a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c015d160 0x7ff6c006d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.798+0000 7ff6c4b9a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff6c00b3140 0x7ff6c006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.798+0000 7ff6c4b9a640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c015d870 con 0x7ff6c00706b0 2023-12-12T09:23:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.798+0000 7ff6c4b9a640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c015e1d0 con 0x7ff6c00b3140 2023-12-12T09:23:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.798+0000 7ff6c4b9a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00cd000 con 0x7ff6c015d160 2023-12-12T09:23:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.799+0000 7ff6bffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff6c00706b0 0x7ff6c0070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34244/0 (socket says 172.21.15.84:34244) 2023-12-12T09:23:32.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.799+0000 7ff6bffff640 1 -- 172.21.15.84:0/693423401 learned_addr learned my addr 172.21.15.84:0/693423401 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.799+0000 7ff6bf7fe640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c015d160 0x7ff6c006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.799+0000 7ff6beffd640 1 --2- 172.21.15.84:0/693423401 >> v2:172.21.15.99:3300/0 conn(0x7ff6c00b3140 0x7ff6c006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.799+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016506059 0 0) 0x7ff6c015d870 con 0x7ff6c00706b0 2023-12-12T09:23:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.799+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ac003520 con 0x7ff6c00706b0 2023-12-12T09:23:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1309237771 0 0) 0x7ff6ac003520 con 0x7ff6c00706b0 2023-12-12T09:23:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c015d160 msgr2=0x7ff6c006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c015d160 0x7ff6c006d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 >> v2:172.21.15.99:3300/0 conn(0x7ff6c00b3140 msgr2=0x7ff6c006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 --2- 172.21.15.84:0/693423401 >> v2:172.21.15.99:3300/0 conn(0x7ff6c00b3140 0x7ff6c006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00b28e0 con 0x7ff6c00706b0 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7ff6b8001670 con 0x7ff6c00706b0 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 >> v1:172.21.15.84:6789/0 conn(0x7ff6c00706b0 legacy=0x7ff6c0070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c015d160 0x7ff6ac0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac003f70 0x7ff6ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac004d00 0x7ff6ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c015e1d0 con 0x7ff6ac003f70 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00cd000 con 0x7ff6ac004d00 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac00dbc0 con 0x7ff6c015d160 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6beffd640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac003f70 0x7ff6ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.800+0000 7ff6bf7fe640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c015d160 0x7ff6ac0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.801+0000 7ff6beffd640 1 -- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c015d160 msgr2=0x7ff6ac0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.801+0000 7ff6beffd640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c015d160 0x7ff6ac0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.801+0000 7ff6beffd640 1 -- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac004d00 msgr2=0x7ff6ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.801+0000 7ff6bffff640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac004d00 0x7ff6ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.801+0000 7ff6beffd640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac004d00 0x7ff6ac005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.801+0000 7ff6beffd640 1 -- 172.21.15.84:0/693423401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac003520 con 0x7ff6ac003f70 2023-12-12T09:23:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.802+0000 7ff6beffd640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac003f70 0x7ff6ac0047c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009ac0 tx=0x7ff6ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e794f4c42d8289 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.802+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a802c6d0 con 0x7ff6ac003f70 2023-12-12T09:23:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.802+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a802c830 con 0x7ff6ac003f70 2023-12-12T09:23:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.802+0000 7ff6be7fc640 1 -- 172.21.15.84:0/693423401 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a802cbc0 con 0x7ff6ac003f70 2023-12-12T09:23:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.803+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/693423401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac003f70 msgr2=0x7ff6ac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.803+0000 7ff6c4b9a640 1 --2- 172.21.15.84:0/693423401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6ac003f70 0x7ff6ac0047c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009ac0 tx=0x7ff6ac0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.803+0000 7ff6bffff640 1 -- 172.21.15.84:0/693423401 reap_dead start 2023-12-12T09:23:32.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.803+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/693423401 shutdown_connections 2023-12-12T09:23:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.803+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/693423401 >> 172.21.15.84:0/693423401 conn(0x7ff6c00b07f0 msgr2=0x7ff6c00b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.803+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/693423401 shutdown_connections 2023-12-12T09:23:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.803+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/693423401 wait complete. 2023-12-12T09:23:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.805+0000 7ff6c4b9a640 1 Processor -- start 2023-12-12T09:23:32.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.805+0000 7ff6c4b9a640 1 -- start start 2023-12-12T09:23:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6c4b9a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac003f70 0x7ff6c0157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6c4b9a640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c014bb90 0x7ff6c014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6c4b9a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6c0151f20 0x7ff6c015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6c4b9a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01526e0 con 0x7ff6c0151f20 2023-12-12T09:23:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6c4b9a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c014c010 con 0x7ff6ac003f70 2023-12-12T09:23:32.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6c4b9a640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0157170 con 0x7ff6c014bb90 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6c0151f20 0x7ff6c015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6c0151f20 0x7ff6c015bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33234/0 (socket says 172.21.15.84:33234) 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6bffff640 1 -- 172.21.15.84:0/1710575520 learned_addr learned my addr 172.21.15.84:0/1710575520 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6bf7fe640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac003f70 0x7ff6c0157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6beffd640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c014bb90 0x7ff6c014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6bffff640 1 -- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c014bb90 msgr2=0x7ff6c014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6bffff640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c014bb90 0x7ff6c014c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6bffff640 1 -- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac003f70 msgr2=0x7ff6c0157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.806+0000 7ff6bffff640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac003f70 0x7ff6c0157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.807+0000 7ff6bffff640 1 -- 172.21.15.84:0/1710575520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0156840 con 0x7ff6c0151f20 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.807+0000 7ff6beffd640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c014bb90 0x7ff6c014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.807+0000 7ff6bffff640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6c0151f20 0x7ff6c015bad0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac003970 tx=0x7ff6b800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:32.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.807+0000 7ff6b7fff640 1 -- 172.21.15.84:0/1710575520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80072d0 con 0x7ff6c0151f20 2023-12-12T09:23:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.807+0000 7ff6b7fff640 1 -- 172.21.15.84:0/1710575520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8007430 con 0x7ff6c0151f20 2023-12-12T09:23:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.807+0000 7ff6b7fff640 1 -- 172.21.15.84:0/1710575520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800dec0 con 0x7ff6c0151f20 2023-12-12T09:23:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.807+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c0156b20 con 0x7ff6c0151f20 2023-12-12T09:23:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.807+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c01523d0 con 0x7ff6c0151f20 2023-12-12T09:23:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.808+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c00673c0 con 0x7ff6c0151f20 2023-12-12T09:23:32.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.809+0000 7ff6b7fff640 1 -- 172.21.15.84:0/1710575520 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6b80047e0 con 0x7ff6c0151f20 2023-12-12T09:23:32.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.810+0000 7ff6b7fff640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff6a006ae70 0x7ff6a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:32.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.810+0000 7ff6b7fff640 1 -- 172.21.15.84:0/1710575520 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff6b80893a0 con 0x7ff6c0151f20 2023-12-12T09:23:32.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.810+0000 7ff6bf7fe640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff6a006ae70 0x7ff6a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:32.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.811+0000 7ff6bf7fe640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff6a006ae70 0x7ff6a006d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00ce970 tx=0x7ff6b000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:32.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:32.815+0000 7ff6b7fff640 1 -- 172.21.15.84:0/1710575520 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6b80543a0 con 0x7ff6c0151f20 2023-12-12T09:23:33.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.040+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6c01572b0 con 0x7ff6c0151f20 2023-12-12T09:23:33.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.041+0000 7ff6b7fff640 1 -- 172.21.15.84:0/1710575520 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7ff6b80579c0 con 0x7ff6c0151f20 2023-12-12T09:23:33.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:33.042 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1966836821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1966836821},{"type":"v1","addr":"172.21.15.99:6835","nonce":1966836821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/4165741100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":4165741100},{"type":"v1","addr":"172.21.15.99:6833","nonce":4165741100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3716664132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3716664132},{"type":"v1","addr":"172.21.15.84:6836","nonce":3716664132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:22:49.741201+0000","modified":"2023-12-12T09:22:52.822545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6237},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6237":{"gid":6237,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/3202590301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3202590301},{"type":"v1","addr":"172.21.15.84:6837","nonce":3202590301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:23:33.042 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-12-12T09:23:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.043+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff6a006ae70 msgr2=0x7ff6a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.043+0000 7ff6c4b9a640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff6a006ae70 0x7ff6a006d330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00ce970 tx=0x7ff6b000b040 comp rx=0 tx=0).stop 2023-12-12T09:23:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.043+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6c0151f20 msgr2=0x7ff6c015bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.043+0000 7ff6c4b9a640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6c0151f20 0x7ff6c015bad0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac003970 tx=0x7ff6b800db80 comp rx=0 tx=0).stop 2023-12-12T09:23:33.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.044+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 shutdown_connections 2023-12-12T09:23:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.044+0000 7ff6c4b9a640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ff6a006ae70 0x7ff6a006d330 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.044+0000 7ff6c4b9a640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6c0151f20 0x7ff6c015bad0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.044+0000 7ff6c4b9a640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ff6c014bb90 0x7ff6c014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.044+0000 7ff6c4b9a640 1 --2- 172.21.15.84:0/1710575520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6ac003f70 0x7ff6c0157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.044+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 >> 172.21.15.84:0/1710575520 conn(0x7ff6c00b07f0 msgr2=0x7ff6c00ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.044+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 shutdown_connections 2023-12-12T09:23:33.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.044+0000 7ff6c4b9a640 1 -- 172.21.15.84:0/1710575520 wait complete. 2023-12-12T09:23:33.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:23:33.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.269+0000 7f2c1761e640 1 Processor -- start 2023-12-12T09:23:33.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.269+0000 7f2c1761e640 1 -- start start 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.271+0000 7f2c1761e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 0x7f2c100d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.271+0000 7f2c1761e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100c6bf0 con 0x7f2c100cfff0 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.271+0000 7f2c1761e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100d1250 con 0x7f2c100b3ed0 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.271+0000 7f2c1761e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100d1530 con 0x7f2c10160ad0 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.271+0000 7f2c15bbb640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2c100cfff0 0x7f2c100cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34256/0 (socket says 172.21.15.84:34256) 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.271+0000 7f2c15bbb640 1 -- 172.21.15.84:0/4232732999 learned_addr learned my addr 172.21.15.84:0/4232732999 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c153ba640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 0x7f2c100d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785895848 0 0) 0x7f2c100c6bf0 con 0x7f2c100cfff0 2023-12-12T09:23:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bfc003520 con 0x7f2c100cfff0 2023-12-12T09:23:33.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3335664566 0 0) 0x7f2bfc003520 con 0x7f2c100cfff0 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 msgr2=0x7f2c100d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 0x7f2c100d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 >> v1:172.21.15.99:6789/0 conn(0x7f2c100b3ed0 legacy=0x7f2c100cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100d1810 con 0x7f2c100cfff0 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2c080019f0 con 0x7f2c100cfff0 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 >> v1:172.21.15.84:6789/0 conn(0x7f2c100cfff0 legacy=0x7f2c100cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bfc0039a0 0x7f2bfc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bfc0047c0 0x7f2bfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 0x7f2bfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100d1530 con 0x7f2bfc0047c0 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc00bab0 con 0x7f2bfc0039a0 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.272+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc00bc70 con 0x7f2c10160ad0 2023-12-12T09:23:33.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c14bb9640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bfc0047c0 0x7f2bfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c153ba640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bfc0039a0 0x7f2bfc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c15bbb640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 0x7f2bfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c14bb9640 1 -- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 msgr2=0x7f2bfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c14bb9640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 0x7f2bfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c14bb9640 1 -- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bfc0039a0 msgr2=0x7f2bfc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c14bb9640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bfc0039a0 0x7f2bfc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c14bb9640 1 -- 172.21.15.84:0/4232732999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc003520 con 0x7f2bfc0047c0 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.273+0000 7f2c15bbb640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2c10160ad0 0x7f2bfc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.274+0000 7f2c14bb9640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bfc0047c0 0x7f2bfc004c40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2c00001720 tx=0x7f2bfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209f3bd9e9a83e21 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.274+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c000052d0 con 0x7f2bfc0047c0 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.274+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0002e050 con 0x7f2bfc0047c0 2023-12-12T09:23:33.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.274+0000 7f2c07fff640 1 -- 172.21.15.84:0/4232732999 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c000035f0 con 0x7f2bfc0047c0 2023-12-12T09:23:33.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.275+0000 7f2c1761e640 1 -- 172.21.15.84:0/4232732999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bfc0047c0 msgr2=0x7f2bfc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.275+0000 7f2c1761e640 1 --2- 172.21.15.84:0/4232732999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2bfc0047c0 0x7f2bfc004c40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2c00001720 tx=0x7f2bfc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.275+0000 7f2c15bbb640 1 -- 172.21.15.84:0/4232732999 reap_dead start 2023-12-12T09:23:33.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.275+0000 7f2c1761e640 1 -- 172.21.15.84:0/4232732999 shutdown_connections 2023-12-12T09:23:33.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.275+0000 7f2c1761e640 1 -- 172.21.15.84:0/4232732999 >> 172.21.15.84:0/4232732999 conn(0x7f2c1009c3e0 msgr2=0x7f2c100d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:33.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.275+0000 7f2c1761e640 1 -- 172.21.15.84:0/4232732999 shutdown_connections 2023-12-12T09:23:33.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.275+0000 7f2c1761e640 1 -- 172.21.15.84:0/4232732999 wait complete. 2023-12-12T09:23:33.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.277+0000 7f2c1761e640 1 Processor -- start 2023-12-12T09:23:33.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.277+0000 7f2c1761e640 1 -- start start 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c1761e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bfc0047c0 0x7f2c1015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c1761e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c101504a0 0x7f2c1015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c1761e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c100b7a20 0x7f2c100b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c1761e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100b83e0 con 0x7f2c100b7a20 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c1761e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100cb340 con 0x7f2c101504a0 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c1761e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10150920 con 0x7f2bfc0047c0 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c15bbb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c100b7a20 0x7f2c100b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c15bbb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c100b7a20 0x7f2c100b7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33254/0 (socket says 172.21.15.84:33254) 2023-12-12T09:23:33.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.278+0000 7f2c15bbb640 1 -- 172.21.15.84:0/683797721 learned_addr learned my addr 172.21.15.84:0/683797721 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c153ba640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bfc0047c0 0x7f2c1015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c15bbb640 1 -- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bfc0047c0 msgr2=0x7f2c1015e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c15bbb640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bfc0047c0 0x7f2c1015e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c14bb9640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c101504a0 0x7f2c1015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c15bbb640 1 -- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c101504a0 msgr2=0x7f2c1015f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c15bbb640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c101504a0 0x7f2c1015f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c15bbb640 1 -- 172.21.15.84:0/683797721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100ca2a0 con 0x7f2c100b7a20 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c153ba640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bfc0047c0 0x7f2c1015e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c15bbb640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c100b7a20 0x7f2c100b7ea0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2c1008c340 tx=0x7f2c0800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c05ffb640 1 -- 172.21.15.84:0/683797721 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08004d60 con 0x7f2c100b7a20 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c05ffb640 1 -- 172.21.15.84:0/683797721 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800bb80 con 0x7f2c100b7a20 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c100ca580 con 0x7f2c100b7a20 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c05ffb640 1 -- 172.21.15.84:0/683797721 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08007110 con 0x7f2c100b7a20 2023-12-12T09:23:33.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.279+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c100cab40 con 0x7f2c100b7a20 2023-12-12T09:23:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.281+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c10072eb0 con 0x7f2c100b7a20 2023-12-12T09:23:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.281+0000 7f2c05ffb640 1 -- 172.21.15.84:0/683797721 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c08007270 con 0x7f2c100b7a20 2023-12-12T09:23:33.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.282+0000 7f2c05ffb640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf406ae40 0x7f2bf406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.282+0000 7f2c05ffb640 1 -- 172.21.15.84:0/683797721 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c080899a0 con 0x7f2c100b7a20 2023-12-12T09:23:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.283+0000 7f2c153ba640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf406ae40 0x7f2bf406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.283+0000 7f2c153ba640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf406ae40 0x7f2bf406d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009a00 tx=0x7f2c0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:33.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.286+0000 7f2c05ffb640 1 -- 172.21.15.84:0/683797721 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c08054900 con 0x7f2c100b7a20 2023-12-12T09:23:33.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.512+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c100cf4b0 con 0x7f2c100b7a20 2023-12-12T09:23:33.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.513+0000 7f2c05ffb640 1 -- 172.21.15.84:0/683797721 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f2c08057f20 con 0x7f2c100b7a20 2023-12-12T09:23:33.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:33.514 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1966836821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1966836821},{"type":"v1","addr":"172.21.15.99:6835","nonce":1966836821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/4165741100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":4165741100},{"type":"v1","addr":"172.21.15.99:6833","nonce":4165741100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3716664132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3716664132},{"type":"v1","addr":"172.21.15.84:6836","nonce":3716664132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T09:22:49.741201+0000","modified":"2023-12-12T09:22:52.822545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6237},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6237":{"gid":6237,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":5,"addr":"172.21.15.84:6837/3202590301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3202590301},{"type":"v1","addr":"172.21.15.84:6837","nonce":3202590301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-12T09:23:33.514 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 27 2023-12-12T09:23:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf406ae40 msgr2=0x7f2bf406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf406ae40 0x7f2bf406d300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009a00 tx=0x7f2c0c008040 comp rx=0 tx=0).stop 2023-12-12T09:23:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c100b7a20 msgr2=0x7f2c100b7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c100b7a20 0x7f2c100b7ea0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f2c1008c340 tx=0x7f2c0800b4a0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 shutdown_connections 2023-12-12T09:23:33.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2bf406ae40 0x7f2bf406d300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c100b7a20 0x7f2c100b7ea0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c101504a0 0x7f2c1015f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 --2- 172.21.15.84:0/683797721 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2bfc0047c0 0x7f2c1015e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 >> 172.21.15.84:0/683797721 conn(0x7f2c1009c3e0 msgr2=0x7f2c1006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:33.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 shutdown_connections 2023-12-12T09:23:33.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.516+0000 7f2c1761e640 1 -- 172.21.15.84:0/683797721 wait complete. 2023-12-12T09:23:33.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.740+0000 7f134b42b640 1 Processor -- start 2023-12-12T09:23:33.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.740+0000 7f134b42b640 1 -- start start 2023-12-12T09:23:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f134b42b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 0x7f1344071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f134b42b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13440cea30 con 0x7f1344143d20 2023-12-12T09:23:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f134b42b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13440702b0 con 0x7f13440b47e0 2023-12-12T09:23:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f134b42b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1344070590 con 0x7f13440ce550 2023-12-12T09:23:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f13491c7640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1344143d20 0x7f13440b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34260/0 (socket says 172.21.15.84:34260) 2023-12-12T09:23:33.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f13491c7640 1 -- 172.21.15.84:0/4031357374 learned_addr learned my addr 172.21.15.84:0/4031357374 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7361487 0 0) 0x7f13440cea30 con 0x7f1344143d20 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1330003520 con 0x7f1344143d20 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.742+0000 7f13499c8640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 0x7f1344071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 948665870 0 0) 0x7f1330003520 con 0x7f1344143d20 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 msgr2=0x7f1344071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 0x7f1344071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 >> v1:172.21.15.99:6789/0 conn(0x7f13440b47e0 legacy=0x7f1344071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344070870 con 0x7f1344143d20 2023-12-12T09:23:33.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f1340001670 con 0x7f1344143d20 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f13499c8640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 0x7f1344071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 >> v1:172.21.15.84:6789/0 conn(0x7f1344143d20 legacy=0x7f13440b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300039a0 0x7f1330003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13300047c0 0x7f1330004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 0x7f1330005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1344070590 con 0x7f13300047c0 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133000bab0 con 0x7f13300039a0 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133000bc70 con 0x7f13440ce550 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.743+0000 7f13489c6640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13300047c0 0x7f1330004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.744+0000 7f13491c7640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300039a0 0x7f1330003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.744+0000 7f13499c8640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 0x7f1330005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.744+0000 7f13489c6640 1 -- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 msgr2=0x7f1330005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.744+0000 7f13489c6640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f13440ce550 0x7f1330005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.744+0000 7f13489c6640 1 -- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300039a0 msgr2=0x7f1330003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:33.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.744+0000 7f13489c6640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300039a0 0x7f1330003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.744+0000 7f13489c6640 1 -- 172.21.15.84:0/4031357374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330003520 con 0x7f13300047c0 2023-12-12T09:23:33.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.744+0000 7f13491c7640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300039a0 0x7f1330003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:33.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.745+0000 7f13489c6640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13300047c0 0x7f1330004c40 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f1334001750 tx=0x7f13300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272a1a8dddc2c0df server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:33.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.745+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13340052d0 con 0x7f13300047c0 2023-12-12T09:23:33.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.745+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133402e050 con 0x7f13300047c0 2023-12-12T09:23:33.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.745+0000 7f133bfff640 1 -- 172.21.15.84:0/4031357374 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13340035f0 con 0x7f13300047c0 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.745+0000 7f134b42b640 1 -- 172.21.15.84:0/4031357374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13300047c0 msgr2=0x7f1330004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.745+0000 7f134b42b640 1 --2- 172.21.15.84:0/4031357374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13300047c0 0x7f1330004c40 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f1334001750 tx=0x7f13300057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.745+0000 7f13499c8640 1 -- 172.21.15.84:0/4031357374 reap_dead start 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.746+0000 7f134b42b640 1 -- 172.21.15.84:0/4031357374 shutdown_connections 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.746+0000 7f134b42b640 1 -- 172.21.15.84:0/4031357374 >> 172.21.15.84:0/4031357374 conn(0x7f134406c3d0 msgr2=0x7f134406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.746+0000 7f134b42b640 1 -- 172.21.15.84:0/4031357374 shutdown_connections 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.746+0000 7f134b42b640 1 -- 172.21.15.84:0/4031357374 wait complete. 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.747+0000 7f134b42b640 1 Processor -- start 2023-12-12T09:23:33.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.748+0000 7f134b42b640 1 -- start start 2023-12-12T09:23:33.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.748+0000 7f134b42b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300047c0 0x7f134414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.748+0000 7f134b42b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f134413efd0 0x7f134415b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f134b42b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f134413f430 0x7f134415ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f134b42b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134415ce20 con 0x7f134413f430 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f134b42b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134415bfa0 con 0x7f13300047c0 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f134b42b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134415c210 con 0x7f134413efd0 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13499c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f134413f430 0x7f134415ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13499c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f134413f430 0x7f134415ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33270/0 (socket says 172.21.15.84:33270) 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13499c8640 1 -- 172.21.15.84:0/4194856823 learned_addr learned my addr 172.21.15.84:0/4194856823 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13489c6640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f134413efd0 0x7f134415b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13491c7640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300047c0 0x7f134414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13499c8640 1 -- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f134413efd0 msgr2=0x7f134415b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13499c8640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f134413efd0 0x7f134415b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13499c8640 1 -- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300047c0 msgr2=0x7f134414add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13499c8640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300047c0 0x7f134414add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13499c8640 1 -- 172.21.15.84:0/4194856823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134415c4f0 con 0x7f134413f430 2023-12-12T09:23:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13489c6640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f134413efd0 0x7f134415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.749+0000 7f13491c7640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300047c0 0x7f134414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.750+0000 7f13499c8640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f134413f430 0x7f134415ba60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f13440ce960 tx=0x7f133c0046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.750+0000 7f1339ffb640 1 -- 172.21.15.84:0/4194856823 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c007d20 con 0x7f134413f430 2023-12-12T09:23:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.750+0000 7f1339ffb640 1 -- 172.21.15.84:0/4194856823 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c007e80 con 0x7f134413f430 2023-12-12T09:23:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.750+0000 7f1339ffb640 1 -- 172.21.15.84:0/4194856823 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c014640 con 0x7f134413f430 2023-12-12T09:23:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.750+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134415c7d0 con 0x7f134413f430 2023-12-12T09:23:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.750+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134414b310 con 0x7f134413f430 2023-12-12T09:23:33.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.751+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134414b530 con 0x7f134413f430 2023-12-12T09:23:33.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.752+0000 7f1339ffb640 1 -- 172.21.15.84:0/4194856823 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f133c01d3b0 con 0x7f134413f430 2023-12-12T09:23:33.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.753+0000 7f1339ffb640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f132806ae40 0x7f132806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:33.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.753+0000 7f1339ffb640 1 -- 172.21.15.84:0/4194856823 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f133c089460 con 0x7f134413f430 2023-12-12T09:23:33.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.753+0000 7f13491c7640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f132806ae40 0x7f132806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:33.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.754+0000 7f13491c7640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f132806ae40 0x7f132806d300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1340001eb0 tx=0x7f1340009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:33.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.757+0000 7f1339ffb640 1 -- 172.21.15.84:0/4194856823 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f134414b530 con 0x7f134413f430 2023-12-12T09:23:33.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.933+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f134414b530 con 0x7f134413f430 2023-12-12T09:23:33.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.936+0000 7f1339ffb640 1 -- 172.21.15.84:0/4194856823 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16686 (secure 0 0 0) 0x7f134414b530 con 0x7f134413f430 2023-12-12T09:23:33.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:33.937 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":58,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:22:51.323009+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-12T09:22:47.550419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-12T09:22:48.743328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.938+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f132806ae40 msgr2=0x7f132806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.938+0000 7f134b42b640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f132806ae40 0x7f132806d300 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1340001eb0 tx=0x7f1340009040 comp rx=0 tx=0).stop 2023-12-12T09:23:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f134413f430 msgr2=0x7f134415ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:33.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f134413f430 0x7f134415ba60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f13440ce960 tx=0x7f133c0046a0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 shutdown_connections 2023-12-12T09:23:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f132806ae40 0x7f132806d300 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f134413f430 0x7f134415ba60 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f134413efd0 0x7f134415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 --2- 172.21.15.84:0/4194856823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13300047c0 0x7f134414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 >> 172.21.15.84:0/4194856823 conn(0x7f134406c3d0 msgr2=0x7f13440b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 shutdown_connections 2023-12-12T09:23:33.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:33.939+0000 7f134b42b640 1 -- 172.21.15.84:0/4194856823 wait complete. 2023-12-12T09:23:33.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T09:23:34.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.164+0000 7f1c78494640 1 Processor -- start 2023-12-12T09:23:34.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.164+0000 7f1c78494640 1 -- start start 2023-12-12T09:23:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.166+0000 7f1c78494640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c70143d20 0x7f1c700b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.166+0000 7f1c78494640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1c701447f0 0x7f1c700b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.166+0000 7f1c78494640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c700cea30 con 0x7f1c700ce550 2023-12-12T09:23:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.166+0000 7f1c78494640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c700702b0 con 0x7f1c70143d20 2023-12-12T09:23:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.166+0000 7f1c78494640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c70070590 con 0x7f1c701447f0 2023-12-12T09:23:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.166+0000 7f1c76230640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c70143d20 0x7f1c700b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.166+0000 7f1c76230640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1c70143d20 0x7f1c700b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33278/0 (socket says 172.21.15.84:33278) 2023-12-12T09:23:34.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.166+0000 7f1c76230640 1 -- 172.21.15.84:0/2624715506 learned_addr learned my addr 172.21.15.84:0/2624715506 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.167+0000 7f1c76230640 1 -- 172.21.15.84:0/2624715506 >> v2:172.21.15.99:3300/0 conn(0x7f1c701447f0 msgr2=0x7f1c700b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.167+0000 7f1c76a31640 1 --2- 172.21.15.84:0/2624715506 >> v2:172.21.15.99:3300/0 conn(0x7f1c701447f0 0x7f1c700b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.167+0000 7f1c76230640 1 --2- 172.21.15.84:0/2624715506 >> v2:172.21.15.99:3300/0 conn(0x7f1c701447f0 0x7f1c700b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.167+0000 7f1c76230640 1 -- 172.21.15.84:0/2624715506 >> v1:172.21.15.99:6789/0 conn(0x7f1c700ce550 legacy=0x7f1c7015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.167+0000 7f1c76230640 1 -- 172.21.15.84:0/2624715506 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70070870 con 0x7f1c70143d20 2023-12-12T09:23:34.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.168+0000 7f1c76230640 1 --2- 172.21.15.84:0/2624715506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c70143d20 0x7f1c700b40d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f1c700ae330 tx=0x7f1c6402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc19c57e2f99f2e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.168+0000 7f1c7522e640 1 -- 172.21.15.84:0/2624715506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6402ca80 con 0x7f1c70143d20 2023-12-12T09:23:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.168+0000 7f1c7522e640 1 -- 172.21.15.84:0/2624715506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6402cbe0 con 0x7f1c70143d20 2023-12-12T09:23:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.168+0000 7f1c7522e640 1 -- 172.21.15.84:0/2624715506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640343f0 con 0x7f1c70143d20 2023-12-12T09:23:34.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.169+0000 7f1c78494640 1 -- 172.21.15.84:0/2624715506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c70143d20 msgr2=0x7f1c700b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.169+0000 7f1c78494640 1 --2- 172.21.15.84:0/2624715506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c70143d20 0x7f1c700b40d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f1c700ae330 tx=0x7f1c6402bee0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.169+0000 7f1c78494640 1 -- 172.21.15.84:0/2624715506 shutdown_connections 2023-12-12T09:23:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.169+0000 7f1c78494640 1 --2- 172.21.15.84:0/2624715506 >> v2:172.21.15.99:3300/0 conn(0x7f1c701447f0 0x7f1c700b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.169+0000 7f1c78494640 1 --2- 172.21.15.84:0/2624715506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c70143d20 0x7f1c700b40d0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.169+0000 7f1c78494640 1 -- 172.21.15.84:0/2624715506 >> 172.21.15.84:0/2624715506 conn(0x7f1c7006c3d0 msgr2=0x7f1c7006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.169+0000 7f1c78494640 1 -- 172.21.15.84:0/2624715506 shutdown_connections 2023-12-12T09:23:34.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.169+0000 7f1c78494640 1 -- 172.21.15.84:0/2624715506 wait complete. 2023-12-12T09:23:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.171+0000 7f1c78494640 1 Processor -- start 2023-12-12T09:23:34.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.171+0000 7f1c78494640 1 -- start start 2023-12-12T09:23:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c78494640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c700ce550 0x7f1c7013b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c78494640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c70143d20 0x7f1c700afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c78494640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c701447f0 0x7f1c700b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c78494640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c701f0f40 con 0x7f1c701447f0 2023-12-12T09:23:34.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c78494640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c70158fd0 con 0x7f1c70143d20 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c78494640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7013c200 con 0x7f1c700ce550 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c76a31640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c701447f0 0x7f1c700b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c76a31640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c701447f0 0x7f1c700b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33290/0 (socket says 172.21.15.84:33290) 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.172+0000 7f1c76a31640 1 -- 172.21.15.84:0/531179739 learned_addr learned my addr 172.21.15.84:0/531179739 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c75a2f640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c70143d20 0x7f1c700afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c76230640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c700ce550 0x7f1c7013b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c76a31640 1 -- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c700ce550 msgr2=0x7f1c7013b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c76a31640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c700ce550 0x7f1c7013b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c76a31640 1 -- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c70143d20 msgr2=0x7f1c700afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c76a31640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c70143d20 0x7f1c700afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c76a31640 1 -- 172.21.15.84:0/531179739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64009b30 con 0x7f1c701447f0 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c76230640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c700ce550 0x7f1c7013b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:34.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c76a31640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c701447f0 0x7f1c700b02b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c5f0 tx=0x7f1c6800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.173+0000 7f1c6effd640 1 -- 172.21.15.84:0/531179739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68004220 con 0x7f1c701447f0 2023-12-12T09:23:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.174+0000 7f1c6effd640 1 -- 172.21.15.84:0/531179739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68004380 con 0x7f1c701447f0 2023-12-12T09:23:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.174+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7013c4e0 con 0x7f1c701447f0 2023-12-12T09:23:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.174+0000 7f1c6effd640 1 -- 172.21.15.84:0/531179739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68003850 con 0x7f1c701447f0 2023-12-12T09:23:34.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.174+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7013caa0 con 0x7f1c701447f0 2023-12-12T09:23:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.175+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c700673c0 con 0x7f1c701447f0 2023-12-12T09:23:34.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.176+0000 7f1c6effd640 1 -- 172.21.15.84:0/531179739 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c680039b0 con 0x7f1c701447f0 2023-12-12T09:23:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.177+0000 7f1c6effd640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1c5406ae40 0x7f1c5406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.177+0000 7f1c6effd640 1 -- 172.21.15.84:0/531179739 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1c680894e0 con 0x7f1c701447f0 2023-12-12T09:23:34.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.177+0000 7f1c76230640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1c5406ae40 0x7f1c5406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.178+0000 7f1c76230640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1c5406ae40 0x7f1c5406d300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c64035000 tx=0x7f1c64030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:34.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.181+0000 7f1c6effd640 1 -- 172.21.15.84:0/531179739 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c68054480 con 0x7f1c701447f0 2023-12-12T09:23:34.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.410+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1c7006e3b0 con 0x7f1c701447f0 2023-12-12T09:23:34.411 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-12-12T09:23:34.411+0000 7f59e3967640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T09:23:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.415+0000 7f1c6effd640 1 -- 172.21.15.84:0/531179739 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1c68057aa0 con 0x7f1c701447f0 2023-12-12T09:23:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T09:23:34.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1c5406ae40 msgr2=0x7f1c5406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1c5406ae40 0x7f1c5406d300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1c64035000 tx=0x7f1c64030000 comp rx=0 tx=0).stop 2023-12-12T09:23:34.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c701447f0 msgr2=0x7f1c700b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c701447f0 0x7f1c700b02b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c5f0 tx=0x7f1c6800cab0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 shutdown_connections 2023-12-12T09:23:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f1c5406ae40 0x7f1c5406d300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c701447f0 0x7f1c700b02b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c70143d20 0x7f1c700afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 --2- 172.21.15.84:0/531179739 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f1c700ce550 0x7f1c7013b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 >> 172.21.15.84:0/531179739 conn(0x7f1c7006c3d0 msgr2=0x7f1c7015b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 shutdown_connections 2023-12-12T09:23:34.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.420+0000 7f1c78494640 1 -- 172.21.15.84:0/531179739 wait complete. 2023-12-12T09:23:34.425 INFO:tasks.ceph.mds.a.smithi084.stderr: -3174> 2023-12-12T09:22:53.671+0000 7f876d8bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T09:23:34.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T09:23:34.477 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-12-12T09:23:34.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.632+0000 7fdaa2dfc640 1 Processor -- start 2023-12-12T09:23:34.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.632+0000 7fdaa2dfc640 1 -- start start 2023-12-12T09:23:34.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.634+0000 7fdaa2dfc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fda9c0b40d0 0x7fda9c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.634+0000 7fdaa2dfc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fda9c15be60 0x7fda9c13e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.634+0000 7fdaa2dfc640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0ceb80 con 0x7fda9c0ce6f0 2023-12-12T09:23:34.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.634+0000 7fdaa2dfc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c0ce260 con 0x7fda9c0b40d0 2023-12-12T09:23:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.634+0000 7fdaa2dfc640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c0cd930 con 0x7fda9c15be60 2023-12-12T09:23:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.634+0000 7fdaa0b98640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fda9c0b40d0 0x7fda9c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.634+0000 7fda93fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fda9c0ce6f0 0x7fda9c0b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34274/0 (socket says 172.21.15.84:34274) 2023-12-12T09:23:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.634+0000 7fda93fff640 1 -- 172.21.15.84:0/3620786728 learned_addr learned my addr 172.21.15.84:0/3620786728 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.635+0000 7fdaa1399640 1 --2- 172.21.15.84:0/3620786728 >> v2:172.21.15.99:3300/0 conn(0x7fda9c15be60 0x7fda9c13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.635+0000 7fda937fe640 1 -- 172.21.15.84:0/3620786728 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356947632 0 0) 0x7fda9c0ceb80 con 0x7fda9c0ce6f0 2023-12-12T09:23:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.635+0000 7fdaa0b98640 1 -- 172.21.15.84:0/3620786728 >> v2:172.21.15.99:3300/0 conn(0x7fda9c15be60 msgr2=0x7fda9c13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.635+0000 7fdaa0b98640 1 --2- 172.21.15.84:0/3620786728 >> v2:172.21.15.99:3300/0 conn(0x7fda9c15be60 0x7fda9c13e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.635+0000 7fdaa0b98640 1 -- 172.21.15.84:0/3620786728 >> v1:172.21.15.84:6789/0 conn(0x7fda9c0ce6f0 legacy=0x7fda9c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.635+0000 7fdaa0b98640 1 -- 172.21.15.84:0/3620786728 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0cdc10 con 0x7fda9c0b40d0 2023-12-12T09:23:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.636+0000 7fdaa0b98640 1 --2- 172.21.15.84:0/3620786728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c06dff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fda9c1592b0 tx=0x7fda9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e6f0125f9e4be server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.636+0000 7fda937fe640 1 -- 172.21.15.84:0/3620786728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98031830 con 0x7fda9c0b40d0 2023-12-12T09:23:34.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.636+0000 7fda937fe640 1 -- 172.21.15.84:0/3620786728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98031990 con 0x7fda9c0b40d0 2023-12-12T09:23:34.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.636+0000 7fda937fe640 1 -- 172.21.15.84:0/3620786728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98031d20 con 0x7fda9c0b40d0 2023-12-12T09:23:34.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.637+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/3620786728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 msgr2=0x7fda9c06dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.637+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/3620786728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c06dff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fda9c1592b0 tx=0x7fda9802b8d0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.637+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/3620786728 shutdown_connections 2023-12-12T09:23:34.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.637+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/3620786728 >> v2:172.21.15.99:3300/0 conn(0x7fda9c15be60 0x7fda9c13e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.637+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/3620786728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c06dff0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.637+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/3620786728 >> 172.21.15.84:0/3620786728 conn(0x7fda9c0b0ac0 msgr2=0x7fda9c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:34.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.637+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/3620786728 shutdown_connections 2023-12-12T09:23:34.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.637+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/3620786728 wait complete. 2023-12-12T09:23:34.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.639+0000 7fdaa2dfc640 1 Processor -- start 2023-12-12T09:23:34.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.639+0000 7fdaa2dfc640 1 -- start start 2023-12-12T09:23:34.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa2dfc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c13fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa2dfc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9c0ce6f0 0x7fda9c132c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa2dfc640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda9c15be60 0x7fda9c0719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa2dfc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1400d0 con 0x7fda9c0b40d0 2023-12-12T09:23:34.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa2dfc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c133170 con 0x7fda9c0ce6f0 2023-12-12T09:23:34.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa2dfc640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c071f10 con 0x7fda9c15be60 2023-12-12T09:23:34.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa0b98640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c13fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa0b98640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c13fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33328/0 (socket says 172.21.15.84:33328) 2023-12-12T09:23:34.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa0b98640 1 -- 172.21.15.84:0/4028379337 learned_addr learned my addr 172.21.15.84:0/4028379337 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa1399640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda9c15be60 0x7fda9c0719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.640+0000 7fdaa0b98640 1 -- 172.21.15.84:0/4028379337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda9c15be60 msgr2=0x7fda9c0719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fdaa0b98640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda9c15be60 0x7fda9c0719d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fdaa0b98640 1 -- 172.21.15.84:0/4028379337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9c0ce6f0 msgr2=0x7fda9c132c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fda93fff640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9c0ce6f0 0x7fda9c132c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fdaa0b98640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9c0ce6f0 0x7fda9c132c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fdaa0b98640 1 -- 172.21.15.84:0/4028379337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98009400 con 0x7fda9c0b40d0 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fdaa0b98640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c13fb90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fda98000c00 tx=0x7fda980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:34.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fda917fa640 1 -- 172.21.15.84:0/4028379337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9803aa60 con 0x7fda9c0b40d0 2023-12-12T09:23:34.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fda917fa640 1 -- 172.21.15.84:0/4028379337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9803abe0 con 0x7fda9c0b40d0 2023-12-12T09:23:34.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fda917fa640 1 -- 172.21.15.84:0/4028379337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980443f0 con 0x7fda9c0b40d0 2023-12-12T09:23:34.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c140300 con 0x7fda9c0b40d0 2023-12-12T09:23:34.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.641+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c1408c0 con 0x7fda9c0b40d0 2023-12-12T09:23:34.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.643+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c0673c0 con 0x7fda9c0b40d0 2023-12-12T09:23:34.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.644+0000 7fda917fa640 1 -- 172.21.15.84:0/4028379337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda9804d450 con 0x7fda9c0b40d0 2023-12-12T09:23:34.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.644+0000 7fda917fa640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fda8806ae40 0x7fda8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:34.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.645+0000 7fda917fa640 1 -- 172.21.15.84:0/4028379337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fda980ab940 con 0x7fda9c0b40d0 2023-12-12T09:23:34.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.645+0000 7fda93fff640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fda8806ae40 0x7fda8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:34.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.645+0000 7fda93fff640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fda8806ae40 0x7fda8806d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fda8c007fd0 tx=0x7fda8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:34.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.649+0000 7fda917fa640 1 -- 172.21.15.84:0/4028379337 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda98076850 con 0x7fda9c0b40d0 2023-12-12T09:23:34.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:34.876+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fda9c15e450 con 0x7fda9c0b40d0 2023-12-12T09:23:35.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.418+0000 7fda917fa640 1 -- 172.21.15.84:0/4028379337 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fda98035020 con 0x7fda9c0b40d0 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.421+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fda8806ae40 msgr2=0x7fda8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.421+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fda8806ae40 0x7fda8806d300 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fda8c007fd0 tx=0x7fda8c009040 comp rx=0 tx=0).stop 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.421+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 msgr2=0x7fda9c13fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.421+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c13fb90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fda98000c00 tx=0x7fda980046c0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.422+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 shutdown_connections 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.422+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fda9c15be60 0x7fda9c0719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.422+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda9c0ce6f0 0x7fda9c132c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.422+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fda8806ae40 0x7fda8806d300 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.422+0000 7fdaa2dfc640 1 --2- 172.21.15.84:0/4028379337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda9c0b40d0 0x7fda9c13fb90 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.422+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 >> 172.21.15.84:0/4028379337 conn(0x7fda9c0b0ac0 msgr2=0x7fda9c06d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:35.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.422+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 shutdown_connections 2023-12-12T09:23:35.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.422+0000 7fdaa2dfc640 1 -- 172.21.15.84:0/4028379337 wait complete. 2023-12-12T09:23:35.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T09:23:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.709+0000 7fc38daf3640 1 Processor -- start 2023-12-12T09:23:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.710+0000 7fc38daf3640 1 -- start start 2023-12-12T09:23:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.711+0000 7fc38daf3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388163f90 0x7fc388166380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.711+0000 7fc38daf3640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc388070cb0 con 0x7fc38806c060 2023-12-12T09:23:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.711+0000 7fc38daf3640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc388070f50 con 0x7fc388071cd0 2023-12-12T09:23:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.711+0000 7fc38daf3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc388072130 con 0x7fc388163f90 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.712+0000 7fc3877fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fc38806c060 0x7fc3880abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34278/0 (socket says 172.21.15.84:34278) 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.712+0000 7fc3877fe640 1 -- 172.21.15.84:0/3223264122 learned_addr learned my addr 172.21.15.84:0/3223264122 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.712+0000 7fc387fff640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388163f90 0x7fc388166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.712+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673645368 0 0) 0x7fc388070cb0 con 0x7fc38806c060 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.712+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc374003520 con 0x7fc38806c060 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.712+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426000719 0 0) 0x7fc374003520 con 0x7fc38806c060 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388163f90 msgr2=0x7fc388166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388163f90 0x7fc388166380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 >> v1:172.21.15.99:6789/0 conn(0x7fc388071cd0 legacy=0x7fc3880ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38806d8c0 con 0x7fc38806c060 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fc3780019f0 con 0x7fc38806c060 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 >> v1:172.21.15.84:6789/0 conn(0x7fc38806c060 legacy=0x7fc3880abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388163f90 0x7fc374003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc3740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc374004d00 0x7fc374005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37400bbb0 con 0x7fc374004000 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37400bd20 con 0x7fc374004d00 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37400bee0 con 0x7fc388163f90 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc386ffd640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc3740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc3877fe640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388163f90 0x7fc374003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.713+0000 7fc387fff640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc374004d00 0x7fc374005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.714+0000 7fc386ffd640 1 -- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388163f90 msgr2=0x7fc374003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.714+0000 7fc386ffd640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388163f90 0x7fc374003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.714+0000 7fc386ffd640 1 -- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc374004d00 msgr2=0x7fc374005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.714+0000 7fc386ffd640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc374004d00 0x7fc374005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.714+0000 7fc386ffd640 1 -- 172.21.15.84:0/3223264122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374003520 con 0x7fc374004000 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.715+0000 7fc386ffd640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc3740047c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc370001750 tx=0x7fc3740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3055cdf1e133a36 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.715+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3700052d0 con 0x7fc374004000 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.715+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37002e050 con 0x7fc374004000 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.715+0000 7fc3867fc640 1 -- 172.21.15.84:0/3223264122 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc370003830 con 0x7fc374004000 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.715+0000 7fc38daf3640 1 -- 172.21.15.84:0/3223264122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 msgr2=0x7fc3740047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.715+0000 7fc38daf3640 1 --2- 172.21.15.84:0/3223264122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc3740047c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc370001750 tx=0x7fc3740057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.715+0000 7fc387fff640 1 -- 172.21.15.84:0/3223264122 reap_dead start 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.716+0000 7fc38daf3640 1 -- 172.21.15.84:0/3223264122 shutdown_connections 2023-12-12T09:23:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.716+0000 7fc38daf3640 1 -- 172.21.15.84:0/3223264122 >> 172.21.15.84:0/3223264122 conn(0x7fc3880b0970 msgr2=0x7fc3880b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.716+0000 7fc38daf3640 1 -- 172.21.15.84:0/3223264122 shutdown_connections 2023-12-12T09:23:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.716+0000 7fc38daf3640 1 -- 172.21.15.84:0/3223264122 wait complete. 2023-12-12T09:23:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.717+0000 7fc38daf3640 1 Processor -- start 2023-12-12T09:23:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.718+0000 7fc38daf3640 1 -- start start 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.718+0000 7fc38daf3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc388157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc38daf3640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388144310 0x7fc388144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc38daf3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38814dab0 0x7fc38814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc38daf3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38815b660 con 0x7fc374004000 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc38daf3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38814f0a0 con 0x7fc38814dab0 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc38daf3640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc388144cb0 con 0x7fc388144310 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc388157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc388157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33340/0 (socket says 172.21.15.84:33340) 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 -- 172.21.15.84:0/3428741601 learned_addr learned my addr 172.21.15.84:0/3428741601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 -- 172.21.15.84:0/3428741601 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388144310 msgr2=0x7fc388144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388144310 0x7fc388144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 -- 172.21.15.84:0/3428741601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38814dab0 msgr2=0x7fc38814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38814dab0 0x7fc38814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 -- 172.21.15.84:0/3428741601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388099f30 con 0x7fc374004000 2023-12-12T09:23:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.719+0000 7fc3877fe640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc388157e10 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc378007a00 tx=0x7fc37800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.720+0000 7fc37ffff640 1 -- 172.21.15.84:0/3428741601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37800ed70 con 0x7fc374004000 2023-12-12T09:23:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.720+0000 7fc37ffff640 1 -- 172.21.15.84:0/3428741601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378013420 con 0x7fc374004000 2023-12-12T09:23:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.720+0000 7fc37ffff640 1 -- 172.21.15.84:0/3428741601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3780137d0 con 0x7fc374004000 2023-12-12T09:23:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.720+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38814eae0 con 0x7fc374004000 2023-12-12T09:23:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.720+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc388099bc0 con 0x7fc374004000 2023-12-12T09:23:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.721+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc388067f60 con 0x7fc374004000 2023-12-12T09:23:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.722+0000 7fc37ffff640 1 -- 172.21.15.84:0/3428741601 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc378013930 con 0x7fc374004000 2023-12-12T09:23:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.723+0000 7fc37ffff640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc36806ae40 0x7fc36806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.723+0000 7fc37ffff640 1 -- 172.21.15.84:0/3428741601 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fc378089ff0 con 0x7fc374004000 2023-12-12T09:23:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.723+0000 7fc386ffd640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc36806ae40 0x7fc36806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.724+0000 7fc386ffd640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc36806ae40 0x7fc36806d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc370033000 tx=0x7fc37002f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:35.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.727+0000 7fc37ffff640 1 -- 172.21.15.84:0/3428741601 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3780bce90 con 0x7fc374004000 2023-12-12T09:23:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:35.918+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc388099a20 con 0x7fc374004000 2023-12-12T09:23:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.430+0000 7fc37ffff640 1 -- 172.21.15.84:0/3428741601 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc388099a20 con 0x7fc374004000 2023-12-12T09:23:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-12-12T09:23:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.433+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc36806ae40 msgr2=0x7fc36806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.433+0000 7fc38daf3640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc36806ae40 0x7fc36806d300 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc370033000 tx=0x7fc37002f000 comp rx=0 tx=0).stop 2023-12-12T09:23:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.433+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 msgr2=0x7fc388157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.433+0000 7fc38daf3640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc388157e10 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc378007a00 tx=0x7fc37800e530 comp rx=0 tx=0).stop 2023-12-12T09:23:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.434+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 shutdown_connections 2023-12-12T09:23:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.434+0000 7fc38daf3640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc38814dab0 0x7fc38814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.434+0000 7fc38daf3640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fc388144310 0x7fc388144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.434+0000 7fc38daf3640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fc36806ae40 0x7fc36806d300 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.434+0000 7fc38daf3640 1 --2- 172.21.15.84:0/3428741601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc374004000 0x7fc388157e10 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.434+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 >> 172.21.15.84:0/3428741601 conn(0x7fc3880b0970 msgr2=0x7fc3880ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.434+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 shutdown_connections 2023-12-12T09:23:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.434+0000 7fc38daf3640 1 -- 172.21.15.84:0/3428741601 wait complete. 2023-12-12T09:23:36.459 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T09:23:36.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.668+0000 7f21d53b0640 1 Processor -- start 2023-12-12T09:23:36.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.669+0000 7f21d53b0640 1 -- start start 2023-12-12T09:23:36.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.670+0000 7f21d53b0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21d0071cd0 0x7f21d00ac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:36.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.670+0000 7f21d53b0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d0070cb0 con 0x7f21d006c440 2023-12-12T09:23:36.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.671+0000 7f21d53b0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d0070f50 con 0x7f21d006c060 2023-12-12T09:23:36.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.671+0000 7f21d53b0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d0072130 con 0x7f21d0071cd0 2023-12-12T09:23:36.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.671+0000 7f21cf7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f21d006c440 0x7f21d006c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50120/0 (socket says 172.21.15.84:50120) 2023-12-12T09:23:36.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.671+0000 7f21cf7fe640 1 -- 172.21.15.84:0/2519697989 learned_addr learned my addr 172.21.15.84:0/2519697989 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:36.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.671+0000 7f21c7fff640 1 --2- 172.21.15.84:0/2519697989 >> v2:172.21.15.99:3300/0 conn(0x7f21d0071cd0 0x7f21d00ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.671+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260273716 0 0) 0x7f21d0070cb0 con 0x7f21d006c440 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.671+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21bc003520 con 0x7f21d006c440 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1430803172 0 0) 0x7f21bc003520 con 0x7f21d006c440 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 >> v2:172.21.15.99:3300/0 conn(0x7f21d0071cd0 msgr2=0x7f21d00ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 --2- 172.21.15.84:0/2519697989 >> v2:172.21.15.99:3300/0 conn(0x7f21d0071cd0 0x7f21d00ac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 >> v1:172.21.15.99:6789/0 conn(0x7f21d006c060 legacy=0x7f21d00abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d006d8c0 con 0x7f21d006c440 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f21c80019f0 con 0x7f21d006c440 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 >> v1:172.21.15.84:6789/0 conn(0x7f21d006c440 legacy=0x7f21d006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:36.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc003a50 0x7f21bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0047c0 0x7f21bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc005380 0x7f21bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc00c210 con 0x7f21bc003a50 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc00c380 con 0x7f21bc005380 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc00c540 con 0x7f21bc0047c0 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.672+0000 7f21ceffd640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc003a50 0x7f21bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21cf7fe640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc005380 0x7f21bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21c7fff640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0047c0 0x7f21bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21ceffd640 1 -- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0047c0 msgr2=0x7f21bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:36.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21ceffd640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0047c0 0x7f21bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21ceffd640 1 -- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc005380 msgr2=0x7f21bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21ceffd640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc005380 0x7f21bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21cf7fe640 1 -- 172.21.15.84:0/2519697989 reap_dead start 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21ceffd640 1 -- 172.21.15.84:0/2519697989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc003520 con 0x7f21bc003a50 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.673+0000 7f21c7fff640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21bc0047c0 0x7f21bc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.674+0000 7f21ceffd640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc003a50 0x7f21bc003e70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f21c0001750 tx=0x7f21bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ebff6939ee4d54 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c00052d0 con 0x7f21bc003a50 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c002e050 con 0x7f21bc003a50 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21ce7fc640 1 -- 172.21.15.84:0/2519697989 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0003830 con 0x7f21bc003a50 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21d53b0640 1 -- 172.21.15.84:0/2519697989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc003a50 msgr2=0x7f21bc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:36.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21d53b0640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc003a50 0x7f21bc003e70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f21c0001750 tx=0x7f21bc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21d53b0640 1 -- 172.21.15.84:0/2519697989 shutdown_connections 2023-12-12T09:23:36.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21d53b0640 1 --2- 172.21.15.84:0/2519697989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc003a50 0x7f21bc003e70 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21d53b0640 1 -- 172.21.15.84:0/2519697989 >> 172.21.15.84:0/2519697989 conn(0x7f21d00b0970 msgr2=0x7f21d00b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:36.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21d53b0640 1 -- 172.21.15.84:0/2519697989 shutdown_connections 2023-12-12T09:23:36.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.675+0000 7f21d53b0640 1 -- 172.21.15.84:0/2519697989 wait complete. 2023-12-12T09:23:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.677+0000 7f21d53b0640 1 Processor -- start 2023-12-12T09:23:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.677+0000 7f21d53b0640 1 -- start start 2023-12-12T09:23:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.678+0000 7f21d53b0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc003a50 0x7f21d00ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:36.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.678+0000 7f21d53b0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21d014a7c0 0x7f21d014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.678+0000 7f21d53b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d014a2c0 0x7f21d009bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.678+0000 7f21d53b0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0151f30 con 0x7f21d014a2c0 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.678+0000 7f21d53b0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0151970 con 0x7f21bc003a50 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.678+0000 7f21d53b0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0151c50 con 0x7f21d014a7c0 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21cf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d014a2c0 0x7f21d009bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21cf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d014a2c0 0x7f21d009bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39938/0 (socket says 172.21.15.84:39938) 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21cf7fe640 1 -- 172.21.15.84:0/1075596711 learned_addr learned my addr 172.21.15.84:0/1075596711 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21ceffd640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc003a50 0x7f21d00ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21c7fff640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21d014a7c0 0x7f21d014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21cf7fe640 1 -- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21d014a7c0 msgr2=0x7f21d014ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21cf7fe640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21d014a7c0 0x7f21d014ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21cf7fe640 1 -- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc003a50 msgr2=0x7f21d00ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:36.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21cf7fe640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc003a50 0x7f21d00ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21cf7fe640 1 -- 172.21.15.84:0/1075596711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d014fb20 con 0x7f21d014a2c0 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.679+0000 7f21ceffd640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc003a50 0x7f21d00ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.680+0000 7f21cf7fe640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d014a2c0 0x7f21d009bbf0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f21d006fef0 tx=0x7f21c8007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.680+0000 7f21c77fe640 1 -- 172.21.15.84:0/1075596711 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800ea20 con 0x7f21d014a2c0 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.680+0000 7f21c77fe640 1 -- 172.21.15.84:0/1075596711 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800eb80 con 0x7f21d014a2c0 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.680+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d0151660 con 0x7f21d014a2c0 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.680+0000 7f21c77fe640 1 -- 172.21.15.84:0/1075596711 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8013420 con 0x7f21d014a2c0 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.680+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d0150040 con 0x7f21d014a2c0 2023-12-12T09:23:36.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.681+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d0067f60 con 0x7f21d014a2c0 2023-12-12T09:23:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.682+0000 7f21c77fe640 1 -- 172.21.15.84:0/1075596711 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21c8013580 con 0x7f21d014a2c0 2023-12-12T09:23:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.683+0000 7f21c77fe640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21b006ae40 0x7f21b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.683+0000 7f21c77fe640 1 -- 172.21.15.84:0/1075596711 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5677+0+0 (secure 0 0 0) 0x7f21c8089950 con 0x7f21d014a2c0 2023-12-12T09:23:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.684+0000 7f21ceffd640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21b006ae40 0x7f21b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:36.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.684+0000 7f21ceffd640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21b006ae40 0x7f21b006d300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f21c0033000 tx=0x7f21c0009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:36.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.688+0000 7f21c77fe640 1 -- 172.21.15.84:0/1075596711 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21c8054a20 con 0x7f21d014a2c0 2023-12-12T09:23:36.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:36.879+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f21d0150230 con 0x7f21d014a2c0 2023-12-12T09:23:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.440+0000 7f21c77fe640 1 -- 172.21.15.84:0/1075596711 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f21c8058040 con 0x7f21d014a2c0 2023-12-12T09:23:37.440 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-12-12T09:23:37.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21b006ae40 msgr2=0x7f21b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:37.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21b006ae40 0x7f21b006d300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f21c0033000 tx=0x7f21c0009030 comp rx=0 tx=0).stop 2023-12-12T09:23:37.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d014a2c0 msgr2=0x7f21d009bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:37.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d014a2c0 0x7f21d009bbf0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f21d006fef0 tx=0x7f21c8007bc0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 shutdown_connections 2023-12-12T09:23:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f21b006ae40 0x7f21b006d300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d014a2c0 0x7f21d009bbf0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f21d014a7c0 0x7f21d014ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 --2- 172.21.15.84:0/1075596711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21bc003a50 0x7f21d00ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 >> 172.21.15.84:0/1075596711 conn(0x7f21d00b0970 msgr2=0x7f21d00abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.444+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 shutdown_connections 2023-12-12T09:23:37.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.445+0000 7f21d53b0640 1 -- 172.21.15.84:0/1075596711 wait complete. 2023-12-12T09:23:37.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-12T09:23:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.677+0000 7fa1842ad640 1 Processor -- start 2023-12-12T09:23:37.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.678+0000 7fa1842ad640 1 -- start start 2023-12-12T09:23:37.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.679+0000 7fa1842ad640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa17c0b40d0 0x7fa17c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.679+0000 7fa1842ad640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa17c15be60 0x7fa17c13e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.679+0000 7fa1842ad640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17c0ceb80 con 0x7fa17c0ce6f0 2023-12-12T09:23:37.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.679+0000 7fa1842ad640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17c0ce260 con 0x7fa17c15be60 2023-12-12T09:23:37.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.679+0000 7fa1842ad640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0cd930 con 0x7fa17c0b40d0 2023-12-12T09:23:37.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.680+0000 7fa181848640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa17c0ce6f0 0x7fa17c0b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50122/0 (socket says 172.21.15.84:50122) 2023-12-12T09:23:37.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.680+0000 7fa181848640 1 -- 172.21.15.84:0/3490917506 learned_addr learned my addr 172.21.15.84:0/3490917506 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.680+0000 7fa18284a640 1 --2- 172.21.15.84:0/3490917506 >> v2:172.21.15.99:3300/0 conn(0x7fa17c15be60 0x7fa17c13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.680+0000 7fa182049640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa17c0b40d0 0x7fa17c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.680+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529323075 0 0) 0x7fa17c0ceb80 con 0x7fa17c0ce6f0 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.680+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa168003520 con 0x7fa17c0ce6f0 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.680+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3270726019 0 0) 0x7fa168003520 con 0x7fa17c0ce6f0 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.680+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa17c0b40d0 msgr2=0x7fa17c06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa17c0b40d0 0x7fa17c06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 >> v2:172.21.15.99:3300/0 conn(0x7fa17c15be60 msgr2=0x7fa17c13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:37.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 --2- 172.21.15.84:0/3490917506 >> v2:172.21.15.99:3300/0 conn(0x7fa17c15be60 0x7fa17c13e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c0cdc10 con 0x7fa17c0ce6f0 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fa16c001670 con 0x7fa17c0ce6f0 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 >> v1:172.21.15.84:6789/0 conn(0x7fa17c0ce6f0 legacy=0x7fa17c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa17c0b40d0 0x7fa168003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa168003ff0 0x7fa1680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa168004d00 0x7fa168005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0ce260 con 0x7fa168003ff0 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c0cd930 con 0x7fa168004d00 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16800bae0 con 0x7fa17c0b40d0 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181848640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa168003ff0 0x7fa1680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa182049640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa17c0b40d0 0x7fa168003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181848640 1 -- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa17c0b40d0 msgr2=0x7fa168003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181848640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa17c0b40d0 0x7fa168003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181848640 1 -- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa168004d00 msgr2=0x7fa168005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:37.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181848640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa168004d00 0x7fa168005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.681+0000 7fa181848640 1 -- 172.21.15.84:0/3490917506 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168003520 con 0x7fa168003ff0 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.683+0000 7fa181848640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa168003ff0 0x7fa1680047c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00c110 tx=0x7fa1680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67db2c31acf9cd95 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.683+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c005ad0 con 0x7fa168003ff0 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.683+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c005c50 con 0x7fa168003ff0 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.683+0000 7fa181047640 1 -- 172.21.15.84:0/3490917506 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c02c830 con 0x7fa168003ff0 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.683+0000 7fa1842ad640 1 -- 172.21.15.84:0/3490917506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa168003ff0 msgr2=0x7fa1680047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.683+0000 7fa1842ad640 1 --2- 172.21.15.84:0/3490917506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa168003ff0 0x7fa1680047c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00c110 tx=0x7fa1680057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.683+0000 7fa18284a640 1 -- 172.21.15.84:0/3490917506 reap_dead start 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.684+0000 7fa1842ad640 1 -- 172.21.15.84:0/3490917506 shutdown_connections 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.684+0000 7fa1842ad640 1 -- 172.21.15.84:0/3490917506 >> 172.21.15.84:0/3490917506 conn(0x7fa17c0b0ac0 msgr2=0x7fa17c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.684+0000 7fa1842ad640 1 -- 172.21.15.84:0/3490917506 shutdown_connections 2023-12-12T09:23:37.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.684+0000 7fa1842ad640 1 -- 172.21.15.84:0/3490917506 wait complete. 2023-12-12T09:23:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.685+0000 7fa1842ad640 1 Processor -- start 2023-12-12T09:23:37.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.686+0000 7fa1842ad640 1 -- start start 2023-12-12T09:23:37.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.686+0000 7fa1842ad640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa168003ff0 0x7fa17c13b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa1842ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa17c1542f0 0x7fa17c154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa1842ad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa17c13e770 0x7fa17c13ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa1842ad640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c13b840 con 0x7fa17c1542f0 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa1842ad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c154cb0 con 0x7fa17c13e770 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa1842ad640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c13f4e0 con 0x7fa168003ff0 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa181848640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa17c1542f0 0x7fa17c154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa181848640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa17c1542f0 0x7fa17c154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39954/0 (socket says 172.21.15.84:39954) 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa181848640 1 -- 172.21.15.84:0/3314280256 learned_addr learned my addr 172.21.15.84:0/3314280256 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa182049640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa168003ff0 0x7fa17c13b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa181848640 1 -- 172.21.15.84:0/3314280256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa168003ff0 msgr2=0x7fa17c13b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa181848640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa168003ff0 0x7fa17c13b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa181848640 1 -- 172.21.15.84:0/3314280256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa17c13e770 msgr2=0x7fa17c13ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa181848640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa17c13e770 0x7fa17c13ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.687+0000 7fa181848640 1 -- 172.21.15.84:0/3314280256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c13f7c0 con 0x7fa17c1542f0 2023-12-12T09:23:37.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.688+0000 7fa181848640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa17c1542f0 0x7fa17c154770 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa16c02c3d0 tx=0x7fa16c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:37.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.688+0000 7fa172ffd640 1 -- 172.21.15.84:0/3314280256 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c03c040 con 0x7fa17c1542f0 2023-12-12T09:23:37.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.688+0000 7fa172ffd640 1 -- 172.21.15.84:0/3314280256 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c02dcd0 con 0x7fa17c1542f0 2023-12-12T09:23:37.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.688+0000 7fa172ffd640 1 -- 172.21.15.84:0/3314280256 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0072b0 con 0x7fa17c1542f0 2023-12-12T09:23:37.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.688+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17c13faa0 con 0x7fa17c1542f0 2023-12-12T09:23:37.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.688+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c140060 con 0x7fa17c1542f0 2023-12-12T09:23:37.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.689+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17c140220 con 0x7fa17c1542f0 2023-12-12T09:23:37.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.690+0000 7fa172ffd640 1 -- 172.21.15.84:0/3314280256 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa16c032070 con 0x7fa17c1542f0 2023-12-12T09:23:37.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.691+0000 7fa172ffd640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa16006ae70 0x7fa16006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:37.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.691+0000 7fa172ffd640 1 -- 172.21.15.84:0/3314280256 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa16c0aafa0 con 0x7fa17c1542f0 2023-12-12T09:23:37.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.691+0000 7fa182049640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa16006ae70 0x7fa16006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:37.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.692+0000 7fa182049640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa16006ae70 0x7fa16006d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa178006fd0 tx=0x7fa178008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:37.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.696+0000 7fa172ffd640 1 -- 172.21.15.84:0/3314280256 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa16c076170 con 0x7fa17c1542f0 2023-12-12T09:23:37.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.885+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa17c0673c0 con 0x7fa17c1542f0 2023-12-12T09:23:37.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.890+0000 7fa172ffd640 1 -- 172.21.15.84:0/3314280256 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa16c079790 con 0x7fa17c1542f0 2023-12-12T09:23:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.893+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa16006ae70 msgr2=0x7fa16006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa16006ae70 0x7fa16006d330 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa178006fd0 tx=0x7fa178008040 comp rx=0 tx=0).stop 2023-12-12T09:23:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa17c1542f0 msgr2=0x7fa17c154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa17c1542f0 0x7fa17c154770 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa16c02c3d0 tx=0x7fa16c001930 comp rx=0 tx=0).stop 2023-12-12T09:23:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 shutdown_connections 2023-12-12T09:23:37.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa17c13e770 0x7fa17c13ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fa16006ae70 0x7fa16006d330 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa17c1542f0 0x7fa17c154770 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 --2- 172.21.15.84:0/3314280256 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fa168003ff0 0x7fa17c13b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 >> 172.21.15.84:0/3314280256 conn(0x7fa17c0b0ac0 msgr2=0x7fa17c15c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 shutdown_connections 2023-12-12T09:23:37.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:37.894+0000 7fa1842ad640 1 -- 172.21.15.84:0/3314280256 wait complete. 2023-12-12T09:23:37.912 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-12-12T09:23:38.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.119+0000 7fb429b76640 1 Processor -- start 2023-12-12T09:23:38.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.119+0000 7fb429b76640 1 -- start start 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.120+0000 7fb429b76640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb424143d20 0x7fb4240b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb429b76640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4241447f0 0x7fb4240b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb429b76640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4240cea30 con 0x7fb4240ce550 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb429b76640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240702b0 con 0x7fb4241447f0 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb429b76640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb424070590 con 0x7fb424143d20 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb423fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4241447f0 0x7fb4240b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb423fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb4241447f0 0x7fb4240b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39968/0 (socket says 172.21.15.84:39968) 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb423fff640 1 -- 172.21.15.84:0/3124635527 learned_addr learned my addr 172.21.15.84:0/3124635527 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb4237fe640 1 --2- 172.21.15.84:0/3124635527 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb424143d20 0x7fb4240b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb423fff640 1 -- 172.21.15.84:0/3124635527 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb424143d20 msgr2=0x7fb4240b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb423fff640 1 --2- 172.21.15.84:0/3124635527 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb424143d20 0x7fb4240b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb423fff640 1 -- 172.21.15.84:0/3124635527 >> v1:172.21.15.99:6789/0 conn(0x7fb4240ce550 legacy=0x7fb42415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:38.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.121+0000 7fb423fff640 1 -- 172.21.15.84:0/3124635527 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424070870 con 0x7fb4241447f0 2023-12-12T09:23:38.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.123+0000 7fb423fff640 1 --2- 172.21.15.84:0/3124635527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb4240b4610 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009e50 tx=0x7fb41c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761e724db94cb5f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:38.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.123+0000 7fb422ffd640 1 -- 172.21.15.84:0/3124635527 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c02cb00 con 0x7fb4241447f0 2023-12-12T09:23:38.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.123+0000 7fb422ffd640 1 -- 172.21.15.84:0/3124635527 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c02cc60 con 0x7fb4241447f0 2023-12-12T09:23:38.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.123+0000 7fb422ffd640 1 -- 172.21.15.84:0/3124635527 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0343f0 con 0x7fb4241447f0 2023-12-12T09:23:38.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.124+0000 7fb429b76640 1 -- 172.21.15.84:0/3124635527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 msgr2=0x7fb4240b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:38.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.124+0000 7fb429b76640 1 --2- 172.21.15.84:0/3124635527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb4240b4610 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009e50 tx=0x7fb41c02bf60 comp rx=0 tx=0).stop 2023-12-12T09:23:38.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.124+0000 7fb429b76640 1 -- 172.21.15.84:0/3124635527 shutdown_connections 2023-12-12T09:23:38.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.124+0000 7fb429b76640 1 --2- 172.21.15.84:0/3124635527 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb4240b4610 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.124+0000 7fb429b76640 1 --2- 172.21.15.84:0/3124635527 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb424143d20 0x7fb4240b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.124+0000 7fb429b76640 1 -- 172.21.15.84:0/3124635527 >> 172.21.15.84:0/3124635527 conn(0x7fb42406c3d0 msgr2=0x7fb42406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:38.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.124+0000 7fb429b76640 1 -- 172.21.15.84:0/3124635527 shutdown_connections 2023-12-12T09:23:38.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.124+0000 7fb429b76640 1 -- 172.21.15.84:0/3124635527 wait complete. 2023-12-12T09:23:38.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.126+0000 7fb429b76640 1 Processor -- start 2023-12-12T09:23:38.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.126+0000 7fb429b76640 1 -- start start 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb429b76640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4240ce550 0x7fb4241f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb429b76640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb424143d20 0x7fb42413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb429b76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb42415ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb429b76640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4241f4430 con 0x7fb4241447f0 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb429b76640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42415b780 con 0x7fb424143d20 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb429b76640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4241f3940 con 0x7fb4240ce550 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb423fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb42415ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb423fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb42415ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39970/0 (socket says 172.21.15.84:39970) 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb423fff640 1 -- 172.21.15.84:0/3312295822 learned_addr learned my addr 172.21.15.84:0/3312295822 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb41bfff640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb424143d20 0x7fb42413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:38.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb4237fe640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4240ce550 0x7fb4241f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:38.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb423fff640 1 -- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4240ce550 msgr2=0x7fb4241f3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:38.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb423fff640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4240ce550 0x7fb4241f3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb423fff640 1 -- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb424143d20 msgr2=0x7fb42413b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:38.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb423fff640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb424143d20 0x7fb42413b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb423fff640 1 -- 172.21.15.84:0/3312295822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c009b30 con 0x7fb4241447f0 2023-12-12T09:23:38.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.127+0000 7fb4237fe640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4240ce550 0x7fb4241f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:38.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.128+0000 7fb423fff640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb42415ce20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb41c036040 tx=0x7fb41c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:38.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.128+0000 7fb420ff9640 1 -- 172.21.15.84:0/3312295822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c040670 con 0x7fb4241447f0 2023-12-12T09:23:38.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.128+0000 7fb420ff9640 1 -- 172.21.15.84:0/3312295822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c0407d0 con 0x7fb4241447f0 2023-12-12T09:23:38.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.128+0000 7fb420ff9640 1 -- 172.21.15.84:0/3312295822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c040b80 con 0x7fb4241447f0 2023-12-12T09:23:38.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.128+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4240cd280 con 0x7fb4241447f0 2023-12-12T09:23:38.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.128+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4241f3e70 con 0x7fb4241447f0 2023-12-12T09:23:38.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.129+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42415b930 con 0x7fb4241447f0 2023-12-12T09:23:38.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.130+0000 7fb420ff9640 1 -- 172.21.15.84:0/3312295822 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb41c040ce0 con 0x7fb4241447f0 2023-12-12T09:23:38.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.131+0000 7fb420ff9640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb40406ae40 0x7fb40406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:38.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.131+0000 7fb420ff9640 1 -- 172.21.15.84:0/3312295822 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb41c0ac590 con 0x7fb4241447f0 2023-12-12T09:23:38.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.131+0000 7fb4237fe640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb40406ae40 0x7fb40406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:38.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.132+0000 7fb4237fe640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb40406ae40 0x7fb40406d300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb414006fd0 tx=0x7fb414008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:38.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.136+0000 7fb420ff9640 1 -- 172.21.15.84:0/3312295822 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb41c077760 con 0x7fb4241447f0 2023-12-12T09:23:38.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.403+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7fb4240673c0 con 0x7fb4241447f0 2023-12-12T09:23:38.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.443+0000 7fb420ff9640 1 -- 172.21.15.84:0/3312295822 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v228) v1 ==== 134+0+0 (secure 0 0 0) 0x7fb41c009510 con 0x7fb4241447f0 2023-12-12T09:23:38.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb40406ae40 msgr2=0x7fb40406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:38.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb40406ae40 0x7fb40406d300 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb414006fd0 tx=0x7fb414008040 comp rx=0 tx=0).stop 2023-12-12T09:23:38.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 msgr2=0x7fb42415ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:38.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb42415ce20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb41c036040 tx=0x7fb41c004a40 comp rx=0 tx=0).stop 2023-12-12T09:23:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 shutdown_connections 2023-12-12T09:23:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fb40406ae40 0x7fb40406d300 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4241447f0 0x7fb42415ce20 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb424143d20 0x7fb42413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 --2- 172.21.15.84:0/3312295822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fb4240ce550 0x7fb4241f3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 >> 172.21.15.84:0/3312295822 conn(0x7fb42406c3d0 msgr2=0x7fb42406dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 shutdown_connections 2023-12-12T09:23:38.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:38.446+0000 7fb429b76640 1 -- 172.21.15.84:0/3312295822 wait complete. 2023-12-12T09:23:38.465 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ERROR 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner: 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner: p.wait() 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-12T09:23:38.466 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner: 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner:Ran 2 tests in 173.553s 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner: 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner: 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner:ERROR: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-12T09:23:38.467 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/test_pool_perm.py", line 52, in test_pool_perm 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner: self.mount_a.run_python(remote_script.format(path=file_path, check_read=str(True))) 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/mount.py", line 775, in run_python 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner: p.wait() 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 1: 'stdin-killer -- python3 -c \'\nimport os\nimport errno\n\nfd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR)\ntry:\n if True:\n ret = os.read(fd, 1024)\n else:\n os.write(fd, b\'"\'"\'content\'"\'"\')\nexcept OSError as e:\n if e.errno != errno.EPERM:\n raise\nelse:\n raise RuntimeError("client does not check permission of data pool")\n\'' 2023-12-12T09:23:38.468 INFO:tasks.cephfs_test_runner: 2023-12-12T09:23:38.468 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-12T09:23:38.546 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9e341174a6034b089f9db369b3338899 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-12-12T09:23:38.548 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-12T09:23:38.557 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-12T09:23:38.577 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-12T09:23:38.577 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:23:38.577 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:38.653 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T09:23:38.653 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-12-12T09:23:38.654 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:38.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054299,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T09:23:38.707 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:23:38.707 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:38.767 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T09:23:38.767 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-12T09:23:38.767 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T09:23:38.821 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054284,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T09:23:38.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:38.822 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-12-12T09:23:38.881 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T09:23:38.881 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T09:23:38.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:38.882 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T09:23:38.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:38.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T09:23:39.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:39.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-12-12T09:23:39.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:39.225 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2023-12-12T09:23:39.284 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T09:23:39.284 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-12T09:23:39.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:39.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T09:23:39.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:39.384 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T09:23:39.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T09:23:39.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2023-12-12T09:23:39.605 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-12T09:23:39.620 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-12T09:23:39.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:23:39.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.842+0000 7f0283b16640 1 Processor -- start 2023-12-12T09:23:39.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.843+0000 7f0283b16640 1 -- start start 2023-12-12T09:23:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.844+0000 7f0283b16640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f027c143d20 0x7f027c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.844+0000 7f0283b16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c1447f0 0x7f027c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.844+0000 7f0283b16640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0cea30 con 0x7f027c0ce550 2023-12-12T09:23:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.844+0000 7f0283b16640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c0702b0 con 0x7f027c143d20 2023-12-12T09:23:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.844+0000 7f0283b16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c070590 con 0x7f027c1447f0 2023-12-12T09:23:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.845+0000 7f02810b1640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f027c0ce550 0x7f027c15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50138/0 (socket says 172.21.15.84:50138) 2023-12-12T09:23:39.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.845+0000 7f02810b1640 1 -- 172.21.15.84:0/616200510 learned_addr learned my addr 172.21.15.84:0/616200510 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.845+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684719177 0 0) 0x7f027c0cea30 con 0x7f027c0ce550 2023-12-12T09:23:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.845+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c003520 con 0x7f027c0ce550 2023-12-12T09:23:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930379180 0 0) 0x7f026c003520 con 0x7f027c0ce550 2023-12-12T09:23:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c1447f0 msgr2=0x7f027c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c1447f0 0x7f027c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 >> v2:172.21.15.99:3300/0 conn(0x7f027c143d20 msgr2=0x7f027c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 --2- 172.21.15.84:0/616200510 >> v2:172.21.15.99:3300/0 conn(0x7f027c143d20 0x7f027c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c070870 con 0x7f027c0ce550 2023-12-12T09:23:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f0268001670 con 0x7f027c0ce550 2023-12-12T09:23:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 >> v1:172.21.15.84:6789/0 conn(0x7f027c0ce550 legacy=0x7f027c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c003970 0x7f026c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c0047c0 0x7f026c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c1447f0 0x7f026c00fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0702b0 con 0x7f026c0047c0 2023-12-12T09:23:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c070590 con 0x7f026c003970 2023-12-12T09:23:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c005570 con 0x7f027c1447f0 2023-12-12T09:23:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02810b1640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c0047c0 0x7f026c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02818b2640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c003970 0x7f026c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02810b1640 1 -- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c1447f0 msgr2=0x7f026c00fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.846+0000 7f02820b3640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c1447f0 0x7f026c00fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.847+0000 7f02810b1640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c1447f0 0x7f026c00fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.847+0000 7f02810b1640 1 -- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c003970 msgr2=0x7f026c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.847+0000 7f02810b1640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c003970 0x7f026c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.847+0000 7f02810b1640 1 -- 172.21.15.84:0/616200510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c003520 con 0x7f026c0047c0 2023-12-12T09:23:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.847+0000 7f02818b2640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c003970 0x7f026c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f02810b1640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c0047c0 0x7f026c004c40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f026800c110 tx=0x7f026c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19409ae6dbf15754 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268005ad0 con 0x7f026c0047c0 2023-12-12T09:23:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0268005c50 con 0x7f026c0047c0 2023-12-12T09:23:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f02808b0640 1 -- 172.21.15.84:0/616200510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026802c830 con 0x7f026c0047c0 2023-12-12T09:23:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f0283b16640 1 -- 172.21.15.84:0/616200510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c0047c0 msgr2=0x7f026c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f0283b16640 1 --2- 172.21.15.84:0/616200510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c0047c0 0x7f026c004c40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f026800c110 tx=0x7f026c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f02820b3640 1 -- 172.21.15.84:0/616200510 reap_dead start 2023-12-12T09:23:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f0283b16640 1 -- 172.21.15.84:0/616200510 shutdown_connections 2023-12-12T09:23:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.848+0000 7f0283b16640 1 -- 172.21.15.84:0/616200510 >> 172.21.15.84:0/616200510 conn(0x7f027c06c3d0 msgr2=0x7f027c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.849+0000 7f0283b16640 1 -- 172.21.15.84:0/616200510 shutdown_connections 2023-12-12T09:23:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.849+0000 7f0283b16640 1 -- 172.21.15.84:0/616200510 wait complete. 2023-12-12T09:23:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.850+0000 7f0283b16640 1 Processor -- start 2023-12-12T09:23:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.851+0000 7f0283b16640 1 -- start start 2023-12-12T09:23:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.851+0000 7f0283b16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c0047c0 0x7f027c1302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.851+0000 7f0283b16640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027c15e070 0x7f027c13e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.851+0000 7f0283b16640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c13d350 0x7f027c13ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.851+0000 7f0283b16640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c15dc50 con 0x7f027c15e070 2023-12-12T09:23:39.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.851+0000 7f0283b16640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c15cfd0 con 0x7f026c0047c0 2023-12-12T09:23:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.851+0000 7f0283b16640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c15d2b0 con 0x7f027c13d350 2023-12-12T09:23:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02810b1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027c15e070 0x7f027c13e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02810b1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027c15e070 0x7f027c13e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39992/0 (socket says 172.21.15.84:39992) 2023-12-12T09:23:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02810b1640 1 -- 172.21.15.84:0/2924146585 learned_addr learned my addr 172.21.15.84:0/2924146585 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02818b2640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c0047c0 0x7f027c1302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:39.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02820b3640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c13d350 0x7f027c13ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02810b1640 1 -- 172.21.15.84:0/2924146585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c13d350 msgr2=0x7f027c13ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02810b1640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c13d350 0x7f027c13ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02810b1640 1 -- 172.21.15.84:0/2924146585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c0047c0 msgr2=0x7f027c1302f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02810b1640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c0047c0 0x7f027c1302f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.852+0000 7f02810b1640 1 -- 172.21.15.84:0/2924146585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c15d590 con 0x7f027c15e070 2023-12-12T09:23:39.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.853+0000 7f02810b1640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027c15e070 0x7f027c13e790 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f026802c3d0 tx=0x7f0268001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.853+0000 7f027a7fc640 1 -- 172.21.15.84:0/2924146585 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026803c040 con 0x7f027c15e070 2023-12-12T09:23:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.853+0000 7f027a7fc640 1 -- 172.21.15.84:0/2924146585 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026802dd50 con 0x7f027c15e070 2023-12-12T09:23:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.853+0000 7f027a7fc640 1 -- 172.21.15.84:0/2924146585 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02680072b0 con 0x7f027c15e070 2023-12-12T09:23:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.853+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c15d870 con 0x7f027c15e070 2023-12-12T09:23:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.853+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c13da60 con 0x7f027c15e070 2023-12-12T09:23:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.854+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c15dd90 con 0x7f027c15e070 2023-12-12T09:23:39.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.855+0000 7f027a7fc640 1 -- 172.21.15.84:0/2924146585 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0268032070 con 0x7f027c15e070 2023-12-12T09:23:39.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.856+0000 7f027a7fc640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f026006ae40 0x7f026006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:39.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.856+0000 7f027a7fc640 1 -- 172.21.15.84:0/2924146585 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f02680aaef0 con 0x7f027c15e070 2023-12-12T09:23:39.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.856+0000 7f02818b2640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f026006ae40 0x7f026006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:39.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.857+0000 7f02818b2640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f026006ae40 0x7f026006d300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0270007f40 tx=0x7f0270007510 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:39.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:39.861+0000 7f027a7fc640 1 -- 172.21.15.84:0/2924146585 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f027c15dd90 con 0x7f027c15e070 2023-12-12T09:23:40.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.046+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f027c141310 con 0x7f026006ae40 2023-12-12T09:23:40.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.052+0000 7f027a7fc640 1 -- 172.21.15.84:0/2924146585 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48036 (secure 0 0 0) 0x7f027c141310 con 0x7f026006ae40 2023-12-12T09:23:40.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:40.054 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:23:40.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f026006ae40 msgr2=0x7f026006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f026006ae40 0x7f026006d300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0270007f40 tx=0x7f0270007510 comp rx=0 tx=0).stop 2023-12-12T09:23:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027c15e070 msgr2=0x7f027c13e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027c15e070 0x7f027c13e790 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f026802c3d0 tx=0x7f0268001930 comp rx=0 tx=0).stop 2023-12-12T09:23:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 shutdown_connections 2023-12-12T09:23:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f027c13d350 0x7f027c13ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f026006ae40 0x7f026006d300 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f027c15e070 0x7f027c13e790 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 --2- 172.21.15.84:0/2924146585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f026c0047c0 0x7f027c1302f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 >> 172.21.15.84:0/2924146585 conn(0x7f027c06c3d0 msgr2=0x7f027c0b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:40.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 shutdown_connections 2023-12-12T09:23:40.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.055+0000 7f0283b16640 1 -- 172.21.15.84:0/2924146585 wait complete. 2023-12-12T09:23:40.074 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-12-12T09:23:39.154550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231156,"kb_used_data":6680,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743564,"statfs":{"total":773094113280,"available":772857409536,"internally_reserved":0,"allocated":6840320,"data_stored":3719126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16046,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001738"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":196,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038229+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:22:52.038229+0000","last_peered":"2023-12-12T09:22:52.038229+0000","last_clean":"2023-12-12T09:22:52.038229+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:22:52.038229+0000","last_undegraded":"2023-12-12T09:22:52.038229+0000","last_fullsized":"2023-12-12T09:22:52.038229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":902215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.036,"15min":1.0229999999999999},"min":{"1min":0.60299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.52,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.385},{"interface":"front","average":{"1min":1.196,"5min":1.2490000000000001,"15min":1.2829999999999999},"min":{"1min":0.89400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5900000000000001,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.2250000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.024,"15min":0.98099999999999998},"min":{"1min":0.754,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.526,"5min":1.827,"15min":1.827},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.786,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3140000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.137,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5960000000000001,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.95299999999999996}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.92700000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.746,"5min":1.887,"15min":1.887},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2270000000000001,"15min":1.246},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.621,"5min":2.355,"15min":2.355},"last":1.165}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3580000000000001},"min":{"1min":0.90600000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.696,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.351},"min":{"1min":0.872,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8069999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.8440000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.387,"15min":1.407},"min":{"1min":1.0700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.724,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.282},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.98599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7769999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.444}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.425,"15min":1.415},"min":{"1min":1.034,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9610000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.712},{"interface":"front","average":{"1min":1.577,"5min":1.472,"15min":1.4690000000000001},"min":{"1min":1.202,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8700000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.6579999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":692224,"data_stored":311687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.97399999999999998,"15min":0.94599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5029999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.012},{"interface":"front","average":{"1min":1.022,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.5329999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.84099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.751},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.722,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.875}]},{"osd":2,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.196,"15min":1.1819999999999999},"min":{"1min":0.87,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.306},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.80000000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.635,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3999999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.198},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.679,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.363},"min":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.4470000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.365,"15min":1.361},"min":{"1min":1.042,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8919999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.268,"15min":1.2569999999999999},"min":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.925,"5min":1.996,"15min":1.996},"last":1.2030000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":1.087,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.153},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4430000000000001,"15min":1.4299999999999999},"min":{"1min":1.1970000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.2450000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.369,"15min":1.355},"min":{"1min":1.171,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.679,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.115},{"interface":"front","average":{"1min":1.504,"5min":1.4910000000000001,"15min":1.484},"min":{"1min":1.0920000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.837,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3620000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":312339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.998,"15min":1.016},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.331,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.113,"15min":1.141},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5980000000000001,"5min":1.909,"15min":1.909},"last":1.4490000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.232},"min":{"1min":0.81799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.373,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.258},{"interface":"front","average":{"1min":1.127,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7949999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.036}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7909999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.224},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.7589999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3879999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5960000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.335,"15min":1.3680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6950000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.327}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.284,"15min":1.266},"min":{"1min":1.0569999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9970000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4750000000000001,"15min":1.49},"min":{"1min":0.98499999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.1819999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.79300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7669999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.46,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1680000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.498}]},{"osd":7,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.569,"15min":1.581},"min":{"1min":1.1080000000000001,"5min":0.627,"15min":0.627},"max":{"1min":2.238,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.52,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0369999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.331,"15min":2.331},"last":1.476}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":333336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.151,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.538,"5min":1.633,"15min":1.633},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.119,"15min":1.123},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.669,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.008}]},{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.194,"15min":1.1799999999999999},"min":{"1min":0.71999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.806,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.538,"5min":2.117,"15min":2.117},"last":1.393}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.502,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.1100000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.339,"15min":1.353},"min":{"1min":0.995,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7589999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.081},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7070000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.45}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.885,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.208},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.456},"min":{"1min":1.0149999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7230000000000001,"5min":3.343,"15min":3.343},"last":1.2829999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.45,"15min":1.4930000000000001},"min":{"1min":1.0680000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.845,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.575},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5529999999999999,"15min":1.583},"min":{"1min":1.012,"5min":0.755,"15min":0.755},"max":{"1min":1.7629999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.337}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.5589999999999999,"15min":1.581},"min":{"1min":1.0529999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8029999999999999,"5min":3.085,"15min":3.085},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.5980000000000001,"15min":1.6519999999999999},"min":{"1min":1.1910000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.964,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.643}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":311743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88200000000000001,"15min":0.91300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4990000000000001,"5min":1.718,"15min":1.718},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.548,"5min":1.71,"15min":1.71},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":1.4419999999999999,"5min":1.575,"15min":1.575},"last":0.59599999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.071,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5609999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.482,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.222,"15min":1.24},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.956,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3080000000000001},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.274,"5min":1.29,"15min":1.284},"min":{"1min":0.871,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.623,"5min":1.73,"15min":1.73},"last":1.111}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3069999999999999,"15min":1.3260000000000001},"min":{"1min":0.78400000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6639999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.752},{"interface":"front","average":{"1min":1.429,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.81799999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0259999999999998,"5min":2.198,"15min":2.198},"last":1.0249999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3859999999999999,"15min":1.4019999999999999},"min":{"1min":0.93200000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6759999999999999,"5min":1.847,"15min":1.847},"last":1.167},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3740000000000001,"15min":1.3979999999999999},"min":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.768,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.79800000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":318144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.95799999999999996}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":0.86399999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.113},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.246},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.91400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":311777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.504,"5min":1.613,"15min":1.613},"last":1.042},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.048,"15min":1.05},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5369999999999999,"5min":2.903,"15min":2.903},"last":1.0049999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.998,"15min":1.002},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.341,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.008,"5min":0.90900000000000003,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4750000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.149,"15min":1.133},"min":{"1min":0.84899999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.167,"15min":1.165},"min":{"1min":0.67000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7430000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.393}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6379999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3109999999999999,"15min":1.3280000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6240000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3080000000000001,"15min":1.288},"min":{"1min":0.879,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0659999999999998,"5min":2.867,"15min":2.867},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.357,"15min":1.3640000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.835,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.4430000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4119999999999999,"15min":1.4279999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7230000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.355,"15min":1.337},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1240000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.429}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1314816,"data_stored":917885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.439,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.135,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.363,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.016}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.014,"15min":1.071},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.018,"15min":1.0429999999999999},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":1.6299999999999999,"5min":2.464,"15min":2.464},"last":1.1839999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.232},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.621,"5min":2.343,"15min":2.343},"last":1.329},{"interface":"front","average":{"1min":1.22,"5min":1.341,"15min":1.375},"min":{"1min":0.82899999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.5629999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.377}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3049999999999999,"15min":1.333},"min":{"1min":0.878,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.774,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7030000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4550000000000001,"15min":1.5029999999999999},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4970000000000001,"5min":2.573,"15min":2.573},"last":1.284},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3500000000000001,"15min":1.381},"min":{"1min":0.91600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4039999999999999,"15min":1.4319999999999999},"min":{"1min":0.90800000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.698,"5min":1.968,"15min":1.968},"last":1.248},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.353,"15min":1.383},"min":{"1min":0.80100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7969999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.579}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:23:40.076 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:23:40.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.286+0000 7f7bbdabb640 1 Processor -- start 2023-12-12T09:23:40.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.287+0000 7f7bbdabb640 1 -- start start 2023-12-12T09:23:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.288+0000 7f7bbdabb640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7bb80b4ba0 0x7f7bb815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.288+0000 7f7bbdabb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80b3b60 con 0x7f7bb8142f40 2023-12-12T09:23:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.288+0000 7f7bbdabb640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80b3de0 con 0x7f7bb813ff90 2023-12-12T09:23:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.288+0000 7f7bbdabb640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb815e6d0 con 0x7f7bb80b4ba0 2023-12-12T09:23:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.289+0000 7f7baffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7bb8142f40 0x7f7bb815d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50150/0 (socket says 172.21.15.84:50150) 2023-12-12T09:23:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.289+0000 7f7baffff640 1 -- 172.21.15.84:0/2298720025 learned_addr learned my addr 172.21.15.84:0/2298720025 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.289+0000 7f7bb7fff640 1 --2- 172.21.15.84:0/2298720025 >> v2:172.21.15.99:3300/0 conn(0x7f7bb80b4ba0 0x7f7bb815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.289+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846619436 0 0) 0x7f7bb80b3b60 con 0x7f7bb8142f40 2023-12-12T09:23:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.289+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ba4003520 con 0x7f7bb8142f40 2023-12-12T09:23:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.289+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1490069576 0 0) 0x7f7ba4003520 con 0x7f7bb8142f40 2023-12-12T09:23:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 >> v2:172.21.15.99:3300/0 conn(0x7f7bb80b4ba0 msgr2=0x7f7bb815e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 --2- 172.21.15.84:0/2298720025 >> v2:172.21.15.99:3300/0 conn(0x7f7bb80b4ba0 0x7f7bb815e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 >> v1:172.21.15.99:6789/0 conn(0x7f7bb813ff90 legacy=0x7f7bb8142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80b40c0 con 0x7f7bb8142f40 2023-12-12T09:23:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f7ba0001670 con 0x7f7bb8142f40 2023-12-12T09:23:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 >> v1:172.21.15.84:6789/0 conn(0x7f7bb8142f40 legacy=0x7f7bb815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba4003970 0x7f7ba4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ba40047c0 0x7f7ba4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ba4005180 0x7f7ba400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb815e6d0 con 0x7f7ba40047c0 2023-12-12T09:23:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba400c020 con 0x7f7ba4003970 2023-12-12T09:23:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba400c1e0 con 0x7f7ba4005180 2023-12-12T09:23:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7baffff640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ba40047c0 0x7f7ba4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb77fe640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba4003970 0x7f7ba4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.290+0000 7f7bb7fff640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ba4005180 0x7f7ba400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.291+0000 7f7baffff640 1 -- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ba4005180 msgr2=0x7f7ba400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.291+0000 7f7baffff640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7ba4005180 0x7f7ba400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.291+0000 7f7baffff640 1 -- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba4003970 msgr2=0x7f7ba4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.291+0000 7f7baffff640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba4003970 0x7f7ba4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.291+0000 7f7baffff640 1 -- 172.21.15.84:0/2298720025 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba4003520 con 0x7f7ba40047c0 2023-12-12T09:23:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.291+0000 7f7bb77fe640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba4003970 0x7f7ba4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T09:23:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.291+0000 7f7bb7fff640 1 -- 172.21.15.84:0/2298720025 reap_dead start 2023-12-12T09:23:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.292+0000 7f7baffff640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ba40047c0 0x7f7ba4004c40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c240 tx=0x7f7ba40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8735264d4824a96 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.292+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0005ad0 con 0x7f7ba40047c0 2023-12-12T09:23:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.292+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0005c30 con 0x7f7ba40047c0 2023-12-12T09:23:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.292+0000 7f7bb6ffd640 1 -- 172.21.15.84:0/2298720025 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba002ca00 con 0x7f7ba40047c0 2023-12-12T09:23:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.293+0000 7f7bbdabb640 1 -- 172.21.15.84:0/2298720025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ba40047c0 msgr2=0x7f7ba4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.293+0000 7f7bbdabb640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ba40047c0 0x7f7ba4004c40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c240 tx=0x7f7ba40057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.293+0000 7f7bbdabb640 1 -- 172.21.15.84:0/2298720025 shutdown_connections 2023-12-12T09:23:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.293+0000 7f7bbdabb640 1 --2- 172.21.15.84:0/2298720025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ba40047c0 0x7f7ba4004c40 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.293+0000 7f7bbdabb640 1 -- 172.21.15.84:0/2298720025 >> 172.21.15.84:0/2298720025 conn(0x7f7bb806c3d0 msgr2=0x7f7bb806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.293+0000 7f7bbdabb640 1 -- 172.21.15.84:0/2298720025 shutdown_connections 2023-12-12T09:23:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.293+0000 7f7bbdabb640 1 -- 172.21.15.84:0/2298720025 wait complete. 2023-12-12T09:23:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.295+0000 7f7bbdabb640 1 Processor -- start 2023-12-12T09:23:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.295+0000 7f7bbdabb640 1 -- start start 2023-12-12T09:23:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7bbdabb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba40047c0 0x7f7bb8137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7bbdabb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bb8156b30 0x7f7bb8156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7bbdabb640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bb813c6e0 0x7f7bb813cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7bbdabb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81574f0 con 0x7f7bb8156b30 2023-12-12T09:23:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7bbdabb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb813d0a0 con 0x7f7ba40047c0 2023-12-12T09:23:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7bbdabb640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8137c50 con 0x7f7bb813c6e0 2023-12-12T09:23:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7baffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bb8156b30 0x7f7bb8156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7baffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bb8156b30 0x7f7bb8156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40010/0 (socket says 172.21.15.84:40010) 2023-12-12T09:23:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7baffff640 1 -- 172.21.15.84:0/1845727562 learned_addr learned my addr 172.21.15.84:0/1845727562 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7bb77fe640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba40047c0 0x7f7bb8137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7bb7fff640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bb813c6e0 0x7f7bb813cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7baffff640 1 -- 172.21.15.84:0/1845727562 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bb813c6e0 msgr2=0x7f7bb813cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7baffff640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bb813c6e0 0x7f7bb813cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7baffff640 1 -- 172.21.15.84:0/1845727562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba40047c0 msgr2=0x7f7bb8137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7baffff640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba40047c0 0x7f7bb8137710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.296+0000 7f7baffff640 1 -- 172.21.15.84:0/1845727562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8159260 con 0x7f7bb8156b30 2023-12-12T09:23:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.297+0000 7f7baffff640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bb8156b30 0x7f7bb8156fb0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c240 tx=0x7f7ba002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.297+0000 7f7bb4ff9640 1 -- 172.21.15.84:0/1845727562 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba003c040 con 0x7f7bb8156b30 2023-12-12T09:23:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.297+0000 7f7bb4ff9640 1 -- 172.21.15.84:0/1845727562 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba002cc90 con 0x7f7bb8156b30 2023-12-12T09:23:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.297+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb8159540 con 0x7f7bb8156b30 2023-12-12T09:23:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.297+0000 7f7bb4ff9640 1 -- 172.21.15.84:0/1845727562 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0007070 con 0x7f7bb8156b30 2023-12-12T09:23:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.297+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb8159b00 con 0x7f7bb8156b30 2023-12-12T09:23:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.298+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb80673c0 con 0x7f7bb8156b30 2023-12-12T09:23:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.299+0000 7f7bb4ff9640 1 -- 172.21.15.84:0/1845727562 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ba0032070 con 0x7f7bb8156b30 2023-12-12T09:23:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.300+0000 7f7bb4ff9640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b9806ae70 0x7f7b9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.300+0000 7f7bb4ff9640 1 -- 172.21.15.84:0/1845727562 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7ba00aaa00 con 0x7f7bb8156b30 2023-12-12T09:23:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.301+0000 7f7bb77fe640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b9806ae70 0x7f7b9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.301+0000 7f7bb77fe640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b9806ae70 0x7f7b9806d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000c00 tx=0x7f7ba8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:40.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.305+0000 7f7bb4ff9640 1 -- 172.21.15.84:0/1845727562 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ba0075cf0 con 0x7f7bb8156b30 2023-12-12T09:23:40.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.494+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7bb80b4680 con 0x7f7b9806ae70 2023-12-12T09:23:40.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.498+0000 7f7bb4ff9640 1 -- 172.21.15.84:0/1845727562 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48036 (secure 0 0 0) 0x7f7ba8014400 con 0x7f7b9806ae70 2023-12-12T09:23:40.499 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:40.499 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:23:40.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b9806ae70 msgr2=0x7f7b9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b9806ae70 0x7f7b9806d330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000c00 tx=0x7f7ba8009040 comp rx=0 tx=0).stop 2023-12-12T09:23:40.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bb8156b30 msgr2=0x7f7bb8156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bb8156b30 0x7f7bb8156fb0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c240 tx=0x7f7ba002e070 comp rx=0 tx=0).stop 2023-12-12T09:23:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 shutdown_connections 2023-12-12T09:23:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7bb813c6e0 0x7f7bb813cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7b9806ae70 0x7f7b9806d330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bb8156b30 0x7f7bb8156fb0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 --2- 172.21.15.84:0/1845727562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba40047c0 0x7f7bb8137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.501+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 >> 172.21.15.84:0/1845727562 conn(0x7f7bb806c3d0 msgr2=0x7f7bb8160c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.502+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 shutdown_connections 2023-12-12T09:23:40.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.502+0000 7f7bbdabb640 1 -- 172.21.15.84:0/1845727562 wait complete. 2023-12-12T09:23:40.521 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-12-12T09:23:39.154550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231156,"kb_used_data":6680,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743564,"statfs":{"total":773094113280,"available":772857409536,"internally_reserved":0,"allocated":6840320,"data_stored":3719126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16046,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001738"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":196,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038229+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:22:52.038229+0000","last_peered":"2023-12-12T09:22:52.038229+0000","last_clean":"2023-12-12T09:22:52.038229+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:22:52.038229+0000","last_undegraded":"2023-12-12T09:22:52.038229+0000","last_fullsized":"2023-12-12T09:22:52.038229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":902215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.036,"15min":1.0229999999999999},"min":{"1min":0.60299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.52,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.385},{"interface":"front","average":{"1min":1.196,"5min":1.2490000000000001,"15min":1.2829999999999999},"min":{"1min":0.89400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5900000000000001,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.2250000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.024,"15min":0.98099999999999998},"min":{"1min":0.754,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.526,"5min":1.827,"15min":1.827},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.786,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3140000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.137,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5960000000000001,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.95299999999999996}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.92700000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.746,"5min":1.887,"15min":1.887},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2270000000000001,"15min":1.246},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.621,"5min":2.355,"15min":2.355},"last":1.165}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3580000000000001},"min":{"1min":0.90600000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.696,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.351},"min":{"1min":0.872,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8069999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.8440000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.387,"15min":1.407},"min":{"1min":1.0700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.724,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.282},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.98599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7769999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.444}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.425,"15min":1.415},"min":{"1min":1.034,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9610000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.712},{"interface":"front","average":{"1min":1.577,"5min":1.472,"15min":1.4690000000000001},"min":{"1min":1.202,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8700000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.6579999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":692224,"data_stored":311687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.97399999999999998,"15min":0.94599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5029999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.012},{"interface":"front","average":{"1min":1.022,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.5329999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.84099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.751},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.722,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.875}]},{"osd":2,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.196,"15min":1.1819999999999999},"min":{"1min":0.87,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.306},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.80000000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.635,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3999999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.198},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.679,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.363},"min":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.4470000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.365,"15min":1.361},"min":{"1min":1.042,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8919999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.268,"15min":1.2569999999999999},"min":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.925,"5min":1.996,"15min":1.996},"last":1.2030000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":1.087,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.153},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4430000000000001,"15min":1.4299999999999999},"min":{"1min":1.1970000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.2450000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.369,"15min":1.355},"min":{"1min":1.171,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.679,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.115},{"interface":"front","average":{"1min":1.504,"5min":1.4910000000000001,"15min":1.484},"min":{"1min":1.0920000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.837,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3620000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":312339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.998,"15min":1.016},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.331,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.113,"15min":1.141},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5980000000000001,"5min":1.909,"15min":1.909},"last":1.4490000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.232},"min":{"1min":0.81799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.373,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.258},{"interface":"front","average":{"1min":1.127,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7949999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.036}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7909999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.224},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.7589999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3879999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5960000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.335,"15min":1.3680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6950000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.327}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.284,"15min":1.266},"min":{"1min":1.0569999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9970000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4750000000000001,"15min":1.49},"min":{"1min":0.98499999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.1819999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.79300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7669999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.46,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1680000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.498}]},{"osd":7,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.569,"15min":1.581},"min":{"1min":1.1080000000000001,"5min":0.627,"15min":0.627},"max":{"1min":2.238,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.52,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0369999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.331,"15min":2.331},"last":1.476}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":333336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.151,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.538,"5min":1.633,"15min":1.633},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.119,"15min":1.123},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.669,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.008}]},{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.194,"15min":1.1799999999999999},"min":{"1min":0.71999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.806,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.538,"5min":2.117,"15min":2.117},"last":1.393}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.502,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.1100000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.339,"15min":1.353},"min":{"1min":0.995,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7589999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.081},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7070000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.45}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.885,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.208},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.456},"min":{"1min":1.0149999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7230000000000001,"5min":3.343,"15min":3.343},"last":1.2829999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.45,"15min":1.4930000000000001},"min":{"1min":1.0680000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.845,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.575},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5529999999999999,"15min":1.583},"min":{"1min":1.012,"5min":0.755,"15min":0.755},"max":{"1min":1.7629999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.337}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.5589999999999999,"15min":1.581},"min":{"1min":1.0529999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8029999999999999,"5min":3.085,"15min":3.085},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.5980000000000001,"15min":1.6519999999999999},"min":{"1min":1.1910000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.964,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.643}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":311743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88200000000000001,"15min":0.91300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4990000000000001,"5min":1.718,"15min":1.718},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.548,"5min":1.71,"15min":1.71},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":1.4419999999999999,"5min":1.575,"15min":1.575},"last":0.59599999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.071,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5609999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.482,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.222,"15min":1.24},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.956,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3080000000000001},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.274,"5min":1.29,"15min":1.284},"min":{"1min":0.871,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.623,"5min":1.73,"15min":1.73},"last":1.111}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3069999999999999,"15min":1.3260000000000001},"min":{"1min":0.78400000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6639999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.752},{"interface":"front","average":{"1min":1.429,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.81799999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0259999999999998,"5min":2.198,"15min":2.198},"last":1.0249999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3859999999999999,"15min":1.4019999999999999},"min":{"1min":0.93200000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6759999999999999,"5min":1.847,"15min":1.847},"last":1.167},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3740000000000001,"15min":1.3979999999999999},"min":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.768,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.79800000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":318144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.95799999999999996}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":0.86399999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.113},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.246},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.91400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":311777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.504,"5min":1.613,"15min":1.613},"last":1.042},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.048,"15min":1.05},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5369999999999999,"5min":2.903,"15min":2.903},"last":1.0049999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.998,"15min":1.002},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.341,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.008,"5min":0.90900000000000003,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4750000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.149,"15min":1.133},"min":{"1min":0.84899999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.167,"15min":1.165},"min":{"1min":0.67000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7430000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.393}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6379999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3109999999999999,"15min":1.3280000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6240000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3080000000000001,"15min":1.288},"min":{"1min":0.879,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0659999999999998,"5min":2.867,"15min":2.867},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.357,"15min":1.3640000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.835,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.4430000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4119999999999999,"15min":1.4279999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7230000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.355,"15min":1.337},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1240000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.429}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1314816,"data_stored":917885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.439,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.135,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.363,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.016}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.014,"15min":1.071},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.018,"15min":1.0429999999999999},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":1.6299999999999999,"5min":2.464,"15min":2.464},"last":1.1839999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.232},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.621,"5min":2.343,"15min":2.343},"last":1.329},{"interface":"front","average":{"1min":1.22,"5min":1.341,"15min":1.375},"min":{"1min":0.82899999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.5629999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.377}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3049999999999999,"15min":1.333},"min":{"1min":0.878,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.774,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7030000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4550000000000001,"15min":1.5029999999999999},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4970000000000001,"5min":2.573,"15min":2.573},"last":1.284},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3500000000000001,"15min":1.381},"min":{"1min":0.91600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4039999999999999,"15min":1.4319999999999999},"min":{"1min":0.90800000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.698,"5min":1.968,"15min":1.968},"last":1.248},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.353,"15min":1.383},"min":{"1min":0.80100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7969999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.579}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:23:40.522 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-12T09:23:40.523 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:23:40.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.737+0000 7f9b46f97640 1 Processor -- start 2023-12-12T09:23:40.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.737+0000 7f9b46f97640 1 -- start start 2023-12-12T09:23:40.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b46f97640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b400cdad0 0x7f9b40161a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b46f97640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400d19a0 0x7f9b40161f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b46f97640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b400cdeb0 0x7f9b40162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b46f97640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4006eb00 con 0x7f9b400cdeb0 2023-12-12T09:23:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b46f97640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4006b610 con 0x7f9b400cdad0 2023-12-12T09:23:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b46f97640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4015d7b0 con 0x7f9b400d19a0 2023-12-12T09:23:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b45534640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b400cdeb0 0x7f9b40162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b45534640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b400cdeb0 0x7f9b40162490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40020/0 (socket says 172.21.15.84:40020) 2023-12-12T09:23:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.739+0000 7f9b45534640 1 -- 172.21.15.84:0/100812566 learned_addr learned my addr 172.21.15.84:0/100812566 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.740+0000 7f9b3ffff640 1 --2- 172.21.15.84:0/100812566 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400d19a0 0x7f9b40161f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.740+0000 7f9b45534640 1 -- 172.21.15.84:0/100812566 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400d19a0 msgr2=0x7f9b40161f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.740+0000 7f9b44d33640 1 --2- 172.21.15.84:0/100812566 >> v2:172.21.15.99:3300/0 conn(0x7f9b400cdad0 0x7f9b40161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.740+0000 7f9b45534640 1 --2- 172.21.15.84:0/100812566 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400d19a0 0x7f9b40161f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.740+0000 7f9b45534640 1 -- 172.21.15.84:0/100812566 >> v2:172.21.15.99:3300/0 conn(0x7f9b400cdad0 msgr2=0x7f9b40161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.740+0000 7f9b45534640 1 --2- 172.21.15.84:0/100812566 >> v2:172.21.15.99:3300/0 conn(0x7f9b400cdad0 0x7f9b40161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.740+0000 7f9b45534640 1 -- 172.21.15.84:0/100812566 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4006e820 con 0x7f9b400cdeb0 2023-12-12T09:23:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.740+0000 7f9b44d33640 1 --2- 172.21.15.84:0/100812566 >> v2:172.21.15.99:3300/0 conn(0x7f9b400cdad0 0x7f9b40161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.741+0000 7f9b45534640 1 --2- 172.21.15.84:0/100812566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40162490 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9b4006b200 tx=0x7f9b3802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a202e9d65505f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.741+0000 7f9b3f7fe640 1 -- 172.21.15.84:0/100812566 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3802c9f0 con 0x7f9b400cdeb0 2023-12-12T09:23:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.741+0000 7f9b3f7fe640 1 -- 172.21.15.84:0/100812566 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3802cb50 con 0x7f9b400cdeb0 2023-12-12T09:23:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.741+0000 7f9b3f7fe640 1 -- 172.21.15.84:0/100812566 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b380343f0 con 0x7f9b400cdeb0 2023-12-12T09:23:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 -- 172.21.15.84:0/100812566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 msgr2=0x7f9b40162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 --2- 172.21.15.84:0/100812566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40162490 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9b4006b200 tx=0x7f9b3802be50 comp rx=0 tx=0).stop 2023-12-12T09:23:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 -- 172.21.15.84:0/100812566 shutdown_connections 2023-12-12T09:23:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 --2- 172.21.15.84:0/100812566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40162490 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 --2- 172.21.15.84:0/100812566 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400d19a0 0x7f9b40161f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 --2- 172.21.15.84:0/100812566 >> v2:172.21.15.99:3300/0 conn(0x7f9b400cdad0 0x7f9b40161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 -- 172.21.15.84:0/100812566 >> 172.21.15.84:0/100812566 conn(0x7f9b400d0e80 msgr2=0x7f9b400d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 -- 172.21.15.84:0/100812566 shutdown_connections 2023-12-12T09:23:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.742+0000 7f9b46f97640 1 -- 172.21.15.84:0/100812566 wait complete. 2023-12-12T09:23:40.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.744+0000 7f9b46f97640 1 Processor -- start 2023-12-12T09:23:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.744+0000 7f9b46f97640 1 -- start start 2023-12-12T09:23:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b46f97640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400cdad0 0x7f9b400c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b46f97640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b46f97640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b400d19a0 0x7f9b401e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b46f97640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b401e83d0 con 0x7f9b400cdeb0 2023-12-12T09:23:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b46f97640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b401e7f00 con 0x7f9b400d19a0 2023-12-12T09:23:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b46f97640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b401e8620 con 0x7f9b400cdad0 2023-12-12T09:23:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b3ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b3ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40022/0 (socket says 172.21.15.84:40022) 2023-12-12T09:23:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.745+0000 7f9b3ffff640 1 -- 172.21.15.84:0/3989347801 learned_addr learned my addr 172.21.15.84:0/3989347801 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b44d33640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400cdad0 0x7f9b400c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b45534640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b400d19a0 0x7f9b401e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b3ffff640 1 -- 172.21.15.84:0/3989347801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400cdad0 msgr2=0x7f9b400c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b3ffff640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400cdad0 0x7f9b400c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b3ffff640 1 -- 172.21.15.84:0/3989347801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b400d19a0 msgr2=0x7f9b401e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b3ffff640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b400d19a0 0x7f9b401e9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b3ffff640 1 -- 172.21.15.84:0/3989347801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b38009b30 con 0x7f9b400cdeb0 2023-12-12T09:23:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b3ffff640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40152fd0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c7f0 tx=0x7f9b2c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.746+0000 7f9b3d7fa640 1 -- 172.21.15.84:0/3989347801 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c004220 con 0x7f9b400cdeb0 2023-12-12T09:23:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.747+0000 7f9b3d7fa640 1 -- 172.21.15.84:0/3989347801 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c004380 con 0x7f9b400cdeb0 2023-12-12T09:23:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.747+0000 7f9b3d7fa640 1 -- 172.21.15.84:0/3989347801 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c007840 con 0x7f9b400cdeb0 2023-12-12T09:23:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.747+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b401e8900 con 0x7f9b400cdeb0 2023-12-12T09:23:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.747+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b40153870 con 0x7f9b400cdeb0 2023-12-12T09:23:40.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.748+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b401e81e0 con 0x7f9b400cdeb0 2023-12-12T09:23:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.749+0000 7f9b3d7fa640 1 -- 172.21.15.84:0/3989347801 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b2c007bb0 con 0x7f9b400cdeb0 2023-12-12T09:23:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.750+0000 7f9b3d7fa640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b2406ae40 0x7f9b2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.750+0000 7f9b3d7fa640 1 -- 172.21.15.84:0/3989347801 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9b2c0893e0 con 0x7f9b400cdeb0 2023-12-12T09:23:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.750+0000 7f9b44d33640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b2406ae40 0x7f9b2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.750+0000 7f9b44d33640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b2406ae40 0x7f9b2406d300 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400b7c0 tx=0x7f9b34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.754+0000 7f9b3d7fa640 1 -- 172.21.15.84:0/3989347801 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b2c0545b0 con 0x7f9b400cdeb0 2023-12-12T09:23:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.939+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b4015b200 con 0x7f9b2406ae40 2023-12-12T09:23:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.942+0000 7f9b3d7fa640 1 -- 172.21.15.84:0/3989347801 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48036 (secure 0 0 0) 0x7f9b4015b200 con 0x7f9b2406ae40 2023-12-12T09:23:40.943 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:23:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.944+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b2406ae40 msgr2=0x7f9b2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.944+0000 7f9b46f97640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b2406ae40 0x7f9b2406d300 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400b7c0 tx=0x7f9b34008040 comp rx=0 tx=0).stop 2023-12-12T09:23:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 msgr2=0x7f9b40152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40152fd0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c7f0 tx=0x7f9b2c00ccb0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 shutdown_connections 2023-12-12T09:23:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b400d19a0 0x7f9b401e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b2406ae40 0x7f9b2406d300 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b400cdeb0 0x7f9b40152fd0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 --2- 172.21.15.84:0/3989347801 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b400cdad0 0x7f9b400c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:40.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 >> 172.21.15.84:0/3989347801 conn(0x7f9b400d0e80 msgr2=0x7f9b400cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:40.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 shutdown_connections 2023-12-12T09:23:40.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:40.945+0000 7f9b46f97640 1 -- 172.21.15.84:0/3989347801 wait complete. 2023-12-12T09:23:40.963 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-12-12T09:23:39.154550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231156,"kb_used_data":6680,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743564,"statfs":{"total":773094113280,"available":772857409536,"internally_reserved":0,"allocated":6840320,"data_stored":3719126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16046,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-66,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001738"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":196,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-12-12T09:22:52.038229+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:22:52.038229+0000","last_peered":"2023-12-12T09:22:52.038229+0000","last_clean":"2023-12-12T09:22:52.038229+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:22:52.038229+0000","last_undegraded":"2023-12-12T09:22:52.038229+0000","last_fullsized":"2023-12-12T09:22:52.038229+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":902215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.036,"15min":1.0229999999999999},"min":{"1min":0.60299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.52,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.385},{"interface":"front","average":{"1min":1.196,"5min":1.2490000000000001,"15min":1.2829999999999999},"min":{"1min":0.89400000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5900000000000001,"5min":4.4340000000000002,"15min":4.4340000000000002},"last":1.2250000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.024,"15min":0.98099999999999998},"min":{"1min":0.754,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.526,"5min":1.827,"15min":1.827},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.0960000000000001,"15min":1.093},"min":{"1min":0.73799999999999999,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.786,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.3140000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.137,"15min":1.127},"min":{"1min":0.80200000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.5960000000000001,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1619999999999999,"15min":1.1739999999999999},"min":{"1min":0.58999999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.95299999999999996}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.92700000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.746,"5min":1.887,"15min":1.887},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2270000000000001,"15min":1.246},"min":{"1min":0.68999999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.621,"5min":2.355,"15min":2.355},"last":1.165}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3160000000000001,"15min":1.3580000000000001},"min":{"1min":0.90600000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.696,"5min":3.2930000000000001,"15min":3.2930000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.351},"min":{"1min":0.872,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8069999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.8440000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.387,"15min":1.407},"min":{"1min":1.0700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.724,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":1.282},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.365,"15min":1.3819999999999999},"min":{"1min":0.98599999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7769999999999999,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.444}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.425,"15min":1.415},"min":{"1min":1.034,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.9610000000000001,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.712},{"interface":"front","average":{"1min":1.577,"5min":1.472,"15min":1.4690000000000001},"min":{"1min":1.202,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.8700000000000001,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.6579999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":692224,"data_stored":311687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.97399999999999998,"15min":0.94599999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5029999999999999,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.012},{"interface":"front","average":{"1min":1.022,"5min":1.0589999999999999,"15min":1.077},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4510000000000001,"5min":1.575,"15min":1.575},"last":1.5329999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.84099999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.751},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.722,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.875}]},{"osd":2,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.196,"15min":1.1819999999999999},"min":{"1min":0.87,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.306},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2629999999999999,"15min":1.2609999999999999},"min":{"1min":0.80000000000000004,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.635,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3999999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.194,"15min":1.198},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.679,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.363},"min":{"1min":0.90700000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.1549999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.4470000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.365,"15min":1.361},"min":{"1min":1.042,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8919999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.268,"15min":1.2569999999999999},"min":{"1min":0.76800000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.925,"5min":1.996,"15min":1.996},"last":1.2030000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":1.087,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2519999999999998,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.153},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4430000000000001,"15min":1.4299999999999999},"min":{"1min":1.1970000000000001,"5min":0.623,"15min":0.623},"max":{"1min":2.0209999999999999,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.2450000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:38 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.369,"15min":1.355},"min":{"1min":1.171,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.679,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.115},{"interface":"front","average":{"1min":1.504,"5min":1.4910000000000001,"15min":1.484},"min":{"1min":1.0920000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.837,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.3620000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":312339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.998,"15min":1.016},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.331,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.113,"15min":1.141},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5980000000000001,"5min":1.909,"15min":1.909},"last":1.4490000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.1990000000000001,"15min":1.232},"min":{"1min":0.81799999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.373,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.258},{"interface":"front","average":{"1min":1.127,"5min":1.2390000000000001,"15min":1.2729999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.7949999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.036}]},{"osd":2,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2130000000000001,"15min":1.232},"min":{"1min":0.72899999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7909999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.224},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.202,"15min":1.1899999999999999},"min":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.7589999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3879999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.27,"15min":1.292},"min":{"1min":0.89400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5960000000000001,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.335,"15min":1.3680000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.6950000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.327}]},{"osd":4,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.284,"15min":1.266},"min":{"1min":1.0569999999999999,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.9970000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4750000000000001,"15min":1.49},"min":{"1min":0.98499999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.1819999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.79300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7669999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.46,"15min":1.484},"min":{"1min":0.76200000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.1680000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.498}]},{"osd":7,"last update":"Tue Dec 12 09:22:41 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.569,"15min":1.581},"min":{"1min":1.1080000000000001,"5min":0.627,"15min":0.627},"max":{"1min":2.238,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.52,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0369999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.052,"5min":2.331,"15min":2.331},"last":1.476}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":333336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.151,"15min":1.1519999999999999},"min":{"1min":0.68799999999999994,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.538,"5min":1.633,"15min":1.633},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.119,"15min":1.123},"min":{"1min":0.80000000000000004,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.669,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":1.008}]},{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.194,"15min":1.1799999999999999},"min":{"1min":0.71999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.806,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.198,"15min":1.2210000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.538,"5min":2.117,"15min":2.117},"last":1.393}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.1539999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.502,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.569,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.1100000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.339,"15min":1.353},"min":{"1min":0.995,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7589999999999999,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.081},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.7070000000000001,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.45}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.397,"15min":1.4179999999999999},"min":{"1min":0.83799999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.885,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.208},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4370000000000001,"15min":1.456},"min":{"1min":1.0149999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7230000000000001,"5min":3.343,"15min":3.343},"last":1.2829999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.45,"15min":1.4930000000000001},"min":{"1min":1.0680000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.845,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.575},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.5529999999999999,"15min":1.583},"min":{"1min":1.012,"5min":0.755,"15min":0.755},"max":{"1min":1.7629999999999999,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.337}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.5589999999999999,"15min":1.581},"min":{"1min":1.0529999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.8029999999999999,"5min":3.085,"15min":3.085},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.5980000000000001,"15min":1.6519999999999999},"min":{"1min":1.1910000000000001,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.964,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.643}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":700416,"data_stored":311743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.85599999999999998,"15min":0.89400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.018,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.88200000000000001,"15min":0.91300000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.4990000000000001,"5min":1.718,"15min":1.718},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.548,"5min":1.71,"15min":1.71},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.97699999999999998,"15min":0.99199999999999999},"min":{"1min":0.443,"5min":0.44,"15min":0.44},"max":{"1min":1.4419999999999999,"5min":1.575,"15min":1.575},"last":0.59599999999999997}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.071,"15min":1.101},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5609999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.0800000000000001,"15min":1.105},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.482,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.222,"15min":1.24},"min":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.956,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3080000000000001},"min":{"1min":0.77600000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.274,"5min":1.29,"15min":1.284},"min":{"1min":0.871,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.623,"5min":1.73,"15min":1.73},"last":1.111}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3069999999999999,"15min":1.3260000000000001},"min":{"1min":0.78400000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6639999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.752},{"interface":"front","average":{"1min":1.429,"5min":1.411,"15min":1.4390000000000001},"min":{"1min":0.81799999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0259999999999998,"5min":2.198,"15min":2.198},"last":1.0249999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3859999999999999,"15min":1.4019999999999999},"min":{"1min":0.93200000000000005,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.6759999999999999,"5min":1.847,"15min":1.847},"last":1.167},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3740000000000001,"15min":1.3979999999999999},"min":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.768,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.79800000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":318144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":0.95799999999999996}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":0.86399999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.1759999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.113},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.246},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.91400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":311777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.43099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.90400000000000003,"15min":0.89400000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.504,"5min":1.613,"15min":1.613},"last":1.042},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.048,"15min":1.05},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5369999999999999,"5min":2.903,"15min":2.903},"last":1.0049999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.998,"15min":1.002},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.341,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.008,"5min":0.90900000000000003,"15min":0.873},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4750000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.149,"15min":1.133},"min":{"1min":0.84899999999999998,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6919999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.165,"5min":1.167,"15min":1.165},"min":{"1min":0.67000000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.7430000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.393}]},{"osd":5,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.2310000000000001,"15min":1.2450000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.6379999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3109999999999999,"15min":1.3280000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.6240000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.0980000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3080000000000001,"15min":1.288},"min":{"1min":0.879,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.0659999999999998,"5min":2.867,"15min":2.867},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.357,"15min":1.3640000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.835,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.4430000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4119999999999999,"15min":1.4279999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.7230000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.355,"15min":1.337},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.1240000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.429}]}]},{"osd":0,"up_from":14,"seq":60129542195,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1314816,"data_stored":917885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.85899999999999999,"15min":0.86499999999999999},"min":{"1min":0.439,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.135,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.363,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.016}]},{"osd":2,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":1.014,"15min":1.071},"min":{"1min":0.54300000000000004,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.018,"15min":1.0429999999999999},"min":{"1min":0.45800000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.1359999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.92100000000000004,"15min":0.94399999999999995},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.2090000000000001,"15min":1.2689999999999999},"min":{"1min":0.435,"5min":0.433,"15min":0.433},"max":{"1min":1.6299999999999999,"5min":2.464,"15min":2.464},"last":1.1839999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.202,"15min":1.232},"min":{"1min":0.77900000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.621,"5min":2.343,"15min":2.343},"last":1.329},{"interface":"front","average":{"1min":1.22,"5min":1.341,"15min":1.375},"min":{"1min":0.82899999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.5629999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.377}]},{"osd":5,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.3049999999999999,"15min":1.333},"min":{"1min":0.878,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.774,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.78000000000000003,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7030000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4550000000000001,"15min":1.5029999999999999},"min":{"1min":0.73999999999999999,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.4970000000000001,"5min":2.573,"15min":2.573},"last":1.284},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3500000000000001,"15min":1.381},"min":{"1min":0.91600000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7070000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.6599999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:22:40 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.4039999999999999,"15min":1.4319999999999999},"min":{"1min":0.90800000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.698,"5min":1.968,"15min":1.968},"last":1.248},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.353,"15min":1.383},"min":{"1min":0.80100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7969999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.579}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:23:40.965 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T09:23:41.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.170+0000 7fe59756c640 1 Processor -- start 2023-12-12T09:23:41.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.170+0000 7fe59756c640 1 -- start start 2023-12-12T09:23:41.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.171+0000 7fe59756c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe59015d160 0x7fe59006d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.171+0000 7fe59756c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe5900b3140 0x7fe59006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.171+0000 7fe59756c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59015d870 con 0x7fe5900706b0 2023-12-12T09:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.171+0000 7fe59756c640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59015e1d0 con 0x7fe5900b3140 2023-12-12T09:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.171+0000 7fe59756c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900cd000 con 0x7fe59015d160 2023-12-12T09:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.171+0000 7fe596d6b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe5900706b0 0x7fe590070c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50158/0 (socket says 172.21.15.84:50158) 2023-12-12T09:23:41.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.171+0000 7fe596d6b640 1 -- 172.21.15.84:0/146650159 learned_addr learned my addr 172.21.15.84:0/146650159 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:41.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551151678 0 0) 0x7fe59015d870 con 0x7fe5900706b0 2023-12-12T09:23:41.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c005730 con 0x7fe5900706b0 2023-12-12T09:23:41.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595d69640 1 --2- 172.21.15.84:0/146650159 >> v2:172.21.15.99:3300/0 conn(0x7fe5900b3140 0x7fe59006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:41.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe59656a640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe59015d160 0x7fe59006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:41.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 487198790 0 0) 0x7fe57c005730 con 0x7fe5900706b0 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe59015d160 msgr2=0x7fe59006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe59015d160 0x7fe59006d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 >> v2:172.21.15.99:3300/0 conn(0x7fe5900b3140 msgr2=0x7fe59006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 --2- 172.21.15.84:0/146650159 >> v2:172.21.15.99:3300/0 conn(0x7fe5900b3140 0x7fe59006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900b28e0 con 0x7fe5900706b0 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7fe5880019f0 con 0x7fe5900706b0 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 >> v1:172.21.15.84:6789/0 conn(0x7fe5900706b0 legacy=0x7fe590070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c005bb0 0x7fe57c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe57c0069d0 0x7fe57c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe59015d160 0x7fe57c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59015e1d0 con 0x7fe57c0069d0 2023-12-12T09:23:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900cd000 con 0x7fe57c005bb0 2023-12-12T09:23:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.172+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c00dcc0 con 0x7fe59015d160 2023-12-12T09:23:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe595d69640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe57c0069d0 0x7fe57c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe59656a640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c005bb0 0x7fe57c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe596d6b640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe59015d160 0x7fe57c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:41.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe595d69640 1 -- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe59015d160 msgr2=0x7fe57c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:41.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe595d69640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe59015d160 0x7fe57c007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe595d69640 1 -- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c005bb0 msgr2=0x7fe57c005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:41.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe595d69640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c005bb0 0x7fe57c005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe595d69640 1 -- 172.21.15.84:0/146650159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c005730 con 0x7fe57c0069d0 2023-12-12T09:23:41.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.173+0000 7fe59656a640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c005bb0 0x7fe57c005fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:41.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.174+0000 7fe595d69640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe57c0069d0 0x7fe57c006e50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe58000ba00 tx=0x7fe57c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2697bf854edf1654 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:41.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.174+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580032630 con 0x7fe57c0069d0 2023-12-12T09:23:41.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.174+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580032790 con 0x7fe57c0069d0 2023-12-12T09:23:41.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.174+0000 7fe595568640 1 -- 172.21.15.84:0/146650159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580032b20 con 0x7fe57c0069d0 2023-12-12T09:23:41.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.175+0000 7fe59756c640 1 -- 172.21.15.84:0/146650159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe57c0069d0 msgr2=0x7fe57c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:41.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.175+0000 7fe59756c640 1 --2- 172.21.15.84:0/146650159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe57c0069d0 0x7fe57c006e50 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe58000ba00 tx=0x7fe57c007a00 comp rx=0 tx=0).stop 2023-12-12T09:23:41.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.175+0000 7fe596d6b640 1 -- 172.21.15.84:0/146650159 reap_dead start 2023-12-12T09:23:41.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.175+0000 7fe59756c640 1 -- 172.21.15.84:0/146650159 shutdown_connections 2023-12-12T09:23:41.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.175+0000 7fe59756c640 1 -- 172.21.15.84:0/146650159 >> 172.21.15.84:0/146650159 conn(0x7fe5900b07f0 msgr2=0x7fe5900b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:41.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.175+0000 7fe59756c640 1 -- 172.21.15.84:0/146650159 shutdown_connections 2023-12-12T09:23:41.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.175+0000 7fe59756c640 1 -- 172.21.15.84:0/146650159 wait complete. 2023-12-12T09:23:41.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.177+0000 7fe59756c640 1 Processor -- start 2023-12-12T09:23:41.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.177+0000 7fe59756c640 1 -- start start 2023-12-12T09:23:41.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe59756c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c0069d0 0x7fe590148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe59756c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe590145770 0x7fe590145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe59756c640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe590144820 0x7fe590144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe59756c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901451e0 con 0x7fe590145770 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe59756c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe590153150 con 0x7fe57c0069d0 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe59756c640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901487a0 con 0x7fe590144820 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe595d69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe590145770 0x7fe590145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe595d69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe590145770 0x7fe590145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40042/0 (socket says 172.21.15.84:40042) 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.178+0000 7fe595d69640 1 -- 172.21.15.84:0/1901688104 learned_addr learned my addr 172.21.15.84:0/1901688104 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:41.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe59656a640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c0069d0 0x7fe590148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe595d69640 1 -- 172.21.15.84:0/1901688104 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe590144820 msgr2=0x7fe590144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe595d69640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe590144820 0x7fe590144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe595d69640 1 -- 172.21.15.84:0/1901688104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c0069d0 msgr2=0x7fe590148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe595d69640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c0069d0 0x7fe590148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe595d69640 1 -- 172.21.15.84:0/1901688104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590146210 con 0x7fe590145770 2023-12-12T09:23:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe59656a640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c0069d0 0x7fe590148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe595d69640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe590145770 0x7fe590145bf0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe58002bf80 tx=0x7fe580004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:41.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.179+0000 7fe586ffd640 1 -- 172.21.15.84:0/1901688104 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58003b7e0 con 0x7fe590145770 2023-12-12T09:23:41.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.180+0000 7fe586ffd640 1 -- 172.21.15.84:0/1901688104 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58003b940 con 0x7fe590145770 2023-12-12T09:23:41.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.180+0000 7fe586ffd640 1 -- 172.21.15.84:0/1901688104 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58003bcd0 con 0x7fe590145770 2023-12-12T09:23:41.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.180+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5901464f0 con 0x7fe590145770 2023-12-12T09:23:41.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.180+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe590152de0 con 0x7fe590145770 2023-12-12T09:23:41.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.181+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe590152f70 con 0x7fe590145770 2023-12-12T09:23:41.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.182+0000 7fe586ffd640 1 -- 172.21.15.84:0/1901688104 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe580043070 con 0x7fe590145770 2023-12-12T09:23:41.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.183+0000 7fe586ffd640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe57406ae70 0x7fe57406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:41.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.183+0000 7fe586ffd640 1 -- 172.21.15.84:0/1901688104 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe5800ab9f0 con 0x7fe590145770 2023-12-12T09:23:41.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.183+0000 7fe59656a640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe57406ae70 0x7fe57406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:41.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.184+0000 7fe59656a640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe57406ae70 0x7fe57406d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe58c006fd0 tx=0x7fe58c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:41.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.187+0000 7fe586ffd640 1 -- 172.21.15.84:0/1901688104 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe590152f70 con 0x7fe590145770 2023-12-12T09:23:41.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.378+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe590152f70 con 0x7fe590145770 2023-12-12T09:23:41.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.380+0000 7fe586ffd640 1 -- 172.21.15.84:0/1901688104 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13107 (secure 0 0 0) 0x7fe58007a650 con 0x7fe590145770 2023-12-12T09:23:41.380 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:41.380 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":61,"fsid":"6cf288f4-52d2-4b85-a338-100a1ef88319","created":"2023-12-12T09:19:22.172929+0000","modified":"2023-12-12T09:23:37.431050+0000","last_up_change":"2023-12-12T09:19:34.202127+0000","last_in_change":"2023-12-12T09:19:25.584361+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T09:19:35.147515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"029fce1c-be3a-4373-ab0b-45cb02eccd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6818","nonce":3970846200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6821","nonce":3970846200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6828","nonce":3970846200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3970846200},{"type":"v1","addr":"172.21.15.84:6824","nonce":3970846200}]},"public_addr":"172.21.15.84:6818/3970846200","cluster_addr":"172.21.15.84:6821/3970846200","heartbeat_back_addr":"172.21.15.84:6828/3970846200","heartbeat_front_addr":"172.21.15.84:6824/3970846200","state":["exists","up"]},{"osd":1,"uuid":"9e830c00-995d-4b11-acf4-d3275347aac4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6819","nonce":1701316875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6825","nonce":1701316875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6831","nonce":1701316875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1701316875},{"type":"v1","addr":"172.21.15.84:6829","nonce":1701316875}]},"public_addr":"172.21.15.84:6819/1701316875","cluster_addr":"172.21.15.84:6825/1701316875","heartbeat_back_addr":"172.21.15.84:6831/1701316875","heartbeat_front_addr":"172.21.15.84:6829/1701316875","state":["exists","up"]},{"osd":2,"uuid":"46def62b-336d-48c1-9f02-d82c7e7c6f26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6809","nonce":3546175864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6811","nonce":3546175864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6815","nonce":3546175864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":3546175864},{"type":"v1","addr":"172.21.15.84:6813","nonce":3546175864}]},"public_addr":"172.21.15.84:6809/3546175864","cluster_addr":"172.21.15.84:6811/3546175864","heartbeat_back_addr":"172.21.15.84:6815/3546175864","heartbeat_front_addr":"172.21.15.84:6813/3546175864","state":["exists","up"]},{"osd":3,"uuid":"f48e5a78-d040-4974-be61-551a7fdebb8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6801","nonce":587370499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6803","nonce":587370499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6807","nonce":587370499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":587370499},{"type":"v1","addr":"172.21.15.84:6805","nonce":587370499}]},"public_addr":"172.21.15.84:6801/587370499","cluster_addr":"172.21.15.84:6803/587370499","heartbeat_back_addr":"172.21.15.84:6807/587370499","heartbeat_front_addr":"172.21.15.84:6805/587370499","state":["exists","up"]},{"osd":4,"uuid":"83bd863a-1a5c-4700-9123-01cfa90442a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6801","nonce":1049904610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6803","nonce":1049904610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6807","nonce":1049904610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1049904610},{"type":"v1","addr":"172.21.15.99:6805","nonce":1049904610}]},"public_addr":"172.21.15.99:6801/1049904610","cluster_addr":"172.21.15.99:6803/1049904610","heartbeat_back_addr":"172.21.15.99:6807/1049904610","heartbeat_front_addr":"172.21.15.99:6805/1049904610","state":["exists","up"]},{"osd":5,"uuid":"c4e2a4a8-8c2a-4ce5-8363-47c0dc3c7d4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6823","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6825","nonce":29339213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6827","nonce":29339213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6831","nonce":29339213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":29339213},{"type":"v1","addr":"172.21.15.99:6829","nonce":29339213}]},"public_addr":"172.21.15.99:6825/29339213","cluster_addr":"172.21.15.99:6827/29339213","heartbeat_back_addr":"172.21.15.99:6831/29339213","heartbeat_front_addr":"172.21.15.99:6829/29339213","state":["exists","up"]},{"osd":6,"uuid":"067ae6ca-66a7-4152-9e03-01718c782591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6817","nonce":826618722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6819","nonce":826618722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6824","nonce":826618722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":826618722},{"type":"v1","addr":"172.21.15.99:6821","nonce":826618722}]},"public_addr":"172.21.15.99:6817/826618722","cluster_addr":"172.21.15.99:6819/826618722","heartbeat_back_addr":"172.21.15.99:6824/826618722","heartbeat_front_addr":"172.21.15.99:6821/826618722","state":["exists","up"]},{"osd":7,"uuid":"96538787-6328-4c1b-8fb9-8b6f1efe26ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6809","nonce":3214921666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6811","nonce":3214921666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6815","nonce":3214921666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3214921666},{"type":"v1","addr":"172.21.15.99:6813","nonce":3214921666}]},"public_addr":"172.21.15.99:6809/3214921666","cluster_addr":"172.21.15.99:6811/3214921666","heartbeat_back_addr":"172.21.15.99:6815/3214921666","heartbeat_front_addr":"172.21.15.99:6813/3214921666","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.920531+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.711668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.941022+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.088833+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.694876+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:31.003835+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.977338+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T09:19:30.937416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6837/3202590301":"2023-12-13T09:23:34.412037+0000","172.21.15.84:6835/3202590301":"2023-12-13T09:23:34.412037+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T09:23:41.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe57406ae70 msgr2=0x7fe57406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:41.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe57406ae70 0x7fe57406d330 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe58c006fd0 tx=0x7fe58c008040 comp rx=0 tx=0).stop 2023-12-12T09:23:41.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe590145770 msgr2=0x7fe590145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:41.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe590145770 0x7fe590145bf0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fe58002bf80 tx=0x7fe580004730 comp rx=0 tx=0).stop 2023-12-12T09:23:41.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 shutdown_connections 2023-12-12T09:23:41.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fe590144820 0x7fe590144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fe57406ae70 0x7fe57406d330 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe590145770 0x7fe590145bf0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 --2- 172.21.15.84:0/1901688104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe57c0069d0 0x7fe590148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 >> 172.21.15.84:0/1901688104 conn(0x7fe5900b07f0 msgr2=0x7fe59006d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 shutdown_connections 2023-12-12T09:23:41.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:41.382+0000 7fe59756c640 1 -- 172.21.15.84:0/1901688104 wait complete. 2023-12-12T09:23:42.403 INFO:tasks.ceph:Scrubbing osd.0 2023-12-12T09:23:42.403 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:23:42.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.628+0000 7f1266852640 1 Processor -- start 2023-12-12T09:23:42.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.628+0000 7f1266852640 1 -- start start 2023-12-12T09:23:42.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f1266852640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 0x7f1260071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f1266852640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f126006c440 0x7f126006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f1266852640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1260070cb0 con 0x7f12600abd50 2023-12-12T09:23:42.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f1266852640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1260070f50 con 0x7f126006c440 2023-12-12T09:23:42.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f1266852640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126006d8c0 con 0x7f126006c060 2023-12-12T09:23:42.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f1257fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f12600abd50 0x7f12600ac1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50170/0 (socket says 172.21.15.84:50170) 2023-12-12T09:23:42.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f1257fff640 1 -- 172.21.15.84:0/3733831394 learned_addr learned my addr 172.21.15.84:0/3733831394 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f125ffff640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 0x7f1260071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.630+0000 7f1264def640 1 --2- 172.21.15.84:0/3733831394 >> v2:172.21.15.99:3300/0 conn(0x7f126006c440 0x7f126006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593579847 0 0) 0x7f1260070cb0 con 0x7f12600abd50 2023-12-12T09:23:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f124c003520 con 0x7f12600abd50 2023-12-12T09:23:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992161135 0 0) 0x7f124c003520 con 0x7f12600abd50 2023-12-12T09:23:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 msgr2=0x7f1260071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 0x7f1260071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 >> v2:172.21.15.99:3300/0 conn(0x7f126006c440 msgr2=0x7f126006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 --2- 172.21.15.84:0/3733831394 >> v2:172.21.15.99:3300/0 conn(0x7f126006c440 0x7f126006c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600711f0 con 0x7f12600abd50 2023-12-12T09:23:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f1248001670 con 0x7f12600abd50 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 >> v1:172.21.15.84:6789/0 conn(0x7f12600abd50 legacy=0x7f12600ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 0x7f124c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f124c003fd0 0x7f124c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f124c004d00 0x7f124c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1260070f50 con 0x7f124c003fd0 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126006d8c0 con 0x7f124c004d00 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.631+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c00bab0 con 0x7f126006c060 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f1257fff640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f124c003fd0 0x7f124c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f1264def640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f124c004d00 0x7f124c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f125ffff640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 0x7f124c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f1257fff640 1 -- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 msgr2=0x7f124c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:42.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f1257fff640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 0x7f124c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f1257fff640 1 -- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f124c004d00 msgr2=0x7f124c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:42.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f1257fff640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f124c004d00 0x7f124c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f1257fff640 1 -- 172.21.15.84:0/3733831394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c003520 con 0x7f124c003fd0 2023-12-12T09:23:42.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.632+0000 7f125ffff640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126006c060 0x7f124c003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:42.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.633+0000 7f1257fff640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f124c003fd0 0x7f124c0047c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f124800c240 tx=0x7f124c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffc656166d9a8ed server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:42.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124802cb00 con 0x7f124c003fd0 2023-12-12T09:23:42.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124802cc60 con 0x7f124c003fd0 2023-12-12T09:23:42.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f125f7fe640 1 -- 172.21.15.84:0/3733831394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248005af0 con 0x7f124c003fd0 2023-12-12T09:23:42.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f1266852640 1 -- 172.21.15.84:0/3733831394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f124c003fd0 msgr2=0x7f124c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f1266852640 1 --2- 172.21.15.84:0/3733831394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f124c003fd0 0x7f124c0047c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f124800c240 tx=0x7f124c0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f1264def640 1 -- 172.21.15.84:0/3733831394 reap_dead start 2023-12-12T09:23:42.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f1266852640 1 -- 172.21.15.84:0/3733831394 shutdown_connections 2023-12-12T09:23:42.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f1266852640 1 -- 172.21.15.84:0/3733831394 >> 172.21.15.84:0/3733831394 conn(0x7f12600b0970 msgr2=0x7f12600b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:42.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f1266852640 1 -- 172.21.15.84:0/3733831394 shutdown_connections 2023-12-12T09:23:42.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.634+0000 7f1266852640 1 -- 172.21.15.84:0/3733831394 wait complete. 2023-12-12T09:23:42.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.636+0000 7f1266852640 1 Processor -- start 2023-12-12T09:23:42.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.636+0000 7f1266852640 1 -- start start 2023-12-12T09:23:42.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.637+0000 7f1266852640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f124c003fd0 0x7f1260150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.637+0000 7f1266852640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12600cf000 0x7f126015d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.637+0000 7f1266852640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126015b620 0x7f126015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.637+0000 7f1266852640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12601488a0 con 0x7f12600cf000 2023-12-12T09:23:42.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.637+0000 7f1266852640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126015e560 con 0x7f124c003fd0 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.637+0000 7f1266852640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126015bfe0 con 0x7f126015b620 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1257fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12600cf000 0x7f126015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1257fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12600cf000 0x7f126015d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40058/0 (socket says 172.21.15.84:40058) 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1257fff640 1 -- 172.21.15.84:0/897725888 learned_addr learned my addr 172.21.15.84:0/897725888 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f125ffff640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f124c003fd0 0x7f1260150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1264def640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126015b620 0x7f126015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1257fff640 1 -- 172.21.15.84:0/897725888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126015b620 msgr2=0x7f126015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1257fff640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f126015b620 0x7f126015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1257fff640 1 -- 172.21.15.84:0/897725888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f124c003fd0 msgr2=0x7f1260150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1257fff640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f124c003fd0 0x7f1260150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.638+0000 7f1257fff640 1 -- 172.21.15.84:0/897725888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600c8c70 con 0x7f12600cf000 2023-12-12T09:23:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.639+0000 7f1257fff640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12600cf000 0x7f126015d730 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f1248000f60 tx=0x7f1248001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.639+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124803c040 con 0x7f12600cf000 2023-12-12T09:23:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.639+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1248004bf0 con 0x7f12600cf000 2023-12-12T09:23:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.639+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248007070 con 0x7f12600cf000 2023-12-12T09:23:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.639+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126015dfa0 con 0x7f12600cf000 2023-12-12T09:23:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.639+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12600c8900 con 0x7f12600cf000 2023-12-12T09:23:42.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.640+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12600c8780 con 0x7f12600cf000 2023-12-12T09:23:42.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.641+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1248032070 con 0x7f12600cf000 2023-12-12T09:23:42.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.642+0000 7f125d7fa640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f124006ae70 0x7f124006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.642+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f12480aa070 con 0x7f12600cf000 2023-12-12T09:23:42.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.642+0000 7f125d7fa640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1240071170 0x7f12400735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.642+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 --> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1240073c80 con 0x7f1240071170 2023-12-12T09:23:42.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.642+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12480ac780 con 0x7f12600cf000 2023-12-12T09:23:42.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.642+0000 7f125ffff640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f124006ae70 0x7f124006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.643+0000 7f1264def640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1240071170 0x7f12400735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.643+0000 7f125ffff640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f124006ae70 0x7f124006d330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f12500099c0 tx=0x7f1250008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:42.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.643+0000 7f1264def640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1240071170 0x7f12400735b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:42.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.644+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 <== osd.0 v2:172.21.15.84:6817/3970846200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1240073c80 con 0x7f1240071170 2023-12-12T09:23:42.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.658+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 --> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12600717b0 con 0x7f1240071170 2023-12-12T09:23:42.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f125d7fa640 1 -- 172.21.15.84:0/897725888 <== osd.0 v2:172.21.15.84:6817/3970846200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f125800f040 con 0x7f1240071170 2023-12-12T09:23:42.659 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:42.659 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:23:42.659 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1240071170 msgr2=0x7f12400735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1266852640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6817/3970846200,v1:172.21.15.84:6818/3970846200] conn(0x7f1240071170 0x7f12400735b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f124006ae70 msgr2=0x7f124006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1266852640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f124006ae70 0x7f124006d330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f12500099c0 tx=0x7f1250008040 comp rx=0 tx=0).stop 2023-12-12T09:23:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12600cf000 msgr2=0x7f126015d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1266852640 1 --2- 172.21.15.84:0/897725888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f12600cf000 0x7f126015d730 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f1248000f60 tx=0x7f1248001a00 comp rx=0 tx=0).stop 2023-12-12T09:23:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1264def640 1 -- 172.21.15.84:0/897725888 reap_dead start 2023-12-12T09:23:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 shutdown_connections 2023-12-12T09:23:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.659+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 >> 172.21.15.84:0/897725888 conn(0x7f12600b0970 msgr2=0x7f126006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:42.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.660+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 shutdown_connections 2023-12-12T09:23:42.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.660+0000 7f1266852640 1 -- 172.21.15.84:0/897725888 wait complete. 2023-12-12T09:23:42.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-12T09:23:42.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.877+0000 7fcc80539640 1 Processor -- start 2023-12-12T09:23:42.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.877+0000 7fcc80539640 1 -- start start 2023-12-12T09:23:42.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.879+0000 7fcc80539640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcc780b4ba0 0x7fcc7815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.879+0000 7fcc80539640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc780b3b60 con 0x7fcc78142f40 2023-12-12T09:23:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.879+0000 7fcc80539640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc780b3de0 con 0x7fcc7813ff90 2023-12-12T09:23:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.879+0000 7fcc80539640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7815e6d0 con 0x7fcc780b4ba0 2023-12-12T09:23:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.879+0000 7fcc7ead6640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcc780b4ba0 0x7fcc7815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.879+0000 7fcc7dad4640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcc78142f40 0x7fcc7815d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50174/0 (socket says 172.21.15.84:50174) 2023-12-12T09:23:42.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.880+0000 7fcc7dad4640 1 -- 172.21.15.84:0/2706502715 learned_addr learned my addr 172.21.15.84:0/2706502715 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:42.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.880+0000 7fcc7ead6640 1 -- 172.21.15.84:0/2706502715 >> v1:172.21.15.99:6789/0 conn(0x7fcc7813ff90 legacy=0x7fcc78142830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.880+0000 7fcc7d2d3640 1 -- 172.21.15.84:0/2706502715 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784059150 0 0) 0x7fcc780b3b60 con 0x7fcc78142f40 2023-12-12T09:23:42.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.880+0000 7fcc7ead6640 1 -- 172.21.15.84:0/2706502715 >> v1:172.21.15.84:6789/0 conn(0x7fcc78142f40 legacy=0x7fcc7815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.880+0000 7fcc7ead6640 1 -- 172.21.15.84:0/2706502715 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780b40c0 con 0x7fcc780b4ba0 2023-12-12T09:23:42.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.881+0000 7fcc7ead6640 1 --2- 172.21.15.84:0/2706502715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7815e0b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009d90 tx=0x7fcc7002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b63bd6eb4c54f4e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:42.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc7d2d3640 1 -- 172.21.15.84:0/2706502715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7002cd00 con 0x7fcc780b4ba0 2023-12-12T09:23:42.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc7d2d3640 1 -- 172.21.15.84:0/2706502715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7002ce60 con 0x7fcc780b4ba0 2023-12-12T09:23:42.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc7d2d3640 1 -- 172.21.15.84:0/2706502715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70034660 con 0x7fcc780b4ba0 2023-12-12T09:23:42.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc80539640 1 -- 172.21.15.84:0/2706502715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 msgr2=0x7fcc7815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc80539640 1 --2- 172.21.15.84:0/2706502715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7815e0b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fcc70009d90 tx=0x7fcc7002bf50 comp rx=0 tx=0).stop 2023-12-12T09:23:42.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc80539640 1 -- 172.21.15.84:0/2706502715 shutdown_connections 2023-12-12T09:23:42.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc80539640 1 --2- 172.21.15.84:0/2706502715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7815e0b0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc80539640 1 -- 172.21.15.84:0/2706502715 >> 172.21.15.84:0/2706502715 conn(0x7fcc7806c3d0 msgr2=0x7fcc7806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:42.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.882+0000 7fcc80539640 1 -- 172.21.15.84:0/2706502715 shutdown_connections 2023-12-12T09:23:42.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.883+0000 7fcc80539640 1 -- 172.21.15.84:0/2706502715 wait complete. 2023-12-12T09:23:42.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.884+0000 7fcc80539640 1 Processor -- start 2023-12-12T09:23:42.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.884+0000 7fcc80539640 1 -- start start 2023-12-12T09:23:42.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.885+0000 7fcc80539640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7813d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.885+0000 7fcc80539640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc7813ff90 0x7fcc78158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.885+0000 7fcc80539640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc78142f40 0x7fcc781406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.885+0000 7fcc80539640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78154d70 con 0x7fcc780b4ba0 2023-12-12T09:23:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.885+0000 7fcc80539640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78155050 con 0x7fcc78142f40 2023-12-12T09:23:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.885+0000 7fcc80539640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78155330 con 0x7fcc7813ff90 2023-12-12T09:23:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7813d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7813d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40070/0 (socket says 172.21.15.84:40070) 2023-12-12T09:23:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 -- 172.21.15.84:0/930405814 learned_addr learned my addr 172.21.15.84:0/930405814 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 -- 172.21.15.84:0/930405814 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc7813ff90 msgr2=0x7fcc78158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc7813ff90 0x7fcc78158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7ead6640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc78142f40 0x7fcc781406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 -- 172.21.15.84:0/930405814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc78142f40 msgr2=0x7fcc781406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc78142f40 0x7fcc781406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 -- 172.21.15.84:0/930405814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70009a70 con 0x7fcc780b4ba0 2023-12-12T09:23:42.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.886+0000 7fcc7e2d5640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7813d5e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c450 tx=0x7fcc7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:42.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.887+0000 7fcc6effd640 1 -- 172.21.15.84:0/930405814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740052d0 con 0x7fcc780b4ba0 2023-12-12T09:23:42.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.887+0000 7fcc6effd640 1 -- 172.21.15.84:0/930405814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74005430 con 0x7fcc780b4ba0 2023-12-12T09:23:42.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.887+0000 7fcc6effd640 1 -- 172.21.15.84:0/930405814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74012870 con 0x7fcc780b4ba0 2023-12-12T09:23:42.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.887+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc78155610 con 0x7fcc780b4ba0 2023-12-12T09:23:42.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.887+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc78158c40 con 0x7fcc780b4ba0 2023-12-12T09:23:42.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.888+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc78155b30 con 0x7fcc780b4ba0 2023-12-12T09:23:42.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.889+0000 7fcc6effd640 1 -- 172.21.15.84:0/930405814 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc740129d0 con 0x7fcc780b4ba0 2023-12-12T09:23:42.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.890+0000 7fcc6effd640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcc5c06ae70 0x7fcc5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:42.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.890+0000 7fcc6effd640 1 -- 172.21.15.84:0/930405814 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcc74088f20 con 0x7fcc780b4ba0 2023-12-12T09:23:42.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.890+0000 7fcc7dad4640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcc5c06ae70 0x7fcc5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:42.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.891+0000 7fcc7dad4640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcc5c06ae70 0x7fcc5c06d330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcc68007fd0 tx=0x7fcc68007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:42.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:42.895+0000 7fcc6effd640 1 -- 172.21.15.84:0/930405814 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc74054190 con 0x7fcc780b4ba0 2023-12-12T09:23:43.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.078+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc780b2950 con 0x7fcc5c06ae70 2023-12-12T09:23:43.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.079+0000 7fcc6effd640 1 -- 172.21.15.84:0/930405814 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcc780b2950 con 0x7fcc5c06ae70 2023-12-12T09:23:43.079 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 0 to deep-scrub 2023-12-12T09:23:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.081+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcc5c06ae70 msgr2=0x7fcc5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.081+0000 7fcc80539640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcc5c06ae70 0x7fcc5c06d330 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcc68007fd0 tx=0x7fcc68007900 comp rx=0 tx=0).stop 2023-12-12T09:23:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 msgr2=0x7fcc7813d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7813d5e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c450 tx=0x7fcc7400c910 comp rx=0 tx=0).stop 2023-12-12T09:23:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 shutdown_connections 2023-12-12T09:23:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc78142f40 0x7fcc781406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fcc7813ff90 0x7fcc78158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fcc5c06ae70 0x7fcc5c06d330 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 --2- 172.21.15.84:0/930405814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc780b4ba0 0x7fcc7813d5e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 >> 172.21.15.84:0/930405814 conn(0x7fcc7806c3d0 msgr2=0x7fcc7813f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 shutdown_connections 2023-12-12T09:23:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.082+0000 7fcc80539640 1 -- 172.21.15.84:0/930405814 wait complete. 2023-12-12T09:23:43.100 INFO:tasks.ceph:Scrubbing osd.1 2023-12-12T09:23:43.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:23:43.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.312+0000 7f852c4cf640 1 Processor -- start 2023-12-12T09:23:43.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.313+0000 7f852c4cf640 1 -- start start 2023-12-12T09:23:43.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.314+0000 7f852c4cf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8524163f90 0x7f8524166380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.314+0000 7f852c4cf640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8524070cb0 con 0x7f852406c060 2023-12-12T09:23:43.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.314+0000 7f852c4cf640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8524070f50 con 0x7f8524071cd0 2023-12-12T09:23:43.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.314+0000 7f852c4cf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8524072130 con 0x7f8524163f90 2023-12-12T09:23:43.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f852a26b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f852406c060 0x7f85240abd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50180/0 (socket says 172.21.15.84:50180) 2023-12-12T09:23:43.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f852a26b640 1 -- 172.21.15.84:0/228537946 learned_addr learned my addr 172.21.15.84:0/228537946 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933365723 0 0) 0x7f8524070cb0 con 0x7f852406c060 2023-12-12T09:23:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f852aa6c640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8524163f90 0x7f8524166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510003520 con 0x7f852406c060 2023-12-12T09:23:43.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3760971616 0 0) 0x7f8510003520 con 0x7f852406c060 2023-12-12T09:23:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8524163f90 msgr2=0x7f8524166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8524163f90 0x7f8524166380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 >> v1:172.21.15.99:6789/0 conn(0x7f8524071cd0 legacy=0x7f85240ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852406d8c0 con 0x7f852406c060 2023-12-12T09:23:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f8520001670 con 0x7f852406c060 2023-12-12T09:23:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 >> v1:172.21.15.84:6789/0 conn(0x7f852406c060 legacy=0x7f85240abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.315+0000 7f8529269640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f8510003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f8529269640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8524163f90 0x7f85100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f8529269640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8510004dd0 0x7f8510005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851000bc80 con 0x7f8510003a80 2023-12-12T09:23:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851000bdf0 con 0x7f8510004dd0 2023-12-12T09:23:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851000bfb0 con 0x7f8524163f90 2023-12-12T09:23:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f852a26b640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f8510003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f8529a6a640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8524163f90 0x7f85100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f852a26b640 1 -- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8524163f90 msgr2=0x7f85100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f852a26b640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8524163f90 0x7f85100047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f852a26b640 1 -- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8510004dd0 msgr2=0x7f8510005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f852a26b640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8510004dd0 0x7f8510005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.316+0000 7f852a26b640 1 -- 172.21.15.84:0/228537946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8510003520 con 0x7f8510003a80 2023-12-12T09:23:43.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.317+0000 7f852a26b640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f8510003ea0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f852000c0e0 tx=0x7f85100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b37c2f5a6e403bf server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.317+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520005ad0 con 0x7f8510003a80 2023-12-12T09:23:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.317+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520005c30 con 0x7f8510003a80 2023-12-12T09:23:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.317+0000 7f8529269640 1 -- 172.21.15.84:0/228537946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852002c810 con 0x7f8510003a80 2023-12-12T09:23:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.318+0000 7f852c4cf640 1 -- 172.21.15.84:0/228537946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 msgr2=0x7f8510003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.318+0000 7f852c4cf640 1 --2- 172.21.15.84:0/228537946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f8510003ea0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f852000c0e0 tx=0x7f85100057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.318+0000 7f852aa6c640 1 -- 172.21.15.84:0/228537946 reap_dead start 2023-12-12T09:23:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.318+0000 7f852c4cf640 1 -- 172.21.15.84:0/228537946 shutdown_connections 2023-12-12T09:23:43.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.318+0000 7f852c4cf640 1 -- 172.21.15.84:0/228537946 >> 172.21.15.84:0/228537946 conn(0x7f85240b0970 msgr2=0x7f85240b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.318+0000 7f852c4cf640 1 -- 172.21.15.84:0/228537946 shutdown_connections 2023-12-12T09:23:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.318+0000 7f852c4cf640 1 -- 172.21.15.84:0/228537946 wait complete. 2023-12-12T09:23:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.320+0000 7f852c4cf640 1 Processor -- start 2023-12-12T09:23:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.320+0000 7f852c4cf640 1 -- start start 2023-12-12T09:23:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852c4cf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f852414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852c4cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85240b3970 0x7f85240b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852c4cf640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852413f2c0 0x7f852413f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852c4cf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85240b3df0 con 0x7f8510003a80 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852c4cf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852413fc80 con 0x7f85240b3970 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852c4cf640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852414d660 con 0x7f852413f2c0 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852a26b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f852414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852a26b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f852414d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40080/0 (socket says 172.21.15.84:40080) 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.321+0000 7f852a26b640 1 -- 172.21.15.84:0/3157735822 learned_addr learned my addr 172.21.15.84:0/3157735822 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f852a26b640 1 -- 172.21.15.84:0/3157735822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852413f2c0 msgr2=0x7f852413f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f852a26b640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f852413f2c0 0x7f852413f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f852a26b640 1 -- 172.21.15.84:0/3157735822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85240b3970 msgr2=0x7f85240b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f852a26b640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85240b3970 0x7f85240b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f852a26b640 1 -- 172.21.15.84:0/3157735822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852414d940 con 0x7f8510003a80 2023-12-12T09:23:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f852a26b640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f852414d080 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f852002c3b0 tx=0x7f8520001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852002dcb0 con 0x7f8510003a80 2023-12-12T09:23:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852002de10 con 0x7f8510003a80 2023-12-12T09:23:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520007270 con 0x7f8510003a80 2023-12-12T09:23:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.322+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852414dc20 con 0x7f8510003a80 2023-12-12T09:23:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.323+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852414e1e0 con 0x7f8510003a80 2023-12-12T09:23:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.323+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85240717b0 con 0x7f8510003a80 2023-12-12T09:23:43.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.325+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8520032070 con 0x7f8510003a80 2023-12-12T09:23:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.325+0000 7f851affd640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f850806ae40 0x7f850806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.326+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f85200aa890 con 0x7f8510003a80 2023-12-12T09:23:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.326+0000 7f8529a6a640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f850806ae40 0x7f850806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.326+0000 7f851affd640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7f8508071140 0x7f8508073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.326+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 --> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8508073c50 con 0x7f8508071140 2023-12-12T09:23:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.326+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85200ace10 con 0x7f8510003a80 2023-12-12T09:23:43.330 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.326+0000 7f852aa6c640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7f8508071140 0x7f8508073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.326+0000 7f8529a6a640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f850806ae40 0x7f850806d300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8524150cb0 tx=0x7f8514009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.327+0000 7f852aa6c640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7f8508071140 0x7f8508073580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:43.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.327+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 <== osd.1 v2:172.21.15.84:6816/1701316875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8508073c50 con 0x7f8508071140 2023-12-12T09:23:43.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.341+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 --> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f85240714d0 con 0x7f8508071140 2023-12-12T09:23:43.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.342+0000 7f851affd640 1 -- 172.21.15.84:0/3157735822 <== osd.1 v2:172.21.15.84:6816/1701316875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f851c00f040 con 0x7f8508071140 2023-12-12T09:23:43.342 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:43.343 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:23:43.343 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.342+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7f8508071140 msgr2=0x7f8508073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.342+0000 7f852c4cf640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6816/1701316875,v1:172.21.15.84:6819/1701316875] conn(0x7f8508071140 0x7f8508073580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.342+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f850806ae40 msgr2=0x7f850806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.342+0000 7f852c4cf640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f850806ae40 0x7f850806d300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8524150cb0 tx=0x7f8514009040 comp rx=0 tx=0).stop 2023-12-12T09:23:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.342+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 msgr2=0x7f852414d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.342+0000 7f852c4cf640 1 --2- 172.21.15.84:0/3157735822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8510003a80 0x7f852414d080 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f852002c3b0 tx=0x7f8520001930 comp rx=0 tx=0).stop 2023-12-12T09:23:43.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.342+0000 7f852aa6c640 1 -- 172.21.15.84:0/3157735822 reap_dead start 2023-12-12T09:23:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.343+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 shutdown_connections 2023-12-12T09:23:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.343+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 >> 172.21.15.84:0/3157735822 conn(0x7f85240b0970 msgr2=0x7f85240b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.343+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 shutdown_connections 2023-12-12T09:23:43.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.343+0000 7f852c4cf640 1 -- 172.21.15.84:0/3157735822 wait complete. 2023-12-12T09:23:43.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-12T09:23:43.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.570+0000 7f9b8e675640 1 Processor -- start 2023-12-12T09:23:43.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.571+0000 7f9b8e675640 1 -- start start 2023-12-12T09:23:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.572+0000 7f9b8e675640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b880b47e0 0x7f9b88071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.572+0000 7f9b8e675640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b880ce550 0x7f9b880715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.572+0000 7f9b8e675640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880cea30 con 0x7f9b88143d20 2023-12-12T09:23:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.572+0000 7f9b8e675640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b880702b0 con 0x7f9b880b47e0 2023-12-12T09:23:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.572+0000 7f9b8e675640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88070590 con 0x7f9b880ce550 2023-12-12T09:23:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.573+0000 7f9b87fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9b88143d20 0x7f9b880b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50194/0 (socket says 172.21.15.84:50194) 2023-12-12T09:23:43.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.573+0000 7f9b87fff640 1 -- 172.21.15.84:0/838791878 learned_addr learned my addr 172.21.15.84:0/838791878 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:43.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.573+0000 7f9b8cc12640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b880ce550 0x7f9b880715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.573+0000 7f9b7ffff640 1 --2- 172.21.15.84:0/838791878 >> v2:172.21.15.99:3300/0 conn(0x7f9b880b47e0 0x7f9b88071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.573+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154793576 0 0) 0x7f9b880cea30 con 0x7f9b88143d20 2023-12-12T09:23:43.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.573+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b74003520 con 0x7f9b88143d20 2023-12-12T09:23:43.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 972228442 0 0) 0x7f9b74003520 con 0x7f9b88143d20 2023-12-12T09:23:43.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b880ce550 msgr2=0x7f9b880715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:43.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b880ce550 0x7f9b880715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 >> v2:172.21.15.99:3300/0 conn(0x7f9b880b47e0 msgr2=0x7f9b88071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 --2- 172.21.15.84:0/838791878 >> v2:172.21.15.99:3300/0 conn(0x7f9b880b47e0 0x7f9b88071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88070870 con 0x7f9b88143d20 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f9b78001670 con 0x7f9b88143d20 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 >> v1:172.21.15.84:6789/0 conn(0x7f9b88143d20 legacy=0x7f9b880b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b74003970 0x7f9b74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b880ce550 0x7f9b740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74004d00 0x7f9b74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880702b0 con 0x7f9b74003970 2023-12-12T09:23:43.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88070590 con 0x7f9b74004d00 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7400b980 con 0x7f9b880ce550 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b87fff640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b74003970 0x7f9b74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.574+0000 7f9b7ffff640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b880ce550 0x7f9b740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.575+0000 7f9b87fff640 1 -- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b880ce550 msgr2=0x7f9b740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.575+0000 7f9b87fff640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b880ce550 0x7f9b740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.575+0000 7f9b87fff640 1 -- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74004d00 msgr2=0x7f9b74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.575+0000 7f9b8cc12640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74004d00 0x7f9b74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.575+0000 7f9b87fff640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74004d00 0x7f9b74005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.575+0000 7f9b87fff640 1 -- 172.21.15.84:0/838791878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74003520 con 0x7f9b74003970 2023-12-12T09:23:43.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.576+0000 7f9b87fff640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b74003970 0x7f9b74003d90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800c190 tx=0x7f9b740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c405c7ed9fc050 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:43.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.576+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78005ad0 con 0x7f9b74003970 2023-12-12T09:23:43.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.576+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78005c30 con 0x7f9b74003970 2023-12-12T09:23:43.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.576+0000 7f9b877fe640 1 -- 172.21.15.84:0/838791878 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7802c810 con 0x7f9b74003970 2023-12-12T09:23:43.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.577+0000 7f9b8e675640 1 -- 172.21.15.84:0/838791878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b74003970 msgr2=0x7f9b74003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.577+0000 7f9b8e675640 1 --2- 172.21.15.84:0/838791878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b74003970 0x7f9b74003d90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800c190 tx=0x7f9b740057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.577+0000 7f9b8cc12640 1 -- 172.21.15.84:0/838791878 reap_dead start 2023-12-12T09:23:43.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.577+0000 7f9b8e675640 1 -- 172.21.15.84:0/838791878 shutdown_connections 2023-12-12T09:23:43.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.577+0000 7f9b8e675640 1 -- 172.21.15.84:0/838791878 >> 172.21.15.84:0/838791878 conn(0x7f9b8806c3d0 msgr2=0x7f9b8806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:43.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.577+0000 7f9b8e675640 1 -- 172.21.15.84:0/838791878 shutdown_connections 2023-12-12T09:23:43.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.577+0000 7f9b8e675640 1 -- 172.21.15.84:0/838791878 wait complete. 2023-12-12T09:23:43.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.579+0000 7f9b8e675640 1 Processor -- start 2023-12-12T09:23:43.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.579+0000 7f9b8e675640 1 -- start start 2023-12-12T09:23:43.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8e675640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b74003970 0x7f9b881f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8e675640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8815a260 0x7f9b881f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8e675640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b881f6970 0x7f9b880afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8e675640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b881f3400 con 0x7f9b881f6970 2023-12-12T09:23:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8e675640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8813fe90 con 0x7f9b8815a260 2023-12-12T09:23:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8e675640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b881f6ef0 con 0x7f9b74003970 2023-12-12T09:23:43.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8cc12640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b881f6970 0x7f9b880afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8cc12640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b881f6970 0x7f9b880afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40110/0 (socket says 172.21.15.84:40110) 2023-12-12T09:23:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.580+0000 7f9b8cc12640 1 -- 172.21.15.84:0/924103246 learned_addr learned my addr 172.21.15.84:0/924103246 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b8cc12640 1 -- 172.21.15.84:0/924103246 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b74003970 msgr2=0x7f9b881f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b8cc12640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b74003970 0x7f9b881f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b7ffff640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8815a260 0x7f9b881f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b8cc12640 1 -- 172.21.15.84:0/924103246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8815a260 msgr2=0x7f9b881f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b8cc12640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8815a260 0x7f9b881f6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b8cc12640 1 -- 172.21.15.84:0/924103246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b881f71d0 con 0x7f9b881f6970 2023-12-12T09:23:43.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b8cc12640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b881f6970 0x7f9b880afbf0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9b880744b0 tx=0x7f9b8000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:43.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b857fa640 1 -- 172.21.15.84:0/924103246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80017400 con 0x7f9b881f6970 2023-12-12T09:23:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b857fa640 1 -- 172.21.15.84:0/924103246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80011040 con 0x7f9b881f6970 2023-12-12T09:23:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b857fa640 1 -- 172.21.15.84:0/924103246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800177c0 con 0x7f9b881f6970 2023-12-12T09:23:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b881400e0 con 0x7f9b881f6970 2023-12-12T09:23:43.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.581+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8813a9e0 con 0x7f9b881f6970 2023-12-12T09:23:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.583+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b88140600 con 0x7f9b881f6970 2023-12-12T09:23:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.583+0000 7f9b857fa640 1 -- 172.21.15.84:0/924103246 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b80017920 con 0x7f9b881f6970 2023-12-12T09:23:43.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.584+0000 7f9b857fa640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b6806ae40 0x7f9b6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.584+0000 7f9b857fa640 1 -- 172.21.15.84:0/924103246 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9b80089970 con 0x7f9b881f6970 2023-12-12T09:23:43.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.584+0000 7f9b87fff640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b6806ae40 0x7f9b6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.585+0000 7f9b87fff640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b6806ae40 0x7f9b6806d300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800c160 tx=0x7f9b7802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:43.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.590+0000 7f9b857fa640 1 -- 172.21.15.84:0/924103246 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b88140600 con 0x7f9b881f6970 2023-12-12T09:23:43.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.767+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b881f7360 con 0x7f9b6806ae40 2023-12-12T09:23:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.767+0000 7f9b857fa640 1 -- 172.21.15.84:0/924103246 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9b881f7360 con 0x7f9b6806ae40 2023-12-12T09:23:43.768 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 1 to deep-scrub 2023-12-12T09:23:43.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b6806ae40 msgr2=0x7f9b6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b6806ae40 0x7f9b6806d300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800c160 tx=0x7f9b7802e000 comp rx=0 tx=0).stop 2023-12-12T09:23:43.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b881f6970 msgr2=0x7f9b880afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:43.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b881f6970 0x7f9b880afbf0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9b880744b0 tx=0x7f9b8000f4a0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 shutdown_connections 2023-12-12T09:23:43.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f9b6806ae40 0x7f9b6806d300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b881f6970 0x7f9b880afbf0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8815a260 0x7f9b881f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 --2- 172.21.15.84:0/924103246 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f9b74003970 0x7f9b881f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:43.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 >> 172.21.15.84:0/924103246 conn(0x7f9b8806c3d0 msgr2=0x7f9b8813ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:43.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 shutdown_connections 2023-12-12T09:23:43.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.770+0000 7f9b8e675640 1 -- 172.21.15.84:0/924103246 wait complete. 2023-12-12T09:23:43.787 INFO:tasks.ceph:Scrubbing osd.2 2023-12-12T09:23:43.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:23:43.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.994+0000 7f2b31ac9640 1 Processor -- start 2023-12-12T09:23:43.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.995+0000 7f2b31ac9640 1 -- start start 2023-12-12T09:23:43.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.996+0000 7f2b31ac9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2b2c15e770 0x7f2b2c0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:43.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.996+0000 7f2b31ac9640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c0b27a0 con 0x7f2b2c1439c0 2023-12-12T09:23:43.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.996+0000 7f2b31ac9640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c0b24c0 con 0x7f2b2c0cdc50 2023-12-12T09:23:43.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.996+0000 7f2b31ac9640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c143da0 con 0x7f2b2c15e770 2023-12-12T09:23:43.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.996+0000 7f2b2b7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b2c1439c0 0x7f2b2c0b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50208/0 (socket says 172.21.15.84:50208) 2023-12-12T09:23:43.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.996+0000 7f2b2b7fe640 1 -- 172.21.15.84:0/374588676 learned_addr learned my addr 172.21.15.84:0/374588676 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:43.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b23fff640 1 --2- 172.21.15.84:0/374588676 >> v2:172.21.15.99:3300/0 conn(0x7f2b2c15e770 0x7f2b2c0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:43.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770145993 0 0) 0x7f2b2c0b27a0 con 0x7f2b2c1439c0 2023-12-12T09:23:43.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b18003520 con 0x7f2b2c1439c0 2023-12-12T09:23:43.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1075902118 0 0) 0x7f2b18003520 con 0x7f2b2c1439c0 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 >> v2:172.21.15.99:3300/0 conn(0x7f2b2c15e770 msgr2=0x7f2b2c0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 --2- 172.21.15.84:0/374588676 >> v2:172.21.15.99:3300/0 conn(0x7f2b2c15e770 0x7f2b2c0cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 >> v1:172.21.15.99:6789/0 conn(0x7f2b2c0cdc50 legacy=0x7f2b2c070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c0cb7d0 con 0x7f2b2c1439c0 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f2b1c001670 con 0x7f2b2c1439c0 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 >> v1:172.21.15.84:6789/0 conn(0x7f2b2c1439c0 legacy=0x7f2b2c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b18003a50 0x7f2b18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b180047c0 0x7f2b18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b18005250 0x7f2b1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c143da0 con 0x7f2b18003a50 2023-12-12T09:23:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1800c1a0 con 0x7f2b18005250 2023-12-12T09:23:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.997+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1800c360 con 0x7f2b180047c0 2023-12-12T09:23:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.998+0000 7f2b2b7fe640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b18003a50 0x7f2b18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.998+0000 7f2b23fff640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b180047c0 0x7f2b18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.998+0000 7f2b2b7fe640 1 -- 172.21.15.84:0/374588676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b180047c0 msgr2=0x7f2b18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.998+0000 7f2b2b7fe640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b180047c0 0x7f2b18004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.998+0000 7f2b2b7fe640 1 -- 172.21.15.84:0/374588676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b18005250 msgr2=0x7f2b1800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.998+0000 7f2b2b7fe640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b18005250 0x7f2b1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.998+0000 7f2b2b7fe640 1 -- 172.21.15.84:0/374588676 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b18003520 con 0x7f2b18003a50 2023-12-12T09:23:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.998+0000 7f2b2bfff640 1 -- 172.21.15.84:0/374588676 reap_dead start 2023-12-12T09:23:44.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.999+0000 7f2b2b7fe640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b18003a50 0x7f2b18003e70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00c240 tx=0x7f2b180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d37c670fcaf681 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.999+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c005ad0 con 0x7f2b18003a50 2023-12-12T09:23:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.999+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c005c30 con 0x7f2b18003a50 2023-12-12T09:23:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:43.999+0000 7f2b2affd640 1 -- 172.21.15.84:0/374588676 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c02caf0 con 0x7f2b18003a50 2023-12-12T09:23:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.000+0000 7f2b31ac9640 1 -- 172.21.15.84:0/374588676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b18003a50 msgr2=0x7f2b18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.000+0000 7f2b31ac9640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b18003a50 0x7f2b18003e70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00c240 tx=0x7f2b180057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.000+0000 7f2b31ac9640 1 -- 172.21.15.84:0/374588676 shutdown_connections 2023-12-12T09:23:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.000+0000 7f2b31ac9640 1 --2- 172.21.15.84:0/374588676 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b18003a50 0x7f2b18003e70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.000+0000 7f2b31ac9640 1 -- 172.21.15.84:0/374588676 >> 172.21.15.84:0/374588676 conn(0x7f2b2c0b0970 msgr2=0x7f2b2c0b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:44.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.000+0000 7f2b31ac9640 1 -- 172.21.15.84:0/374588676 shutdown_connections 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.000+0000 7f2b31ac9640 1 -- 172.21.15.84:0/374588676 wait complete. 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.002+0000 7f2b31ac9640 1 Processor -- start 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.002+0000 7f2b31ac9640 1 -- start start 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b31ac9640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b18003a50 0x7f2b2c13c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b31ac9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c13f550 0x7f2b2c0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b31ac9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c13f9d0 0x7f2b2c0ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b31ac9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c141d40 con 0x7f2b2c13f550 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b31ac9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c099f20 con 0x7f2b2c13f9d0 2023-12-12T09:23:44.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b31ac9640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c1427c0 con 0x7f2b18003a50 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c13f550 0x7f2b2c0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c13f550 0x7f2b2c0abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40122/0 (socket says 172.21.15.84:40122) 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.003+0000 7f2b23fff640 1 -- 172.21.15.84:0/996401464 learned_addr learned my addr 172.21.15.84:0/996401464 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b23fff640 1 -- 172.21.15.84:0/996401464 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b18003a50 msgr2=0x7f2b2c13c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b23fff640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f2b18003a50 0x7f2b2c13c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b23fff640 1 -- 172.21.15.84:0/996401464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c13f9d0 msgr2=0x7f2b2c0ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b23fff640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c13f9d0 0x7f2b2c0ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b23fff640 1 -- 172.21.15.84:0/996401464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c141f20 con 0x7f2b2c13f550 2023-12-12T09:23:44.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b23fff640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c13f550 0x7f2b2c0abd50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2b14010870 tx=0x7f2b14010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b140095f0 con 0x7f2b2c13f550 2023-12-12T09:23:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1400eb00 con 0x7f2b2c13f550 2023-12-12T09:23:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c142200 con 0x7f2b2c13f550 2023-12-12T09:23:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1400eeb0 con 0x7f2b2c13f550 2023-12-12T09:23:44.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.004+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c159a10 con 0x7f2b2c13f550 2023-12-12T09:23:44.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.005+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b2c0ce0a0 con 0x7f2b2c13f550 2023-12-12T09:23:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.006+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b1401c400 con 0x7f2b2c13f550 2023-12-12T09:23:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.007+0000 7f2b28ff9640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0c06ae70 0x7f2b0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.007+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2b14089480 con 0x7f2b2c13f550 2023-12-12T09:23:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.007+0000 7f2b2b7fe640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0c06ae70 0x7f2b0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.008+0000 7f2b28ff9640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f2b0c071170 0x7f2b0c0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.008+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 --> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b0c073c80 con 0x7f2b0c071170 2023-12-12T09:23:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.008+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b1408ba60 con 0x7f2b2c13f550 2023-12-12T09:23:44.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.008+0000 7f2b2bfff640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f2b0c071170 0x7f2b0c0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.008+0000 7f2b2b7fe640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0c06ae70 0x7f2b0c06d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c034000 tx=0x7f2b1c039040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.008+0000 7f2b2bfff640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f2b0c071170 0x7f2b0c0735b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.009+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 <== osd.2 v2:172.21.15.84:6808/3546175864 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2b0c073c80 con 0x7f2b0c071170 2023-12-12T09:23:44.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.023+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 --> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2b2c0cbd90 con 0x7f2b0c071170 2023-12-12T09:23:44.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.024+0000 7f2b28ff9640 1 -- 172.21.15.84:0/996401464 <== osd.2 v2:172.21.15.84:6808/3546175864 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2b24001770 con 0x7f2b0c071170 2023-12-12T09:23:44.024 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:44.025 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:23:44.025 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:44.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.024+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f2b0c071170 msgr2=0x7f2b0c0735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.024+0000 7f2b31ac9640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6808/3546175864,v1:172.21.15.84:6809/3546175864] conn(0x7f2b0c071170 0x7f2b0c0735b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0c06ae70 msgr2=0x7f2b0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b31ac9640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f2b0c06ae70 0x7f2b0c06d330 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c034000 tx=0x7f2b1c039040 comp rx=0 tx=0).stop 2023-12-12T09:23:44.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c13f550 msgr2=0x7f2b2c0abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b31ac9640 1 --2- 172.21.15.84:0/996401464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c13f550 0x7f2b2c0abd50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2b14010870 tx=0x7f2b14010d30 comp rx=0 tx=0).stop 2023-12-12T09:23:44.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b2bfff640 1 -- 172.21.15.84:0/996401464 reap_dead start 2023-12-12T09:23:44.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 shutdown_connections 2023-12-12T09:23:44.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 >> 172.21.15.84:0/996401464 conn(0x7f2b2c0b0970 msgr2=0x7f2b2c0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:44.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 shutdown_connections 2023-12-12T09:23:44.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.025+0000 7f2b31ac9640 1 -- 172.21.15.84:0/996401464 wait complete. 2023-12-12T09:23:44.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-12T09:23:44.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.251+0000 7f0512461640 1 Processor -- start 2023-12-12T09:23:44.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.251+0000 7f0512461640 1 -- start start 2023-12-12T09:23:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.252+0000 7f0512461640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f050c143d20 0x7f050c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.252+0000 7f0512461640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f050c0ce550 0x7f050c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.252+0000 7f0512461640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050c0cea30 con 0x7f050c1447f0 2023-12-12T09:23:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.252+0000 7f0512461640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050c0702b0 con 0x7f050c0ce550 2023-12-12T09:23:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.252+0000 7f0512461640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050c070590 con 0x7f050c143d20 2023-12-12T09:23:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.252+0000 7f0503fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f050c0ce550 0x7f050c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.253+0000 7f05109fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f050c1447f0 0x7f050c15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50214/0 (socket says 172.21.15.84:50214) 2023-12-12T09:23:44.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.253+0000 7f05109fe640 1 -- 172.21.15.84:0/1077395739 learned_addr learned my addr 172.21.15.84:0/1077395739 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:44.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.253+0000 7f050bfff640 1 --2- 172.21.15.84:0/1077395739 >> v2:172.21.15.99:3300/0 conn(0x7f050c143d20 0x7f050c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.253+0000 7f0503fff640 1 -- 172.21.15.84:0/1077395739 >> v2:172.21.15.99:3300/0 conn(0x7f050c143d20 msgr2=0x7f050c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.253+0000 7f0503fff640 1 --2- 172.21.15.84:0/1077395739 >> v2:172.21.15.99:3300/0 conn(0x7f050c143d20 0x7f050c0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.253+0000 7f0503fff640 1 -- 172.21.15.84:0/1077395739 >> v1:172.21.15.84:6789/0 conn(0x7f050c1447f0 legacy=0x7f050c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.253+0000 7f0503fff640 1 -- 172.21.15.84:0/1077395739 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c070870 con 0x7f050c0ce550 2023-12-12T09:23:44.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.253+0000 7f050b7fe640 1 -- 172.21.15.84:0/1077395739 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930628477 0 0) 0x7f050c0cea30 con 0x7f050c1447f0 2023-12-12T09:23:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.254+0000 7f0503fff640 1 --2- 172.21.15.84:0/1077395739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c0ce550 0x7f050c0b4610 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f050c04f7a0 tx=0x7f04f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84f7c0253729f01 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f050b7fe640 1 -- 172.21.15.84:0/1077395739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4031830 con 0x7f050c0ce550 2023-12-12T09:23:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f050b7fe640 1 -- 172.21.15.84:0/1077395739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f4031990 con 0x7f050c0ce550 2023-12-12T09:23:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f050b7fe640 1 -- 172.21.15.84:0/1077395739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4031d20 con 0x7f050c0ce550 2023-12-12T09:23:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f0512461640 1 -- 172.21.15.84:0/1077395739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c0ce550 msgr2=0x7f050c0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f0512461640 1 --2- 172.21.15.84:0/1077395739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c0ce550 0x7f050c0b4610 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f050c04f7a0 tx=0x7f04f402b8d0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f0512461640 1 -- 172.21.15.84:0/1077395739 shutdown_connections 2023-12-12T09:23:44.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f0512461640 1 --2- 172.21.15.84:0/1077395739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c0ce550 0x7f050c0b4610 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f0512461640 1 --2- 172.21.15.84:0/1077395739 >> v2:172.21.15.99:3300/0 conn(0x7f050c143d20 0x7f050c0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f0512461640 1 -- 172.21.15.84:0/1077395739 >> 172.21.15.84:0/1077395739 conn(0x7f050c06c3d0 msgr2=0x7f050c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f0512461640 1 -- 172.21.15.84:0/1077395739 shutdown_connections 2023-12-12T09:23:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.255+0000 7f0512461640 1 -- 172.21.15.84:0/1077395739 wait complete. 2023-12-12T09:23:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.257+0000 7f0512461640 1 Processor -- start 2023-12-12T09:23:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.257+0000 7f0512461640 1 -- start start 2023-12-12T09:23:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f0512461640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c0ce550 0x7f050c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f0512461640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c143d20 0x7f050c1e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f0512461640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c1447f0 0x7f050c13b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f0512461640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0cd310 con 0x7f050c1447f0 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f0512461640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050c0c46a0 con 0x7f050c0ce550 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f0512461640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050c13ab20 con 0x7f050c143d20 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f05109fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c1447f0 0x7f050c13b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f05109fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c1447f0 0x7f050c13b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40138/0 (socket says 172.21.15.84:40138) 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.258+0000 7f05109fe640 1 -- 172.21.15.84:0/579968948 learned_addr learned my addr 172.21.15.84:0/579968948 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f0503fff640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c143d20 0x7f050c1e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f050bfff640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c0ce550 0x7f050c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05109fe640 1 -- 172.21.15.84:0/579968948 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c143d20 msgr2=0x7f050c1e9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05109fe640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c143d20 0x7f050c1e9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05109fe640 1 -- 172.21.15.84:0/579968948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c0ce550 msgr2=0x7f050c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05109fe640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c0ce550 0x7f050c0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05109fe640 1 -- 172.21.15.84:0/579968948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f4009400 con 0x7f050c1447f0 2023-12-12T09:23:44.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05109fe640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c1447f0 0x7f050c13b110 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f050400c700 tx=0x7f050400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05097fa640 1 -- 172.21.15.84:0/579968948 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400ce10 con 0x7f050c1447f0 2023-12-12T09:23:44.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05097fa640 1 -- 172.21.15.84:0/579968948 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050400a640 con 0x7f050c1447f0 2023-12-12T09:23:44.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f05097fa640 1 -- 172.21.15.84:0/579968948 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400a9f0 con 0x7f050c1447f0 2023-12-12T09:23:44.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.259+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050c0c48f0 con 0x7f050c1447f0 2023-12-12T09:23:44.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.260+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050c1f73f0 con 0x7f050c1447f0 2023-12-12T09:23:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.261+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050c0673c0 con 0x7f050c1447f0 2023-12-12T09:23:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.261+0000 7f05097fa640 1 -- 172.21.15.84:0/579968948 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f050400ab50 con 0x7f050c1447f0 2023-12-12T09:23:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.262+0000 7f05097fa640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f04ec06ae40 0x7f04ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.263+0000 7f05097fa640 1 -- 172.21.15.84:0/579968948 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f05040887d0 con 0x7f050c1447f0 2023-12-12T09:23:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.263+0000 7f050bfff640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f04ec06ae40 0x7f04ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.263+0000 7f050bfff640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f04ec06ae40 0x7f04ec06d300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f04fc006fd0 tx=0x7f04fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.267+0000 7f05097fa640 1 -- 172.21.15.84:0/579968948 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0504053ad0 con 0x7f050c1447f0 2023-12-12T09:23:44.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.442+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f050c13cf70 con 0x7f04ec06ae40 2023-12-12T09:23:44.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.443+0000 7f05097fa640 1 -- 172.21.15.84:0/579968948 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f050c13cf70 con 0x7f04ec06ae40 2023-12-12T09:23:44.443 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 2 to deep-scrub 2023-12-12T09:23:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f04ec06ae40 msgr2=0x7f04ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f04ec06ae40 0x7f04ec06d300 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f04fc006fd0 tx=0x7f04fc008040 comp rx=0 tx=0).stop 2023-12-12T09:23:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c1447f0 msgr2=0x7f050c13b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c1447f0 0x7f050c13b110 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f050400c700 tx=0x7f050400cbc0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 shutdown_connections 2023-12-12T09:23:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f04ec06ae40 0x7f04ec06d300 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f050c1447f0 0x7f050c13b110 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f050c143d20 0x7f050c1e9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 --2- 172.21.15.84:0/579968948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f050c0ce550 0x7f050c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.445+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 >> 172.21.15.84:0/579968948 conn(0x7f050c06c3d0 msgr2=0x7f050c06d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:44.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.446+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 shutdown_connections 2023-12-12T09:23:44.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.446+0000 7f0512461640 1 -- 172.21.15.84:0/579968948 wait complete. 2023-12-12T09:23:44.464 INFO:tasks.ceph:Scrubbing osd.3 2023-12-12T09:23:44.464 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:23:44.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.670+0000 7f8b5ce3d640 1 Processor -- start 2023-12-12T09:23:44.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.670+0000 7f8b5ce3d640 1 -- start start 2023-12-12T09:23:44.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.672+0000 7f8b5ce3d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b580ce360 0x7f8b580cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.672+0000 7f8b5ce3d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b580b27a0 con 0x7f8b5815e770 2023-12-12T09:23:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.672+0000 7f8b5ce3d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b580b24c0 con 0x7f8b581439c0 2023-12-12T09:23:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.672+0000 7f8b5ce3d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b58143da0 con 0x7f8b580ce360 2023-12-12T09:23:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.672+0000 7f8b56d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b580ce360 0x7f8b580cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.672+0000 7f8b56d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8b580ce360 0x7f8b580cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40154/0 (socket says 172.21.15.84:40154) 2023-12-12T09:23:44.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.672+0000 7f8b56d9d640 1 -- 172.21.15.84:0/2981512530 learned_addr learned my addr 172.21.15.84:0/2981512530 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:44.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.673+0000 7f8b56d9d640 1 -- 172.21.15.84:0/2981512530 >> v1:172.21.15.99:6789/0 conn(0x7f8b581439c0 legacy=0x7f8b580b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.673+0000 7f8b56d9d640 1 -- 172.21.15.84:0/2981512530 >> v1:172.21.15.84:6789/0 conn(0x7f8b5815e770 legacy=0x7f8b580cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.673+0000 7f8b56d9d640 1 -- 172.21.15.84:0/2981512530 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580cb7d0 con 0x7f8b580ce360 2023-12-12T09:23:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.674+0000 7f8b56d9d640 1 --2- 172.21.15.84:0/2981512530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b580ce360 0x7f8b580cc2b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009e50 tx=0x7f8b5002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b5091c7e01a57d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.674+0000 7f8b5559a640 1 -- 172.21.15.84:0/2981512530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5002ca80 con 0x7f8b580ce360 2023-12-12T09:23:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.674+0000 7f8b5559a640 1 -- 172.21.15.84:0/2981512530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5002cbe0 con 0x7f8b580ce360 2023-12-12T09:23:44.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.674+0000 7f8b5559a640 1 -- 172.21.15.84:0/2981512530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b500343f0 con 0x7f8b580ce360 2023-12-12T09:23:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.675+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/2981512530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b580ce360 msgr2=0x7f8b580cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.675+0000 7f8b5ce3d640 1 --2- 172.21.15.84:0/2981512530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b580ce360 0x7f8b580cc2b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009e50 tx=0x7f8b5002bee0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.675+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/2981512530 shutdown_connections 2023-12-12T09:23:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.675+0000 7f8b5ce3d640 1 --2- 172.21.15.84:0/2981512530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b580ce360 0x7f8b580cc2b0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.675+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/2981512530 >> 172.21.15.84:0/2981512530 conn(0x7f8b580b0970 msgr2=0x7f8b580b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.675+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/2981512530 shutdown_connections 2023-12-12T09:23:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.675+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/2981512530 wait complete. 2023-12-12T09:23:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.677+0000 7f8b5ce3d640 1 Processor -- start 2023-12-12T09:23:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.677+0000 7f8b5ce3d640 1 -- start start 2023-12-12T09:23:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b5ce3d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b580ce360 0x7f8b5813d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b5ce3d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b581439c0 0x7f8b5813df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b5ce3d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b5815e770 0x7f8b5809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b5ce3d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5815bf50 con 0x7f8b5815e770 2023-12-12T09:23:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b5ce3d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5809a5b0 con 0x7f8b580ce360 2023-12-12T09:23:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b5ce3d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5809a850 con 0x7f8b581439c0 2023-12-12T09:23:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b56d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b5815e770 0x7f8b5809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b56d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b5815e770 0x7f8b5809beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40162/0 (socket says 172.21.15.84:40162) 2023-12-12T09:23:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.678+0000 7f8b56d9d640 1 -- 172.21.15.84:0/3419572882 learned_addr learned my addr 172.21.15.84:0/3419572882 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b56d9d640 1 -- 172.21.15.84:0/3419572882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b581439c0 msgr2=0x7f8b5813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b5659c640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b580ce360 0x7f8b5813d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b55d9b640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b581439c0 0x7f8b5813df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b56d9d640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8b581439c0 0x7f8b5813df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b56d9d640 1 -- 172.21.15.84:0/3419572882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b580ce360 msgr2=0x7f8b5813d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b56d9d640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b580ce360 0x7f8b5813d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b56d9d640 1 -- 172.21.15.84:0/3419572882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50009b30 con 0x7f8b5815e770 2023-12-12T09:23:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b5659c640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b580ce360 0x7f8b5813d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b56d9d640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b5815e770 0x7f8b5809beb0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8b50036040 tx=0x7f8b50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5003e450 con 0x7f8b5815e770 2023-12-12T09:23:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5003e5d0 con 0x7f8b5815e770 2023-12-12T09:23:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5003e980 con 0x7f8b5815e770 2023-12-12T09:23:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.679+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5815b900 con 0x7f8b5815e770 2023-12-12T09:23:44.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.680+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5809a180 con 0x7f8b5815e770 2023-12-12T09:23:44.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.680+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b580cbd90 con 0x7f8b5815e770 2023-12-12T09:23:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.682+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b5002cd50 con 0x7f8b5815e770 2023-12-12T09:23:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.682+0000 7f8b46ffd640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b3806ae40 0x7f8b3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.683+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8b500abff0 con 0x7f8b5815e770 2023-12-12T09:23:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.683+0000 7f8b5659c640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b3806ae40 0x7f8b3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.683+0000 7f8b46ffd640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f8b38071140 0x7f8b38073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.683+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 --> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b38073c50 con 0x7f8b38071140 2023-12-12T09:23:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.683+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b500ae650 con 0x7f8b5815e770 2023-12-12T09:23:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.683+0000 7f8b55d9b640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f8b38071140 0x7f8b38073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.683+0000 7f8b5659c640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b3806ae40 0x7f8b3806d300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8b581e7570 tx=0x7f8b48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.684+0000 7f8b55d9b640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f8b38071140 0x7f8b38073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.684+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 <== osd.3 v2:172.21.15.84:6800/587370499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8b38073c50 con 0x7f8b38071140 2023-12-12T09:23:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.699+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 --> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8b5809aa70 con 0x7f8b38071140 2023-12-12T09:23:44.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.699+0000 7f8b46ffd640 1 -- 172.21.15.84:0/3419572882 <== osd.3 v2:172.21.15.84:6800/587370499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8b5809aa70 con 0x7f8b38071140 2023-12-12T09:23:44.700 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:44.700 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:23:44.700 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.699+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f8b38071140 msgr2=0x7f8b38073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.699+0000 7f8b5ce3d640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6800/587370499,v1:172.21.15.84:6801/587370499] conn(0x7f8b38071140 0x7f8b38073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b3806ae40 msgr2=0x7f8b3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b5ce3d640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8b3806ae40 0x7f8b3806d300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8b581e7570 tx=0x7f8b48009040 comp rx=0 tx=0).stop 2023-12-12T09:23:44.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b5815e770 msgr2=0x7f8b5809beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b5ce3d640 1 --2- 172.21.15.84:0/3419572882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b5815e770 0x7f8b5809beb0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8b50036040 tx=0x7f8b50004a40 comp rx=0 tx=0).stop 2023-12-12T09:23:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b56d9d640 1 -- 172.21.15.84:0/3419572882 reap_dead start 2023-12-12T09:23:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 shutdown_connections 2023-12-12T09:23:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 >> 172.21.15.84:0/3419572882 conn(0x7f8b580b0970 msgr2=0x7f8b580cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 shutdown_connections 2023-12-12T09:23:44.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.700+0000 7f8b5ce3d640 1 -- 172.21.15.84:0/3419572882 wait complete. 2023-12-12T09:23:44.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-12T09:23:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.914+0000 7f8a1759e640 1 Processor -- start 2023-12-12T09:23:44.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.915+0000 7f8a1759e640 1 -- start start 2023-12-12T09:23:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.916+0000 7f8a1759e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1006dff0 0x7f8a10070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.916+0000 7f8a1759e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8a1006d1f0 0x7f8a10070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.916+0000 7f8a1759e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1006c430 con 0x7f8a1015d050 2023-12-12T09:23:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.916+0000 7f8a1759e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a10071430 con 0x7f8a1006d1f0 2023-12-12T09:23:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.916+0000 7f8a1759e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1006c710 con 0x7f8a1006dff0 2023-12-12T09:23:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1659c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8a1015d050 0x7f8a1006d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50238/0 (socket says 172.21.15.84:50238) 2023-12-12T09:23:44.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1659c640 1 -- 172.21.15.84:0/202544610 learned_addr learned my addr 172.21.15.84:0/202544610 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:44.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a16d9d640 1 --2- 172.21.15.84:0/202544610 >> v2:172.21.15.99:3300/0 conn(0x7f8a1006d1f0 0x7f8a10070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a15d9b640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1006dff0 0x7f8a10070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062295305 0 0) 0x7f8a1006c430 con 0x7f8a1015d050 2023-12-12T09:23:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89fc003520 con 0x7f8a1015d050 2023-12-12T09:23:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3930220861 0 0) 0x7f89fc003520 con 0x7f8a1015d050 2023-12-12T09:23:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1006dff0 msgr2=0x7f8a10070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1006dff0 0x7f8a10070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 >> v2:172.21.15.99:3300/0 conn(0x7f8a1006d1f0 msgr2=0x7f8a10070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 --2- 172.21.15.84:0/202544610 >> v2:172.21.15.99:3300/0 conn(0x7f8a1006d1f0 0x7f8a10070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1006c9f0 con 0x7f8a1015d050 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f8a04001670 con 0x7f8a1015d050 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 >> v1:172.21.15.84:6789/0 conn(0x7f8a1015d050 legacy=0x7f8a1006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.917+0000 7f8a1559a640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f89fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1559a640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1006dff0 0x7f89fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1559a640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89fc004d00 0x7f89fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10071430 con 0x7f89fc003970 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1006c710 con 0x7f89fc004d00 2023-12-12T09:23:44.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc00ba00 con 0x7f8a1006dff0 2023-12-12T09:23:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1659c640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f89fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1659c640 1 -- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1006dff0 msgr2=0x7f89fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1659c640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a1006dff0 0x7f89fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1659c640 1 -- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89fc004d00 msgr2=0x7f89fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1659c640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89fc004d00 0x7f89fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.918+0000 7f8a1659c640 1 -- 172.21.15.84:0/202544610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc003520 con 0x7f89fc003970 2023-12-12T09:23:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.919+0000 7f8a1659c640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f89fc003d90 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400c110 tx=0x7f89fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e6fcacf2144966 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.919+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04005ad0 con 0x7f89fc003970 2023-12-12T09:23:44.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.919+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a04005c50 con 0x7f89fc003970 2023-12-12T09:23:44.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.919+0000 7f8a1559a640 1 -- 172.21.15.84:0/202544610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0402c830 con 0x7f89fc003970 2023-12-12T09:23:44.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.920+0000 7f8a1759e640 1 -- 172.21.15.84:0/202544610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 msgr2=0x7f89fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.920+0000 7f8a1759e640 1 --2- 172.21.15.84:0/202544610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f89fc003d90 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400c110 tx=0x7f89fc0057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.920+0000 7f8a16d9d640 1 -- 172.21.15.84:0/202544610 reap_dead start 2023-12-12T09:23:44.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.920+0000 7f8a1759e640 1 -- 172.21.15.84:0/202544610 shutdown_connections 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.920+0000 7f8a1759e640 1 -- 172.21.15.84:0/202544610 >> 172.21.15.84:0/202544610 conn(0x7f8a100b07f0 msgr2=0x7f8a100b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.920+0000 7f8a1759e640 1 -- 172.21.15.84:0/202544610 shutdown_connections 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.920+0000 7f8a1759e640 1 -- 172.21.15.84:0/202544610 wait complete. 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.922+0000 7f8a1759e640 1 Processor -- start 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.922+0000 7f8a1759e640 1 -- start start 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f8a10151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1759e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a101509b0 0x7f8a1015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1759e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a10150e30 0x7f8a1015fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1759e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10156800 con 0x7f89fc003970 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1759e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101564d0 con 0x7f8a101509b0 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1759e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10152d80 con 0x7f8a10150e30 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f8a10151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f8a10151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40186/0 (socket says 172.21.15.84:40186) 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.923+0000 7f8a1659c640 1 -- 172.21.15.84:0/3692475389 learned_addr learned my addr 172.21.15.84:0/3692475389 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a1659c640 1 -- 172.21.15.84:0/3692475389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a10150e30 msgr2=0x7f8a1015fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a1659c640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a10150e30 0x7f8a1015fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a1659c640 1 -- 172.21.15.84:0/3692475389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a101509b0 msgr2=0x7f8a1015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:44.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a1659c640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a101509b0 0x7f8a1015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:44.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a1659c640 1 -- 172.21.15.84:0/3692475389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a101527c0 con 0x7f89fc003970 2023-12-12T09:23:44.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a1659c640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f8a10151c10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8a0402c3d0 tx=0x7f8a04001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a02ffd640 1 -- 172.21.15.84:0/3692475389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0403c040 con 0x7f89fc003970 2023-12-12T09:23:44.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a02ffd640 1 -- 172.21.15.84:0/3692475389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0402dd50 con 0x7f89fc003970 2023-12-12T09:23:44.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a10152aa0 con 0x7f89fc003970 2023-12-12T09:23:44.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a02ffd640 1 -- 172.21.15.84:0/3692475389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040072b0 con 0x7f89fc003970 2023-12-12T09:23:44.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.924+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a101513f0 con 0x7f89fc003970 2023-12-12T09:23:44.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.926+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a101515b0 con 0x7f89fc003970 2023-12-12T09:23:44.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.926+0000 7f8a02ffd640 1 -- 172.21.15.84:0/3692475389 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a04032070 con 0x7f89fc003970 2023-12-12T09:23:44.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.928+0000 7f8a02ffd640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f89f406ae40 0x7f89f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:44.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.928+0000 7f8a02ffd640 1 -- 172.21.15.84:0/3692475389 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8a040aaf80 con 0x7f89fc003970 2023-12-12T09:23:44.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.928+0000 7f8a15d9b640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f89f406ae40 0x7f89f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:44.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.929+0000 7f8a15d9b640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f89f406ae40 0x7f89f406d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a08006a90 tx=0x7f8a08006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:44.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:44.932+0000 7f8a02ffd640 1 -- 172.21.15.84:0/3692475389 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a04076150 con 0x7f89fc003970 2023-12-12T09:23:45.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.122+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a1015e310 con 0x7f89f406ae40 2023-12-12T09:23:45.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.122+0000 7f8a02ffd640 1 -- 172.21.15.84:0/3692475389 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a0800e7e0 con 0x7f89f406ae40 2023-12-12T09:23:45.123 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 3 to deep-scrub 2023-12-12T09:23:45.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f89f406ae40 msgr2=0x7f89f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f89f406ae40 0x7f89f406d300 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a08006a90 tx=0x7f8a08006a20 comp rx=0 tx=0).stop 2023-12-12T09:23:45.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 msgr2=0x7f8a10151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f8a10151c10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f8a0402c3d0 tx=0x7f8a04001930 comp rx=0 tx=0).stop 2023-12-12T09:23:45.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 shutdown_connections 2023-12-12T09:23:45.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a10150e30 0x7f8a1015fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a101509b0 0x7f8a1015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f89f406ae40 0x7f89f406d300 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 --2- 172.21.15.84:0/3692475389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89fc003970 0x7f8a10151c10 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 >> 172.21.15.84:0/3692475389 conn(0x7f8a100b07f0 msgr2=0x7f8a100661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:45.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 shutdown_connections 2023-12-12T09:23:45.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.125+0000 7f8a1759e640 1 -- 172.21.15.84:0/3692475389 wait complete. 2023-12-12T09:23:45.143 INFO:tasks.ceph:Scrubbing osd.4 2023-12-12T09:23:45.143 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:23:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.353+0000 7f94b9e2b640 1 Processor -- start 2023-12-12T09:23:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.353+0000 7f94b9e2b640 1 -- start start 2023-12-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.354+0000 7f94b9e2b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f94b415f270 0x7f94b4162840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.354+0000 7f94b9e2b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94b40b2a30 0x7f94b40cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.354+0000 7f94b9e2b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b40b32d0 con 0x7f94b40cbb50 2023-12-12T09:23:45.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.354+0000 7f94b9e2b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40cbfc0 con 0x7f94b40b2a30 2023-12-12T09:23:45.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.354+0000 7f94b9e2b640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40b35b0 con 0x7f94b415f270 2023-12-12T09:23:45.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94aaffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94b40b2a30 0x7f94b40cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94aaffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f94b40b2a30 0x7f94b40cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40198/0 (socket says 172.21.15.84:40198) 2023-12-12T09:23:45.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94aaffd640 1 -- 172.21.15.84:0/2705147815 learned_addr learned my addr 172.21.15.84:0/2705147815 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:45.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94b3fff640 1 --1- 172.21.15.84:0/2705147815 >> v1:172.21.15.84:6789/0 conn(0x7f94b40cbb50 0x7f94b4165290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:50248/0 (socket says 172.21.15.84:50248) 2023-12-12T09:23:45.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94b37fe640 1 --2- 172.21.15.84:0/2705147815 >> v2:172.21.15.99:3300/0 conn(0x7f94b415f270 0x7f94b4162840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94aaffd640 1 -- 172.21.15.84:0/2705147815 >> v2:172.21.15.99:3300/0 conn(0x7f94b415f270 msgr2=0x7f94b4162840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:45.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94aaffd640 1 --2- 172.21.15.84:0/2705147815 >> v2:172.21.15.99:3300/0 conn(0x7f94b415f270 0x7f94b4162840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94aaffd640 1 -- 172.21.15.84:0/2705147815 >> v1:172.21.15.84:6789/0 conn(0x7f94b40cbb50 legacy=0x7f94b4165290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94aaffd640 1 -- 172.21.15.84:0/2705147815 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40b3890 con 0x7f94b40b2a30 2023-12-12T09:23:45.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.355+0000 7f94b2ffd640 1 -- 172.21.15.84:0/2705147815 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120770109 0 0) 0x7f94b40b32d0 con 0x7f94b40cbb50 2023-12-12T09:23:45.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.356+0000 7f94aaffd640 1 --2- 172.21.15.84:0/2705147815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 0x7f94b40cb610 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f94b404f8d0 tx=0x7f94a402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55b075d01177f19 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b2ffd640 1 -- 172.21.15.84:0/2705147815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4030860 con 0x7f94b40b2a30 2023-12-12T09:23:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b2ffd640 1 -- 172.21.15.84:0/2705147815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a40309c0 con 0x7f94b40b2a30 2023-12-12T09:23:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b2ffd640 1 -- 172.21.15.84:0/2705147815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4030d50 con 0x7f94b40b2a30 2023-12-12T09:23:45.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b9e2b640 1 -- 172.21.15.84:0/2705147815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 msgr2=0x7f94b40cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b9e2b640 1 --2- 172.21.15.84:0/2705147815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 0x7f94b40cb610 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f94b404f8d0 tx=0x7f94a402b9a0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b9e2b640 1 -- 172.21.15.84:0/2705147815 shutdown_connections 2023-12-12T09:23:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b9e2b640 1 --2- 172.21.15.84:0/2705147815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 0x7f94b40cb610 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b9e2b640 1 --2- 172.21.15.84:0/2705147815 >> v2:172.21.15.99:3300/0 conn(0x7f94b415f270 0x7f94b4162840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b9e2b640 1 -- 172.21.15.84:0/2705147815 >> 172.21.15.84:0/2705147815 conn(0x7f94b40b0970 msgr2=0x7f94b40b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b9e2b640 1 -- 172.21.15.84:0/2705147815 shutdown_connections 2023-12-12T09:23:45.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.357+0000 7f94b9e2b640 1 -- 172.21.15.84:0/2705147815 wait complete. 2023-12-12T09:23:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.359+0000 7f94b9e2b640 1 Processor -- start 2023-12-12T09:23:45.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.359+0000 7f94b9e2b640 1 -- start start 2023-12-12T09:23:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.360+0000 7f94b9e2b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 0x7f94b409b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.360+0000 7f94b9e2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94b40cbb50 0x7f94b414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.360+0000 7f94b9e2b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94b415f270 0x7f94b414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.360+0000 7f94b9e2b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b41499f0 con 0x7f94b40b2a30 2023-12-12T09:23:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.360+0000 7f94b9e2b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b4149c80 con 0x7f94b40cbb50 2023-12-12T09:23:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.360+0000 7f94b9e2b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b4099a20 con 0x7f94b415f270 2023-12-12T09:23:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.360+0000 7f94b37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 0x7f94b409b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 0x7f94b409b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40202/0 (socket says 172.21.15.84:40202) 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b37fe640 1 -- 172.21.15.84:0/3134778869 learned_addr learned my addr 172.21.15.84:0/3134778869 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b37fe640 1 -- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94b415f270 msgr2=0x7f94b414c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b37fe640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f94b415f270 0x7f94b414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b37fe640 1 -- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94b40cbb50 msgr2=0x7f94b414bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b37fe640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94b40cbb50 0x7f94b414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b37fe640 1 -- 172.21.15.84:0/3134778869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40094d0 con 0x7f94b40b2a30 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b37fe640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 0x7f94b409b570 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f949c00d620 tx=0x7f949c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.361+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00b620 con 0x7f94b40b2a30 2023-12-12T09:23:45.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.362+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c00b780 con 0x7f94b40b2a30 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.362+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c00bb10 con 0x7f94b40b2a30 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.362+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b4071950 con 0x7f94b40b2a30 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.362+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b414a1b0 con 0x7f94b40b2a30 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.363+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94b415f650 con 0x7f94b40b2a30 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.364+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f949c00bc70 con 0x7f94b40b2a30 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.364+0000 7f94b0ff9640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f949406ae40 0x7f949406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.365+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f949c0899e0 con 0x7f94b40b2a30 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.365+0000 7f94aaffd640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f949406ae40 0x7f949406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.365+0000 7f94b0ff9640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7f9494071140 0x7f9494073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.365+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 --> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9494073c50 con 0x7f9494071140 2023-12-12T09:23:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.365+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f949c08e2a0 con 0x7f94b40b2a30 2023-12-12T09:23:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.365+0000 7f94aaffd640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f949406ae40 0x7f949406d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f94a4036000 tx=0x7f94a403b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:45.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.366+0000 7f94b3fff640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7f9494071140 0x7f9494073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.367+0000 7f94b3fff640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7f9494071140 0x7f9494073580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:45.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.369+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 <== osd.4 v2:172.21.15.99:6800/1049904610 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9494073c50 con 0x7f9494071140 2023-12-12T09:23:45.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.383+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 --> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94b40b3e50 con 0x7f9494071140 2023-12-12T09:23:45.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.384+0000 7f94b0ff9640 1 -- 172.21.15.84:0/3134778869 <== osd.4 v2:172.21.15.99:6800/1049904610 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f94ac001e10 con 0x7f9494071140 2023-12-12T09:23:45.385 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:45.385 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:23:45.385 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7f9494071140 msgr2=0x7f9494073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.99:6800/1049904610,v1:172.21.15.99:6801/1049904610] conn(0x7f9494071140 0x7f9494073580 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f949406ae40 msgr2=0x7f949406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f949406ae40 0x7f949406d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f94a4036000 tx=0x7f94a403b040 comp rx=0 tx=0).stop 2023-12-12T09:23:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 msgr2=0x7f94b409b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 --2- 172.21.15.84:0/3134778869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f94b40b2a30 0x7f94b409b570 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f949c00d620 tx=0x7f949c00dae0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b3fff640 1 -- 172.21.15.84:0/3134778869 reap_dead start 2023-12-12T09:23:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 shutdown_connections 2023-12-12T09:23:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 >> 172.21.15.84:0/3134778869 conn(0x7f94b40b0970 msgr2=0x7f94b40ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 shutdown_connections 2023-12-12T09:23:45.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.385+0000 7f94b9e2b640 1 -- 172.21.15.84:0/3134778869 wait complete. 2023-12-12T09:23:45.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-12T09:23:45.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.609+0000 7f55cfdd7640 1 Processor -- start 2023-12-12T09:23:45.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.609+0000 7f55cfdd7640 1 -- start start 2023-12-12T09:23:45.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.611+0000 7f55cfdd7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55c8143d20 0x7f55c80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.611+0000 7f55cfdd7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f55c80ce550 0x7f55c80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.611+0000 7f55cfdd7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80cea30 con 0x7f55c81447f0 2023-12-12T09:23:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.611+0000 7f55cfdd7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c80702b0 con 0x7f55c8143d20 2023-12-12T09:23:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.611+0000 7f55cfdd7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c8070590 con 0x7f55c80ce550 2023-12-12T09:23:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.611+0000 7f55cdb73640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55c8143d20 0x7f55c80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.612+0000 7f55cdb73640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f55c8143d20 0x7f55c80b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40212/0 (socket says 172.21.15.84:40212) 2023-12-12T09:23:45.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.612+0000 7f55cdb73640 1 -- 172.21.15.84:0/1397442159 learned_addr learned my addr 172.21.15.84:0/1397442159 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:45.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.612+0000 7f55cd372640 1 --2- 172.21.15.84:0/1397442159 >> v2:172.21.15.99:3300/0 conn(0x7f55c80ce550 0x7f55c80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.612+0000 7f55cdb73640 1 -- 172.21.15.84:0/1397442159 >> v2:172.21.15.99:3300/0 conn(0x7f55c80ce550 msgr2=0x7f55c80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.612+0000 7f55cdb73640 1 --2- 172.21.15.84:0/1397442159 >> v2:172.21.15.99:3300/0 conn(0x7f55c80ce550 0x7f55c80b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.612+0000 7f55cdb73640 1 -- 172.21.15.84:0/1397442159 >> v1:172.21.15.99:6789/0 conn(0x7f55c81447f0 legacy=0x7f55c815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.612+0000 7f55cdb73640 1 -- 172.21.15.84:0/1397442159 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8070870 con 0x7f55c8143d20 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.612+0000 7f55cd372640 1 --2- 172.21.15.84:0/1397442159 >> v2:172.21.15.99:3300/0 conn(0x7f55c80ce550 0x7f55c80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.613+0000 7f55cdb73640 1 --2- 172.21.15.84:0/1397442159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c8143d20 0x7f55c80b40d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f55c806be30 tx=0x7f55c402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4324c19d38f83b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.613+0000 7f55ccb71640 1 -- 172.21.15.84:0/1397442159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c402ca80 con 0x7f55c8143d20 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.613+0000 7f55ccb71640 1 -- 172.21.15.84:0/1397442159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c402cbe0 con 0x7f55c8143d20 2023-12-12T09:23:45.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.613+0000 7f55ccb71640 1 -- 172.21.15.84:0/1397442159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40343f0 con 0x7f55c8143d20 2023-12-12T09:23:45.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.614+0000 7f55cfdd7640 1 -- 172.21.15.84:0/1397442159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c8143d20 msgr2=0x7f55c80b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.614+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/1397442159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c8143d20 0x7f55c80b40d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f55c806be30 tx=0x7f55c402bee0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.614+0000 7f55cfdd7640 1 -- 172.21.15.84:0/1397442159 shutdown_connections 2023-12-12T09:23:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.614+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/1397442159 >> v2:172.21.15.99:3300/0 conn(0x7f55c80ce550 0x7f55c80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.614+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/1397442159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c8143d20 0x7f55c80b40d0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.614+0000 7f55cfdd7640 1 -- 172.21.15.84:0/1397442159 >> 172.21.15.84:0/1397442159 conn(0x7f55c806c3d0 msgr2=0x7f55c806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.614+0000 7f55cfdd7640 1 -- 172.21.15.84:0/1397442159 shutdown_connections 2023-12-12T09:23:45.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.614+0000 7f55cfdd7640 1 -- 172.21.15.84:0/1397442159 wait complete. 2023-12-12T09:23:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.616+0000 7f55cfdd7640 1 Processor -- start 2023-12-12T09:23:45.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.616+0000 7f55cfdd7640 1 -- start start 2023-12-12T09:23:45.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cfdd7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c80ce550 0x7f55c813d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cfdd7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c8143d20 0x7f55c813b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cfdd7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c81447f0 0x7f55c814f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cfdd7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c813b5f0 con 0x7f55c80ce550 2023-12-12T09:23:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cfdd7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c814fb40 con 0x7f55c81447f0 2023-12-12T09:23:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cfdd7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c813aef0 con 0x7f55c8143d20 2023-12-12T09:23:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cdb73640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c80ce550 0x7f55c813d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cdb73640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c80ce550 0x7f55c813d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40220/0 (socket says 172.21.15.84:40220) 2023-12-12T09:23:45.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.617+0000 7f55cdb73640 1 -- 172.21.15.84:0/572274158 learned_addr learned my addr 172.21.15.84:0/572274158 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55ce374640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c81447f0 0x7f55c814f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55cdb73640 1 -- 172.21.15.84:0/572274158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c8143d20 msgr2=0x7f55c813b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55cdb73640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c8143d20 0x7f55c813b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55cdb73640 1 -- 172.21.15.84:0/572274158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c81447f0 msgr2=0x7f55c814f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55cdb73640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c81447f0 0x7f55c814f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55cdb73640 1 -- 172.21.15.84:0/572274158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c4009b30 con 0x7f55c80ce550 2023-12-12T09:23:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55cdb73640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c80ce550 0x7f55c813d3e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f55c4000f80 tx=0x7f55c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:45.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55be7fc640 1 -- 172.21.15.84:0/572274158 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c403e450 con 0x7f55c80ce550 2023-12-12T09:23:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55be7fc640 1 -- 172.21.15.84:0/572274158 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c403e5d0 con 0x7f55c80ce550 2023-12-12T09:23:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55be7fc640 1 -- 172.21.15.84:0/572274158 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c403e980 con 0x7f55c80ce550 2023-12-12T09:23:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.618+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c813b820 con 0x7f55c80ce550 2023-12-12T09:23:45.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.619+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c813bde0 con 0x7f55c80ce550 2023-12-12T09:23:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.620+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c80673c0 con 0x7f55c80ce550 2023-12-12T09:23:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.621+0000 7f55be7fc640 1 -- 172.21.15.84:0/572274158 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55c402cd50 con 0x7f55c80ce550 2023-12-12T09:23:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.621+0000 7f55be7fc640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f55ac06ae40 0x7f55ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.622+0000 7f55be7fc640 1 -- 172.21.15.84:0/572274158 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f55c40ac360 con 0x7f55c80ce550 2023-12-12T09:23:45.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.622+0000 7f55cd372640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f55ac06ae40 0x7f55ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:45.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.622+0000 7f55cd372640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f55ac06ae40 0x7f55ac06d300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f55b8006fd0 tx=0x7f55b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:45.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.626+0000 7f55be7fc640 1 -- 172.21.15.84:0/572274158 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55c4077780 con 0x7f55c80ce550 2023-12-12T09:23:45.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.814+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f55c8143020 con 0x7f55ac06ae40 2023-12-12T09:23:45.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.815+0000 7f55be7fc640 1 -- 172.21.15.84:0/572274158 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f55c8143020 con 0x7f55ac06ae40 2023-12-12T09:23:45.815 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 4 to deep-scrub 2023-12-12T09:23:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f55ac06ae40 msgr2=0x7f55ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f55ac06ae40 0x7f55ac06d300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f55b8006fd0 tx=0x7f55b8008040 comp rx=0 tx=0).stop 2023-12-12T09:23:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c80ce550 msgr2=0x7f55c813d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c80ce550 0x7f55c813d3e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f55c4000f80 tx=0x7f55c4004a40 comp rx=0 tx=0).stop 2023-12-12T09:23:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 shutdown_connections 2023-12-12T09:23:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55c81447f0 0x7f55c814f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f55c8143d20 0x7f55c813b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f55ac06ae40 0x7f55ac06d300 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 --2- 172.21.15.84:0/572274158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f55c80ce550 0x7f55c813d3e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.817+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 >> 172.21.15.84:0/572274158 conn(0x7f55c806c3d0 msgr2=0x7f55c8141da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.818+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 shutdown_connections 2023-12-12T09:23:45.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:45.818+0000 7f55cfdd7640 1 -- 172.21.15.84:0/572274158 wait complete. 2023-12-12T09:23:45.837 INFO:tasks.ceph:Scrubbing osd.5 2023-12-12T09:23:45.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.039+0000 7f0025ee0640 1 Processor -- start 2023-12-12T09:23:46.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.040+0000 7f0025ee0640 1 -- start start 2023-12-12T09:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.041+0000 7f0025ee0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f00200ac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.041+0000 7f0025ee0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f002006c440 0x7f002006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.041+0000 7f0025ee0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0020070cb0 con 0x7f002006c060 2023-12-12T09:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.041+0000 7f0025ee0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0020072130 con 0x7f002006c440 2023-12-12T09:23:46.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.041+0000 7f0025ee0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0020070f50 con 0x7f0020071cd0 2023-12-12T09:23:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.042+0000 7f001effd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f00200ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.042+0000 7f001ffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f002006c440 0x7f002006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.042+0000 7f001effd640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f00200ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3301/0 says I am v2:172.21.15.84:36600/0 (socket says 172.21.15.84:36600) 2023-12-12T09:23:46.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.042+0000 7f001effd640 1 -- 172.21.15.84:0/1979692890 learned_addr learned my addr 172.21.15.84:0/1979692890 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.043+0000 7f001effd640 1 -- 172.21.15.84:0/1979692890 >> v2:172.21.15.99:3300/0 conn(0x7f002006c440 msgr2=0x7f002006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.043+0000 7f001effd640 1 --2- 172.21.15.84:0/1979692890 >> v2:172.21.15.99:3300/0 conn(0x7f002006c440 0x7f002006c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.043+0000 7f001effd640 1 -- 172.21.15.84:0/1979692890 >> v1:172.21.15.99:6789/0 conn(0x7f002006c060 legacy=0x7f00200abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.043+0000 7f001effd640 1 -- 172.21.15.84:0/1979692890 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002006d8c0 con 0x7f0020071cd0 2023-12-12T09:23:46.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.043+0000 7f001ffff640 1 --2- 172.21.15.84:0/1979692890 >> v2:172.21.15.99:3300/0 conn(0x7f002006c440 0x7f002006c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T09:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.045+0000 7f001effd640 1 --2- 172.21.15.84:0/1979692890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f00200ac460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0008009e50 tx=0x7f000802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2bca218717ccd3c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.045+0000 7f001e7fc640 1 -- 172.21.15.84:0/1979692890 <== mon.2 v2:172.21.15.99:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000802ca70 con 0x7f0020071cd0 2023-12-12T09:23:46.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.045+0000 7f001e7fc640 1 -- 172.21.15.84:0/1979692890 <== mon.2 v2:172.21.15.99:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000802cbd0 con 0x7f0020071cd0 2023-12-12T09:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.045+0000 7f001e7fc640 1 -- 172.21.15.84:0/1979692890 <== mon.2 v2:172.21.15.99:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080343f0 con 0x7f0020071cd0 2023-12-12T09:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.046+0000 7f0025ee0640 1 -- 172.21.15.84:0/1979692890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 msgr2=0x7f00200ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.046+0000 7f0025ee0640 1 --2- 172.21.15.84:0/1979692890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f00200ac460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0008009e50 tx=0x7f000802bed0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.046+0000 7f0025ee0640 1 -- 172.21.15.84:0/1979692890 shutdown_connections 2023-12-12T09:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.046+0000 7f0025ee0640 1 --2- 172.21.15.84:0/1979692890 >> v2:172.21.15.99:3300/0 conn(0x7f002006c440 0x7f002006c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.046+0000 7f0025ee0640 1 --2- 172.21.15.84:0/1979692890 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f00200ac460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.046+0000 7f0025ee0640 1 -- 172.21.15.84:0/1979692890 >> 172.21.15.84:0/1979692890 conn(0x7f00200b0970 msgr2=0x7f00200b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.046+0000 7f0025ee0640 1 -- 172.21.15.84:0/1979692890 shutdown_connections 2023-12-12T09:23:46.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.046+0000 7f0025ee0640 1 -- 172.21.15.84:0/1979692890 wait complete. 2023-12-12T09:23:46.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.048+0000 7f0025ee0640 1 Processor -- start 2023-12-12T09:23:46.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.048+0000 7f0025ee0640 1 -- start start 2023-12-12T09:23:46.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.049+0000 7f0025ee0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f002006c060 0x7f002014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.049+0000 7f0025ee0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f002006c440 0x7f00200c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.049+0000 7f0025ee0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f002009b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.049+0000 7f0025ee0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200ca940 con 0x7f002006c060 2023-12-12T09:23:46.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.049+0000 7f0025ee0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00201f3660 con 0x7f002006c440 2023-12-12T09:23:46.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.049+0000 7f0025ee0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00201f3940 con 0x7f0020071cd0 2023-12-12T09:23:46.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f002006c060 0x7f002014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f002006c060 0x7f002014f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52236/0 (socket says 172.21.15.84:52236) 2023-12-12T09:23:46.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 -- 172.21.15.84:0/895912919 learned_addr learned my addr 172.21.15.84:0/895912919 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:46.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001effd640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f002006c440 0x7f00200c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001ffff640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f002009b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 -- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 msgr2=0x7f002009b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f0020071cd0 0x7f002009b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 -- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f002006c440 msgr2=0x7f00200c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f002006c440 0x7f00200c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 -- 172.21.15.84:0/895912919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018009400 con 0x7f002006c060 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.050+0000 7f001f7fe640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f002006c060 0x7f002014f4c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f001000c450 tx=0x7f001000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.051+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00100052d0 con 0x7f002006c060 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.051+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0010005430 con 0x7f002006c060 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.051+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010012870 con 0x7f002006c060 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.051+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0008009b30 con 0x7f002006c060 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.051+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002014fa00 con 0x7f002006c060 2023-12-12T09:23:46.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.052+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00200cc6c0 con 0x7f002006c060 2023-12-12T09:23:46.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.053+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00100129d0 con 0x7f002006c060 2023-12-12T09:23:46.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.054+0000 7f0017fff640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f000006ae40 0x7f000006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.054+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0010088f20 con 0x7f002006c060 2023-12-12T09:23:46.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.054+0000 7f0017fff640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7f0000071140 0x7f0000073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.054+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 --> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0000073c50 con 0x7f0000071140 2023-12-12T09:23:46.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.054+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f001008b5c0 con 0x7f002006c060 2023-12-12T09:23:46.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.054+0000 7f001effd640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f000006ae40 0x7f000006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.055+0000 7f001ffff640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7f0000071140 0x7f0000073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.055+0000 7f001effd640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f000006ae40 0x7f000006d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0008035000 tx=0x7f0008030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.056+0000 7f001ffff640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7f0000071140 0x7f0000073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.058+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 <== osd.5 v2:172.21.15.99:6823/29339213 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f0000073c50 con 0x7f0000071140 2023-12-12T09:23:46.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.073+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 --> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00200717b0 con 0x7f0000071140 2023-12-12T09:23:46.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.074+0000 7f0017fff640 1 -- 172.21.15.84:0/895912919 <== osd.5 v2:172.21.15.99:6823/29339213 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f00180098b0 con 0x7f0000071140 2023-12-12T09:23:46.075 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:46.075 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:23:46.075 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7f0000071140 msgr2=0x7f0000073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.99:6823/29339213,v1:172.21.15.99:6825/29339213] conn(0x7f0000071140 0x7f0000073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f000006ae40 msgr2=0x7f000006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f000006ae40 0x7f000006d300 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0008035000 tx=0x7f0008030000 comp rx=0 tx=0).stop 2023-12-12T09:23:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f002006c060 msgr2=0x7f002014f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 --2- 172.21.15.84:0/895912919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f002006c060 0x7f002014f4c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f001000c450 tx=0x7f001000c910 comp rx=0 tx=0).stop 2023-12-12T09:23:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f001ffff640 1 -- 172.21.15.84:0/895912919 reap_dead start 2023-12-12T09:23:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 shutdown_connections 2023-12-12T09:23:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 >> 172.21.15.84:0/895912919 conn(0x7f00200b0970 msgr2=0x7f002006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 shutdown_connections 2023-12-12T09:23:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.075+0000 7f0025ee0640 1 -- 172.21.15.84:0/895912919 wait complete. 2023-12-12T09:23:46.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-12T09:23:46.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.309+0000 7f3b5093b640 1 Processor -- start 2023-12-12T09:23:46.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.309+0000 7f3b5093b640 1 -- start start 2023-12-12T09:23:46.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.311+0000 7f3b5093b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 0x7f3b4c06de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.311+0000 7f3b5093b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b4c15f4c0 0x7f3b4c0705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.311+0000 7f3b5093b640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c144b20 con 0x7f3b4c15e950 2023-12-12T09:23:46.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.311+0000 7f3b5093b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c06d670 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.311+0000 7f3b5093b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c06cdd0 con 0x7f3b4c144740 2023-12-12T09:23:46.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.311+0000 7f3b4b59e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b4c15f4c0 0x7f3b4c0705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.311+0000 7f3b4b59e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3b4c15f4c0 0x7f3b4c0705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52246/0 (socket says 172.21.15.84:52246) 2023-12-12T09:23:46.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.311+0000 7f3b4b59e640 1 -- 172.21.15.84:0/2552345949 learned_addr learned my addr 172.21.15.84:0/2552345949 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:46.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.312+0000 7f3b4ad9d640 1 --2- 172.21.15.84:0/2552345949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 0x7f3b4c06de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.312+0000 7f3b4b59e640 1 -- 172.21.15.84:0/2552345949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 msgr2=0x7f3b4c06de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:46.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.312+0000 7f3b4b59e640 1 --2- 172.21.15.84:0/2552345949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 0x7f3b4c06de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.312+0000 7f3b4b59e640 1 -- 172.21.15.84:0/2552345949 >> v1:172.21.15.99:6789/0 conn(0x7f3b4c15e950 legacy=0x7f3b4c15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:46.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.312+0000 7f3b4b59e640 1 -- 172.21.15.84:0/2552345949 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c06d0b0 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.313+0000 7f3b4b59e640 1 --2- 172.21.15.84:0/2552345949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c0705b0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009e50 tx=0x7f3b4402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c2b402fa65e4b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.313+0000 7f3b49d9b640 1 -- 172.21.15.84:0/2552345949 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4402ca70 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.313+0000 7f3b49d9b640 1 -- 172.21.15.84:0/2552345949 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4402cbd0 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.313+0000 7f3b49d9b640 1 -- 172.21.15.84:0/2552345949 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440343f0 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.314+0000 7f3b5093b640 1 -- 172.21.15.84:0/2552345949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 msgr2=0x7f3b4c0705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.314+0000 7f3b5093b640 1 --2- 172.21.15.84:0/2552345949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c0705b0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009e50 tx=0x7f3b4402bed0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.314+0000 7f3b5093b640 1 -- 172.21.15.84:0/2552345949 shutdown_connections 2023-12-12T09:23:46.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.314+0000 7f3b5093b640 1 --2- 172.21.15.84:0/2552345949 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c0705b0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.314+0000 7f3b5093b640 1 --2- 172.21.15.84:0/2552345949 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 0x7f3b4c06de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.314+0000 7f3b5093b640 1 -- 172.21.15.84:0/2552345949 >> 172.21.15.84:0/2552345949 conn(0x7f3b4c0b07f0 msgr2=0x7f3b4c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:46.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.314+0000 7f3b5093b640 1 -- 172.21.15.84:0/2552345949 shutdown_connections 2023-12-12T09:23:46.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.314+0000 7f3b5093b640 1 -- 172.21.15.84:0/2552345949 wait complete. 2023-12-12T09:23:46.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.316+0000 7f3b5093b640 1 Processor -- start 2023-12-12T09:23:46.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.316+0000 7f3b5093b640 1 -- start start 2023-12-12T09:23:46.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b5093b640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 0x7f3b4c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b5093b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b4c15e950 0x7f3b4c0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b5093b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c1312e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b5093b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c12fc40 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b5093b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c15aa90 con 0x7f3b4c15e950 2023-12-12T09:23:46.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b5093b640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c12f2a0 con 0x7f3b4c144740 2023-12-12T09:23:46.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c1312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c1312e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52260/0 (socket says 172.21.15.84:52260) 2023-12-12T09:23:46.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.317+0000 7f3b4b59e640 1 -- 172.21.15.84:0/1957719408 learned_addr learned my addr 172.21.15.84:0/1957719408 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:46.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b4ad9d640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 0x7f3b4c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b4a59c640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b4c15e950 0x7f3b4c0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b4b59e640 1 -- 172.21.15.84:0/1957719408 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 msgr2=0x7f3b4c0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b4b59e640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 0x7f3b4c0c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b4b59e640 1 -- 172.21.15.84:0/1957719408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b4c15e950 msgr2=0x7f3b4c0c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b4b59e640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b4c15e950 0x7f3b4c0c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b4b59e640 1 -- 172.21.15.84:0/1957719408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44009b30 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b4b59e640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c1312e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f3b44036040 tx=0x7f3b44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b337fe640 1 -- 172.21.15.84:0/1957719408 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44009510 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b337fe640 1 -- 172.21.15.84:0/1957719408 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4403e450 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b337fe640 1 -- 172.21.15.84:0/1957719408 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4403e7e0 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.318+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4c12f580 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.319+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c0c8cd0 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.320+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c0c8e90 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.321+0000 7f3b337fe640 1 -- 172.21.15.84:0/1957719408 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b4403e940 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.322+0000 7f3b337fe640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b3806ae40 0x7f3b3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.322+0000 7f3b337fe640 1 -- 172.21.15.84:0/1957719408 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3b440ac260 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.322+0000 7f3b4ad9d640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b3806ae40 0x7f3b3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.322+0000 7f3b4ad9d640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b3806ae40 0x7f3b3806d300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c006fd0 tx=0x7f3b3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.326+0000 7f3b337fe640 1 -- 172.21.15.84:0/1957719408 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b440774c0 con 0x7f3b4c15f4c0 2023-12-12T09:23:46.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.516+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b4c15f320 con 0x7f3b3806ae40 2023-12-12T09:23:46.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.517+0000 7f3b337fe640 1 -- 172.21.15.84:0/1957719408 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b4c15f320 con 0x7f3b3806ae40 2023-12-12T09:23:46.517 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 5 to deep-scrub 2023-12-12T09:23:46.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b3806ae40 msgr2=0x7f3b3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b3806ae40 0x7f3b3806d300 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c006fd0 tx=0x7f3b3c008040 comp rx=0 tx=0).stop 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 msgr2=0x7f3b4c1312e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c1312e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f3b44036040 tx=0x7f3b44004a40 comp rx=0 tx=0).stop 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 shutdown_connections 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f3b3806ae40 0x7f3b3806d300 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b4c15f4c0 0x7f3b4c1312e0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b4c15e950 0x7f3b4c0c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 --2- 172.21.15.84:0/1957719408 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f3b4c144740 0x7f3b4c0c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 >> 172.21.15.84:0/1957719408 conn(0x7f3b4c0b07f0 msgr2=0x7f3b4c1425e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 shutdown_connections 2023-12-12T09:23:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.520+0000 7f3b5093b640 1 -- 172.21.15.84:0/1957719408 wait complete. 2023-12-12T09:23:46.539 INFO:tasks.ceph:Scrubbing osd.6 2023-12-12T09:23:46.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:23:46.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.755+0000 7ffb6b24f640 1 Processor -- start 2023-12-12T09:23:46.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.755+0000 7ffb6b24f640 1 -- start start 2023-12-12T09:23:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.757+0000 7ffb6b24f640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb640b4760 0x7ffb640d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.757+0000 7ffb6b24f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 0x7ffb640cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.757+0000 7ffb6b24f640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb640c6ba0 con 0x7ffb640cff80 2023-12-12T09:23:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.757+0000 7ffb6b24f640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb640d0410 con 0x7ffb640b4760 2023-12-12T09:23:46.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.757+0000 7ffb6b24f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640d1e80 con 0x7ffb640d1630 2023-12-12T09:23:46.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.757+0000 7ffb68feb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb640b4760 0x7ffb640d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.757+0000 7ffb68feb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffb640b4760 0x7ffb640d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52266/0 (socket says 172.21.15.84:52266) 2023-12-12T09:23:46.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.757+0000 7ffb68feb640 1 -- 172.21.15.84:0/2454803308 learned_addr learned my addr 172.21.15.84:0/2454803308 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:46.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.758+0000 7ffb63fff640 1 --2- 172.21.15.84:0/2454803308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 0x7ffb640cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.758+0000 7ffb68feb640 1 -- 172.21.15.84:0/2454803308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 msgr2=0x7ffb640cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:46.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.758+0000 7ffb68feb640 1 --2- 172.21.15.84:0/2454803308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 0x7ffb640cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.758+0000 7ffb68feb640 1 -- 172.21.15.84:0/2454803308 >> v1:172.21.15.99:6789/0 conn(0x7ffb640cff80 legacy=0x7ffb640cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:46.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.758+0000 7ffb68feb640 1 -- 172.21.15.84:0/2454803308 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640c6e60 con 0x7ffb640b4760 2023-12-12T09:23:46.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.759+0000 7ffb68feb640 1 --2- 172.21.15.84:0/2454803308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 0x7ffb640d3760 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009870 tx=0x7ffb5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ea77d9651b4b8e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.759+0000 7ffb637fe640 1 -- 172.21.15.84:0/2454803308 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58031640 con 0x7ffb640b4760 2023-12-12T09:23:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.759+0000 7ffb637fe640 1 -- 172.21.15.84:0/2454803308 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb580317a0 con 0x7ffb640b4760 2023-12-12T09:23:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.759+0000 7ffb637fe640 1 -- 172.21.15.84:0/2454803308 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58031b30 con 0x7ffb640b4760 2023-12-12T09:23:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.760+0000 7ffb6b24f640 1 -- 172.21.15.84:0/2454803308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 msgr2=0x7ffb640d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.760+0000 7ffb6b24f640 1 --2- 172.21.15.84:0/2454803308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 0x7ffb640d3760 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009870 tx=0x7ffb5802b8f0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.760+0000 7ffb6b24f640 1 -- 172.21.15.84:0/2454803308 shutdown_connections 2023-12-12T09:23:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.760+0000 7ffb6b24f640 1 --2- 172.21.15.84:0/2454803308 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 0x7ffb640cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.760+0000 7ffb6b24f640 1 --2- 172.21.15.84:0/2454803308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 0x7ffb640d3760 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.760+0000 7ffb6b24f640 1 -- 172.21.15.84:0/2454803308 >> 172.21.15.84:0/2454803308 conn(0x7ffb6409c320 msgr2=0x7ffb640d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:46.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.760+0000 7ffb6b24f640 1 -- 172.21.15.84:0/2454803308 shutdown_connections 2023-12-12T09:23:46.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.760+0000 7ffb6b24f640 1 -- 172.21.15.84:0/2454803308 wait complete. 2023-12-12T09:23:46.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.762+0000 7ffb6b24f640 1 Processor -- start 2023-12-12T09:23:46.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.762+0000 7ffb6b24f640 1 -- start start 2023-12-12T09:23:46.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.763+0000 7ffb6b24f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 0x7ffb6415d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.763+0000 7ffb6b24f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb640cff80 0x7ffb640b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.763+0000 7ffb6b24f640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 0x7ffb6414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.763+0000 7ffb6b24f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6415d8b0 con 0x7ffb640b4760 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.763+0000 7ffb6b24f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640b6b20 con 0x7ffb640cff80 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.763+0000 7ffb6b24f640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb640b6dc0 con 0x7ffb640d1630 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.763+0000 7ffb68feb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 0x7ffb6415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.763+0000 7ffb68feb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 0x7ffb6415d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52268/0 (socket says 172.21.15.84:52268) 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb68feb640 1 -- 172.21.15.84:0/2866188535 learned_addr learned my addr 172.21.15.84:0/2866188535 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb63fff640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb640cff80 0x7ffb640b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb697ec640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 0x7ffb6414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb68feb640 1 -- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 msgr2=0x7ffb6414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb68feb640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 0x7ffb6414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb68feb640 1 -- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb640cff80 msgr2=0x7ffb640b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb68feb640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb640cff80 0x7ffb640b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb68feb640 1 -- 172.21.15.84:0/2866188535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb580094d0 con 0x7ffb640b4760 2023-12-12T09:23:46.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb63fff640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb640cff80 0x7ffb640b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:46.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb697ec640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7ffb640d1630 0x7ffb6414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:46.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.764+0000 7ffb68feb640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 0x7ffb6415d370 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009870 tx=0x7ffb580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.765+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5803ac60 con 0x7ffb640b4760 2023-12-12T09:23:46.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.765+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5803adc0 con 0x7ffb640b4760 2023-12-12T09:23:46.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.765+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58044630 con 0x7ffb640b4760 2023-12-12T09:23:46.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.765+0000 7ffb6b24f640 1 -- 172.21.15.84:0/2866188535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb640b70a0 con 0x7ffb640b4760 2023-12-12T09:23:46.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.765+0000 7ffb6b24f640 1 -- 172.21.15.84:0/2866188535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb640b7660 con 0x7ffb640b4760 2023-12-12T09:23:46.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.766+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb640c7420 con 0x7ffb640b4760 2023-12-12T09:23:46.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.767+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb5802f050 con 0x7ffb640b4760 2023-12-12T09:23:46.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.768+0000 7ffb617fa640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb4806ae40 0x7ffb4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.768+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ffb580ab2d0 con 0x7ffb640b4760 2023-12-12T09:23:46.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.768+0000 7ffb617fa640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7ffb48071140 0x7ffb48073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:46.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.768+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 --> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb48073c50 con 0x7ffb48071140 2023-12-12T09:23:46.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.768+0000 7ffb63fff640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb4806ae40 0x7ffb4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.768+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb580ad990 con 0x7ffb640b4760 2023-12-12T09:23:46.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.769+0000 7ffb63fff640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb4806ae40 0x7ffb4806d300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb640c8d00 tx=0x7ffb50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.769+0000 7ffb697ec640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7ffb48071140 0x7ffb48073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:46.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.770+0000 7ffb697ec640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7ffb48071140 0x7ffb48073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:46.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.772+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 <== osd.6 v2:172.21.15.99:6816/826618722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffb48073c50 con 0x7ffb48071140 2023-12-12T09:23:46.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.786+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 --> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb640b7850 con 0x7ffb48071140 2023-12-12T09:23:46.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.787+0000 7ffb617fa640 1 -- 172.21.15.84:0/2866188535 <== osd.6 v2:172.21.15.99:6816/826618722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffb640b7850 con 0x7ffb48071140 2023-12-12T09:23:46.790 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:46.790 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:23:46.790 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:46.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7ffb48071140 msgr2=0x7ffb48073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.99:6816/826618722,v1:172.21.15.99:6817/826618722] conn(0x7ffb48071140 0x7ffb48073580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb4806ae40 msgr2=0x7ffb4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7ffb4806ae40 0x7ffb4806d300 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb640c8d00 tx=0x7ffb50008040 comp rx=0 tx=0).stop 2023-12-12T09:23:46.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 msgr2=0x7ffb6415d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:46.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 --2- 172.21.15.84:0/2866188535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb640b4760 0x7ffb6415d370 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009870 tx=0x7ffb580046c0 comp rx=0 tx=0).stop 2023-12-12T09:23:46.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb697ec640 1 -- 172.21.15.84:0/2866188535 reap_dead start 2023-12-12T09:23:46.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 shutdown_connections 2023-12-12T09:23:46.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 >> 172.21.15.84:0/2866188535 conn(0x7ffb6409c320 msgr2=0x7ffb640d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:46.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 shutdown_connections 2023-12-12T09:23:46.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:46.788+0000 7ffb4effd640 1 -- 172.21.15.84:0/2866188535 wait complete. 2023-12-12T09:23:46.806 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-12T09:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.018+0000 7f8a989f0640 1 Processor -- start 2023-12-12T09:23:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.018+0000 7f8a989f0640 1 -- start start 2023-12-12T09:23:47.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.020+0000 7f8a989f0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 0x7f8a9415f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.020+0000 7f8a989f0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9406e2e0 con 0x7f8a940705b0 2023-12-12T09:23:47.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.020+0000 7f8a989f0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a94144b20 con 0x7f8a94144740 2023-12-12T09:23:47.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.020+0000 7f8a989f0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9406d670 con 0x7f8a9406de80 2023-12-12T09:23:47.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.020+0000 7f8a93fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8a940705b0 0x7f8a94070a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40732/0 (socket says 172.21.15.84:40732) 2023-12-12T09:23:47.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.020+0000 7f8a93fff640 1 -- 172.21.15.84:0/3179480756 learned_addr learned my addr 172.21.15.84:0/3179480756 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.020+0000 7f8a8bfff640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 0x7f8a9415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377840632 0 0) 0x7f8a8c001490 con 0x7f8a940705b0 2023-12-12T09:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a80003520 con 0x7f8a940705b0 2023-12-12T09:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 856295191 0 0) 0x7f8a80003520 con 0x7f8a940705b0 2023-12-12T09:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 msgr2=0x7f8a9415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:47.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 0x7f8a9415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 >> v1:172.21.15.99:6789/0 conn(0x7f8a94144740 legacy=0x7f8a9415e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9406cdd0 con 0x7f8a940705b0 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f8a8c001b80 con 0x7f8a940705b0 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 >> v1:172.21.15.84:6789/0 conn(0x7f8a940705b0 legacy=0x7f8a94070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a800039a0 0x7f8a80003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a800047c0 0x7f8a80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 0x7f8a80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9406d670 con 0x7f8a800039a0 2023-12-12T09:23:47.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000ba60 con 0x7f8a800047c0 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.021+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000bc20 con 0x7f8a9406de80 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a937fe640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a800039a0 0x7f8a80003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a8bfff640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a800047c0 0x7f8a80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a937fe640 1 -- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 msgr2=0x7f8a80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a93fff640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 0x7f8a80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a937fe640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 0x7f8a80005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a937fe640 1 -- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a800047c0 msgr2=0x7f8a80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a937fe640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a800047c0 0x7f8a80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a937fe640 1 -- 172.21.15.84:0/3179480756 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80003520 con 0x7f8a800039a0 2023-12-12T09:23:47.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a93fff640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a9406de80 0x7f8a80005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:47.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.022+0000 7f8a8bfff640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a800047c0 0x7f8a80004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:47.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.023+0000 7f8a937fe640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a800039a0 0x7f8a80003dc0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8a84001720 tx=0x7f8a800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63869101a11b5d44 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.023+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a840052d0 con 0x7f8a800039a0 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.023+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8402e050 con 0x7f8a800039a0 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.023+0000 7f8a92ffd640 1 -- 172.21.15.84:0/3179480756 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a840035f0 con 0x7f8a800039a0 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.024+0000 7f8a989f0640 1 -- 172.21.15.84:0/3179480756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a800039a0 msgr2=0x7f8a80003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.024+0000 7f8a989f0640 1 --2- 172.21.15.84:0/3179480756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a800039a0 0x7f8a80003dc0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8a84001720 tx=0x7f8a800057f0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.024+0000 7f8a93fff640 1 -- 172.21.15.84:0/3179480756 reap_dead start 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.024+0000 7f8a989f0640 1 -- 172.21.15.84:0/3179480756 shutdown_connections 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.024+0000 7f8a989f0640 1 -- 172.21.15.84:0/3179480756 >> 172.21.15.84:0/3179480756 conn(0x7f8a940b07f0 msgr2=0x7f8a940b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.024+0000 7f8a989f0640 1 -- 172.21.15.84:0/3179480756 shutdown_connections 2023-12-12T09:23:47.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.024+0000 7f8a989f0640 1 -- 172.21.15.84:0/3179480756 wait complete. 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.026+0000 7f8a989f0640 1 Processor -- start 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.026+0000 7f8a989f0640 1 -- start start 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a989f0640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a800039a0 0x7f8a94137570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a989f0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a9413d6b0 0x7f8a9413db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a989f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a9413e820 0x7f8a9413eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a989f0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94137ab0 con 0x7f8a9413e820 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a989f0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9413e050 con 0x7f8a9413d6b0 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a989f0640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94156be0 con 0x7f8a800039a0 2023-12-12T09:23:47.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a9413e820 0x7f8a9413eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a93fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a9413e820 0x7f8a9413eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52286/0 (socket says 172.21.15.84:52286) 2023-12-12T09:23:47.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.027+0000 7f8a93fff640 1 -- 172.21.15.84:0/3539496150 learned_addr learned my addr 172.21.15.84:0/3539496150 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:47.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a937fe640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a800039a0 0x7f8a94137570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a8bfff640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a9413d6b0 0x7f8a9413db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a93fff640 1 -- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a800039a0 msgr2=0x7f8a94137570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a93fff640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a800039a0 0x7f8a94137570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a93fff640 1 -- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a9413d6b0 msgr2=0x7f8a9413db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a93fff640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a9413d6b0 0x7f8a9413db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a93fff640 1 -- 172.21.15.84:0/3539496150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9413f590 con 0x7f8a9413e820 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a937fe640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a800039a0 0x7f8a94137570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a8bfff640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a9413d6b0 0x7f8a9413db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a93fff640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a9413e820 0x7f8a9413eca0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8a9415e890 tx=0x7f8a8c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a90ff9640 1 -- 172.21.15.84:0/3539496150 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c004d60 con 0x7f8a9413e820 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a90ff9640 1 -- 172.21.15.84:0/3539496150 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c00bb50 con 0x7f8a9413e820 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a941562b0 con 0x7f8a9413e820 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.028+0000 7f8a90ff9640 1 -- 172.21.15.84:0/3539496150 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c007070 con 0x7f8a9413e820 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.029+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a94156870 con 0x7f8a9413e820 2023-12-12T09:23:47.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.030+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a94156a30 con 0x7f8a9413e820 2023-12-12T09:23:47.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.031+0000 7f8a90ff9640 1 -- 172.21.15.84:0/3539496150 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a8c0073e0 con 0x7f8a9413e820 2023-12-12T09:23:47.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.031+0000 7f8a90ff9640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a7406ae40 0x7f8a7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.032+0000 7f8a90ff9640 1 -- 172.21.15.84:0/3539496150 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8a8c089890 con 0x7f8a9413e820 2023-12-12T09:23:47.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.032+0000 7f8a937fe640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a7406ae40 0x7f8a7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.033+0000 7f8a937fe640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a7406ae40 0x7f8a7406d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8a84033000 tx=0x7f8a84009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.036+0000 7f8a90ff9640 1 -- 172.21.15.84:0/3539496150 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a8c054a60 con 0x7f8a9413e820 2023-12-12T09:23:47.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.230+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a94070090 con 0x7f8a7406ae40 2023-12-12T09:23:47.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.230+0000 7f8a90ff9640 1 -- 172.21.15.84:0/3539496150 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8a84005480 con 0x7f8a7406ae40 2023-12-12T09:23:47.231 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 6 to deep-scrub 2023-12-12T09:23:47.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a7406ae40 msgr2=0x7f8a7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a7406ae40 0x7f8a7406d300 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8a84033000 tx=0x7f8a84009030 comp rx=0 tx=0).stop 2023-12-12T09:23:47.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a9413e820 msgr2=0x7f8a9413eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a9413e820 0x7f8a9413eca0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8a9415e890 tx=0x7f8a8c00b4a0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 shutdown_connections 2023-12-12T09:23:47.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f8a7406ae40 0x7f8a7406d300 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a9413e820 0x7f8a9413eca0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a9413d6b0 0x7f8a9413db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 --2- 172.21.15.84:0/3539496150 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f8a800039a0 0x7f8a94137570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.233+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 >> 172.21.15.84:0/3539496150 conn(0x7f8a940b07f0 msgr2=0x7f8a9406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:47.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.234+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 shutdown_connections 2023-12-12T09:23:47.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.234+0000 7f8a989f0640 1 -- 172.21.15.84:0/3539496150 wait complete. 2023-12-12T09:23:47.251 INFO:tasks.ceph:Scrubbing osd.7 2023-12-12T09:23:47.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-12T09:23:47.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.464+0000 7f96ab2e7640 1 Processor -- start 2023-12-12T09:23:47.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.465+0000 7f96ab2e7640 1 -- start start 2023-12-12T09:23:47.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.466+0000 7f96ab2e7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 0x7f96a4071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.466+0000 7f96ab2e7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96a406c440 0x7f96a406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.466+0000 7f96ab2e7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a4070cb0 con 0x7f96a40abd50 2023-12-12T09:23:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.466+0000 7f96ab2e7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a4070f50 con 0x7f96a406c440 2023-12-12T09:23:47.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.466+0000 7f96ab2e7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a406d8c0 con 0x7f96a406c060 2023-12-12T09:23:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9884640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96a406c440 0x7f96a406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9884640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f96a406c440 0x7f96a406c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52298/0 (socket says 172.21.15.84:52298) 2023-12-12T09:23:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9884640 1 -- 172.21.15.84:0/1264658536 learned_addr learned my addr 172.21.15.84:0/1264658536 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9884640 1 -- 172.21.15.84:0/1264658536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 msgr2=0x7f96a4071cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:47.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9083640 1 --2- 172.21.15.84:0/1264658536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 0x7f96a4071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9884640 1 --2- 172.21.15.84:0/1264658536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 0x7f96a4071cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9884640 1 -- 172.21.15.84:0/1264658536 >> v1:172.21.15.99:6789/0 conn(0x7f96a40abd50 legacy=0x7f96a40ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9884640 1 -- 172.21.15.84:0/1264658536 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40711f0 con 0x7f96a406c440 2023-12-12T09:23:47.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.467+0000 7f96a9083640 1 --2- 172.21.15.84:0/1264658536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 0x7f96a4071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:23:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.468+0000 7f96a9884640 1 --2- 172.21.15.84:0/1264658536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 0x7f96a406c8d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f969c009e50 tx=0x7f969c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eba545d5b08eec2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.469+0000 7f96a3fff640 1 -- 172.21.15.84:0/1264658536 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c02c9f0 con 0x7f96a406c440 2023-12-12T09:23:47.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.469+0000 7f96a3fff640 1 -- 172.21.15.84:0/1264658536 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c02cb50 con 0x7f96a406c440 2023-12-12T09:23:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.469+0000 7f96a3fff640 1 -- 172.21.15.84:0/1264658536 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0343f0 con 0x7f96a406c440 2023-12-12T09:23:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.469+0000 7f96ab2e7640 1 -- 172.21.15.84:0/1264658536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 msgr2=0x7f96a406c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.469+0000 7f96ab2e7640 1 --2- 172.21.15.84:0/1264658536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 0x7f96a406c8d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f969c009e50 tx=0x7f969c02be50 comp rx=0 tx=0).stop 2023-12-12T09:23:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.470+0000 7f96ab2e7640 1 -- 172.21.15.84:0/1264658536 shutdown_connections 2023-12-12T09:23:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.470+0000 7f96ab2e7640 1 --2- 172.21.15.84:0/1264658536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 0x7f96a406c8d0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.470+0000 7f96ab2e7640 1 --2- 172.21.15.84:0/1264658536 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 0x7f96a4071cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.470+0000 7f96ab2e7640 1 -- 172.21.15.84:0/1264658536 >> 172.21.15.84:0/1264658536 conn(0x7f96a40b0970 msgr2=0x7f96a40b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:47.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.470+0000 7f96ab2e7640 1 -- 172.21.15.84:0/1264658536 shutdown_connections 2023-12-12T09:23:47.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.470+0000 7f96ab2e7640 1 -- 172.21.15.84:0/1264658536 wait complete. 2023-12-12T09:23:47.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.471+0000 7f96ab2e7640 1 Processor -- start 2023-12-12T09:23:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.472+0000 7f96ab2e7640 1 -- start start 2023-12-12T09:23:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.472+0000 7f96ab2e7640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 0x7f96a413b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.472+0000 7f96ab2e7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 0x7f96a40ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.472+0000 7f96ab2e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96a40abd50 0x7f96a413d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.472+0000 7f96ab2e7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a413b710 con 0x7f96a406c440 2023-12-12T09:23:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.472+0000 7f96ab2e7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a409c3a0 con 0x7f96a40abd50 2023-12-12T09:23:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.472+0000 7f96ab2e7640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a409b820 con 0x7f96a406c060 2023-12-12T09:23:47.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 0x7f96a40ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 0x7f96a40ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52314/0 (socket says 172.21.15.84:52314) 2023-12-12T09:23:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 -- 172.21.15.84:0/631710364 learned_addr learned my addr 172.21.15.84:0/631710364 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a9083640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 0x7f96a413b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a9884640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96a40abd50 0x7f96a413d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 -- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 msgr2=0x7f96a413b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f96a406c060 0x7f96a413b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 -- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96a40abd50 msgr2=0x7f96a413d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96a40abd50 0x7f96a413d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 -- 172.21.15.84:0/631710364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c009b30 con 0x7f96a406c440 2023-12-12T09:23:47.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.473+0000 7f96a8882640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 0x7f96a40ccb40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f969800b3f0 tx=0x7f969800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.474+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698011830 con 0x7f96a406c440 2023-12-12T09:23:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.474+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698011990 con 0x7f96a406c440 2023-12-12T09:23:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.474+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698011d40 con 0x7f96a406c440 2023-12-12T09:23:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.474+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a409bb00 con 0x7f96a406c440 2023-12-12T09:23:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.474+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a409c0c0 con 0x7f96a406c440 2023-12-12T09:23:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.475+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96a40717b0 con 0x7f96a406c440 2023-12-12T09:23:47.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.476+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f969801a400 con 0x7f96a406c440 2023-12-12T09:23:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.477+0000 7f96a1ffb640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f969006ae40 0x7f969006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.477+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f96980892a0 con 0x7f96a406c440 2023-12-12T09:23:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.477+0000 7f96a9083640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f969006ae40 0x7f969006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.477+0000 7f96a1ffb640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f9690071140 0x7f9690073580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.477+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 --> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9690073c50 con 0x7f9690071140 2023-12-12T09:23:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.477+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f969808b880 con 0x7f96a406c440 2023-12-12T09:23:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.478+0000 7f96a9083640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f969006ae40 0x7f969006d300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f969400a950 tx=0x7f9694008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.478+0000 7f96a9884640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f9690071140 0x7f9690073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.479+0000 7f96a9884640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f9690071140 0x7f9690073580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.481+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 <== osd.7 v2:172.21.15.99:6808/3214921666 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9690073c50 con 0x7f9690071140 2023-12-12T09:23:47.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.495+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 --> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f96a413ba10 con 0x7f9690071140 2023-12-12T09:23:47.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.496+0000 7f96a1ffb640 1 -- 172.21.15.84:0/631710364 <== osd.7 v2:172.21.15.99:6808/3214921666 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f96a413ba10 con 0x7f9690071140 2023-12-12T09:23:47.496 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-12-12T09:23:47.496 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T09:23:47.497 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-12-12T09:23:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.496+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f9690071140 msgr2=0x7f9690073580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.496+0000 7f96ab2e7640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.99:6808/3214921666,v1:172.21.15.99:6809/3214921666] conn(0x7f9690071140 0x7f9690073580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f969006ae40 msgr2=0x7f969006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96ab2e7640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f969006ae40 0x7f969006d300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f969400a950 tx=0x7f9694008040 comp rx=0 tx=0).stop 2023-12-12T09:23:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 msgr2=0x7f96a40ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96ab2e7640 1 --2- 172.21.15.84:0/631710364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a406c440 0x7f96a40ccb40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f969800b3f0 tx=0x7f969800b8b0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96a9884640 1 -- 172.21.15.84:0/631710364 reap_dead start 2023-12-12T09:23:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 shutdown_connections 2023-12-12T09:23:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 >> 172.21.15.84:0/631710364 conn(0x7f96a40b0970 msgr2=0x7f96a40af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 shutdown_connections 2023-12-12T09:23:47.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.497+0000 7f96ab2e7640 1 -- 172.21.15.84:0/631710364 wait complete. 2023-12-12T09:23:47.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-12T09:23:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.725+0000 7fadaac25640 1 Processor -- start 2023-12-12T09:23:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.725+0000 7fadaac25640 1 -- start start 2023-12-12T09:23:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.727+0000 7fadaac25640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fada4144740 0x7fada406de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.727+0000 7fadaac25640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada4144b20 con 0x7fada415e950 2023-12-12T09:23:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.727+0000 7fadaac25640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada406d670 con 0x7fada415f4f0 2023-12-12T09:23:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.727+0000 7fadaac25640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada406cdd0 con 0x7fada4144740 2023-12-12T09:23:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.727+0000 7fada9c23640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fada4144740 0x7fada406de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.727+0000 7fada9422640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fada415e950 0x7fada415ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:40736/0 (socket says 172.21.15.84:40736) 2023-12-12T09:23:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.727+0000 7fada9422640 1 -- 172.21.15.84:0/1798521128 learned_addr learned my addr 172.21.15.84:0/1798521128 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:23:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.728+0000 7fada9c23640 1 -- 172.21.15.84:0/1798521128 >> v1:172.21.15.99:6789/0 conn(0x7fada415f4f0 legacy=0x7fada40705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:47.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.728+0000 7fada9c23640 1 -- 172.21.15.84:0/1798521128 >> v1:172.21.15.84:6789/0 conn(0x7fada415e950 legacy=0x7fada415ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.728+0000 7fada9c23640 1 -- 172.21.15.84:0/1798521128 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada406d0b0 con 0x7fada4144740 2023-12-12T09:23:47.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.728+0000 7fada8c21640 1 -- 172.21.15.84:0/1798521128 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320255806 0 0) 0x7fada4144b20 con 0x7fada415e950 2023-12-12T09:23:47.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.729+0000 7fada9c23640 1 --2- 172.21.15.84:0/1798521128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada4144740 0x7fada406de80 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fada00097a0 tx=0x7fada002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ce4509baf6260a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.729+0000 7fada8c21640 1 -- 172.21.15.84:0/1798521128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0031830 con 0x7fada4144740 2023-12-12T09:23:47.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.729+0000 7fada8c21640 1 -- 172.21.15.84:0/1798521128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada0031990 con 0x7fada4144740 2023-12-12T09:23:47.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.729+0000 7fada8c21640 1 -- 172.21.15.84:0/1798521128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada0031d20 con 0x7fada4144740 2023-12-12T09:23:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.730+0000 7fadaac25640 1 -- 172.21.15.84:0/1798521128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada4144740 msgr2=0x7fada406de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.730+0000 7fadaac25640 1 --2- 172.21.15.84:0/1798521128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada4144740 0x7fada406de80 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fada00097a0 tx=0x7fada002b8d0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.730+0000 7fadaac25640 1 -- 172.21.15.84:0/1798521128 shutdown_connections 2023-12-12T09:23:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.730+0000 7fadaac25640 1 --2- 172.21.15.84:0/1798521128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada4144740 0x7fada406de80 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.730+0000 7fadaac25640 1 -- 172.21.15.84:0/1798521128 >> 172.21.15.84:0/1798521128 conn(0x7fada40b07f0 msgr2=0x7fada40b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.730+0000 7fadaac25640 1 -- 172.21.15.84:0/1798521128 shutdown_connections 2023-12-12T09:23:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.730+0000 7fadaac25640 1 -- 172.21.15.84:0/1798521128 wait complete. 2023-12-12T09:23:47.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.732+0000 7fadaac25640 1 Processor -- start 2023-12-12T09:23:47.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.732+0000 7fadaac25640 1 -- start start 2023-12-12T09:23:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaac25640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fada4144740 0x7fada413a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaac25640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada415e950 0x7fada41573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaac25640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada415f4f0 0x7fada4152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaac25640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada4157220 con 0x7fada415f4f0 2023-12-12T09:23:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaac25640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada4157910 con 0x7fada415e950 2023-12-12T09:23:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaac25640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada4159e40 con 0x7fada4144740 2023-12-12T09:23:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaa424640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada415f4f0 0x7fada4152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaa424640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada415f4f0 0x7fada4152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52324/0 (socket says 172.21.15.84:52324) 2023-12-12T09:23:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.733+0000 7fadaa424640 1 -- 172.21.15.84:0/1854100164 learned_addr learned my addr 172.21.15.84:0/1854100164 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fada9c23640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fada4144740 0x7fada413a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fadaa424640 1 -- 172.21.15.84:0/1854100164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fada4144740 msgr2=0x7fada413a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fadaa424640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fada4144740 0x7fada413a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fadaa424640 1 -- 172.21.15.84:0/1854100164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada415e950 msgr2=0x7fada41573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fadaa424640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada415e950 0x7fada41573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fadaa424640 1 -- 172.21.15.84:0/1854100164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada0009400 con 0x7fada415f4f0 2023-12-12T09:23:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fadaa424640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada415f4f0 0x7fada4152f00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00b970 tx=0x7fad9c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fad9a7fc640 1 -- 172.21.15.84:0/1854100164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00cb40 con 0x7fada415f4f0 2023-12-12T09:23:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fad9a7fc640 1 -- 172.21.15.84:0/1854100164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c00cca0 con 0x7fada415f4f0 2023-12-12T09:23:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fad9a7fc640 1 -- 172.21.15.84:0/1854100164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c014680 con 0x7fada415f4f0 2023-12-12T09:23:47.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.734+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada415a120 con 0x7fada415f4f0 2023-12-12T09:23:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.735+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada4153440 con 0x7fada415f4f0 2023-12-12T09:23:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.736+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada41546c0 con 0x7fada415f4f0 2023-12-12T09:23:47.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.737+0000 7fad9a7fc640 1 -- 172.21.15.84:0/1854100164 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad9c01d3b0 con 0x7fada415f4f0 2023-12-12T09:23:47.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.737+0000 7fad9a7fc640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad8806ae40 0x7fad8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:47.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.738+0000 7fad9a7fc640 1 -- 172.21.15.84:0/1854100164 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fad9c089280 con 0x7fada415f4f0 2023-12-12T09:23:47.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.738+0000 7fada9c23640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad8806ae40 0x7fad8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:47.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.739+0000 7fada9c23640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad8806ae40 0x7fad8806d300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fada0036000 tx=0x7fada0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:47.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.743+0000 7fad9a7fc640 1 -- 172.21.15.84:0/1854100164 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fada41546c0 con 0x7fada415f4f0 2023-12-12T09:23:47.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.932+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fada406e900 con 0x7fad8806ae40 2023-12-12T09:23:47.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.933+0000 7fad9a7fc640 1 -- 172.21.15.84:0/1854100164 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fada406e900 con 0x7fad8806ae40 2023-12-12T09:23:47.934 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 7 to deep-scrub 2023-12-12T09:23:47.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad8806ae40 msgr2=0x7fad8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad8806ae40 0x7fad8806d300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fada0036000 tx=0x7fada0008030 comp rx=0 tx=0).stop 2023-12-12T09:23:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada415f4f0 msgr2=0x7fada4152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada415f4f0 0x7fada4152f00 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00b970 tx=0x7fad9c00be30 comp rx=0 tx=0).stop 2023-12-12T09:23:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 shutdown_connections 2023-12-12T09:23:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7fad8806ae40 0x7fad8806d300 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fada415f4f0 0x7fada4152f00 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fada415e950 0x7fada41573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 --2- 172.21.15.84:0/1854100164 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7fada4144740 0x7fada413a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:47.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 >> 172.21.15.84:0/1854100164 conn(0x7fada40b07f0 msgr2=0x7fada4142680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:47.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 shutdown_connections 2023-12-12T09:23:47.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:47.936+0000 7fadaac25640 1 -- 172.21.15.84:0/1854100164 wait complete. 2023-12-12T09:23:47.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:23:48.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.171+0000 7f7c23f6e640 1 Processor -- start 2023-12-12T09:23:48.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.171+0000 7f7c23f6e640 1 -- start start 2023-12-12T09:23:48.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.173+0000 7f7c23f6e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7c1c071bb0 0x7f7c1c071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.173+0000 7f7c23f6e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c1c0ce330 0x7f7c1c13d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.173+0000 7f7c23f6e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c0724d0 con 0x7f7c1c0ce7c0 2023-12-12T09:23:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.173+0000 7f7c23f6e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1c140270 con 0x7f7c1c0ce330 2023-12-12T09:23:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.173+0000 7f7c23f6e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1c0cd850 con 0x7f7c1c071bb0 2023-12-12T09:23:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.173+0000 7f7c21509640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c1c0ce330 0x7f7c1c13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.173+0000 7f7c21509640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7c1c0ce330 0x7f7c1c13d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52330/0 (socket says 172.21.15.84:52330) 2023-12-12T09:23:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.173+0000 7f7c21509640 1 -- 172.21.15.84:0/482045715 learned_addr learned my addr 172.21.15.84:0/482045715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:48.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.174+0000 7f7c21d0a640 1 --2- 172.21.15.84:0/482045715 >> v2:172.21.15.99:3300/0 conn(0x7f7c1c071bb0 0x7f7c1c071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.174+0000 7f7c21509640 1 -- 172.21.15.84:0/482045715 >> v2:172.21.15.99:3300/0 conn(0x7f7c1c071bb0 msgr2=0x7f7c1c071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.174+0000 7f7c21509640 1 --2- 172.21.15.84:0/482045715 >> v2:172.21.15.99:3300/0 conn(0x7f7c1c071bb0 0x7f7c1c071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.174+0000 7f7c21509640 1 -- 172.21.15.84:0/482045715 >> v1:172.21.15.99:6789/0 conn(0x7f7c1c0ce7c0 legacy=0x7f7c1c13f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:23:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.174+0000 7f7c21509640 1 -- 172.21.15.84:0/482045715 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0cdb30 con 0x7f7c1c0ce330 2023-12-12T09:23:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.175+0000 7f7c21509640 1 --2- 172.21.15.84:0/482045715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c0ce330 0x7f7c1c13d3d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0744b0 tx=0x7f7c0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa11d2fb6847f92 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.175+0000 7f7c20d08640 1 -- 172.21.15.84:0/482045715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08031870 con 0x7f7c1c0ce330 2023-12-12T09:23:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.175+0000 7f7c20d08640 1 -- 172.21.15.84:0/482045715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c080319d0 con 0x7f7c1c0ce330 2023-12-12T09:23:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.175+0000 7f7c20d08640 1 -- 172.21.15.84:0/482045715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08031d60 con 0x7f7c1c0ce330 2023-12-12T09:23:48.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.176+0000 7f7c23f6e640 1 -- 172.21.15.84:0/482045715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c0ce330 msgr2=0x7f7c1c13d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:48.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.176+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/482045715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c0ce330 0x7f7c1c13d3d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0744b0 tx=0x7f7c0802b910 comp rx=0 tx=0).stop 2023-12-12T09:23:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.176+0000 7f7c23f6e640 1 -- 172.21.15.84:0/482045715 shutdown_connections 2023-12-12T09:23:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.176+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/482045715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c0ce330 0x7f7c1c13d3d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.176+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/482045715 >> v2:172.21.15.99:3300/0 conn(0x7f7c1c071bb0 0x7f7c1c071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.176+0000 7f7c23f6e640 1 -- 172.21.15.84:0/482045715 >> 172.21.15.84:0/482045715 conn(0x7f7c1c06c3d0 msgr2=0x7f7c1c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.176+0000 7f7c23f6e640 1 -- 172.21.15.84:0/482045715 shutdown_connections 2023-12-12T09:23:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.176+0000 7f7c23f6e640 1 -- 172.21.15.84:0/482045715 wait complete. 2023-12-12T09:23:48.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.178+0000 7f7c23f6e640 1 Processor -- start 2023-12-12T09:23:48.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.178+0000 7f7c23f6e640 1 -- start start 2023-12-12T09:23:48.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c23f6e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c071bb0 0x7f7c1c1f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:48.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c23f6e640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1c0ce330 0x7f7c1c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c23f6e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1c0ce7c0 0x7f7c1c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c23f6e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c0b27a0 con 0x7f7c1c071bb0 2023-12-12T09:23:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c23f6e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c0b2a80 con 0x7f7c1c0ce7c0 2023-12-12T09:23:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c23f6e640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c0b2d60 con 0x7f7c1c0ce330 2023-12-12T09:23:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c21d0a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c071bb0 0x7f7c1c1f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c21d0a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c071bb0 0x7f7c1c1f0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52346/0 (socket says 172.21.15.84:52346) 2023-12-12T09:23:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.179+0000 7f7c21d0a640 1 -- 172.21.15.84:0/2757582720 learned_addr learned my addr 172.21.15.84:0/2757582720 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:23:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c21d0a640 1 -- 172.21.15.84:0/2757582720 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1c0ce330 msgr2=0x7f7c1c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c21d0a640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1c0ce330 0x7f7c1c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c21d0a640 1 -- 172.21.15.84:0/2757582720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1c0ce7c0 msgr2=0x7f7c1c159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c21d0a640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1c0ce7c0 0x7f7c1c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c21d0a640 1 -- 172.21.15.84:0/2757582720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080094d0 con 0x7f7c1c071bb0 2023-12-12T09:23:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c21d0a640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c071bb0 0x7f7c1c1f0480 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000ccd0 tx=0x7f7c1000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c1a7fc640 1 -- 172.21.15.84:0/2757582720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10003990 con 0x7f7c1c071bb0 2023-12-12T09:23:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c1a7fc640 1 -- 172.21.15.84:0/2757582720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c10003af0 con 0x7f7c1c071bb0 2023-12-12T09:23:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1c0b3040 con 0x7f7c1c071bb0 2023-12-12T09:23:48.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.180+0000 7f7c1a7fc640 1 -- 172.21.15.84:0/2757582720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c10004020 con 0x7f7c1c071bb0 2023-12-12T09:23:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.181+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1c0b1a90 con 0x7f7c1c071bb0 2023-12-12T09:23:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.182+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1c1527e0 con 0x7f7c1c071bb0 2023-12-12T09:23:48.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.183+0000 7f7c1a7fc640 1 -- 172.21.15.84:0/2757582720 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c10004180 con 0x7f7c1c071bb0 2023-12-12T09:23:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.183+0000 7f7c1a7fc640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c0006ae70 0x7f7c0006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:23:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.184+0000 7f7c1a7fc640 1 -- 172.21.15.84:0/2757582720 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7c10089900 con 0x7f7c1c071bb0 2023-12-12T09:23:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.184+0000 7f7c21509640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c0006ae70 0x7f7c0006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:23:48.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.184+0000 7f7c21509640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c0006ae70 0x7f7c0006d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7c08036000 tx=0x7f7c08030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:23:48.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.188+0000 7f7c1a7fc640 1 -- 172.21.15.84:0/2757582720 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c10054ad0 con 0x7f7c1c071bb0 2023-12-12T09:23:48.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.378+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c1c0b2bf0 con 0x7f7c0006ae70 2023-12-12T09:23:48.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.381+0000 7f7c1a7fc640 1 -- 172.21.15.84:0/2757582720 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48411 (secure 0 0 0) 0x7f7c1c0b2bf0 con 0x7f7c0006ae70 2023-12-12T09:23:48.382 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:23:48.383 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:23:48.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c0006ae70 msgr2=0x7f7c0006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c0006ae70 0x7f7c0006d330 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7c08036000 tx=0x7f7c08030000 comp rx=0 tx=0).stop 2023-12-12T09:23:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c071bb0 msgr2=0x7f7c1c1f0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:23:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c071bb0 0x7f7c1c1f0480 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000ccd0 tx=0x7f7c1000a5c0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 shutdown_connections 2023-12-12T09:23:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c1c0ce7c0 0x7f7c1c159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f7c1c0ce330 0x7f7c1c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f7c0006ae70 0x7f7c0006d330 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 --2- 172.21.15.84:0/2757582720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7c1c071bb0 0x7f7c1c1f0480 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:23:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 >> 172.21.15.84:0/2757582720 conn(0x7f7c1c06c3d0 msgr2=0x7f7c1c0afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:23:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 shutdown_connections 2023-12-12T09:23:48.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:23:48.384+0000 7f7c23f6e640 1 -- 172.21.15.84:0/2757582720 wait complete. 2023-12-12T09:23:48.402 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2023-12-12T09:23:47.156267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":231408,"kb_used_data":6920,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743312,"statfs":{"total":773094113280,"available":772857151488,"internally_reserved":0,"allocated":7086080,"data_stored":3823104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002229"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":199,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-12T09:23:39.054654+0000","last_change":"2023-12-12T09:19:36.706349+0000","last_active":"2023-12-12T09:23:39.054654+0000","last_peered":"2023-12-12T09:23:39.054654+0000","last_clean":"2023-12-12T09:23:39.054654+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:23:39.054654+0000","last_undegraded":"2023-12-12T09:23:39.054654+0000","last_fullsized":"2023-12-12T09:23:39.054654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T09:19:35.516905+0000","last_clean_scrub_stamp":"2023-12-12T09:19:35.516905+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:34:14.353013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1331200,"data_stored":920664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.139,"15min":1.0569999999999999},"min":{"1min":0.56499999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":8.5410000000000004,"5min":8.5410000000000004,"15min":8.5410000000000004},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.2949999999999999,"15min":1.2989999999999999},"min":{"1min":0.65400000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":6.8369999999999997,"5min":6.8369999999999997,"15min":6.8369999999999997},"last":0.75}]},{"osd":1,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.137,"15min":1.0189999999999999},"min":{"1min":0.74099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":1.198},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.113,"15min":1.099},"min":{"1min":0.72499999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5700000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.083}]},{"osd":2,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.232,"15min":1.1579999999999999},"min":{"1min":0.82299999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":6.7709999999999999,"5min":6.7709999999999999,"15min":6.7709999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.633,"5min":1.252,"15min":1.204},"min":{"1min":0.67800000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":8.7609999999999992,"5min":8.7609999999999992,"15min":8.7609999999999992},"last":1.2629999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.2889999999999999,"15min":1.236},"min":{"1min":0.80300000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":6.6740000000000004,"5min":6.6740000000000004,"15min":6.6740000000000004},"last":1.425},{"interface":"front","average":{"1min":1.603,"5min":1.296,"15min":1.2689999999999999},"min":{"1min":0.76100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.6750000000000007,"5min":8.6750000000000007,"15min":8.6750000000000007},"last":1.385}]},{"osd":4,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.359,"15min":1.373},"min":{"1min":0.86099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":7.0670000000000002,"5min":7.0670000000000002,"15min":7.0670000000000002},"last":1.319},{"interface":"front","average":{"1min":1.75,"5min":1.427,"15min":1.377},"min":{"1min":1.101,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":1.536}]},{"osd":5,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":1.462,"15min":1.4319999999999999},"min":{"1min":0.80900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":8.9559999999999995,"5min":8.9559999999999995,"15min":8.9559999999999995},"last":1.484},{"interface":"front","average":{"1min":1.704,"5min":1.427,"15min":1.403},"min":{"1min":0.78400000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":7.1609999999999996,"5min":7.1609999999999996,"15min":7.1609999999999996},"last":1.46}]},{"osd":6,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":1.5009999999999999,"15min":1.4410000000000001},"min":{"1min":1.169,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":6.4160000000000004,"5min":6.4160000000000004,"15min":6.4160000000000004},"last":1.6080000000000001},{"interface":"front","average":{"1min":1.875,"5min":1.5529999999999999,"15min":1.496},"min":{"1min":0.97899999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":8.8490000000000002,"5min":8.8490000000000002,"15min":8.8490000000000002},"last":1.5600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98799999999999999,"15min":0.95099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.575,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.204},{"interface":"front","average":{"1min":1.141,"5min":1.0700000000000001,"15min":1.0800000000000001},"min":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.1559999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0680000000000001,"15min":1.0169999999999999},"min":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.212,"15min":1.2350000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.194,"15min":1.1819999999999999},"min":{"1min":0.72399999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8180000000000001,"5min":1.966,"15min":1.966},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.294,"5min":1.2689999999999999,"15min":1.2629999999999999},"min":{"1min":0.89900000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.601,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.89900000000000002}]},{"osd":3,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1699999999999999,"15min":1.1899999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.397,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3129999999999999,"15min":1.357},"min":{"1min":0.94699999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9730000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.246}]},{"osd":4,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.369,"15min":1.3620000000000001},"min":{"1min":0.90000000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.6890000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.371},{"interface":"front","average":{"1min":1.149,"5min":1.2470000000000001,"15min":1.25},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.696,"5min":1.996,"15min":1.996},"last":1.3140000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":0.91000000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9830000000000001,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.464},{"interface":"front","average":{"1min":1.474,"5min":1.4530000000000001,"15min":1.4330000000000001},"min":{"1min":1.119,"5min":0.623,"15min":0.623},"max":{"1min":2.0259999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.1259999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.359,"15min":1.3520000000000001},"min":{"1min":1.115,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.732,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.488,"15min":1.4830000000000001},"min":{"1min":1.0469999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8999999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.5760000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.996,"15min":1.0149999999999999},"min":{"1min":0.66800000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.5149999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.153,"5min":1.1120000000000001,"15min":1.1399999999999999},"min":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7949999999999999,"5min":1.909,"15min":1.909},"last":1.339}]},{"osd":1,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1890000000000001,"15min":1.2290000000000001},"min":{"1min":0.77500000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.2,"15min":1.26},"min":{"1min":0.70599999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6579999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":1.2}]},{"osd":2,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1850000000000001,"15min":1.2230000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.452,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.22,"15min":1.196},"min":{"1min":0.80200000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8600000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.677}]},{"osd":3,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2490000000000001,"15min":1.2849999999999999},"min":{"1min":0.88700000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.637,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.3080000000000001,"15min":1.359},"min":{"1min":0.751,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.724,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.2509999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2949999999999999,"15min":1.27},"min":{"1min":0.77200000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5880000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.464,"15min":1.486},"min":{"1min":0.95499999999999996,"5min":0.628,"15min":0.628},"max":{"1min":1.8280000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.3}]},{"osd":6,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.381,"15min":1.399},"min":{"1min":0.79800000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.78,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.534},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.454,"15min":1.482},"min":{"1min":0.82199999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9550000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.794}]},{"osd":7,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.554,"15min":1.5760000000000001},"min":{"1min":0.90200000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.829,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.498},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.97399999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.331,"15min":2.331},"last":1.6279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.157,"15min":1.1539999999999999},"min":{"1min":0.79800000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5189999999999999,"5min":1.633,"15min":1.633},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.109,"15min":1.1200000000000001},"min":{"1min":0.68100000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5940000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.81399999999999995}]},{"osd":1,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.1799999999999999},"min":{"1min":0.75900000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6160000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1870000000000001,"15min":1.2170000000000001},"min":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":2.117,"15min":2.117},"last":0.95599999999999996}]},{"osd":2,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1319999999999999,"15min":1.1539999999999999},"min":{"1min":0.77300000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.506,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.385},{"interface":"front","average":{"1min":1.325,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":1.046,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7609999999999999,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.2949999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.304,"15min":1.341},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.772,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.256},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.298,"15min":1.3720000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.667,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":0.92700000000000005}]},{"osd":5,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3779999999999999,"15min":1.4119999999999999},"min":{"1min":0.79300000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7030000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.8200000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.425,"15min":1.452},"min":{"1min":1.109,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.754,"5min":3.343,"15min":3.343},"last":1.5329999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.431,"15min":1.4870000000000001},"min":{"1min":0.99399999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7390000000000001,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.528,"15min":1.575},"min":{"1min":1.071,"5min":0.755,"15min":0.755},"max":{"1min":1.806,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.6659999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.5549999999999999,"15min":1.579},"min":{"1min":1.2889999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.9610000000000001,"5min":3.085,"15min":3.085},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5740000000000001,"15min":1.6439999999999999},"min":{"1min":1.113,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.823,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.7569999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.88500000000000001},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.27,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.873},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.874,"15min":0.91000000000000003},"min":{"1min":0.40999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.3240000000000001,"5min":1.718,"15min":1.718},"last":0.81299999999999994}]},{"osd":1,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.83799999999999997,"15min":0.85599999999999998},"min":{"1min":0.433,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.6419999999999999,"5min":1.71,"15min":1.71},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.98599999999999999},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.3149999999999999,"5min":1.575,"15min":1.575},"last":1.2949999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.046,"15min":1.093},"min":{"1min":0.48299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.512,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.0649999999999999,"15min":1.1000000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.175}]},{"osd":4,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.71299999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.262},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.22,"15min":1.24},"min":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6479999999999999,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.236}]},{"osd":5,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.2809999999999999,"15min":1.3049999999999999},"min":{"1min":0.85799999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.734,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.113},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2809999999999999},"min":{"1min":0.76700000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.0229999999999999}]},{"osd":6,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.296,"15min":1.3220000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.78,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.482},{"interface":"front","average":{"1min":1.333,"5min":1.387,"15min":1.431},"min":{"1min":0.81499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8240000000000001,"5min":2.198,"15min":2.198},"last":1.3400000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3560000000000001,"15min":1.3919999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7050000000000001,"5min":1.847,"15min":1.847},"last":1.387},{"interface":"front","average":{"1min":1.361,"5min":1.3640000000000001,"15min":1.3939999999999999},"min":{"1min":0.79800000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.879,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.5640000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.86799999999999999,"15min":0.91400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.3160000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.753},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.96999999999999997,"15min":1.016},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.4079999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":1.0629999999999999,"15min":1.137},"min":{"1min":0.51300000000000001,"5min":0.437,"15min":0.437},"max":{"1min":1.5,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.163},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.226,"15min":1.306},"min":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.6140000000000001,"5min":2.867,"15min":2.867},"last":1.532}]},{"osd":3,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":1.0009999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.181,"15min":1.268},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.25}]},{"osd":4,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.3220000000000001,"15min":1.373},"min":{"1min":0.70199999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.806,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.4039999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.571,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.2230000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.325,"15min":1.3939999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.528,"5min":2.21,"15min":2.21},"last":1.294},{"interface":"front","average":{"1min":1.321,"5min":1.516,"15min":1.6040000000000001},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6890000000000001,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.488}]},{"osd":6,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7629999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.625},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.3779999999999999,"15min":1.4330000000000001},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.6930000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.4330000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:22:42 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.482,"15min":1.5760000000000001},"min":{"1min":0.871,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6890000000000001,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.339},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4510000000000001,"15min":1.5209999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.6180000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.5780000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82599999999999996,"15min":0.83899999999999997},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90200000000000002,"15min":0.89400000000000002},"min":{"1min":0.54300000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2929999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1279999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.83499999999999996},"min":{"1min":0.46300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5549999999999999,"5min":1.613,"15min":1.613},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.042,"15min":1.048},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7549999999999999,"5min":2.903,"15min":2.903},"last":1.2410000000000001}]},{"osd":3,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.98399999999999999,"15min":0.997},"min":{"1min":0.59999999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.333,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.48},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5920000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.98699999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1439999999999999,"15min":1.131},"min":{"1min":0.68000000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5069999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.069},{"interface":"front","average":{"1min":1.147,"5min":1.163,"15min":1.163},"min":{"1min":0.77200000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.5449999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.151}]},{"osd":5,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2170000000000001,"15min":1.24},"min":{"1min":0.76500000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.5209999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.286,"15min":1.3200000000000001},"min":{"1min":0.79600000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.633,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.5720000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3129999999999999,"15min":1.2889999999999999},"min":{"1min":0.748,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.712,"5min":2.867,"15min":2.867},"last":1.196},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.345,"15min":1.3600000000000001},"min":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.681,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.3360000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3959999999999999,"15min":1.423},"min":{"1min":0.877,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8280000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3540000000000001,"15min":1.337},"min":{"1min":0.98999999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7669999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.306}]}]},{"osd":0,"up_from":14,"seq":60129542197,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":1331200,"data_stored":920664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.86199999999999999,"15min":0.86599999999999999},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.44800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2090000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.95899999999999996,"15min":1.0529999999999999},"min":{"1min":0.48999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1919999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.98199999999999998,"15min":1.0309999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4850000000000001,"5min":1.694,"15min":1.694},"last":0.42599999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.89300000000000002,"15min":0.93500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.294,"5min":1.502,"15min":1.502},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.1399999999999999,"15min":1.246},"min":{"1min":0.51900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.4139999999999999,"5min":2.464,"15min":2.464},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1850000000000001,"15min":1.2270000000000001},"min":{"1min":0.76400000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5549999999999999,"5min":2.343,"15min":2.343},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.3089999999999999,"15min":1.3640000000000001},"min":{"1min":0.84599999999999997,"5min":0.502,"15min":0.502},"max":{"1min":1.625,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.98799999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2709999999999999,"15min":1.321},"min":{"1min":0.88500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5920000000000001,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.208,"5min":1.2509999999999999,"15min":1.302},"min":{"1min":0.82599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7090000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.081}]},{"osd":6,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4079999999999999,"15min":1.4870000000000001},"min":{"1min":0.877,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.74,"5min":2.573,"15min":2.573},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3260000000000001,"15min":1.373},"min":{"1min":0.85999999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7789999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.0149999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.367,"15min":1.4199999999999999},"min":{"1min":0.80900000000000005,"5min":0.754,"15min":0.754},"max":{"1min":1.6639999999999999,"5min":1.968,"15min":1.968},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.323,"5min":1.337,"15min":1.3779999999999999},"min":{"1min":0.79700000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.696,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.335}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:23:48.407 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-12T09:19:35.516905+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=12, tm_hour=9, tm_min=19, tm_sec=35, tm_wday=1, tm_yday=346, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=12, tm_hour=9, tm_min=23, tm_sec=41, tm_wday=1, tm_yday=346, tm_isdst=0) 2023-12-12T09:23:48.407 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-12T09:23:58.821 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:23:58.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:24:08.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T09:24:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.628+0000 7efc83d1d640 1 Processor -- start 2023-12-12T09:24:08.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.628+0000 7efc83d1d640 1 -- start start 2023-12-12T09:24:08.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.629+0000 7efc83d1d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efc7c143d20 0x7efc7c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:08.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.629+0000 7efc83d1d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c0ce550 0x7efc7c0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.629+0000 7efc83d1d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc7c1447f0 0x7efc7c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.629+0000 7efc83d1d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0cea30 con 0x7efc7c1447f0 2023-12-12T09:24:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.629+0000 7efc83d1d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0702b0 con 0x7efc7c143d20 2023-12-12T09:24:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.629+0000 7efc83d1d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c070590 con 0x7efc7c0ce550 2023-12-12T09:24:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc822ba640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc7c1447f0 0x7efc7c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc822ba640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efc7c1447f0 0x7efc7c15eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35004/0 (socket says 172.21.15.84:35004) 2023-12-12T09:24:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc822ba640 1 -- 172.21.15.84:0/3732343466 learned_addr learned my addr 172.21.15.84:0/3732343466 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:24:08.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc812b8640 1 --2- 172.21.15.84:0/3732343466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c0ce550 0x7efc7c0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc822ba640 1 -- 172.21.15.84:0/3732343466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c0ce550 msgr2=0x7efc7c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:24:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc822ba640 1 --2- 172.21.15.84:0/3732343466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c0ce550 0x7efc7c0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc822ba640 1 -- 172.21.15.84:0/3732343466 >> v2:172.21.15.99:3300/0 conn(0x7efc7c143d20 msgr2=0x7efc7c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:24:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc822ba640 1 --2- 172.21.15.84:0/3732343466 >> v2:172.21.15.99:3300/0 conn(0x7efc7c143d20 0x7efc7c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.630+0000 7efc822ba640 1 -- 172.21.15.84:0/3732343466 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c070870 con 0x7efc7c1447f0 2023-12-12T09:24:08.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.631+0000 7efc822ba640 1 --2- 172.21.15.84:0/3732343466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c1447f0 0x7efc7c15eaf0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7efc7c04f7a0 tx=0x7efc7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3386fa4cf71b801 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:08.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc80ab7640 1 -- 172.21.15.84:0/3732343466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74031870 con 0x7efc7c1447f0 2023-12-12T09:24:08.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc80ab7640 1 -- 172.21.15.84:0/3732343466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc740319d0 con 0x7efc7c1447f0 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc80ab7640 1 -- 172.21.15.84:0/3732343466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74031d60 con 0x7efc7c1447f0 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc83d1d640 1 -- 172.21.15.84:0/3732343466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c1447f0 msgr2=0x7efc7c15eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc83d1d640 1 --2- 172.21.15.84:0/3732343466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c1447f0 0x7efc7c15eaf0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7efc7c04f7a0 tx=0x7efc7402b910 comp rx=0 tx=0).stop 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc83d1d640 1 -- 172.21.15.84:0/3732343466 shutdown_connections 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc83d1d640 1 --2- 172.21.15.84:0/3732343466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c1447f0 0x7efc7c15eaf0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc83d1d640 1 --2- 172.21.15.84:0/3732343466 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c0ce550 0x7efc7c0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc83d1d640 1 --2- 172.21.15.84:0/3732343466 >> v2:172.21.15.99:3300/0 conn(0x7efc7c143d20 0x7efc7c0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.632+0000 7efc83d1d640 1 -- 172.21.15.84:0/3732343466 >> 172.21.15.84:0/3732343466 conn(0x7efc7c06c3d0 msgr2=0x7efc7c06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:24:08.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.633+0000 7efc83d1d640 1 -- 172.21.15.84:0/3732343466 shutdown_connections 2023-12-12T09:24:08.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.633+0000 7efc83d1d640 1 -- 172.21.15.84:0/3732343466 wait complete. 2023-12-12T09:24:08.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.635+0000 7efc83d1d640 1 Processor -- start 2023-12-12T09:24:08.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.635+0000 7efc83d1d640 1 -- start start 2023-12-12T09:24:08.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc83d1d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c0ce550 0x7efc7c1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc83d1d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c143d20 0x7efc7c139730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc83d1d640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c1447f0 0x7efc7c0acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc83d1d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c13bf20 con 0x7efc7c0ce550 2023-12-12T09:24:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc83d1d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c13b3a0 con 0x7efc7c143d20 2023-12-12T09:24:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc83d1d640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c13b680 con 0x7efc7c1447f0 2023-12-12T09:24:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc81ab9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c0ce550 0x7efc7c1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc81ab9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c0ce550 0x7efc7c1599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35014/0 (socket says 172.21.15.84:35014) 2023-12-12T09:24:08.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.636+0000 7efc81ab9640 1 -- 172.21.15.84:0/993580509 learned_addr learned my addr 172.21.15.84:0/993580509 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:24:08.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc81ab9640 1 -- 172.21.15.84:0/993580509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c1447f0 msgr2=0x7efc7c0acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc81ab9640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c1447f0 0x7efc7c0acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc81ab9640 1 -- 172.21.15.84:0/993580509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c143d20 msgr2=0x7efc7c139730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc81ab9640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c143d20 0x7efc7c139730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc81ab9640 1 -- 172.21.15.84:0/993580509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc740094d0 con 0x7efc7c0ce550 2023-12-12T09:24:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc81ab9640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c0ce550 0x7efc7c1599f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7efc7000ba50 tx=0x7efc7000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc7a7fc640 1 -- 172.21.15.84:0/993580509 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7000cbe0 con 0x7efc7c0ce550 2023-12-12T09:24:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc7a7fc640 1 -- 172.21.15.84:0/993580509 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7000cd60 con 0x7efc7c0ce550 2023-12-12T09:24:08.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc7a7fc640 1 -- 172.21.15.84:0/993580509 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70014680 con 0x7efc7c0ce550 2023-12-12T09:24:08.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.637+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c13b960 con 0x7efc7c0ce550 2023-12-12T09:24:08.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.638+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c159f30 con 0x7efc7c0ce550 2023-12-12T09:24:08.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.639+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c06e190 con 0x7efc7c0ce550 2023-12-12T09:24:08.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.640+0000 7efc7a7fc640 1 -- 172.21.15.84:0/993580509 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc7001d3b0 con 0x7efc7c0ce550 2023-12-12T09:24:08.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.641+0000 7efc7a7fc640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc6006ae70 0x7efc6006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:08.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.641+0000 7efc7a7fc640 1 -- 172.21.15.84:0/993580509 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7efc70089490 con 0x7efc7c0ce550 2023-12-12T09:24:08.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.641+0000 7efc812b8640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc6006ae70 0x7efc6006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:08.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.642+0000 7efc812b8640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc6006ae70 0x7efc6006d330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc68006fd0 tx=0x7efc68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:08.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.647+0000 7efc7a7fc640 1 -- 172.21.15.84:0/993580509 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc70054660 con 0x7efc7c0ce550 2023-12-12T09:24:08.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.834+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 --> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc7c0673c0 con 0x7efc6006ae70 2023-12-12T09:24:08.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.840+0000 7efc7a7fc640 1 -- 172.21.15.84:0/993580509 <== mgr.4110 v2:172.21.15.84:6832/2629859879 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48368 (secure 0 0 0) 0x7efc7c0673c0 con 0x7efc6006ae70 2023-12-12T09:24:08.842 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:24:08.842 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-12-12T09:24:08.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc6006ae70 msgr2=0x7efc6006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:08.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc6006ae70 0x7efc6006d330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc68006fd0 tx=0x7efc68008040 comp rx=0 tx=0).stop 2023-12-12T09:24:08.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c0ce550 msgr2=0x7efc7c1599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c0ce550 0x7efc7c1599f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7efc7000ba50 tx=0x7efc7000bf10 comp rx=0 tx=0).stop 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 shutdown_connections 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7efc7c1447f0 0x7efc7c0acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc7c143d20 0x7efc7c139730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7efc6006ae70 0x7efc6006d330 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 --2- 172.21.15.84:0/993580509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc7c0ce550 0x7efc7c1599f0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 >> 172.21.15.84:0/993580509 conn(0x7efc7c06c3d0 msgr2=0x7efc7c0afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 shutdown_connections 2023-12-12T09:24:08.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:08.843+0000 7efc83d1d640 1 -- 172.21.15.84:0/993580509 wait complete. 2023-12-12T09:24:08.864 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2023-12-12T09:24:07.162024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":231400,"kb_used_data":6920,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743320,"statfs":{"total":773094113280,"available":772857159680,"internally_reserved":0,"allocated":7086080,"data_stored":3823104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003326"},"pg_stats":[{"pgid":"1.0","version":"61'119","reported_seq":210,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-12T09:23:48.290087+0000","last_change":"2023-12-12T09:23:48.290153+0000","last_active":"2023-12-12T09:23:48.290087+0000","last_peered":"2023-12-12T09:23:48.290087+0000","last_clean":"2023-12-12T09:23:48.290087+0000","last_became_active":"2023-12-12T09:19:36.704500+0000","last_became_peered":"2023-12-12T09:19:36.704500+0000","last_unstale":"2023-12-12T09:23:48.290087+0000","last_undegraded":"2023-12-12T09:23:48.290087+0000","last_fullsized":"2023-12-12T09:23:48.290087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'119","last_scrub_stamp":"2023-12-12T09:23:48.289928+0000","last_deep_scrub":"61'119","last_deep_scrub_stamp":"2023-12-12T09:23:48.289928+0000","last_clean_scrub_stamp":"2023-12-12T09:23:48.289928+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:46:14.408083+0000","scrub_duration":0.010841247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542200,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1331200,"data_stored":920664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.139,"15min":1.0569999999999999},"min":{"1min":0.56499999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":8.5410000000000004,"5min":8.5410000000000004,"15min":8.5410000000000004},"last":1.296},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.2949999999999999,"15min":1.2989999999999999},"min":{"1min":0.65400000000000003,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":6.8369999999999997,"5min":6.8369999999999997,"15min":6.8369999999999997},"last":1.6240000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.137,"15min":1.0189999999999999},"min":{"1min":0.74099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.113,"15min":1.099},"min":{"1min":0.72499999999999998,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.5700000000000001,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.577}]},{"osd":2,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.232,"15min":1.1579999999999999},"min":{"1min":0.82299999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":6.7709999999999999,"5min":6.7709999999999999,"15min":6.7709999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.633,"5min":1.252,"15min":1.204},"min":{"1min":0.67800000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":8.7609999999999992,"5min":8.7609999999999992,"15min":8.7609999999999992},"last":1.089}]},{"osd":3,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.2889999999999999,"15min":1.236},"min":{"1min":0.80300000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":6.6740000000000004,"5min":6.6740000000000004,"15min":6.6740000000000004},"last":1.248},{"interface":"front","average":{"1min":1.603,"5min":1.296,"15min":1.2689999999999999},"min":{"1min":0.76100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.6750000000000007,"5min":8.6750000000000007,"15min":8.6750000000000007},"last":1.2070000000000001}]},{"osd":4,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.359,"15min":1.373},"min":{"1min":0.86099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":7.0670000000000002,"5min":7.0670000000000002,"15min":7.0670000000000002},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.75,"5min":1.427,"15min":1.377},"min":{"1min":1.101,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":6.5730000000000004,"5min":6.5730000000000004,"15min":6.5730000000000004},"last":1.7230000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":1.462,"15min":1.4319999999999999},"min":{"1min":0.80900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":8.9559999999999995,"5min":8.9559999999999995,"15min":8.9559999999999995},"last":1.512},{"interface":"front","average":{"1min":1.704,"5min":1.427,"15min":1.403},"min":{"1min":0.78400000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":7.1609999999999996,"5min":7.1609999999999996,"15min":7.1609999999999996},"last":1.4530000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":1.5009999999999999,"15min":1.4410000000000001},"min":{"1min":1.169,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":6.4160000000000004,"5min":6.4160000000000004,"15min":6.4160000000000004},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.875,"5min":1.5529999999999999,"15min":1.496},"min":{"1min":0.97899999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":8.8490000000000002,"5min":8.8490000000000002,"15min":8.8490000000000002},"last":1.6739999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98799999999999999,"15min":0.95099999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.575,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.0700000000000001,"15min":1.0800000000000001},"min":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.728}]},{"osd":1,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.0680000000000001,"15min":1.0169999999999999},"min":{"1min":0.66900000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.212,"15min":1.2350000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.4570000000000001}]},{"osd":2,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.194,"15min":1.1819999999999999},"min":{"1min":0.72399999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8180000000000001,"5min":1.966,"15min":1.966},"last":1.494},{"interface":"front","average":{"1min":1.294,"5min":1.2689999999999999,"15min":1.2629999999999999},"min":{"1min":0.89900000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.601,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.2829999999999999}]},{"osd":3,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1699999999999999,"15min":1.1899999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.397,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3129999999999999,"15min":1.357},"min":{"1min":0.94699999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9730000000000001,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.778}]},{"osd":4,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.369,"15min":1.3620000000000001},"min":{"1min":0.90000000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.6890000000000001,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.2470000000000001,"15min":1.25},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.696,"5min":1.996,"15min":1.996},"last":1.1559999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3340000000000001,"15min":1.3160000000000001},"min":{"1min":0.91000000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9830000000000001,"5min":2.2519999999999998,"15min":2.2519999999999998},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.4530000000000001,"15min":1.4330000000000001},"min":{"1min":1.119,"5min":0.623,"15min":0.623},"max":{"1min":2.0259999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.5580000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:23:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.359,"15min":1.3520000000000001},"min":{"1min":1.115,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.732,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.466,"5min":1.488,"15min":1.4830000000000001},"min":{"1min":1.0469999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8999999999999999,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.677}]}]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.996,"15min":1.0149999999999999},"min":{"1min":0.66800000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.5149999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1.417},{"interface":"front","average":{"1min":1.153,"5min":1.1120000000000001,"15min":1.1399999999999999},"min":{"1min":0.60399999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.7949999999999999,"5min":1.909,"15min":1.909},"last":0.95899999999999996}]},{"osd":1,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1890000000000001,"15min":1.2290000000000001},"min":{"1min":0.77500000000000002,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.667,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":1.163},{"interface":"front","average":{"1min":1.095,"5min":1.2,"15min":1.26},"min":{"1min":0.70599999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6579999999999999,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.92100000000000004}]},{"osd":2,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1850000000000001,"15min":1.2230000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.452,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.22,"15min":1.196},"min":{"1min":0.80200000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.8600000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.292}]},{"osd":3,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.2490000000000001,"15min":1.2849999999999999},"min":{"1min":0.88700000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.637,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":1.246},{"interface":"front","average":{"1min":1.25,"5min":1.3080000000000001,"15min":1.359},"min":{"1min":0.751,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.724,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.6659999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2949999999999999,"15min":1.27},"min":{"1min":0.77200000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.5880000000000001,"5min":2.5219999999999998,"15min":2.5219999999999998},"last":1.367},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.464,"15min":1.486},"min":{"1min":0.95499999999999996,"5min":0.628,"15min":0.628},"max":{"1min":1.8280000000000001,"5min":2.8420000000000001,"15min":2.8420000000000001},"last":1.48}]},{"osd":6,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.381,"15min":1.399},"min":{"1min":0.79800000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.78,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.454,"15min":1.482},"min":{"1min":0.82199999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9550000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.5269999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:23:43 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.554,"15min":1.5760000000000001},"min":{"1min":0.90200000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.829,"5min":2.7490000000000001,"15min":2.7490000000000001},"last":1.605},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.97399999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.024,"5min":2.331,"15min":2.331},"last":1.8049999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.157,"15min":1.1539999999999999},"min":{"1min":0.79800000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.5189999999999999,"5min":1.633,"15min":1.633},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.109,"15min":1.1200000000000001},"min":{"1min":0.68100000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.5940000000000001,"5min":2.1469999999999998,"15min":2.1469999999999998},"last":0.88400000000000001}]},{"osd":1,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1919999999999999,"15min":1.1799999999999999},"min":{"1min":0.75900000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6160000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1870000000000001,"15min":1.2170000000000001},"min":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.474,"5min":2.117,"15min":2.117},"last":1.046}]},{"osd":2,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.1319999999999999,"15min":1.1539999999999999},"min":{"1min":0.77300000000000002,"5min":0.753,"15min":0.753},"max":{"1min":1.506,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.365},{"interface":"front","average":{"1min":1.325,"5min":1.3029999999999999,"15min":1.3160000000000001},"min":{"1min":1.046,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.7609999999999999,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.204}]},{"osd":3,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.304,"15min":1.341},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.772,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.169},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.298,"15min":1.3720000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.667,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":1.129}]},{"osd":5,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3779999999999999,"15min":1.4119999999999999},"min":{"1min":0.79300000000000004,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7030000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.425,"15min":1.452},"min":{"1min":1.109,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.754,"5min":3.343,"15min":3.343},"last":1.413}]},{"osd":6,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.431,"15min":1.4870000000000001},"min":{"1min":0.99399999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7390000000000001,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.528,"15min":1.575},"min":{"1min":1.071,"5min":0.755,"15min":0.755},"max":{"1min":1.806,"5min":3.2240000000000002,"15min":3.2240000000000002},"last":1.655}]},{"osd":7,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.5549999999999999,"15min":1.579},"min":{"1min":1.2889999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.9610000000000001,"5min":3.085,"15min":3.085},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5740000000000001,"15min":1.6439999999999999},"min":{"1min":1.113,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.823,"5min":3.1899999999999999,"15min":3.1899999999999999},"last":1.599}]}]},{"osd":3,"up_from":14,"seq":60129542202,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.88500000000000001},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.27,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.874,"15min":0.91000000000000003},"min":{"1min":0.40999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.3240000000000001,"5min":1.718,"15min":1.718},"last":1.109}]},{"osd":1,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.83799999999999997,"15min":0.85599999999999998},"min":{"1min":0.433,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.6419999999999999,"5min":1.71,"15min":1.71},"last":1.1870000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.95899999999999996,"15min":0.98599999999999999},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":1.3149999999999999,"5min":1.575,"15min":1.575},"last":0.875}]},{"osd":2,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.046,"15min":1.093},"min":{"1min":0.48299999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.512,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.046,"5min":1.0649999999999999,"15min":1.1000000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.343}]},{"osd":4,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1779999999999999,"15min":1.1830000000000001},"min":{"1min":0.71299999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.22,"15min":1.24},"min":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.6479999999999999,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.4199999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.2809999999999999,"15min":1.3049999999999999},"min":{"1min":0.85799999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.734,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.282},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2809999999999999},"min":{"1min":0.76700000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.5700000000000001}]},{"osd":6,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.296,"15min":1.3220000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.78,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.387,"15min":1.431},"min":{"1min":0.81499999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8240000000000001,"5min":2.198,"15min":2.198},"last":1.5309999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:23:39 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3560000000000001,"15min":1.3919999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7050000000000001,"5min":1.847,"15min":1.847},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.3640000000000001,"15min":1.3939999999999999},"min":{"1min":0.79800000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.879,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.244}]}]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82999999999999996,"15min":0.90200000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.2769999999999999,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":1.169},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.94699999999999995,"15min":1.0089999999999999},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.5589999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.0089999999999999}]},{"osd":1,"last update":"Tue Dec 12 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.0049999999999999,"15min":1.117},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.377,"5min":2.4430000000000001,"15min":2.4430000000000001},"last":1.268},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.149,"15min":1.28},"min":{"1min":0.51800000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.532,"5min":2.867,"15min":2.867},"last":1.113}]},{"osd":3,"last update":"Tue Dec 12 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.91700000000000004,"15min":0.99199999999999999},"min":{"1min":0.48699999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.044,"5min":1.127,"15min":1.25},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.6240000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.3819999999999999}]},{"osd":4,"last update":"Tue Dec 12 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2789999999999999,"15min":1.359},"min":{"1min":0.70599999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7150000000000001,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.296,"15min":1.3879999999999999},"min":{"1min":0.69099999999999995,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.946,"5min":3.0950000000000002,"15min":3.0950000000000002},"last":1.3580000000000001}]},{"osd":5,"last update":"Tue Dec 12 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.286,"15min":1.381},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8049999999999999,"5min":2.21,"15min":2.21},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.4570000000000001,"15min":1.585},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.125,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.514}]},{"osd":6,"last update":"Tue Dec 12 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3979999999999999,"15min":1.5029999999999999},"min":{"1min":0.75800000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.7529999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.349,"15min":1.423},"min":{"1min":0.73499999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.843,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":1.3260000000000001}]},{"osd":7,"last update":"Tue Dec 12 09:23:45 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.4299999999999999,"15min":1.5580000000000001},"min":{"1min":0.85799999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8899999999999999,"5min":3.0310000000000001,"15min":3.0310000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.4079999999999999,"15min":1.506},"min":{"1min":0.77000000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.7370000000000001,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.0840000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":737280,"data_stored":330296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.82599999999999996,"15min":0.83899999999999997},"min":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.90200000000000002,"15min":0.89400000000000002},"min":{"1min":0.54300000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2929999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.103}]},{"osd":2,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.85499999999999998,"15min":0.83499999999999996},"min":{"1min":0.46300000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5549999999999999,"5min":1.613,"15min":1.613},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.042,"15min":1.048},"min":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7549999999999999,"5min":2.903,"15min":2.903},"last":1.222}]},{"osd":3,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.98399999999999999,"15min":0.997},"min":{"1min":0.59999999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.333,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.92000000000000004,"15min":0.876},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5920000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.008}]},{"osd":4,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1439999999999999,"15min":1.131},"min":{"1min":0.68000000000000005,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5069999999999999,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.163,"15min":1.163},"min":{"1min":0.77200000000000002,"5min":0.629,"15min":0.629},"max":{"1min":1.5449999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.1579999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2170000000000001,"15min":1.24},"min":{"1min":0.76500000000000001,"5min":0.626,"15min":0.626},"max":{"1min":1.5209999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.286,"15min":1.3200000000000001},"min":{"1min":0.79600000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.633,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":1.385}]},{"osd":6,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3129999999999999,"15min":1.2889999999999999},"min":{"1min":0.748,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.712,"5min":2.867,"15min":2.867},"last":1.278},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.345,"15min":1.3600000000000001},"min":{"1min":0.82099999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.681,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.2549999999999999}]},{"osd":7,"last update":"Tue Dec 12 09:23:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3959999999999999,"15min":1.423},"min":{"1min":0.877,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.8280000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3540000000000001,"15min":1.337},"min":{"1min":0.98999999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.7669999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.351}]}]},{"osd":0,"up_from":14,"seq":60129542201,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":1331200,"data_stored":920664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.86199999999999999,"15min":0.86599999999999999},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.44800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.2090000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0349999999999999}]},{"osd":2,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.95899999999999996,"15min":1.0529999999999999},"min":{"1min":0.48999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1919999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.98199999999999998,"15min":1.0309999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.4850000000000001,"5min":1.694,"15min":1.694},"last":0.83799999999999997}]},{"osd":3,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.89300000000000002,"15min":0.93500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.294,"5min":1.502,"15min":1.502},"last":1.4990000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.1399999999999999,"15min":1.246},"min":{"1min":0.51900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.4139999999999999,"5min":2.464,"15min":2.464},"last":1.454}]},{"osd":4,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1850000000000001,"15min":1.2270000000000001},"min":{"1min":0.76400000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.5549999999999999,"5min":2.343,"15min":2.343},"last":1.194},{"interface":"front","average":{"1min":1.232,"5min":1.3089999999999999,"15min":1.3640000000000001},"min":{"1min":0.84599999999999997,"5min":0.502,"15min":0.502},"max":{"1min":1.625,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.5429999999999999}]},{"osd":5,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2709999999999999,"15min":1.321},"min":{"1min":0.88500000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5920000000000001,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.2509999999999999,"15min":1.302},"min":{"1min":0.82599999999999996,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7090000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":1.395}]},{"osd":6,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4079999999999999,"15min":1.4870000000000001},"min":{"1min":0.877,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.74,"5min":2.573,"15min":2.573},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3260000000000001,"15min":1.373},"min":{"1min":0.85999999999999999,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7789999999999999,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.27}]},{"osd":7,"last update":"Tue Dec 12 09:23:44 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.367,"15min":1.4199999999999999},"min":{"1min":0.80900000000000005,"5min":0.754,"15min":0.754},"max":{"1min":1.6639999999999999,"5min":1.968,"15min":1.968},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.337,"15min":1.3779999999999999},"min":{"1min":0.79700000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.696,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.294}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T09:24:08.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-12T09:24:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.102+0000 7f1511a56640 1 Processor -- start 2023-12-12T09:24:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.103+0000 7f1511a56640 1 -- start start 2023-12-12T09:24:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.104+0000 7f1511a56640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f150c0b1c00 0x7f150c0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.104+0000 7f1511a56640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c0b21e0 con 0x7f150c06beb0 2023-12-12T09:24:09.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.104+0000 7f1511a56640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150c0b24c0 con 0x7f150c146ac0 2023-12-12T09:24:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.104+0000 7f1511a56640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0b27a0 con 0x7f150c0b1c00 2023-12-12T09:24:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.105+0000 7f150b7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f150c06beb0 0x7f150c070340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38882/0 (socket says 172.21.15.84:38882) 2023-12-12T09:24:09.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.105+0000 7f150b7fe640 1 -- 172.21.15.84:0/3629039568 learned_addr learned my addr 172.21.15.84:0/3629039568 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:24:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.105+0000 7f150a7fc640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f150c0b1c00 0x7f150c0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.105+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033564903 0 0) 0x7f150c0b21e0 con 0x7f150c06beb0 2023-12-12T09:24:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.105+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f8003520 con 0x7f150c06beb0 2023-12-12T09:24:09.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.105+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972568376 0 0) 0x7f14f8003520 con 0x7f150c06beb0 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f150c0b1c00 msgr2=0x7f150c0b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f150c0b1c00 0x7f150c0b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 >> v1:172.21.15.99:6789/0 conn(0x7f150c146ac0 legacy=0x7f150c15e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0b2a80 con 0x7f150c06beb0 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f1504001670 con 0x7f150c06beb0 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 >> v1:172.21.15.84:6789/0 conn(0x7f150c06beb0 legacy=0x7f150c070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14f80039a0 0x7f14f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14f80047c0 0x7f14f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f150c0b1c00 0x7f14f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c0b27a0 con 0x7f14f80047c0 2023-12-12T09:24:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f800ba60 con 0x7f14f80039a0 2023-12-12T09:24:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f800bc20 con 0x7f150c0b1c00 2023-12-12T09:24:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f150a7fc640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14f80047c0 0x7f14f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f150a7fc640 1 -- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f150c0b1c00 msgr2=0x7f14f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:24:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f150a7fc640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f150c0b1c00 0x7f14f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f150affd640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14f80039a0 0x7f14f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f150a7fc640 1 -- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14f80039a0 msgr2=0x7f14f8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:24:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f150a7fc640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14f80039a0 0x7f14f8003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.106+0000 7f150a7fc640 1 -- 172.21.15.84:0/3629039568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8003520 con 0x7f14f80047c0 2023-12-12T09:24:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.108+0000 7f150a7fc640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14f80047c0 0x7f14f8004c40 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009a90 tx=0x7f14f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb8e49aaa6f2dfc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.108+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f402c6b0 con 0x7f14f80047c0 2023-12-12T09:24:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.108+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f402c810 con 0x7f14f80047c0 2023-12-12T09:24:09.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.108+0000 7f1509ffb640 1 -- 172.21.15.84:0/3629039568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f402cba0 con 0x7f14f80047c0 2023-12-12T09:24:09.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.108+0000 7f1511a56640 1 -- 172.21.15.84:0/3629039568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14f80047c0 msgr2=0x7f14f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.108+0000 7f1511a56640 1 --2- 172.21.15.84:0/3629039568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f14f80047c0 0x7f14f8004c40 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009a90 tx=0x7f14f80057f0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.108+0000 7f150b7fe640 1 -- 172.21.15.84:0/3629039568 reap_dead start 2023-12-12T09:24:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.109+0000 7f1511a56640 1 -- 172.21.15.84:0/3629039568 shutdown_connections 2023-12-12T09:24:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.109+0000 7f1511a56640 1 -- 172.21.15.84:0/3629039568 >> 172.21.15.84:0/3629039568 conn(0x7f150c0b0900 msgr2=0x7f150c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:24:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.109+0000 7f1511a56640 1 -- 172.21.15.84:0/3629039568 shutdown_connections 2023-12-12T09:24:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.109+0000 7f1511a56640 1 -- 172.21.15.84:0/3629039568 wait complete. 2023-12-12T09:24:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.110+0000 7f1511a56640 1 Processor -- start 2023-12-12T09:24:09.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.111+0000 7f1511a56640 1 -- start start 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.111+0000 7f1511a56640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14f80047c0 0x7f150c15c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.111+0000 7f1511a56640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150c099a20 0x7f150c13cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.111+0000 7f1511a56640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f150c099e80 0x7f150c15f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.111+0000 7f1511a56640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c13b000 con 0x7f150c099e80 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.111+0000 7f1511a56640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c13b2a0 con 0x7f150c099a20 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.111+0000 7f1511a56640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150c13b580 con 0x7f14f80047c0 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f150c099e80 0x7f150c15f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f150c099e80 0x7f150c15f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35046/0 (socket says 172.21.15.84:35046) 2023-12-12T09:24:09.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150b7fe640 1 -- 172.21.15.84:0/2034695749 learned_addr learned my addr 172.21.15.84:0/2034695749 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150a7fc640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150c099a20 0x7f150c13cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150b7fe640 1 -- 172.21.15.84:0/2034695749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14f80047c0 msgr2=0x7f150c15c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150b7fe640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14f80047c0 0x7f150c15c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150b7fe640 1 -- 172.21.15.84:0/2034695749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150c099a20 msgr2=0x7f150c13cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150b7fe640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150c099a20 0x7f150c13cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.112+0000 7f150b7fe640 1 -- 172.21.15.84:0/2034695749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c13b860 con 0x7f150c099e80 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.113+0000 7f150b7fe640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f150c099e80 0x7f150c15f290 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f150c066ab0 tx=0x7f150400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.113+0000 7f1503fff640 1 -- 172.21.15.84:0/2034695749 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504007440 con 0x7f150c099e80 2023-12-12T09:24:09.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.113+0000 7f1503fff640 1 -- 172.21.15.84:0/2034695749 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15040075a0 con 0x7f150c099e80 2023-12-12T09:24:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.113+0000 7f1503fff640 1 -- 172.21.15.84:0/2034695749 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1504004a20 con 0x7f150c099e80 2023-12-12T09:24:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.113+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c13bb40 con 0x7f150c099e80 2023-12-12T09:24:09.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.113+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c13ff10 con 0x7f150c099e80 2023-12-12T09:24:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.114+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c13bd30 con 0x7f150c099e80 2023-12-12T09:24:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.115+0000 7f1503fff640 1 -- 172.21.15.84:0/2034695749 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1504004b80 con 0x7f150c099e80 2023-12-12T09:24:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.116+0000 7f1503fff640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f14ec06ae40 0x7f14ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.116+0000 7f1503fff640 1 -- 172.21.15.84:0/2034695749 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1504088a20 con 0x7f150c099e80 2023-12-12T09:24:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.116+0000 7f150affd640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f14ec06ae40 0x7f14ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.117+0000 7f150affd640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f14ec06ae40 0x7f14ec06d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f14fc001d50 tx=0x7f14fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:09.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.120+0000 7f1503fff640 1 -- 172.21.15.84:0/2034695749 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1504053c00 con 0x7f150c099e80 2023-12-12T09:24:09.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.310+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f150c0673c0 con 0x7f150c099e80 2023-12-12T09:24:09.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.316+0000 7f1503fff640 1 -- 172.21.15.84:0/2034695749 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f150401a070 con 0x7f150c099e80 2023-12-12T09:24:09.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.318+0000 7f1503fff640 1 -- 172.21.15.84:0/2034695749 <== mon.0 v2:172.21.15.84:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1504001a00 con 0x7f150c099e80 2023-12-12T09:24:09.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f14ec06ae40 msgr2=0x7f14ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f14ec06ae40 0x7f14ec06d300 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f14fc001d50 tx=0x7f14fc009040 comp rx=0 tx=0).stop 2023-12-12T09:24:09.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f150c099e80 msgr2=0x7f150c15f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f150c099e80 0x7f150c15f290 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f150c066ab0 tx=0x7f150400c960 comp rx=0 tx=0).stop 2023-12-12T09:24:09.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 shutdown_connections 2023-12-12T09:24:09.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f14ec06ae40 0x7f14ec06d300 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f150c099e80 0x7f150c15f290 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150c099a20 0x7f150c13cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 --2- 172.21.15.84:0/2034695749 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f14f80047c0 0x7f150c15c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 >> 172.21.15.84:0/2034695749 conn(0x7f150c0b0900 msgr2=0x7f150c0661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:24:09.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 shutdown_connections 2023-12-12T09:24:09.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.320+0000 7f1511a56640 1 -- 172.21.15.84:0/2034695749 wait complete. 2023-12-12T09:24:09.338 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T09:24:09.339 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T09:24:09.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.538+0000 7f39928ff640 1 Processor -- start 2023-12-12T09:24:09.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.539+0000 7f39928ff640 1 -- start start 2023-12-12T09:24:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.540+0000 7f39928ff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f398c0715c0 0x7f398c165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.540+0000 7f39928ff640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c144b20 con 0x7f398c06de80 2023-12-12T09:24:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.540+0000 7f39928ff640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c15f770 con 0x7f398c144740 2023-12-12T09:24:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.540+0000 7f39928ff640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c06e310 con 0x7f398c0715c0 2023-12-12T09:24:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.540+0000 7f39910fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f398c06de80 0x7f398c15f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:38886/0 (socket says 172.21.15.84:38886) 2023-12-12T09:24:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.540+0000 7f39910fc640 1 -- 172.21.15.84:0/1490419125 learned_addr learned my addr 172.21.15.84:0/1490419125 (peer_addr_for_me v1:172.21.15.84:0/0) 2023-12-12T09:24:09.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39920fe640 1 --2- 172.21.15.84:0/1490419125 >> v2:172.21.15.99:3300/0 conn(0x7f398c0715c0 0x7f398c165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888275841 0 0) 0x7f398c144b20 con 0x7f398c06de80 2023-12-12T09:24:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3978003520 con 0x7f398c06de80 2023-12-12T09:24:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1294849446 0 0) 0x7f3978003520 con 0x7f398c06de80 2023-12-12T09:24:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 >> v2:172.21.15.99:3300/0 conn(0x7f398c0715c0 msgr2=0x7f398c165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:24:09.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 --2- 172.21.15.84:0/1490419125 >> v2:172.21.15.99:3300/0 conn(0x7f398c0715c0 0x7f398c165ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 >> v1:172.21.15.99:6789/0 conn(0x7f398c144740 legacy=0x7f398c15e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c06d670 con 0x7f398c06de80 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 738479635 0 0) 0x7f397c001670 con 0x7f398c06de80 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.541+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 >> v1:172.21.15.84:6789/0 conn(0x7f398c06de80 legacy=0x7f398c15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39908fb640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39780039c0 0x7f3978003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39908fb640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39780047c0 0x7f3978004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39908fb640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f397800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c06e310 con 0x7f39780051d0 2023-12-12T09:24:09.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397800c120 con 0x7f39780047c0 2023-12-12T09:24:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397800c2e0 con 0x7f39780039c0 2023-12-12T09:24:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39920fe640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f397800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39910fc640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39780047c0 0x7f3978004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39918fd640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39780039c0 0x7f3978003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39920fe640 1 -- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39780039c0 msgr2=0x7f3978003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:24:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39920fe640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39780039c0 0x7f3978003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39920fe640 1 -- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39780047c0 msgr2=0x7f3978004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T09:24:09.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39920fe640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39780047c0 0x7f3978004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39920fe640 1 -- 172.21.15.84:0/1490419125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978003520 con 0x7f39780051d0 2023-12-12T09:24:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39910fc640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39780047c0 0x7f3978004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:24:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.542+0000 7f39918fd640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f39780039c0 0x7f3978003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T09:24:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.543+0000 7f39920fe640 1 -- 172.21.15.84:0/1490419125 reap_dead start 2023-12-12T09:24:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.543+0000 7f39920fe640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f397800b980 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f3984009f90 tx=0x7f39780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c104c3d53bbdd7e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398402cc20 con 0x7f39780051d0 2023-12-12T09:24:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f398400f040 con 0x7f39780051d0 2023-12-12T09:24:09.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39908fb640 1 -- 172.21.15.84:0/1490419125 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984003990 con 0x7f39780051d0 2023-12-12T09:24:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39928ff640 1 -- 172.21.15.84:0/1490419125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 msgr2=0x7f397800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39928ff640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f397800b980 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f3984009f90 tx=0x7f39780057f0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39928ff640 1 -- 172.21.15.84:0/1490419125 shutdown_connections 2023-12-12T09:24:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39928ff640 1 --2- 172.21.15.84:0/1490419125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f397800b980 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39928ff640 1 -- 172.21.15.84:0/1490419125 >> 172.21.15.84:0/1490419125 conn(0x7f398c0b07f0 msgr2=0x7f398c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:24:09.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39928ff640 1 -- 172.21.15.84:0/1490419125 shutdown_connections 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.544+0000 7f39928ff640 1 -- 172.21.15.84:0/1490419125 wait complete. 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.546+0000 7f39928ff640 1 Processor -- start 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.546+0000 7f39928ff640 1 -- start start 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.547+0000 7f39928ff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f398c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.547+0000 7f39928ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f398c14f3b0 0x7f398c0c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.547+0000 7f39928ff640 1 --2- >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f398c13f640 0x7f398c13fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.547+0000 7f39928ff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c140000 con 0x7f39780051d0 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.547+0000 7f39928ff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0b3c80 con 0x7f398c14f3b0 2023-12-12T09:24:09.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.547+0000 7f39928ff640 1 -- --> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0b2be0 con 0x7f398c13f640 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f398c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f398c0b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35056/0 (socket says 172.21.15.84:35056) 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 -- 172.21.15.84:0/3377540797 learned_addr learned my addr 172.21.15.84:0/3377540797 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 -- 172.21.15.84:0/3377540797 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f398c13f640 msgr2=0x7f398c13fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f398c13f640 0x7f398c13fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39910fc640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f398c14f3b0 0x7f398c0c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 -- 172.21.15.84:0/3377540797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f398c14f3b0 msgr2=0x7f398c0c4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f398c14f3b0 0x7f398c0c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 -- 172.21.15.84:0/3377540797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0b2ec0 con 0x7f39780051d0 2023-12-12T09:24:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39918fd640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f398c0b2600 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f398800d7a0 tx=0x7f398800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.548+0000 7f39827fc640 1 -- 172.21.15.84:0/3377540797 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988005270 con 0x7f39780051d0 2023-12-12T09:24:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.549+0000 7f39827fc640 1 -- 172.21.15.84:0/3377540797 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f39880053d0 con 0x7f39780051d0 2023-12-12T09:24:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.549+0000 7f39827fc640 1 -- 172.21.15.84:0/3377540797 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800b8f0 con 0x7f39780051d0 2023-12-12T09:24:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.549+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c0b31a0 con 0x7f39780051d0 2023-12-12T09:24:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.549+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c0b3760 con 0x7f39780051d0 2023-12-12T09:24:09.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.550+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c0b3920 con 0x7f39780051d0 2023-12-12T09:24:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.551+0000 7f39827fc640 1 -- 172.21.15.84:0/3377540797 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f398800ba50 con 0x7f39780051d0 2023-12-12T09:24:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.551+0000 7f39827fc640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f397006ae40 0x7f397006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T09:24:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.552+0000 7f39827fc640 1 -- 172.21.15.84:0/3377540797 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f39880895a0 con 0x7f39780051d0 2023-12-12T09:24:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.552+0000 7f39910fc640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f397006ae40 0x7f397006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T09:24:09.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.552+0000 7f39910fc640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f397006ae40 0x7f397006d300 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f397c001200 tx=0x7f397c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T09:24:09.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.556+0000 7f39827fc640 1 -- 172.21.15.84:0/3377540797 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3988054650 con 0x7f39780051d0 2023-12-12T09:24:09.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.782+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f398c0673c0 con 0x7f39780051d0 2023-12-12T09:24:09.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.782+0000 7f39827fc640 1 -- 172.21.15.84:0/3377540797 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f3988019310 con 0x7f39780051d0 2023-12-12T09:24:09.784 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-12T09:24:09.784 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1966836821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1966836821},{"type":"v1","addr":"172.21.15.99:6835","nonce":1966836821}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5152,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/4165741100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":4165741100},{"type":"v1","addr":"172.21.15.99:6833","nonce":4165741100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/3716664132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":3716664132},{"type":"v1","addr":"172.21.15.84:6836","nonce":3716664132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":6702,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2334351336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":2334351336},{"type":"v1","addr":"172.21.15.84:6837","nonce":2334351336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[]} 2023-12-12T09:24:09.784 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 29 2023-12-12T09:24:09.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f397006ae40 msgr2=0x7f397006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f397006ae40 0x7f397006d300 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f397c001200 tx=0x7f397c009040 comp rx=0 tx=0).stop 2023-12-12T09:24:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 msgr2=0x7f398c0b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T09:24:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f398c0b2600 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f398800d7a0 tx=0x7f398800dc60 comp rx=0 tx=0).stop 2023-12-12T09:24:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 shutdown_connections 2023-12-12T09:24:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] conn(0x7f398c13f640 0x7f398c13fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f398c14f3b0 0x7f398c0c4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:6832/2629859879,v1:172.21.15.84:6833/2629859879] conn(0x7f397006ae40 0x7f397006d300 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 --2- 172.21.15.84:0/3377540797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39780051d0 0x7f398c0b2600 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T09:24:09.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 >> 172.21.15.84:0/3377540797 conn(0x7f398c0b07f0 msgr2=0x7f398c141510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T09:24:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 shutdown_connections 2023-12-12T09:24:09.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-12-12T09:24:09.785+0000 7f39928ff640 1 -- 172.21.15.84:0/3377540797 wait complete. 2023-12-12T09:24:09.804 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-12T09:24:09.804 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-12T09:24:09.804 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T09:24:09.804 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:09.823 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T09:24:09.823 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T09:24:09.823 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:09.884 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T09:24:09.884 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T09:24:09.885 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:09.912 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T09:24:09.913 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T09:24:09.913 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:09.974 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T09:24:09.974 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-12T09:24:09.975 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-12T09:24:09.975 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.028 INFO:tasks.ceph.osd.0:Stopped 2023-12-12T09:24:10.029 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-12T09:24:10.029 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.076 INFO:tasks.ceph.osd.1:Stopped 2023-12-12T09:24:10.076 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-12T09:24:10.076 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.124 INFO:tasks.ceph.osd.2:Stopped 2023-12-12T09:24:10.124 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-12T09:24:10.124 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.199 INFO:tasks.ceph.osd.3:Stopped 2023-12-12T09:24:10.200 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-12T09:24:10.200 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.270 INFO:tasks.ceph.osd.4:Stopped 2023-12-12T09:24:10.270 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-12T09:24:10.270 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.328 INFO:tasks.ceph.osd.5:Stopped 2023-12-12T09:24:10.328 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-12T09:24:10.328 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.388 INFO:tasks.ceph.osd.6:Stopped 2023-12-12T09:24:10.388 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-12T09:24:10.388 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.447 INFO:tasks.ceph.osd.7:Stopped 2023-12-12T09:24:10.447 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-12T09:24:10.448 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-12T09:24:10.448 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.517 INFO:tasks.ceph.mgr.y:Stopped 2023-12-12T09:24:10.517 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-12T09:24:10.517 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.592 INFO:tasks.ceph.mgr.x:Stopped 2023-12-12T09:24:10.592 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-12T09:24:10.592 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-12T09:24:10.593 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.642 INFO:tasks.ceph.mon.a:Stopped 2023-12-12T09:24:10.642 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-12T09:24:10.642 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.682 INFO:tasks.ceph.mon.b:Stopped 2023-12-12T09:24:10.683 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-12T09:24:10.683 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T09:24:10.768 INFO:tasks.ceph.mon.c:Stopped 2023-12-12T09:24:10.768 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-12T09:24:10.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-12T09:24:10.880 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:24:10.880 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-12T09:24:11.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:24:11.134 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-12T09:24:11.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:24:11.296 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-12T09:24:11.458 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:24:11.458 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-12T09:24:11.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:24:11.619 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-12T09:24:11.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:24:11.886 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-12T09:24:12.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:24:12.044 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-12T09:24:12.209 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:24:12.209 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-12T09:24:12.373 INFO:tasks.ceph:Archiving mon data... 2023-12-12T09:24:12.374 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/data/mon.a.tgz 2023-12-12T09:24:12.374 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-12-12T09:24:12.435 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.GeyVgkrDpy 2023-12-12T09:24:12.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GeyVgkrDpy 2023-12-12T09:24:12.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.GeyVgkrDpy 2023-12-12T09:24:12.776 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.GeyVgkrDpy is 383KB 2023-12-12T09:24:12.886 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.GeyVgkrDpy 2023-12-12T09:24:12.945 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/data/mon.b.tgz 2023-12-12T09:24:12.945 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-12-12T09:24:13.005 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.7cm8QSYx1b 2023-12-12T09:24:13.005 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7cm8QSYx1b 2023-12-12T09:24:13.224 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.7cm8QSYx1b 2023-12-12T09:24:13.377 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.7cm8QSYx1b is 504KB 2023-12-12T09:24:13.487 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.7cm8QSYx1b 2023-12-12T09:24:13.545 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/data/mon.c.tgz 2023-12-12T09:24:13.545 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-12-12T09:24:13.602 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.BIIDD65T25 2023-12-12T09:24:13.602 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.BIIDD65T25 2023-12-12T09:24:13.811 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.BIIDD65T25 2023-12-12T09:24:13.967 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.BIIDD65T25 is 504KB 2023-12-12T09:24:14.077 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.BIIDD65T25 2023-12-12T09:24:14.135 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-12T09:24:14.136 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-12T09:24:14.145 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-12T09:24:14.299 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-12T09:24:14.358 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-12T09:24:14.359 INFO:tasks.ceph:Archiving crash dumps... 2023-12-12T09:24:14.360 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/remote/smithi084/crash 2023-12-12T09:24:14.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-12T09:24:14.464 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/remote/smithi099/crash 2023-12-12T09:24:14.465 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-12T09:24:14.565 INFO:tasks.ceph:Shutting down logrotate 2023-12-12T09:24:14.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:24:14.575 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T09:24:14.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-12T09:24:14.948 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-12T09:24:15.046 INFO:tasks.ceph:Compressing logs... 2023-12-12T09:24:15.047 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T09:24:15.055 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T09:24:15.143 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105313.log 2023-12-12T09:24:15.144 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103073.log 2023-12-12T09:24:15.145 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113515.log 2023-12-12T09:24:15.146 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105313.log.gz 2023-12-12T09:24:15.146 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111753.log 2023-12-12T09:24:15.147 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103073.log.gz 2023-12-12T09:24:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-12T09:24:15.148 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112737.log 2023-12-12T09:24:15.148 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113515.log.gz 2023-12-12T09:24:15.149 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111753.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111753.log.gz 2023-12-12T09:24:15.149 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114131.log 2023-12-12T09:24:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88292.log 2023-12-12T09:24:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88412.log 2023-12-12T09:24:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88372.log 2023-12-12T09:24:15.151 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88292.log.gz 2023-12-12T09:24:15.152 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113034.log 2023-12-12T09:24:15.152 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112737.log.gz 2023-12-12T09:24:15.153 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114131.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114131.log.gz 2023-12-12T09:24:15.153 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95313.log 2023-12-12T09:24:15.153 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113034.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113034.log.gz 2023-12-12T09:24:15.153 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-12T09:24:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99620.log 2023-12-12T09:24:15.155 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95313.log.gz 2023-12-12T09:24:15.155 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96209.log 2023-12-12T09:24:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88412.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88412.log.gz 2023-12-12T09:24:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88452.log 2023-12-12T09:24:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88372.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88372.log.gz 2023-12-12T09:24:15.156 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-12T09:24:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88452.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88452.log.gz 2023-12-12T09:24:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-12T09:24:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-12T09:24:15.157 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-12T09:24:15.158 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.4.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-12T09:24:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100513.log 2023-12-12T09:24:15.159 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99620.log.gz 2023-12-12T09:24:15.159 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95087.log 2023-12-12T09:24:15.159 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96209.log.gz 2023-12-12T09:24:15.160 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100513.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.106269.log -- replaced with /var/log/ceph/ceph-client.admin.100513.log.gz 2023-12-12T09:24:15.160 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-12-12T09:24:15.160 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100708.log 2023-12-12T09:24:15.160 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95087.log.gz 2023-12-12T09:24:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.94334.log 2023-12-12T09:24:15.161 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-12T09:24:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112695.log 2023-12-12T09:24:15.162 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106269.log.gz 2023-12-12T09:24:15.162 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96806.log 87.8% 2023-12-12T09:24:15.162 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100708.log.gz 2023-12-12T09:24:15.164 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.1.94334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94786.log 2023-12-12T09:24:15.164 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.1.94334.log.gz 2023-12-12T09:24:15.164 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88332.log 2023-12-12T09:24:15.165 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113286.log 2023-12-12T09:24:15.165 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112695.log.gz 2023-12-12T09:24:15.165 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106783.log 2023-12-12T09:24:15.165 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96806.log.gz 2023-12-12T09:24:15.165 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111585.log 2023-12-12T09:24:15.165 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113286.log.gz 2023-12-12T09:24:15.167 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.3.94786.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-12T09:24:15.167 INFO:teuthology.orchestra.run.smithi099.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.3.94786.log.gz 2023-12-12T09:24:15.167 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.98860.log 2023-12-12T09:24:15.168 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106783.log.gz 2023-12-12T09:24:15.168 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110975.log 2023-12-12T09:24:15.168 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111585.log.gz 2023-12-12T09:24:15.169 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88172.log 2023-12-12T09:24:15.169 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.88332.log.gz 2023-12-12T09:24:15.169 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88212.log 2023-12-12T09:24:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.2.98860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100040.log 2023-12-12T09:24:15.170 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110975.log: 92.3% -- replaced with /var/log/ceph/ceph-client.2.98860.log.gz 2023-12-12T09:24:15.171 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102149.log 2023-12-12T09:24:15.171 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110975.log.gz 2023-12-12T09:24:15.171 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105497.log 2023-12-12T09:24:15.171 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100040.log.gz 2023-12-12T09:24:15.172 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105053.log 2023-12-12T09:24:15.173 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102149.log.gz 2023-12-12T09:24:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88172.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88172.log.gz 2023-12-12T09:24:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88212.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.88212.log.gz 2023-12-12T09:24:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88252.log 2023-12-12T09:24:15.176 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95045.log 2023-12-12T09:24:15.176 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105497.log.gz 2023-12-12T09:24:15.176 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108456.log 2023-12-12T09:24:15.176 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105053.log.gz 2023-12-12T09:24:15.176 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110623.log 2023-12-12T09:24:15.176 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95045.log.gz 2023-12-12T09:24:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-12T09:24:15.177 INFO:teuthology.orchestra.run.smithi099.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-12T09:24:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88252.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88252.log.gz 2023-12-12T09:24:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-12T09:24:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-12T09:24:15.178 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.b.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-12T09:24:15.179 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99914.log 2023-12-12T09:24:15.180 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108456.log.gz 2023-12-12T09:24:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97720.log 2023-12-12T09:24:15.180 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110623.log.gz 2023-12-12T09:24:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114383.log 2023-12-12T09:24:15.180 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99914.log.gz 2023-12-12T09:24:15.180 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97720.log: gzip -5 88.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.97720.log.gz -- 2023-12-12T09:24:15.180 INFO:teuthology.orchestra.run.smithi084.stderr: /var/log/ceph/ceph-client.admin.109500.log 2023-12-12T09:24:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-12T09:24:15.182 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99536.log 2023-12-12T09:24:15.182 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114383.log.gz 2023-12-12T09:24:15.182 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108396.log 2023-12-12T09:24:15.182 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109500.log.gz 2023-12-12T09:24:15.183 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-12T09:24:15.184 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101425.log 2023-12-12T09:24:15.184 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99536.log.gz 2023-12-12T09:24:15.184 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108396.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108396.log.gz 2023-12-12T09:24:15.184 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103319.log 2023-12-12T09:24:15.185 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96908.log 2023-12-12T09:24:15.185 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101425.log.gz 2023-12-12T09:24:15.186 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99578.log 2023-12-12T09:24:15.186 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103319.log.gz 2023-12-12T09:24:15.187 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96908.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96908.log.gz 2023-12-12T09:24:15.188 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96808.log 2023-12-12T09:24:15.189 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93520.log 2023-12-12T09:24:15.189 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99578.log.gz 2023-12-12T09:24:15.190 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97468.log 2023-12-12T09:24:15.190 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96808.log.gz 2023-12-12T09:24:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93520.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93520.log.gz 2023-12-12T09:24:15.191 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95620.log 2023-12-12T09:24:15.191 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.c.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-12T09:24:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97468.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82371.log 2023-12-12T09:24:15.192 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97468.log.gz 2023-12-12T09:24:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107601.log 2023-12-12T09:24:15.193 INFO:teuthology.orchestra.run.smithi084.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95620.log.gz 2023-12-12T09:24:15.194 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.tmp-client.admin.82371.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82371.log.gz 2023-12-12T09:24:15.194 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100793.log 2023-12-12T09:24:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110933.log 2023-12-12T09:24:15.196 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107601.log.gz 2023-12-12T09:24:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108018.log 2023-12-12T09:24:15.197 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100793.log.gz 2023-12-12T09:24:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110933.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110933.log.gz 2023-12-12T09:24:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94037.log 2023-12-12T09:24:15.199 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98451.log 2023-12-12T09:24:15.199 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.108018.log.gz 2023-12-12T09:24:15.200 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96548.log 2023-12-12T09:24:15.200 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94037.log.gz 2023-12-12T09:24:15.201 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.98451.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98451.log.gz 2023-12-12T09:24:15.202 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108727.log 2023-12-12T09:24:15.203 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105455.log 2023-12-12T09:24:15.203 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96548.log.gz 2023-12-12T09:24:15.204 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103571.log 2023-12-12T09:24:15.204 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108727.log.gz 2023-12-12T09:24:15.205 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105455.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105455.log.gz 2023-12-12T09:24:15.205 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109152.log 2023-12-12T09:24:15.206 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96556.log 2023-12-12T09:24:15.206 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103571.log.gz 2023-12-12T09:24:15.207 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111895.log 2023-12-12T09:24:15.207 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.109152.log.gz 2023-12-12T09:24:15.208 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96556.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96556.log.gz 2023-12-12T09:24:15.208 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104275.log 2023-12-12T09:24:15.209 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105665.log 2023-12-12T09:24:15.210 INFO:teuthology.orchestra.run.smithi084.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.111895.log.gz 2023-12-12T09:24:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103715.log 2023-12-12T09:24:15.211 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104275.log.gz 2023-12-12T09:24:15.212 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105665.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105665.log.gz 2023-12-12T09:24:15.212 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102821.log 2023-12-12T09:24:15.213 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113473.log 2023-12-12T09:24:15.213 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103715.log.gz 2023-12-12T09:24:15.214 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105271.log 2023-12-12T09:24:15.214 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102821.log.gz 2023-12-12T09:24:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113473.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113473.log.gz 2023-12-12T09:24:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112992.log 2023-12-12T09:24:15.216 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114005.log 2023-12-12T09:24:15.217 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105271.log.gz 2023-12-12T09:24:15.217 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96934.log 2023-12-12T09:24:15.218 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112992.log.gz 2023-12-12T09:24:15.219 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114005.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114005.log.gzgzip 2023-12-12T09:24:15.219 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.93953.log 2023-12-12T09:24:15.220 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99158.log 2023-12-12T09:24:15.220 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96934.log.gz 2023-12-12T09:24:15.221 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102779.log 2023-12-12T09:24:15.221 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93953.log.gz 2023-12-12T09:24:15.222 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99158.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99158.log.gz 2023-12-12T09:24:15.222 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101039.log 2023-12-12T09:24:15.223 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108559.log 2023-12-12T09:24:15.224 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102779.log.gz 2023-12-12T09:24:15.224 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94081.log 2023-12-12T09:24:15.225 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101039.log.gz 2023-12-12T09:24:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108559.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108559.log.gz 2023-12-12T09:24:15.226 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103529.log 2023-12-12T09:24:15.227 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101225.log 2023-12-12T09:24:15.227 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94081.log.gz 2023-12-12T09:24:15.228 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113711.log 2023-12-12T09:24:15.228 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103529.log.gz 2023-12-12T09:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101225.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101225.log.gz 2023-12-12T09:24:15.229 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105623.log 2023-12-12T09:24:15.230 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111669.log 2023-12-12T09:24:15.230 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113711.log.gz 2023-12-12T09:24:15.231 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105623.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.105623.log.gz -5 2023-12-12T09:24:15.232 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph-client.admin.103759.log 2023-12-12T09:24:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111669.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111669.log.gz 2023-12-12T09:24:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108601.log 2023-12-12T09:24:15.233 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96554.log 2023-12-12T09:24:15.234 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103759.log.gz 2023-12-12T09:24:15.235 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114341.log 2023-12-12T09:24:15.235 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108601.log.gz 2023-12-12T09:24:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96554.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96554.log.gz 2023-12-12T09:24:15.236 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105539.log 2023-12-12T09:24:15.237 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103613.log 2023-12-12T09:24:15.237 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114341.log.gz 2023-12-12T09:24:15.238 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109364.log 2023-12-12T09:24:15.238 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105539.log.gz 2023-12-12T09:24:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108895.log 2023-12-12T09:24:15.240 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103613.log.gz 2023-12-12T09:24:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97426.log 2023-12-12T09:24:15.241 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109364.log.gz 2023-12-12T09:24:15.242 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95373.log 2023-12-12T09:24:15.242 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108895.log.gz 2023-12-12T09:24:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102275.log 2023-12-12T09:24:15.243 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97426.log.gz 2023-12-12T09:24:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95373.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95373.log.gz 2023-12-12T09:24:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94375.log 2023-12-12T09:24:15.245 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108811.log 2023-12-12T09:24:15.246 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102275.log.gz 2023-12-12T09:24:15.246 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103853.log 2023-12-12T09:24:15.247 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108811.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94375.log.gz 2023-12-12T09:24:15.248 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97132.log 2023-12-12T09:24:15.248 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108811.log.gz 2023-12-12T09:24:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103853.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103853.log.gz 2023-12-12T09:24:15.249 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104786.log 2023-12-12T09:24:15.250 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102065.log 2023-12-12T09:24:15.250 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97132.log.gz 2023-12-12T09:24:15.251 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.104786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95255.log 2023-12-12T09:24:15.252 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102065.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102065.log.gz 2023-12-12T09:24:15.252 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107102.log 2023-12-12T09:24:15.253 INFO:teuthology.orchestra.run.smithi084.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.104786.log.gz 2023-12-12T09:24:15.253 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94333.log 2023-12-12T09:24:15.254 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95255.log.gz 2023-12-12T09:24:15.255 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.107102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99116.log 2023-12-12T09:24:15.256 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94333.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.107102.log.gz 2023-12-12T09:24:15.256 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94333.log.gz 2023-12-12T09:24:15.256 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114089.log 2023-12-12T09:24:15.257 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103673.log 2023-12-12T09:24:15.257 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99116.log.gz 2023-12-12T09:24:15.258 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109278.log 2023-12-12T09:24:15.258 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114089.log.gz 2023-12-12T09:24:15.259 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103673.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103673.log.gz 2023-12-12T09:24:15.260 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95415.log 2023-12-12T09:24:15.261 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94249.log 2023-12-12T09:24:15.261 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109278.log.gz 2023-12-12T09:24:15.262 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110891.log 2023-12-12T09:24:15.262 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95415.log.gz 2023-12-12T09:24:15.263 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101735.log 2023-12-12T09:24:15.263 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94249.log.gz 2023-12-12T09:24:15.264 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110891.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110891.log.gz 2023-12-12T09:24:15.264 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113076.log 2023-12-12T09:24:15.265 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96040.log 2023-12-12T09:24:15.265 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101735.log.gz 2023-12-12T09:24:15.266 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112569.log 2023-12-12T09:24:15.266 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113076.log.gz 2023-12-12T09:24:15.267 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96040.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96040.log.gz 2023-12-12T09:24:15.268 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105761.log 2023-12-12T09:24:15.268 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99704.log 2023-12-12T09:24:15.269 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112569.log.gz 2023-12-12T09:24:15.269 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105397.log 2023-12-12T09:24:15.270 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105761.log.gz 2023-12-12T09:24:15.271 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99704.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99704.log.gz 2023-12-12T09:24:15.271 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109982.log 2023-12-12T09:24:15.272 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88399.log 2023-12-12T09:24:15.272 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105397.log.gz 2023-12-12T09:24:15.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108312.log 2023-12-12T09:24:15.273 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109982.log.gz 2023-12-12T09:24:15.274 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.88399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111372.log 2023-12-12T09:24:15.275 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.88399.log.gz 2023-12-12T09:24:15.276 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113160.log 2023-12-12T09:24:15.276 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108312.log.gz 2023-12-12T09:24:15.276 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.111372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107685.log 2023-12-12T09:24:15.278 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113160.log: 90.1% -- replaced with /var/log/ceph/ceph-client.0.111372.log.gz 2023-12-12T09:24:15.278 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-12T09:24:15.278 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113160.log.gz 2023-12-12T09:24:15.279 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107643.log 2023-12-12T09:24:15.279 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107685.log.gz 2023-12-12T09:24:15.280 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107976.log 2023-12-12T09:24:15.281 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107643.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107643.log.gz 2023-12-12T09:24:15.281 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103937.log 2023-12-12T09:24:15.282 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-12T09:24:15.283 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-12T09:24:15.283 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109320.log 2023-12-12T09:24:15.283 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107976.log.gz 2023-12-12T09:24:15.284 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103937.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103937.log.gz 2023-12-12T09:24:15.284 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106353.log 2023-12-12T09:24:15.285 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102023.log 2023-12-12T09:24:15.285 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109320.log.gz 2023-12-12T09:24:15.286 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102905.log 2023-12-12T09:24:15.286 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106353.log.gz 2023-12-12T09:24:15.287 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104107.log 2023-12-12T09:24:15.287 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102023.log.gz 2023-12-12T09:24:15.288 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102905.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102905.log.gz 2023-12-12T09:24:15.288 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96213.log 2023-12-12T09:24:15.289 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100471.log 2023-12-12T09:24:15.290 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104107.log.gz 2023-12-12T09:24:15.290 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107459.log 2023-12-12T09:24:15.291 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96213.log.gz 2023-12-12T09:24:15.292 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100471.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100471.log.gz 2023-12-12T09:24:15.292 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108990.log 2023-12-12T09:24:15.293 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101467.log 2023-12-12T09:24:15.293 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107459.log.gz 2023-12-12T09:24:15.294 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99326.log 2023-12-12T09:24:15.294 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108990.log.gz 2023-12-12T09:24:15.295 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101467.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101467.log.gz 2023-12-12T09:24:15.295 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106621.log 2023-12-12T09:24:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94123.log 2023-12-12T09:24:15.296 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99326.log.gz 2023-12-12T09:24:15.297 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103277.log 2023-12-12T09:24:15.298 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106621.log.gz 2023-12-12T09:24:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94123.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94123.log.gz 2023-12-12T09:24:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93815.log 2023-12-12T09:24:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103277.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103277.log.gz 2023-12-12T09:24:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114569.log 2023-12-12T09:24:15.301 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95704.log 2023-12-12T09:24:15.301 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93815.log.gz 2023-12-12T09:24:15.302 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107333.log 2023-12-12T09:24:15.302 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114569.log.gz 2023-12-12T09:24:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95704.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95704.log.gz 2023-12-12T09:24:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108270.log 2023-12-12T09:24:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114173.log 2023-12-12T09:24:15.305 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107333.log.gz 2023-12-12T09:24:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109194.log 2023-12-12T09:24:15.306 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108270.log.gz 2023-12-12T09:24:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114173.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114173.log.gz 2023-12-12T09:24:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109542.log 2023-12-12T09:24:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106537.log 2023-12-12T09:24:15.308 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109194.log.gz 2023-12-12T09:24:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114257.log 2023-12-12T09:24:15.309 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109542.log.gz 2023-12-12T09:24:15.310 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88653.log 2023-12-12T09:24:15.310 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106537.log.gz 2023-12-12T09:24:15.311 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111527.log 2023-12-12T09:24:15.312 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114257.log.gz 2023-12-12T09:24:15.312 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.88653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100997.log 2023-12-12T09:24:15.313 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88653.log.gz 2023-12-12T09:24:15.313 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105129.log 2023-12-12T09:24:15.313 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111527.log.gz 2023-12-12T09:24:15.315 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100997.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100997.log.gz 2023-12-12T09:24:15.315 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94441.log 2023-12-12T09:24:15.316 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113879.log 2023-12-12T09:24:15.316 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105129.log.gz 2023-12-12T09:24:15.317 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107727.log 2023-12-12T09:24:15.317 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94441.log.gz 2023-12-12T09:24:15.318 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113879.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.113879.log.gz 2023-12-12T09:24:15.318 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110066.log 2023-12-12T09:24:15.319 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114047.log 2023-12-12T09:24:15.320 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107727.log.gz 2023-12-12T09:24:15.320 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100750.log 2023-12-12T09:24:15.321 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.110066.log.gz 2023-12-12T09:24:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114047.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114047.log.gz 2023-12-12T09:24:15.322 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109670.log 2023-12-12T09:24:15.323 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101509.log 2023-12-12T09:24:15.323 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100750.log.gz 2023-12-12T09:24:15.324 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97384.log 2023-12-12T09:24:15.324 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109670.log.gz 2023-12-12T09:24:15.325 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101509.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101509.log.gz 2023-12-12T09:24:15.325 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97300.log 2023-12-12T09:24:15.326 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113669.log 2023-12-12T09:24:15.327 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97384.log.gz 2023-12-12T09:24:15.328 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114425.log 2023-12-12T09:24:15.328 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97300.log.gz 2023-12-12T09:24:15.329 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95998.log 2023-12-12T09:24:15.329 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113669.log.gz 2023-12-12T09:24:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114425.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114425.log.gz 2023-12-12T09:24:15.330 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114215.log 2023-12-12T09:24:15.331 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111095.log 2023-12-12T09:24:15.331 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95998.log.gz 2023-12-12T09:24:15.332 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108060.log 2023-12-12T09:24:15.332 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114215.log.gz 2023-12-12T09:24:15.333 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111095.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111095.log.gz 2023-12-12T09:24:15.334 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97762.log 2023-12-12T09:24:15.334 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110849.log 2023-12-12T09:24:15.335 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108060.log.gz 2023-12-12T09:24:15.335 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112653.log 2023-12-12T09:24:15.336 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97762.log.gz 2023-12-12T09:24:15.337 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110849.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110849.log.gz 2023-12-12T09:24:15.337 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106579.log 2023-12-12T09:24:15.338 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103361.log 2023-12-12T09:24:15.338 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112653.log.gz 2023-12-12T09:24:15.339 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102653.log 2023-12-12T09:24:15.339 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106579.log.gz 2023-12-12T09:24:15.340 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103361.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103361.log.gz 2023-12-12T09:24:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102527.log 2023-12-12T09:24:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93909.log 2023-12-12T09:24:15.342 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102653.log.gz 2023-12-12T09:24:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102695.log 2023-12-12T09:24:15.343 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102527.log.gz 2023-12-12T09:24:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93909.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93909.log.gz 2023-12-12T09:24:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103403.log 2023-12-12T09:24:15.345 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95129.log 2023-12-12T09:24:15.345 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102695.log.gz 2023-12-12T09:24:15.346 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99494.log 2023-12-12T09:24:15.346 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103403.log.gz 2023-12-12T09:24:15.347 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95129.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95129.log.gz 2023-12-12T09:24:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105355.log 2023-12-12T09:24:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104191.log 2023-12-12T09:24:15.349 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99494.log.gz 2023-12-12T09:24:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105355.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-12T09:24:15.350 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105355.log.gz 2023-12-12T09:24:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104191.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104191.log.gzgzip 2023-12-12T09:24:15.351 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.99746.log 2023-12-12T09:24:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100614.log 2023-12-12T09:24:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103803.log 2023-12-12T09:24:15.353 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99746.log.gz 2023-12-12T09:24:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100614.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100614.log.gz 2023-12-12T09:24:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107501.log 2023-12-12T09:24:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102233.log 2023-12-12T09:24:15.356 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103803.log.gz 2023-12-12T09:24:15.357 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107501.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107501.log.gz 2023-12-12T09:24:15.357 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106437.log 2023-12-12T09:24:15.358 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102359.log 2023-12-12T09:24:15.358 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102233.log.gz 2023-12-12T09:24:15.359 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106437.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.106437.log.gz 2023-12-12T09:24:15.359 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107375.log 2023-12-12T09:24:15.360 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110565.log 2023-12-12T09:24:15.360 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102359.log.gz 2023-12-12T09:24:15.361 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93995.log 2023-12-12T09:24:15.362 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107375.log.gz 2023-12-12T09:24:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100166.log 2023-12-12T09:24:15.363 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110565.log.gz 2023-12-12T09:24:15.364 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93995.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93995.log.gz 2023-12-12T09:24:15.364 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99788.log 2023-12-12T09:24:15.365 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99368.log 2023-12-12T09:24:15.365 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100166.log.gz 2023-12-12T09:24:15.366 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-12T09:24:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99788.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99788.log.gz 2023-12-12T09:24:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103895.log 2023-12-12T09:24:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96859.log 2023-12-12T09:24:15.368 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99368.log.gz 2023-12-12T09:24:15.368 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103895.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103895.log.gz 2023-12-12T09:24:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95956.log 2023-12-12T09:24:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95830.log 2023-12-12T09:24:15.370 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96859.log.gz 2023-12-12T09:24:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95956.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95956.log.gz 2023-12-12T09:24:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94165.log 2023-12-12T09:24:15.373 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111017.log 2023-12-12T09:24:15.373 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95830.log.gz 2023-12-12T09:24:15.374 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94165.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94165.log.gz 2023-12-12T09:24:15.374 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113431.log 2023-12-12T09:24:15.375 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111017.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111017.log.gz 2023-12-12T09:24:15.376 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100303.log 2023-12-12T09:24:15.377 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113431.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113431.log.gz 2023-12-12T09:24:15.377 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94207.log 2023-12-12T09:24:15.378 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102569.log 2023-12-12T09:24:15.378 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100303.log.gz 2023-12-12T09:24:15.379 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94207.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94207.log.gz 2023-12-12T09:24:15.380 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95213.log 2023-12-12T09:24:15.381 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102569.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.96786.log 2023-12-12T09:24:15.381 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102569.log.gz 2023-12-12T09:24:15.382 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95213.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95213.log.gz 2023-12-12T09:24:15.383 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113202.log 2023-12-12T09:24:15.384 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96786.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96786.log.gz 2023-12-12T09:24:15.384 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111853.log 2023-12-12T09:24:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113202.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.113202.log.gz 2023-12-12T09:24:15.385 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101081.log 2023-12-12T09:24:15.386 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93764.log 2023-12-12T09:24:15.386 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111853.log.gz 2023-12-12T09:24:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101081.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101081.log.gz 2023-12-12T09:24:15.387 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104401.log 2023-12-12T09:24:15.389 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104149.log 2023-12-12T09:24:15.389 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93764.log.gz 2023-12-12T09:24:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104401.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104401.log.gz 2023-12-12T09:24:15.390 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109838.log 2023-12-12T09:24:15.391 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93424.log 2023-12-12T09:24:15.391 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104149.log.gz 2023-12-12T09:24:15.392 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109838.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109838.log.gz 2023-12-12T09:24:15.392 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97510.log 2023-12-12T09:24:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93424.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93424.log.gz 2023-12-12T09:24:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97594.log 2023-12-12T09:24:15.394 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97510.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97510.log.gz 2023-12-12T09:24:15.395 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104925.log 2023-12-12T09:24:15.396 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109754.log 2023-12-12T09:24:15.396 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97594.log.gz 2023-12-12T09:24:15.397 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104925.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104925.log.gz 2023-12-12T09:24:15.397 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109880.log 2023-12-12T09:24:15.398 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109754.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109754.log.gz 2023-12-12T09:24:15.399 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102401.log 2023-12-12T09:24:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109880.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109880.log.gz 2023-12-12T09:24:15.400 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107559.log 2023-12-12T09:24:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102401.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102401.log.gz 2023-12-12T09:24:15.401 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108228.log 2023-12-12T09:24:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107559.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107559.log.gz 2023-12-12T09:24:15.402 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101551.log 2023-12-12T09:24:15.403 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108228.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108228.log.gz 2023-12-12T09:24:15.404 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104359.log 2023-12-12T09:24:15.405 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101551.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101551.log.gz 2023-12-12T09:24:15.405 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97174.log 2023-12-12T09:24:15.406 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106311.log 2023-12-12T09:24:15.406 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104359.log.gz 2023-12-12T09:24:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97174.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97174.log.gz 2023-12-12T09:24:15.407 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107847.log 2023-12-12T09:24:15.408 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106038.log 2023-12-12T09:24:15.408 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106311.log.gz 2023-12-12T09:24:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107847.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107847.log.gz 2023-12-12T09:24:15.409 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93857.log 2023-12-12T09:24:15.411 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.106038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94872.log 2023-12-12T09:24:15.411 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93857.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.106038.log.gz 2023-12-12T09:24:15.412 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93857.log.gz 2023-12-12T09:24:15.412 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108643.log 2023-12-12T09:24:15.414 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94291.log 2023-12-12T09:24:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108643.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.94872.log.gz 2023-12-12T09:24:15.415 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104969.log 2023-12-12T09:24:15.416 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108643.log.gz 2023-12-12T09:24:15.416 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.94291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100659.log 2023-12-12T09:24:15.417 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94291.log.gz 2023-12-12T09:24:15.418 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111811.log 2023-12-12T09:24:15.418 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104969.log.gz 2023-12-12T09:24:15.419 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100659.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.100659.log.gz 2023-12-12T09:24:15.419 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-12T09:24:15.420 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102611.log 2023-12-12T09:24:15.420 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111811.log.gz 2023-12-12T09:24:15.421 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96551.log 2023-12-12T09:24:15.422 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102611.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102611.log.gz 2023-12-12T09:24:15.423 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102737.log 2023-12-12T09:24:15.424 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96551.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96551.log.gz 2023-12-12T09:24:15.424 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96924.log 2023-12-12T09:24:15.425 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99452.log 2023-12-12T09:24:15.426 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102737.log.gz 2023-12-12T09:24:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96924.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96924.log.gz 2023-12-12T09:24:15.427 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95788.log 2023-12-12T09:24:15.428 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99452.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99452.log.gz 2023-12-12T09:24:15.429 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102191.log 2023-12-12T09:24:15.430 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97258.log 2023-12-12T09:24:15.430 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95788.log.gz 2023-12-12T09:24:15.431 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102191.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102191.log.gz 2023-12-12T09:24:15.432 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110665.log 2023-12-12T09:24:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97258.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97258.log.gz 2023-12-12T09:24:15.433 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112611.log 2023-12-12T09:24:15.434 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99956.log 2023-12-12T09:24:15.435 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110665.log.gz 2023-12-12T09:24:15.435 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112611.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112611.log.gz 2023-12-12T09:24:15.436 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97636.log 2023-12-12T09:24:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99956.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99956.log.gz 2023-12-12T09:24:15.437 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102317.log 2023-12-12T09:24:15.438 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109408.log 2023-12-12T09:24:15.439 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97636.log.gz 2023-12-12T09:24:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102317.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102317.log.gz 2023-12-12T09:24:15.440 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97342.log 2023-12-12T09:24:15.441 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109408.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.109408.log.gz 2023-12-12T09:24:15.441 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111627.log 2023-12-12T09:24:15.443 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108516.log 2023-12-12T09:24:15.443 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97342.log.gz 2023-12-12T09:24:15.444 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111627.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111627.log.gz 2023-12-12T09:24:15.444 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102485.log 2023-12-12T09:24:15.445 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108516.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108516.log.gz 2023-12-12T09:24:15.446 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105229.log 2023-12-12T09:24:15.447 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108186.log 2023-12-12T09:24:15.447 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102485.log.gz 2023-12-12T09:24:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105229.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105229.log.gz 2023-12-12T09:24:15.449 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113244.log 2023-12-12T09:24:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108186.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108186.log.gz 2023-12-12T09:24:15.450 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112950.log 2023-12-12T09:24:15.451 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99410.log 2023-12-12T09:24:15.452 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113244.log.gz 2023-12-12T09:24:15.453 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112950.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112950.log.gzgzip 2023-12-12T09:24:15.453 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101693.log 2023-12-12T09:24:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99410.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99410.log.gz 2023-12-12T09:24:15.454 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99006.log 2023-12-12T09:24:15.455 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104065.log 2023-12-12T09:24:15.456 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101693.log.gz 2023-12-12T09:24:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99006.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99006.log.gz 2023-12-12T09:24:15.457 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96215.log 2023-12-12T09:24:15.459 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101267.log 2023-12-12T09:24:15.459 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104065.log.gz 2023-12-12T09:24:15.460 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96215.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96215.log.gz 2023-12-12T09:24:15.460 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96476.log 2023-12-12T09:24:15.461 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100429.log 2023-12-12T09:24:15.462 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101267.log.gz 2023-12-12T09:24:15.463 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96476.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.96476.log.gz 2023-12-12T09:24:15.463 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108769.log 2023-12-12T09:24:15.464 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100429.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100429.log.gz 2023-12-12T09:24:15.464 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110132.log 2023-12-12T09:24:15.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111979.log 2023-12-12T09:24:15.466 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108769.log.gz 2023-12-12T09:24:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110132.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110132.log.gz 2023-12-12T09:24:15.467 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101777.log 2023-12-12T09:24:15.468 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111979.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111979.log.gz 2023-12-12T09:24:15.469 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99872.log 2023-12-12T09:24:15.470 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99998.log 2023-12-12T09:24:15.471 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101777.log.gz 2023-12-12T09:24:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99872.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99872.log.gz 2023-12-12T09:24:15.472 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96208.log 2023-12-12T09:24:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99998.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99998.log.gz 2023-12-12T09:24:15.473 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101819.log 2023-12-12T09:24:15.474 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108853.log 2023-12-12T09:24:15.475 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96208.log.gz 2023-12-12T09:24:15.476 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101819.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101819.log.gz 2023-12-12T09:24:15.476 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102989.log 2023-12-12T09:24:15.477 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108853.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108853.log.gz 2023-12-12T09:24:15.477 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107291.log 2023-12-12T09:24:15.478 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105187.log 2023-12-12T09:24:15.479 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102989.log.gz 2023-12-12T09:24:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107291.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107291.log.gz 2023-12-12T09:24:15.480 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98345.log 2023-12-12T09:24:15.481 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105187.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105187.log.gz 2023-12-12T09:24:15.482 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107417.log 2023-12-12T09:24:15.483 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.98345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112490.log 2023-12-12T09:24:15.484 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107417.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.98345.log.gz 2023-12-12T09:24:15.484 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107417.log.gz 2023-12-12T09:24:15.485 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100082.log 2023-12-12T09:24:15.486 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99284.log 2023-12-12T09:24:15.486 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112490.log.gz 2023-12-12T09:24:15.487 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100082.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100082.log.gz 2023-12-12T09:24:15.488 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110024.log 2023-12-12T09:24:15.489 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109628.log 2023-12-12T09:24:15.489 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99284.log.gz 2023-12-12T09:24:15.490 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110024.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110024.log.gz 2023-12-12T09:24:15.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-12T09:24:15.491 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101903.log 2023-12-12T09:24:15.492 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109628.log.gz 2023-12-12T09:24:15.493 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107769.log 2023-12-12T09:24:15.495 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103031.log 2023-12-12T09:24:15.495 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101903.log.gz 2023-12-12T09:24:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100345.log 2023-12-12T09:24:15.496 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107769.log.gz 2023-12-12T09:24:15.498 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97090.log 2023-12-12T09:24:15.498 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103031.log.gz 2023-12-12T09:24:15.499 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103445.log 2023-12-12T09:24:15.499 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100345.log.gz 2023-12-12T09:24:15.500 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106227.log 2023-12-12T09:24:15.501 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97090.log.gz 2023-12-12T09:24:15.502 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103981.log 2023-12-12T09:24:15.502 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103445.log.gz 2023-12-12T09:24:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109586.log 2023-12-12T09:24:15.504 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106227.log.gz 2023-12-12T09:24:15.505 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96220.log 2023-12-12T09:24:15.505 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103981.log.gz 2023-12-12T09:24:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100387.log 2023-12-12T09:24:15.507 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109586.log.gz 2023-12-12T09:24:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95499.log 2023-12-12T09:24:15.508 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96220.log.gz 2023-12-12T09:24:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112866.log 2023-12-12T09:24:15.509 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100387.log.gz 2023-12-12T09:24:15.511 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105011.log 2023-12-12T09:24:15.511 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95499.log.gz 2023-12-12T09:24:15.513 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97804.log 2023-12-12T09:24:15.513 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112866.log.gz 2023-12-12T09:24:15.514 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104023.log 2023-12-12T09:24:15.514 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105011.log.gz 2023-12-12T09:24:15.516 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101593.log 2023-12-12T09:24:15.516 INFO:teuthology.orchestra.run.smithi084.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.97804.log.gz 2023-12-12T09:24:15.517 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103115.log 88.3% 2023-12-12T09:24:15.517 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104023.log.gz 2023-12-12T09:24:15.518 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88767.log 2023-12-12T09:24:15.519 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101593.log.gz 2023-12-12T09:24:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114609.log 2023-12-12T09:24:15.520 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103115.log.gz 2023-12-12T09:24:15.522 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.88767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112908.log 2023-12-12T09:24:15.522 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88767.log.gz 2023-12-12T09:24:15.523 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106705.log 2023-12-12T09:24:15.523 INFO:teuthology.orchestra.run.smithi084.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-12T09:24:15.523 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114609.log.gz 2023-12-12T09:24:15.524 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113837.log 2023-12-12T09:24:15.524 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112908.log.gz 2023-12-12T09:24:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106705.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106705.log.gz 2023-12-12T09:24:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101351.log 2023-12-12T09:24:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113837.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.113837.log.gz 2023-12-12T09:24:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101183.log 2023-12-12T09:24:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105581.log 2023-12-12T09:24:15.529 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.101351.log.gz 2023-12-12T09:24:15.530 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101183.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101183.log.gz 2023-12-12T09:24:15.530 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101635.log 2023-12-12T09:24:15.531 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105581.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105581.log.gz 2023-12-12T09:24:15.531 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113753.log 2023-12-12T09:24:15.532 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111937.log 2023-12-12T09:24:15.533 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101635.log.gz 2023-12-12T09:24:15.534 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113753.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.113753.log.gz -5 2023-12-12T09:24:15.534 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-12T09:24:15.536 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112334.log 2023-12-12T09:24:15.536 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111937.log.gz 2023-12-12T09:24:15.537 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109940.log 2023-12-12T09:24:15.539 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.112334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100208.log 2023-12-12T09:24:15.540 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109940.log: 90.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95914.log 2023-12-12T09:24:15.540 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.0.112334.log.gz 2023-12-12T09:24:15.540 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109940.log.gz 2023-12-12T09:24:15.542 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95457.log 2023-12-12T09:24:15.542 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100208.log.gz 2023-12-12T09:24:15.543 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103487.log 2023-12-12T09:24:15.543 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95914.log.gz 2023-12-12T09:24:15.545 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96485.log 2023-12-12T09:24:15.545 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95457.log.gz 2023-12-12T09:24:15.546 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104317.log 2023-12-12T09:24:15.547 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103487.log.gz 2023-12-12T09:24:15.548 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100124.log 2023-12-12T09:24:15.548 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96485.log.gz 2023-12-12T09:24:15.549 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104509.log 2023-12-12T09:24:15.549 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104317.log.gz 2023-12-12T09:24:15.551 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109712.log 2023-12-12T09:24:15.551 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100124.log.gz 2023-12-12T09:24:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113118.log 2023-12-12T09:24:15.552 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104509.log.gz 2023-12-12T09:24:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109458.log 2023-12-12T09:24:15.554 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109712.log.gz 2023-12-12T09:24:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108685.log 2023-12-12T09:24:15.555 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.113118.log.gz 2023-12-12T09:24:15.557 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99830.log 2023-12-12T09:24:15.557 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109458.log.gz 2023-12-12T09:24:15.558 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98964.log 2023-12-12T09:24:15.558 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108685.log.gz 2023-12-12T09:24:15.560 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112057.log 2023-12-12T09:24:15.560 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99830.log.gz 2023-12-12T09:24:15.561 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.98964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97678.log 2023-12-12T09:24:15.561 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98964.log.gz 2023-12-12T09:24:15.562 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.112057.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.112057.log.gz -- 2023-12-12T09:24:15.563 INFO:teuthology.orchestra.run.smithi084.stderr: /var/log/ceph/ceph-client.admin.113389.log 2023-12-12T09:24:15.564 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97678.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-12T09:24:15.564 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97678.log.gz 2023-12-12T09:24:15.566 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113389.log: 91.5%gzip -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-12T09:24:15.566 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97552.log 2023-12-12T09:24:15.566 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113389.log.gz 2023-12-12T09:24:15.567 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93709.log 2023-12-12T09:24:15.568 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97552.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-12T09:24:15.568 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97552.log.gz 2023-12-12T09:24:15.568 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97216.log 2023-12-12T09:24:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93709.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93709.log.gz 2023-12-12T09:24:15.570 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-12T09:24:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97216.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97216.log.gz 2023-12-12T09:24:15.571 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100955.log 2023-12-12T09:24:15.572 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100913.log 2023-12-12T09:24:15.574 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100955.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100955.log.gz 2023-12-12T09:24:15.574 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110409.log 2023-12-12T09:24:15.576 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100913.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100913.log.gz 2023-12-12T09:24:15.576 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96558.log 2023-12-12T09:24:15.577 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.0.110409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108354.log 2023-12-12T09:24:15.579 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96558.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-12T09:24:15.579 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96558.log.gz 2023-12-12T09:24:15.579 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.110409.log.gz 2023-12-12T09:24:15.580 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109796.log 2023-12-12T09:24:15.580 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108354.log.gz 2023-12-12T09:24:15.581 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114299.log 2023-12-12T09:24:15.582 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109796.log: 91.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-12T09:24:15.583 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99662.log 2023-12-12T09:24:15.583 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109796.log.gz 2023-12-12T09:24:15.584 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101139.log 2023-12-12T09:24:15.584 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114299.log.gz 2023-12-12T09:24:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99662.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99662.log.gz 2023-12-12T09:24:15.585 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113921.log 2023-12-12T09:24:15.586 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101139.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101139.log.gz 2023-12-12T09:24:15.587 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101309.log 2023-12-12T09:24:15.589 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95746.log 2023-12-12T09:24:15.589 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113921.log.gz 2023-12-12T09:24:15.589 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101309.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101309.log.gz 2023-12-12T09:24:15.589 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99200.log 2023-12-12T09:24:15.590 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104233.log 2023-12-12T09:24:15.591 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95746.log.gz 2023-12-12T09:24:15.592 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114651.log 2023-12-12T09:24:15.592 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99200.log.gz 2023-12-12T09:24:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104233.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104233.log.gz 2023-12-12T09:24:15.593 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101981.log 2023-12-12T09:24:15.594 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102107.log 2023-12-12T09:24:15.595 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114651.log.gz 2023-12-12T09:24:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101981.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101981.log.gz 2023-12-12T09:24:15.596 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110791.log 2023-12-12T09:24:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102107.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102107.log.gz 2023-12-12T09:24:15.598 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104443.log 2023-12-12T09:24:15.599 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110791.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110791.log.gz 2023-12-12T09:24:15.599 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97932.log 2023-12-12T09:24:15.601 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.104443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95872.log 2023-12-12T09:24:15.601 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.104443.log.gz 2023-12-12T09:24:15.602 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97932.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97932.log.gz 2023-12-12T09:24:15.602 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114467.log 2023-12-12T09:24:15.603 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113963.log 2023-12-12T09:24:15.604 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95872.log.gz 2023-12-12T09:24:15.604 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114467.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.114467.log.gz 2023-12-12T09:24:15.605 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99242.log 2023-12-12T09:24:15.606 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113963.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.113963.log.gz 2023-12-12T09:24:15.606 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106495.log 2023-12-12T09:24:15.607 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96555.log 2023-12-12T09:24:15.608 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99242.log.gz 2023-12-12T09:24:15.609 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106495.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106495.log.gz 2023-12-12T09:24:15.609 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106395.log 2023-12-12T09:24:15.610 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95541.log 2023-12-12T09:24:15.611 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96555.log.gz 2023-12-12T09:24:15.611 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106395.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106395.log.gz 2023-12-12T09:24:15.611 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103195.log 2023-12-12T09:24:15.613 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96222.log 2023-12-12T09:24:15.613 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95541.log.gz 2023-12-12T09:24:15.614 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103195.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103195.log.gz 2023-12-12T09:24:15.614 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110749.log 2023-12-12T09:24:15.615 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96222.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96222.log.gz 2023-12-12T09:24:15.616 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111711.log 2023-12-12T09:24:15.617 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110749.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110749.log.gz 2023-12-12T09:24:15.617 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100571.log 2023-12-12T09:24:15.618 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113346.log 2023-12-12T09:24:15.619 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111711.log.gz 2023-12-12T09:24:15.620 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100571.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100571.log.gz 2023-12-12T09:24:15.620 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95171.log 2023-12-12T09:24:15.621 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113346.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113346.log.gz 2023-12-12T09:24:15.621 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113795.log 2023-12-12T09:24:15.622 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95171.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95171.log.gz 2023-12-12T09:24:15.623 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102947.log 2023-12-12T09:24:15.624 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113795.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113795.log.gz 2023-12-12T09:24:15.624 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102863.log 2023-12-12T09:24:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102947.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102947.log.gz 2023-12-12T09:24:15.626 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93601.log 2023-12-12T09:24:15.627 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102863.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102863.log.gz 2023-12-12T09:24:15.628 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109236.log 2023-12-12T09:24:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93601.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93601.log.gz 2023-12-12T09:24:15.629 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109110.log 2023-12-12T09:24:15.630 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109236.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109236.log.gz 2023-12-12T09:24:15.631 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106825.log 2023-12-12T09:24:15.632 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.109110.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109110.log.gz 2023-12-12T09:24:15.632 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95662.log 2023-12-12T09:24:15.633 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106825.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106825.log.gz 2023-12-12T09:24:15.634 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108144.log 2023-12-12T09:24:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.95662.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95662.log.gz 2023-12-12T09:24:15.635 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108102.log 2023-12-12T09:24:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108144.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108144.log.gz 2023-12-12T09:24:15.637 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110707.log 2023-12-12T09:24:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108102.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108102.log.gz 2023-12-12T09:24:15.638 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-12T09:24:15.640 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114509.log 2023-12-12T09:24:15.640 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110707.log.gz 2023-12-12T09:24:15.641 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96221.log 2023-12-12T09:24:15.643 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.114509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106663.log 2023-12-12T09:24:15.643 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114509.log.gz 2023-12-12T09:24:15.644 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93661.log 2023-12-12T09:24:15.644 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96221.log.gz 2023-12-12T09:24:15.646 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102443.log 2023-12-12T09:24:15.646 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106663.log.gz 2023-12-12T09:24:15.647 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.93661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96919.log 2023-12-12T09:24:15.647 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93661.log.gz 2023-12-12T09:24:15.649 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101861.log 2023-12-12T09:24:15.649 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102443.log.gz 2023-12-12T09:24:15.650 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96919.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96218.log 2023-12-12T09:24:15.650 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96919.log.gz 2023-12-12T09:24:15.651 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100871.log 2023-12-12T09:24:15.652 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101861.log.gz 2023-12-12T09:24:15.653 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96218.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96218.log.gz 2023-12-12T09:24:15.654 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100871.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100871.log.gz 2023-12-12T09:24:15.688 INFO:teuthology.orchestra.run.smithi084.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-12T09:24:15.977 INFO:teuthology.orchestra.run.smithi099.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-12T09:24:16.010 INFO:teuthology.orchestra.run.smithi099.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-12T09:24:16.010 INFO:teuthology.orchestra.run.smithi099.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-12T09:24:16.017 INFO:teuthology.orchestra.run.smithi099.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-12T09:24:16.021 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-12T09:24:16.021 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m0.913s 2023-12-12T09:24:16.021 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m3.465s 2023-12-12T09:24:16.021 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.402s 2023-12-12T09:24:16.192 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-12T09:24:16.293 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-12T09:24:16.345 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-12T09:24:16.386 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-12T09:24:16.391 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-12-12T09:24:16.391 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m1.288s 2023-12-12T09:24:16.391 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m3.711s 2023-12-12T09:24:16.391 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m1.373s 2023-12-12T09:24:16.392 INFO:tasks.ceph:Archiving logs... 2023-12-12T09:24:16.392 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/remote/smithi084/log 2023-12-12T09:24:16.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T09:24:17.244 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/remote/smithi099/log 2023-12-12T09:24:17.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T09:24:17.829 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-12T09:24:17.839 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-12T09:24:17.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-12T09:24:17.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-12T09:24:18.007 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-12T09:24:18.016 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-12T09:24:18.016 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T09:24:18.026 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T09:24:18.074 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2023-12-12T09:24:18.082 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2023-12-12T09:24:18.084 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T09:24:18.084 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2023-12-12T09:24:18.085 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 +1234us[+1232us] +/- 73ms 2023-12-12T09:24:18.085 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -1163us[-1165us] +/- 72ms 2023-12-12T09:24:18.085 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv03.front.sepia.ceph.com 3 6 377 26 +25us[ +23us] +/- 70ms 2023-12-12T09:24:18.085 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:24:18.092 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-12T09:24:18.092 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2023-12-12T09:24:18.092 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 +1279us[+1279us] +/- 73ms 2023-12-12T09:24:18.092 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 -1164us[-1164us] +/- 72ms 2023-12-12T09:24:18.092 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv03.front.sepia.ceph.com 3 6 377 27 +63us[ +78us] +/- 70ms 2023-12-12T09:24:18.092 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-12T09:24:18.093 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-12T09:24:18.104 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-12T09:24:18.104 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-12T09:24:18.113 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-12T09:24:18.380 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-12T09:24:18.635 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T09:24:18.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:24:18.748 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-12T09:24:18.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:24:18.857 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-12T09:24:18.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-12T09:24:18.877 INFO:teuthology.task.internal:Duration was 1249.792288 seconds 2023-12-12T09:24:18.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-12T09:24:18.886 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-12T09:24:18.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-12T09:24:18.896 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-12T09:24:19.057 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T09:24:19.063 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-12T09:24:19.553 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-12T09:24:19.554 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2023-12-12T09:24:19.555 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-12T09:24:19.623 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2023-12-12T09:24:19.623 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-12T09:24:19.707 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-12T09:24:19.708 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-12T09:24:19.716 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-12T09:24:19.810 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-12T09:24:19.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-12T09:24:19.816 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-12T09:24:20.001 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-12T09:24:20.012 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-12T09:24:20.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-12T09:24:20.096 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-12T09:24:20.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-12T09:24:20.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-12T09:24:20.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-12T09:24:20.322 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2023-12-12T09:24:20.336 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2023-12-12T09:24:20.387 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-12T09:24:20.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:24:20.438 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-12T09:24:20.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:24:20.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-12T09:24:20.507 INFO:teuthology.task.internal:Transferring archived files... 2023-12-12T09:24:20.508 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/remote/smithi084 2023-12-12T09:24:20.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T09:24:20.620 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184/remote/smithi099 2023-12-12T09:24:20.620 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T09:24:20.731 INFO:teuthology.task.internal:Removing archive directory... 2023-12-12T09:24:20.731 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-12T09:24:20.740 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-12T09:24:20.828 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-12T09:24:20.839 INFO:teuthology.task.internal:Not uploading archives. 2023-12-12T09:24:20.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-12T09:24:20.849 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-12T09:24:20.849 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-12T09:24:20.859 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-12T09:24:20.910 INFO:teuthology.orchestra.run.smithi084.stdout: 524321 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 12 09:24 /home/ubuntu/cephtest 2023-12-12T09:24:20.918 INFO:teuthology.orchestra.run.smithi099.stdout: 395176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 12 09:24 /home/ubuntu/cephtest 2023-12-12T09:24:20.921 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-12T09:24:20.931 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-12T09:24:20.952 INFO:teuthology.nuke:Checking targets against current locks 2023-12-12T09:24:20.978 DEBUG:teuthology.nuke:shortname: smithi084 2023-12-12T09:24:20.978 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T09:24:21.002 DEBUG:teuthology.nuke:shortname: smithi099 2023-12-12T09:24:21.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T09:24:21.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 08:47:45.354792', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAqNLpf4IbFXbiM18QnkWOef8PT2IowuupE1hWdbapuXdOjF7PZrwyAYfLpYFUaSic7P/nqdQ87LHwyut5lLwnk='} 2023-12-12T09:24:21.029 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488184', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 08:47:45.353119', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBONAwCdHqF9AWgE5HTVT/FvFhV6fiaVq5ALNYzBlibIW1xnpUuwLbM+Ck0NdCbwA2nxbnyN/wgTiPCSfeREef3w='} 2023-12-12T09:24:21.057 INFO:teuthology.orchestra.console.smithi084:Power off 2023-12-12T09:24:21.057 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T09:24:21.080 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-12-12T09:24:21.080 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:24:21.097 INFO:teuthology.orchestra.console.smithi099:Power off 2023-12-12T09:24:21.097 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T09:24:21.106 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-12-12T09:24:21.121 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-12-12T09:24:21.121 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:24:21.143 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-12T09:24:25.107 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:24:25.144 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:24:25.219 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-12-12T09:24:25.255 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-12T09:24:29.222 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:24:29.256 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T09:24:29.333 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-12-12T09:24:29.366 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-12T09:24:29.434 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-12-12T09:24:29.468 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-12-12T09:24:29.577 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 1249.7922880649567 failure_reason: 'Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm)' flavor: default mon.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: mchangir sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9e341174a6034b089f9db369b3338899 status: fail success: false 2023-12-12T09:24:29.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T09:24:29.667 INFO:teuthology.run:FAIL